CN107705402A - A kind of door system on duty and the real-time voice response method based on priority - Google Patents

A kind of door system on duty and the real-time voice response method based on priority Download PDF

Info

Publication number
CN107705402A
CN107705402A CN201710887961.2A CN201710887961A CN107705402A CN 107705402 A CN107705402 A CN 107705402A CN 201710887961 A CN201710887961 A CN 201710887961A CN 107705402 A CN107705402 A CN 107705402A
Authority
CN
China
Prior art keywords
facial image
door
keyword
response
controller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710887961.2A
Other languages
Chinese (zh)
Other versions
CN107705402B (en
Inventor
秦方
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin Heng Hui Intention Science And Technology Ltd
Original Assignee
Tianjin Heng Hui Intention Science And Technology Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin Heng Hui Intention Science And Technology Ltd filed Critical Tianjin Heng Hui Intention Science And Technology Ltd
Priority to CN201710887961.2A priority Critical patent/CN107705402B/en
Publication of CN107705402A publication Critical patent/CN107705402A/en
Application granted granted Critical
Publication of CN107705402B publication Critical patent/CN107705402B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00563Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/68Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/683Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Collating Specific Patterns (AREA)
  • Lock And Its Accessories (AREA)

Abstract

The present invention relates to a kind of door system on duty and the real-time voice response method based on priority, the present invention is analyzed the voice collected using the keyword with priority, the facial image outdoors collected is analyzed with the facial image with priority, facial image and speech recognition and when depositing, it is specified that how to define the method for responding object.The state monitored with reference to sensor group, more targeted real-time voice Response Policy and step can be realized, broadcasting, intelligence aids module and the door-lock controller that record group is responded by real-time voice are worked in coordination, and then door device on duty is possessed the ability for handling more complex situations.

Description

A kind of door system on duty and the real-time voice response method based on priority
Technical field
The present invention relates to a kind of door system on duty and implementation method, is that one kind of artificial intelligence identification technology specifically should With the result more particularly to obtained by facial image identification with speech recognition technology, in door system on duty and implementation method Application.
Background technology
It is often to occur simultaneously in facial image in front of the door and voice for door device on duty, if by facial image Identification is applied in door process approach on duty simultaneously with speech recognition technology, can improve real-time voice response, situation is led to The defensive measures such as report, door-lock controller design precision, more rationally, in time, more hommization.
The content of the invention
In view of the above-mentioned problems, it is an object of the invention to propose a kind of door system on duty and instant sound based on priority Sound response method, technical scheme is used by the present invention solves above-mentioned technical problem:
A kind of door system on duty, including door, lock core, lockset and the sensor set in door, lock core, lockset Group, it is characterised in that voice acquisition device, face harvester are additionally provided with the outside of the door, control is provided with the inside of door Device processed, face database, key word library, sound play device, intelligence aids module, door-lock controller, wherein,
The sound play device is connected with controller, for playing keyword response voice record group and facial image sound Sound responds record group, and sound play device can install multiple positions indoors;
The intelligence aids module is connected with controller, the exception occurred for external reporting, and the object of report can be Mobile communications tool or the message processing device of other networkings;
The door-lock controller is connected with controller, and when needing to strengthen the defense, order, door lock control are sent by controller Device processed performs the operation for further strengthening door locking or locking;
The voice acquisition device is connected with the controller, for gathering the voice messaging outside door, and is sent to institute State controller;
The key word library is connected with the controller, and the voice messaging that voice acquisition device obtains is entered with key word library Row compares, and looks for whether to exist the keyword in key word library;
The face harvester is used to gather the facial image on the outside of door, and face harvester connects with the controller Connect, the facial image gathered on the outside of door is compared with face database, looks for whether to exist the facial image in face database;
Moreover, the facial image and keyword in the face database and key word library are respectively equipped with priority, for providing The order responded, follow-up operation is determined by facial image and keyword, wherein, the number of levels of priority is by the reality applied Border it needs to be determined that;The sound play device plays the keyword response voice record group and facial image response voice record Group is to handle one of abnormal means of door.
Real-time voice response method based on priority, it is characterised in that keyword response voice record group carries suitable With condition, including:Time, place, personage, event;Applicable elements determine which keyword response voice record group can be performed, When applicable elements meet, play applicable elements corresponding to keyword response voice record group be handle the abnormal means of door it One;One-to-many relation be present between keyword and keyword response voice record group;The different sound of corresponding same keyword Responding record group has different applicable elements, and then ensures that the selection of response voice record group has uniqueness;
Facial image response voice record group carries applicable elements, and applicable elements can include:Time, place, personage, thing Part;Applicable elements determine which facial image response voice record group can be performed, and when applicable elements meet, play applicable elements Corresponding facial image response voice record group is to handle one of abnormal means of door;Facial image returns with facial image sound Answer between record group and one-to-many relation be present;The different response voice record group of corresponding same facial image has different fit There is uniqueness with the selection of condition, and then guarantee response voice record group;
Following operation is triggered when monitoring facial image and/or keyword:
Step S1:By the facial image of image acquisition device people outdoors, while gathered by voice acquisition device Keyword in voice outdoors, facial image and keyword are sent to controller;
Step S2:Controller is by the facial image received and keyword respectively with being pre-stored in face database and key word library Facial image and keyword compared one by one, find out currently the only response object;
Step S3:Controller searches applicable elements corresponding to facial image, when applicable elements are expired after facial image appearance When sufficient, corresponding operation is performed;
Moreover, the real-time voice response method based on priority, it is characterised in that the step S2, controller When determining currently the only response object, including following four kinds of situations:
If 1) find the facial image of matching, and voice messaging is received, while find the keyword of matching:Then control Device processed is according to priority to the keyword rank found out, and the keyword of highest priority is as response object;
If 2) find the facial image of matching, voice messaging is not received by:The controller according to priority people to finding out Face image sorts, and the facial image of highest priority is as response object;
If 3) do not find the facial image of matching, the keyword that matching is have found in voice messaging is received:Control Device is according to priority to the keyword rank found out, and the keyword of highest priority is as response object;
If 4) find the facial image of matching, the keyword that matching is not found out in voice messaging is received:Controller According to priority the facial image found out is sorted, the facial image of highest priority is as response object;
Moreover, performing corresponding operation when the step S3 applicable elements meet, processing method is as follows:
Step S01:Sound play device plays response voice record group corresponding to applicable elements;
Step S02:According to applicable elements, the people specified from intelligence aids module into applicable elements sends report, report The event and process data that set in applicable elements and door scene has occurred and that;
Step S03:If the sensor group set on door, lock core, lockset monitors to attempt the abnormal row for entering door To send order by controller, door-lock controller performs the operation for further strengthening door locking or locking, and passes through situation Circulate a notice of module external reporting again;
Moreover, occurring multiple facial images of same priority simultaneously, controller selects nearest from door open position Facial image is as selected facial image;There are multiple keywords of same priority simultaneously, controller is selected now Between earliest keyword as selected keyword.
Moreover, the keyword response voice record group and facial image response voice record group possess a plurality of sound respectively Record is responded, every response voice record carries corresponding applicable elements, and controller passes through on door, lock core, lockset The time of state and the generating state change of the sensor group of setting, remember with response voice in selected response voice record group The applicable elements of record are compared, it is determined that applicable response voice record, is played out by sound play device.
Moreover, the object of the intelligence aids module report comprises at least:Telecommunication network alarm, 110 alarms, property report It is alert;The content of the intelligence aids module report comprises at least:The keyword that is prioritized, it is prioritized Other exceptions of audio and video information and sensor group discovery inside and outside facial image, door, the day occurred extremely Phase and time;The mode of intelligence aids module report comprises at least:It is wirelessly transmitted to specific high in the clouds, mobile terminal or PC ends;Feelings The opportunity of condition circular module report comprises at least:It is abnormal when occurring, abnormal when repeating to occur, owner is outgoing when coming back, user from The condition of definition.
Moreover, there are additions and deletions to change editting function for face database and key word library and priority;Keyword response voice record group And there are applicable elements additions and deletions to change editting function;Facial image response voice record group and applicable elements have additions and deletions reorganization volume work( Energy.
Moreover, the facial image that face harvester gathers before door is not found in face database, it is considered as stranger, and Store the facial image.
The advantage of the invention is that:
The present invention relates to a kind of door system on duty and the real-time voice response method based on priority, the present invention use band The keyword for having priority analyzed the voice collected, with the facial image with priority to collect outdoors Facial image is analyzed, and object is responded, it is specified that how to define also with regard to facial image and speech recognition and when depositing in method Method.
In a kind of door system on duty and real-time voice response method based on priority, facial image will be based on and identified It is applied to simultaneously in door process approach on duty with speech recognition technology, the state monitored with reference to sensor group, Ke Yishi Existing more targeted real-time voice Response Policy and step, broadcasting, the intelligence aids mould of record group are responded by real-time voice Block and door-lock controller are worked in coordination, and then door device on duty is possessed the ability for handling more complex situations.
Brief description of the drawings
, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical scheme of the prior art The required accompanying drawing used is briefly described in embodiment or description of the prior art, it should be apparent that, in describing below Accompanying drawing is some embodiments of the present invention, for those of ordinary skill in the art, before creative work is not paid Put, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is the system construction drawing of the present invention
Embodiment
A kind of door system on duty includes door, lock core, lockset and the sensor group set in door, lock core, lockset, Characterized in that, being additionally provided with voice acquisition device, face harvester on the outside of the door, control is provided with the inside of door Device, face database, key word library, sound play device, intelligence aids module, door-lock controller, wherein,
The sound play device is connected with controller, for playing keyword response voice record group and facial image sound Sound responds record group, and sound play device can install multiple positions indoors;
The intelligence aids module is connected with controller, the exception occurred for external reporting, and the object of report can be Mobile communications tool or the message processing device of other networkings;
The door-lock controller is connected with controller, and when needing to strengthen the defense, order, door lock control are sent by controller Device processed performs the operation for further strengthening door locking or locking;
The voice acquisition device is connected with the controller, for gathering the voice messaging outside door, and is sent to institute State controller;
The key word library is connected with the controller, and the voice messaging that voice acquisition device obtains is entered with key word library Row compares, and looks for whether to exist the keyword in key word library;
The face harvester is used to gather the facial image on the outside of door, and face harvester connects with the controller Connect, the facial image gathered on the outside of door is compared with face database, looks for whether to exist the facial image in face database;
Moreover, the facial image and keyword in the face database and key word library are respectively equipped with priority, for providing The order responded, follow-up operation is determined by facial image and keyword, wherein, the number of levels of priority is by the reality applied Border it needs to be determined that;The sound play device plays the keyword response voice record group and facial image response voice record Group is to handle one of abnormal means of door.
A kind of real-time voice response method based on priority, the applicable elements that keyword response voice record group carries, Including:Time, place, personage, event;Applicable elements determine which keyword response voice record group can be performed, and are applicable bar When part meets, keyword response voice record group corresponding to broadcasting applicable elements is to handle one of abnormal means of door;It is crucial One-to-many relation be present between word and keyword response voice record group;The different response voice record of corresponding same keyword Group has different applicable elements, and then ensures that the selection of response voice record group has uniqueness;
Facial image response voice record group carries applicable elements, and applicable elements can include:Time, place, personage, thing Part;Applicable elements determine which facial image response voice record group can be performed, and when applicable elements meet, play applicable elements Corresponding facial image response voice record group is to handle one of abnormal means of door;Facial image returns with facial image sound Answer between record group and one-to-many relation be present;The different response voice record group of corresponding same facial image has different fit There is uniqueness with the selection of condition, and then guarantee response voice record group;
Following operation is triggered when monitoring facial image and/or keyword:
Step S1:By the facial image of image acquisition device people outdoors, while gathered by voice acquisition device Keyword in voice outdoors, facial image and keyword are sent to controller;
Step S2:Controller is by the facial image received and keyword respectively with being pre-stored in face database and key word library Facial image and keyword compared one by one, find out currently the only response object;
Step S3:Controller searches applicable elements corresponding to facial image, when applicable elements are expired after facial image appearance When sufficient, corresponding operation is performed;
Moreover, the real-time voice response method based on priority, it is characterised in that the step S2, controller When determining currently the only response object, including following four kinds of situations:
If 1) find the facial image of matching, and voice messaging is received, while find the keyword of matching:Then control Device processed is according to priority to the keyword rank found out, and the keyword of highest priority is as response object;
If 2) find the facial image of matching, voice messaging is not received by:The controller according to priority people to finding out Face image sorts, and the facial image of highest priority is as response object;
If 3) do not find the facial image of matching, the keyword that matching is have found in voice messaging is received:Control Device is according to priority to the keyword rank found out, and the keyword of highest priority is as response object;
If 4) find the facial image of matching, the keyword that matching is not found out in voice messaging is received:Controller According to priority the facial image found out is sorted, the facial image of highest priority is as response object;
Moreover, performing corresponding operation when the step S3 applicable elements meet, processing method is as follows:
Step S01:Sound play device plays response voice record group corresponding to applicable elements;
Step S02:According to applicable elements, the people specified from intelligence aids module into applicable elements sends report, report The event and process data that set in applicable elements and door scene has occurred and that;
Step S03:If the sensor group set on door, lock core, lockset monitors to attempt the abnormal row for entering door To send order by controller, door-lock controller performs the operation for further strengthening door locking or locking, and passes through situation Circulate a notice of module external reporting again;
Moreover, occurring multiple facial images of same priority simultaneously, controller selects nearest from door open position Facial image is as selected facial image;There are multiple keywords of same priority simultaneously, controller is selected now Between earliest keyword as selected keyword.
Moreover, the keyword response voice record group and facial image response voice record group possess a plurality of sound respectively Record is responded, every response voice record carries corresponding applicable elements, and controller passes through on door, lock core, lockset The time of state and the generating state change of the sensor group of setting, remember with response voice in selected response voice record group The applicable elements of record are compared, it is determined that applicable response voice record, is played out by sound play device.
Moreover, the object of the intelligence aids module report comprises at least:Telecommunication network alarm, 110 alarms, property report It is alert;The content of the intelligence aids module report comprises at least:The keyword that is prioritized, it is prioritized Other exceptions of audio and video information and sensor group discovery inside and outside facial image, door, the day occurred extremely Phase and time;The mode of intelligence aids module report comprises at least:It is wirelessly transmitted to specific high in the clouds, mobile terminal or PC ends;Feelings The opportunity of condition circular module report comprises at least:It is abnormal when occurring, abnormal when repeating to occur, owner is outgoing when coming back, user from The condition of definition.
Moreover, there are additions and deletions to change editting function for face database and key word library and priority;Keyword response voice record group And there are applicable elements additions and deletions to change editting function;Facial image response voice record group and applicable elements have additions and deletions reorganization volume work( Energy.
Moreover, the facial image that face harvester gathers before door is not found in face database, it is considered as stranger, and Store the facial image.
Applicable elements include following Application Example:
Application examples 1:
Xiao Ming 13 years old, it is the son of this family owner, arranges in applicable elements corresponding to Xiao Ming's facial image:Xiao Ming is not having On the premise of obtaining parent's agreement, it is not possible to which band stranger carrys out family.
Situation about occurring outdoors is that Xiao Ming together comes in front of the door with stranger, prepares to enter.
Sound play device:" Xiao Ming, whom this position is at one's side for you, your mother is not to enjoin you to be gone home with stranger ”
Xiao Ming:" this is my friends " (this person is not in facial image database)
Intelligence aids module:(situation for circulating a notice of here to occur to export-oriented parent)
Sound play device:" Xiao Ming, etc., I circulates a notice of, and we first obtains the agreement of parent.”
Door-lock controller:(if necessary, such as:The situation of key unlocking occurs, performs the operation of further locking door)
System is waited after network distal end parent learns, is directly linked up with Xiao Ming, is waited the decision after human intervention, then do into The processing of one step.
Application examples 2:One frequent customer of company Li total prior Yue Liao companies always meets in week to company, and in all total face figures In the applicable elements as corresponding to, the time for illustrating always to come to visit in week, place of receiving a visitor, the information such as people, participant are received;
Always appeared in front of the door when week
Sound play device:" week is total good!Come in for you, and you please arrive reception room and slightly sit, and I has circulated a notice of, and Li is total, and he can be slightly After come to see you.”
Intelligence aids module:(being reported immediately to PC ends total Li and/or mobile terminal) " week has always arrived company, is arranged in meeting Guest room etc. you "
Intelligence aids module:(immediately to it is prearranged other people PC ends and/or mobile terminal report) " client Zhou Zongyi To company, would you please go meeting room to have a meeting at once.”
In application examples 3-8 as follows, for the door in building apartment, key word library and priority may be designed to:
Highest priority:Catch fire, explode, burning, metal run out, leak, smolder, factory have a power failure
Priority is taken second place:Ammeter, coal gas, water meter, express delivery, express mail, registered mail, bottled water, take-away, neighbours, property, residence Committee, elder sister Liu, Lao Zhou, send water, security personnel
Priority is minimum:Upstairs, downstairs, next door
Application examples 3:(during 6 points to 7 points of dusk, the hostess appears in front of the door in family in face database)
Sound play device (child's sound):" messenger, it is that my mother returns!" (Sensor monitoring to knock at the door or by Doorbell turns the key in the lock)
Sound play device (male person's sound):" hear, the rice is done for positive favour!" (Sensor monitoring to door is opened Moment)
Sound play device (male person's sound):" your sound of grandfather one is cried out, preparation is had a meal!”
Sound play device (child's sound):Running sound+" grandfather, have a meal!”
Application examples 4:(not in face database, (Sensor monitoring to someone is attempting to be opened with key the face occurred in front of the door Door)
Sound play device (male person's sound):The quick footsteps+" who are you for moving towards door!Go to the wrong way door”
(if sensor group finds that door bolt is unlatched, starts latch in executing agency's locking door immediately.)
(by dialog procedure and outdoors image circulates a notice of mobile terminal or cell security personnel)
Application examples 5:(face occurred in front of the door is being knocked at the door or rung a doorbell not in face database)
Sound play device (male person's sound):Move towards the footsteps of door+" whom you look for!”
(if continue to knock at the door outdoors, or do not occur the keyword in keyword key word library in voice afterwards)
Sound play device (male person's sound):" you admit one's mistake door!”
(if sensor group finds that door bolt is unlatched, starts latch in executing agency's locking door immediately.)
(if sensor finds that people outdoors does not leave also)
Sound play device (sound that male person makes a phone call):" feed!Property is ensured public securityYou it is upper I this look at do not have not The people of understanding, always turns at us, it is not known that be why on earth!”
(mobile terminal or cell security personnel that dialog procedure and outdoors image are circulated a notice of to house-owner)
Application examples 6:(receiving coming for coal gas)
Outdoors:Knock at the door or ring a doorbell
Sound play device (the old's sound):" whose”
Outdoors:" intake gas charge!”
Sound play device (the old's sound):", gas meter is too high, and I am invisible.”
Outdoors:" opening the door, I looks at for you." (knock at the door or ring a doorbell again while may also talking)
Sound play device (the old's sound):" you is not bothered, you first look into others' family, and my son is back soon ." (according to the current period, be known a priori by soon someone and go home, the words meets preset applicable elements)
(by dialog procedure and outdoors image circulate a notice of room owner mobile terminal)
Application examples 7:
Outdoors:Knock at the door or ring a doorbell
Sound play device (the old's sound):" whom looks for”
Outdoors:" I is elder sister Liu of property, and neighbours reflect that the roof of lavatory is wet downstairs for you, look at whether your families Leak”
Sound play device (the old's sound):" it is!Leak, I, which Calls Now, allows my son to lose no time to look back at See.”
Intelligence aids module:(dialog procedure and the outdoors mobile terminal of image circular room owner)
Application examples 8:(Ms goes home, and when finding to be trailed or coerced by people, during unlocking, actively tells in advance The code word of agreement, keyword " having a power failure in factory ")
(Ms is turning the key in the lock outdoors)
Sound play device (indoor male voice):" who returns" (sensor group monitors that key inserts)
Ms is outdoors:" have a power failure in factory, come off duty in advance." (being the response of keyword " having a power failure in factory " triggering below)
Sound play device (indoor male voice):" just, Xiao Zhou they all in my family!”
Sound play device (another indoor male voice):Footsteps+" Ow!Sister in law returns..." (sensor group Monitoring is opened the moment of door, is played in room)
Finally it should be noted that:Various embodiments above is merely illustrative of the technical solution of the present invention, rather than its limitations;To the greatest extent The present invention is described in detail with reference to foregoing embodiments for pipe, it will be understood by those within the art that:Its according to The technical scheme described in foregoing embodiments can so be modified, either which part or all technical characteristic are entered Row equivalent substitution;And these modifications or replacement, the essence of appropriate technical solution is departed from various embodiments of the present invention technology The scope of scheme.

Claims (10)

1. a kind of door system on duty, including door, lock core, lockset and the sensor group set in door, lock core, lockset, Characterized in that, being additionally provided with voice acquisition device, face harvester on the outside of the door, control is provided with the inside of door Device, face database, key word library, sound play device, intelligence aids module, door-lock controller, wherein,
The sound play device is connected with controller, is returned for playing keyword response voice record group and facial image sound Record group is answered, sound play device can install multiple positions indoors;
The intelligence aids module is connected with controller, and the exception occurred for external reporting, the object of report can be mobile Communication tool or the message processing device of other networkings;
The door-lock controller is connected with controller, and when needing to strengthen the defense, order, door lock control dress are sent by controller Put the operation for performing and further strengthening door locking or locking;
The voice acquisition device is connected with the controller, for gathering the voice messaging outside door, and is sent to the control Device processed;
The key word library is connected with the controller, and the voice messaging that voice acquisition device obtains is compared with key word library It is right, look for whether to exist the keyword in key word library;
The face harvester is used to gather the facial image on the outside of door, and face harvester is connected with the controller, The facial image gathered on the outside of door is compared with face database, looks for whether to exist the facial image in face database.
2. a kind of door system on duty according to claim 1, it is characterised in that in the face database and key word library Facial image and keyword are respectively equipped with priority, for the order for providing to be responded, are determined by facial image and keyword Follow-up operation, wherein, the number of levels of priority is actually needed determination by what is applied;The sound play device plays the pass Key word response voice record group and facial image response voice record group are to handle one of abnormal means of door.
3. the real-time voice response method based on priority that a kind of door system on duty based on described in claim 1 is realized, Characterized in that, the applicable elements that the keyword response voice record group carries, including:Time, place, personage, event;Institute State applicable elements and determine which keyword response voice record group can be performed, when applicable elements meet, play applicable elements pair The keyword response voice record group answered is to handle one of abnormal means of door;Keyword and keyword response voice record group Between one-to-many relation be present;The different response voice record group of corresponding same keyword has different applicable elements, enters And ensureing the selection of response voice record group has uniqueness;
Facial image response voice record group carries applicable elements, and applicable elements can include:Time, place, personage, event; Applicable elements determine which facial image response voice record group can be performed, and when applicable elements meet, play applicable elements pair The facial image response voice record group answered is to handle one of abnormal means of door;Facial image and facial image response voice One-to-many relation between record group be present;The different response voice record group of corresponding same facial image has different be applicable Condition, and then ensure that the selection of response voice record group has uniqueness;
Following operation is triggered when monitoring facial image and/or keyword:
Step S1:By the facial image of image acquisition device people outdoors, while by voice acquisition device collection outdoors Keyword in voice, facial image and keyword are sent to controller;
Step S2:Controller is by the facial image received and the keyword people with being pre-stored in face database and key word library respectively Face image and keyword are compared one by one, find out currently the only response object;
Step S3:Controller searches applicable elements corresponding to facial image after facial image appearance, when applicable elements meet When, perform corresponding operation.
4. the real-time voice response method according to claim 3 based on priority, it is characterised in that the step S2, When controller determines currently the only response object, including following four kinds of situations:
If 1) find the facial image of matching, and voice messaging is received, while find the keyword of matching:Then controller According to priority to the keyword rank found out, the keyword of highest priority is as response object;
If 2) find the facial image of matching, voice messaging is not received by:The controller according to priority face figure to finding out As sequence, the facial image of highest priority is as response object;
If 3) do not find the facial image of matching, the keyword that matching is have found in voice messaging is received:Controller is pressed Priority is to the keyword rank found out, and the keyword of highest priority is as response object;
If 4) find the facial image of matching, the keyword that matching is not found out in voice messaging is received:Controller is by excellent First level sorts to the facial image found out, and the facial image of highest priority is as response object.
A kind of 5. real-time voice response method based on priority according to claim 3, it is characterised in that the step Corresponding operation is performed when S3 applicable elements meet, processing method is as follows:
Step S01:Sound play device plays response voice record group corresponding to applicable elements;
Step S02:According to applicable elements, the people specified from intelligence aids module into applicable elements sends report, and report is applicable The event and process data that set in condition and door scene has occurred and that;
Step S03:If the sensor group set on door, lock core, lockset monitors to attempt the abnormal behavior for entering door, by Controller sends order, and door-lock controller performs the operation for further strengthening door locking or locking, and passes through intelligence aids Module external reporting again.
6. the real-time voice response method according to claim 3 based on priority, it is characterised in that while occur same Multiple facial images of priority, controller select the facial image nearest from door open position as selected face figure Picture;There are multiple keywords of same priority simultaneously, controller selection time of occurrence earliest keyword is as selecting Keyword.
7. the real-time voice response method according to claim 3 based on priority, it is characterised in that the keyword sound Sound responds record group and facial image response voice record group possesses a plurality of response voice record, every response voice respectively Record carries corresponding applicable elements, and controller passes through the state and hair of the sensor group set on door, lock core, lockset The time of raw state change, the applicable elements recorded with response voice in selected response voice record group are compared, it is determined that Applicable response voice record, is played out by sound play device.
8. the real-time voice response method according to claim 3 based on priority, it is characterised in that the intelligence aids The object of module report comprises at least:Telecommunication network alarm, 110 alarms, property alarm;The intelligence aids module is reported interior Appearance comprises at least:The keyword that is prioritized, the facial image being prioritized, the audio inside and outside door and regard Other abnormal, the dates and time that occur extremely that frequency information and the sensor group are found;The report of intelligence aids module Mode comprises at least:It is wirelessly transmitted to specific high in the clouds, mobile terminal or PC ends;The opportunity of intelligence aids module report at least wraps Include:It is abnormal when occurring, abnormal when repeating to occur, owner is outgoing when coming back, user-defined condition.
9. the real-time voice response method according to claim 3 based on priority, it is characterised in that face database and key There are additions and deletions to change editting function for character library and priority;Keyword response voice record group and applicable elements have additions and deletions reorganization volume work( Energy;There are additions and deletions to change editting function for facial image response voice record group and applicable elements.
10. the real-time voice response method according to claim 3 based on priority, it is characterised in that face collection dress Put the facial image gathered before door not find in face database, be considered as stranger, and store the facial image.
CN201710887961.2A 2017-09-27 2017-09-27 A kind of door system on duty and priority-based real-time voice response method Active CN107705402B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710887961.2A CN107705402B (en) 2017-09-27 2017-09-27 A kind of door system on duty and priority-based real-time voice response method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710887961.2A CN107705402B (en) 2017-09-27 2017-09-27 A kind of door system on duty and priority-based real-time voice response method

Publications (2)

Publication Number Publication Date
CN107705402A true CN107705402A (en) 2018-02-16
CN107705402B CN107705402B (en) 2019-11-01

Family

ID=61174983

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710887961.2A Active CN107705402B (en) 2017-09-27 2017-09-27 A kind of door system on duty and priority-based real-time voice response method

Country Status (1)

Country Link
CN (1) CN107705402B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109191777A (en) * 2018-09-17 2019-01-11 郑州云海信息技术有限公司 A kind of threat identification system and method based on artificial intelligence

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103177519A (en) * 2013-02-22 2013-06-26 秦方 Remote monitoring system and remote monitoring method with door alarm and real-time voice response functions
CN104282064A (en) * 2014-09-30 2015-01-14 小米科技有限责任公司 Entrance guard response method and entrance guard response device
CN104834273A (en) * 2014-02-11 2015-08-12 刘振东 Non-attended anti-theft system
CN105139557A (en) * 2015-08-05 2015-12-09 移康智能科技(上海)有限公司 Artificial intelligence doorbell information prompt method and artificial intelligence doorbell
CN105809781A (en) * 2016-03-03 2016-07-27 李艳 Visiting request responding method and visiting request responding device
CN106790537A (en) * 2016-12-22 2017-05-31 天津恒辉创意科技有限公司 Safety-protection system and its implementation based on internet and sensor door
CN107100437A (en) * 2017-06-28 2017-08-29 天津恒辉创意科技有限公司 A kind of door is from crime prevention system and its implementation
US20170256257A1 (en) * 2016-03-01 2017-09-07 Microsoft Technology Licensing, Llc Conversational Software Agent

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103177519A (en) * 2013-02-22 2013-06-26 秦方 Remote monitoring system and remote monitoring method with door alarm and real-time voice response functions
CN104834273A (en) * 2014-02-11 2015-08-12 刘振东 Non-attended anti-theft system
CN104282064A (en) * 2014-09-30 2015-01-14 小米科技有限责任公司 Entrance guard response method and entrance guard response device
CN105139557A (en) * 2015-08-05 2015-12-09 移康智能科技(上海)有限公司 Artificial intelligence doorbell information prompt method and artificial intelligence doorbell
US20170256257A1 (en) * 2016-03-01 2017-09-07 Microsoft Technology Licensing, Llc Conversational Software Agent
CN105809781A (en) * 2016-03-03 2016-07-27 李艳 Visiting request responding method and visiting request responding device
CN106790537A (en) * 2016-12-22 2017-05-31 天津恒辉创意科技有限公司 Safety-protection system and its implementation based on internet and sensor door
CN107100437A (en) * 2017-06-28 2017-08-29 天津恒辉创意科技有限公司 A kind of door is from crime prevention system and its implementation

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109191777A (en) * 2018-09-17 2019-01-11 郑州云海信息技术有限公司 A kind of threat identification system and method based on artificial intelligence

Also Published As

Publication number Publication date
CN107705402B (en) 2019-11-01

Similar Documents

Publication Publication Date Title
CN104639907B (en) A kind of intelligent security guard method and system based on mobile terminal
CN107341880A (en) A kind of home security method and system
US7460859B2 (en) System and method for obtaining a status of an authorization device over a network for administration of theatrical performances
US7529350B2 (en) System and method for obtaining equipment status data over a network
CN106952366A (en) A kind of access control management method social based on real name
CN101247516B (en) Visible intercommunication method and system for buildings
CN1227628C (en) Alarm method and device
US10178225B1 (en) Contraband wireless communications device identification in controlled-environment facilities
CN109665397A (en) Elevator Internet of Things security protection interactive system and method based on recognition of face
CN108198304A (en) A kind of stress alarm method and device based on intelligent door lock
CN107592498A (en) A kind of cell management method and relevant device based on intelligent video camera head
CN107102559A (en) A kind of intelligent home control system and method
CN111914640A (en) Intelligent doorbell control method and system
CN110335437A (en) A kind of wisdom house security system based on block chain
CN111063088A (en) Control method of intelligent building intercom system
CN107131607A (en) Monitoring method, device, system and air-conditioning based on air-conditioning
CN115273369A (en) Intelligent household security monitoring device and monitoring method thereof
US10783759B2 (en) Intruder detection method and apparatus
CN107705402B (en) A kind of door system on duty and priority-based real-time voice response method
CN115604049B (en) Intelligent communication network system for household multifunctional monitoring
CN103793961A (en) Safety identification method capable of comparing identity in real time
US7177668B2 (en) Access monitoring via piconet connection to telephone
CN110992543A (en) Control method of building intercom system
US7734018B2 (en) System and method for establishing a call between a calling party and a called party over a wired network
CN206149399U (en) But network management structure of talkbacking of remote monitoring

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
OL01 Intention to license declared
OL01 Intention to license declared