WO2019062122A1 - Door opening method and device, access control device, and computer readable storage medium - Google Patents

Door opening method and device, access control device, and computer readable storage medium Download PDF

Info

Publication number
WO2019062122A1
WO2019062122A1 PCT/CN2018/085634 CN2018085634W WO2019062122A1 WO 2019062122 A1 WO2019062122 A1 WO 2019062122A1 CN 2018085634 W CN2018085634 W CN 2018085634W WO 2019062122 A1 WO2019062122 A1 WO 2019062122A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
voice
voice information
user
feature
Prior art date
Application number
PCT/CN2018/085634
Other languages
French (fr)
Chinese (zh)
Inventor
关岩
Original Assignee
深圳春沐源控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳春沐源控股有限公司 filed Critical 深圳春沐源控股有限公司
Publication of WO2019062122A1 publication Critical patent/WO2019062122A1/en

Links

Images

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00309Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys operated with bidirectional data transmission between data carrier and locks
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00563Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00896Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys specially adapted for particular uses
    • G07C9/00904Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys specially adapted for particular uses for hotels, motels, office buildings or the like

Definitions

  • the present invention relates to the field of security protection technologies, and in particular, to a method and device for opening a door, an access device, and a computer readable storage medium.
  • the hotel device allocates a first unlocking password corresponding to the room information in the check-in confirmation information based on the acquired check-in confirmation information, and changes the state of the room information to a check-in state.
  • the hotel device sends the room information and the first unlocking password to a corresponding mobile device, and sends the check-in state and the first unlocking password to a door lock terminal corresponding to the room information.
  • the door lock terminal receives a second unlocking password from the mobile device, and the door lock terminal matches the first unlocking password and the second unlocking password according to the check-in state, and determines whether to open the door according to the matching result.
  • the hotel equipment may also cancel the first unlock password of the allocated corresponding room based on the acquired check-in information, and simultaneously transfer the status of the room information from the check-in state, and then turn The outgoing status is sent to the door lock terminal, and further, the door lock terminal determines that the first unlock password is an invalid password.
  • the above conventional fingerprint unlocking and password unlocking have certain shortcomings.
  • the hotel uses conventional fingerprint unlocking, the fingerprint information is easily copied and stolen, and the security needs to be further improved.
  • the password unlocking requires the customer to provide a password. Before opening the door, the user needs to find the password to unlock it, which brings inconvenience to the user.
  • a door opening method is applied to an access control device, wherein the access control device communicates with a server, the method comprising:
  • the matching the second voice information with the first voice information comprises:
  • the voice feature in the first voice information and the voice feature in the second voice information include a combination of one or more of the following: tone, pitch, and loudness;
  • the method further includes:
  • the voice instruction that the user facial information matches fails is output.
  • the method further includes:
  • the method before acquiring the voice signal corresponding to the updated term input by the user, the method further includes:
  • the voice signal corresponding to the updated term input by the user is acquired.
  • the method further includes:
  • a door opening device operating in an access device, the door device communicating with a server, the device comprising:
  • a receiving unit configured to receive feature information of a user sent by the server, where the feature information includes first voice information of the user and first face information of the user;
  • An acquiring unit configured to acquire second voice information
  • a matching unit configured to match the second voice information with the first voice information
  • the acquiring unit is further configured to acquire second face information when the second voice information is successfully matched with the first voice information
  • the matching unit is further configured to match the second facial information with the first facial information
  • an execution unit configured to perform a door opening operation when the second face information is successfully matched with the first face information.
  • the matching unit matching the second voice information with the first voice information includes:
  • the voice feature in the first voice information and the voice feature in the second voice information include a combination of one or more of the following: tone, pitch, and loudness;
  • the apparatus further includes:
  • An output unit configured to: when the second voice information is unsuccessful to match the first voice information, output a voice command that the user voice information fails to match, and prompt the user to continue to input voice for matching; or When the second voice information is successfully matched with the first voice information, outputting the voice command that the user voice information matches successfully, and outputting the voice command of the user to cooperate with the face recognition; or when the second face information and the location When the first facial information matching is unsuccessful, the voice instruction that the user facial information matches fails is output.
  • the apparatus further includes:
  • the receiving unit is further configured to receive an instruction to change a preset opening statement in the first voice information
  • the acquiring unit is further configured to acquire a voice signal corresponding to the updated term input by the user;
  • a changing unit configured to change a voice signal of the preset door opening term in the first voice information to a voice signal corresponding to the updated term.
  • the device before the acquiring unit acquires the voice signal corresponding to the updated term input by the user, the device further includes:
  • the obtaining unit is further configured to acquire contact information of the terminal of the user;
  • a sending unit configured to send, according to the contact information, verification information to a terminal of the user
  • the receiving unit is further configured to receive verification information input by the user
  • the matching unit is further configured to match the received verification information with the sent verification information
  • the acquiring unit is further configured to: when the received verification information and the sent verification information match successfully, acquire a voice signal corresponding to the updated term input by the user.
  • the apparatus further includes:
  • a detecting unit configured to detect a switch state of the door
  • the output unit is further configured to output a corresponding voice instruction according to the switch state when receiving an inquiry command corresponding to the preset door closing language input by the user.
  • An access control device includes:
  • a memory instructions stored in the memory are executed by the processor to implement the method of opening the door.
  • a computer readable storage medium the instructions stored in the computer readable storage medium being executed by a processor in an access device to implement the door opening method.
  • the present invention receives the feature information of the user sent by the server, and the feature information includes the first voice information of the user and the first facial information of the user, which is visible.
  • a voice message and the first face information are voice information and face information of the user, and are used as a basis for subsequent door opening verification.
  • the second voice information may be acquired first, the second voice information may be from the user itself, or may be from other people than the user; and the second voice information is related to the first The voice information is matched; when the second voice information is successfully matched with the first voice information, the second voice information is identical or extremely similar to the first voice information, and is initially determined to be The same person, but in order to ensure security, the following further confirmation is made: acquiring second face information, matching the second face information with the first face information, when the second face information and the first When the face information is successfully matched, the door opening operation is performed, so that the door opener information is verified according to both the voice and the face to determine whether the door opener is a user who has the right to open the door, and not only achieves multi-layer protection, but also is more secure and reliable.
  • the matching of facial information needs to be based on the matching of voice information, it does not need to be activated at the same time, which saves energy, realizes resource optimization processing, and is convenient to operate, has certain interest and customer participation, and enhances A sense of customer experience.
  • FIG. 1 is an application environment diagram of a first preferred embodiment of the method for achieving a door opening according to the present invention.
  • FIG. 2 is a diagram showing an application environment of a second preferred embodiment of the method for achieving a door opening according to the present invention.
  • Figure 3 is a flow chart of a preferred embodiment of the method of opening a door of the present invention.
  • Figure 4 is a functional block diagram of a preferred embodiment of the door opening device of the present invention.
  • FIG. 5 is a schematic structural view of an access control device according to a preferred embodiment of the present invention.
  • FIG. 1 is an application environment diagram of a first preferred embodiment of the method for implementing a door opening according to the present invention.
  • the application environment diagram includes an access control device 1, a server 3, and a first collection device 4.
  • the access device 1 is in communication with the server 3, and the server 3 is in communication with the first acquisition device 4.
  • the door opening method is applied to the access device 1, the door opening device 1 performing a switching operation of the door by executing a corresponding operational command of the door opening method.
  • the server 3 collects feature information of the user through the first collection device 4, and transmits the feature information to the access control device 1 for the access control device 1 to The feature information serves as the basis for subsequent door opening verification.
  • the access control device 1 is in communication with the user's terminal 5 to facilitate subsequent modification of the door opening information (e.g., door opening terms).
  • the first collection device 4 can be located in the terminal 5, so that the user can connect to the server 3 through the terminal 5, facilitating login and modification of user information and the like.
  • the terminal 5 may collect feature information of the user by using the first collecting device 4, and send the feature information to the server 3, and then send the feature information to the access control via the server 3.
  • the device 1 or the terminal 5 can receive the authorization of the server 3 to directly send the feature information to the access device 1 , which is not limited herein.
  • FIG. 3 is a flow chart of a preferred embodiment of the method of opening a door of the present invention.
  • the order of the steps in the flowchart may be changed according to different requirements, and some steps may be omitted.
  • the door opening method is applied to one or more access control devices 1 which are devices capable of automatically performing numerical calculation and/or information processing according to preset or stored instructions, the hardware including but not It is limited to a microprocessor, an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a digital signal processor (DSP), an embedded device, and the like.
  • ASIC application specific integrated circuit
  • FPGA field-programmable gate array
  • DSP digital signal processor
  • the access control device 1 can be any electronic product that can interact with a user, such as an intelligent embedded device or the like.
  • the network in which the access control device 1 is located includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (VPN), and the like.
  • VPN virtual private network
  • the access control device 1 receives feature information of a user sent by the server 3, and the feature information includes first voice information of the user and first face information of the user.
  • the first voice information includes, but is not limited to, one or a combination of the following:
  • the speech feature includes one or more of the following: a timbre of the user, a pitch of the user, a loudness of the user, and the like.
  • the preset door opening term may be “please open the door”, “open the door with sesame”, etc., and the invention is not limited thereto.
  • the feature information may further include contact information of the terminal 5 of the user, for example, the mobile phone number of the user, and the like.
  • the access control device 1 may further modify a preset opening statement in the first voice information, and a specific implementation manner is:
  • the access control device 1 receives an instruction to change a preset opening statement in the first voice information, and acquires a voice signal corresponding to the updated term input by the user.
  • the access control device 1 changes a voice signal of a preset door opening term in the first voice information to a voice signal corresponding to the updated term.
  • the manner in which the access control device 1 receives an instruction to change a preset opening statement in the first voice information may include:
  • the access control device 1 acquires an instruction that the user touches a preset physical button or a preset virtual control.
  • the access control device 1 receives a voice command for changing a preset door opening term in the first voice information.
  • the user can set the preset opening language according to the preference, which enhances the fun, and is more secure and brings a better use experience.
  • the method before the access control device 1 acquires a voice signal corresponding to the updated term input by the user, the method further includes:
  • the access control device 1 acquires contact information of the terminal 5 of the user, and transmits verification information to the terminal 5 of the user according to the contact information.
  • the access control device 1 receives the verification information input by the user, and matches the received verification information with the transmitted verification information. When the received verification information is successfully matched with the transmitted verification information, the voice signal corresponding to the updated term input by the user is acquired.
  • the access control device 1 acquires the mobile phone number of the user, and sends a verification code to the terminal 5 of the mobile phone number for the user to input the transmitted verification code to the access control device 1 for verification.
  • the access control device 1 receives the verification code input by the user, and matches the verification code input by the user with the transmitted verification code. If the verification code input by the user is successfully matched with the transmitted verification code, the access control device 1 acquires a voice signal corresponding to the updated term input by the user.
  • the access control device 1 acquires second voice information.
  • the second voice information includes, but is not limited to, one or a combination of the following:
  • the opening prompt in the second voice information and the voice feature in the second voice information includes a combination of one or more of the following: a tone color of the user corresponding to the second voice information, a tone of the user corresponding to the second voice information, a loudness of the user corresponding to the second voice information, and the like. .
  • the access control device 1 can acquire the second voice information through a sound collection device 14 in communication with the access control device 1, and the sound collection device 14 can also be installed in the In the access device 1, of course, in other embodiments, other methods may be employed.
  • the access control device 1 matches the second voice information with the first voice information.
  • the step of the access control device 1 matching the second voice information with the first voice information includes: opening an opening term in the second voice information and the The default opening words in a voice message are matched.
  • the voice feature in the second voice information and the first voice information are The voice features are matched.
  • the voice features in the first voice information and the voice features in the second voice information include, but are not limited to, a combination of one or more of the following: tone, pitch, loudness Wait.
  • the access control device 1 determines the second voice information and the first The voice information is matched successfully.
  • the access control device 1 determines the second voice information and the first Voice message matching failed.
  • the access control device 1 determines the second voice information and the first voice information. The match failed.
  • the error range may be set by the access control device 1 according to well-known empirical values involved in the related art in the field of speech recognition, and the present invention is not limited thereto.
  • the method further includes:
  • the access control device 1 When the matching of the second voice information with the first voice information is unsuccessful, the access control device 1 outputs a voice command that the user voice information fails to match, and prompts the user to continue inputting voice for matching.
  • the access control device 1 when the second voice information is unsuccessful to match the first voice information, the access control device 1 outputs a prompt voice: "Your door opening instruction is incorrect, please re-enter the door opening command, thank you for your cooperation.”
  • the access control device 1 when the second voice information is successfully matched with the first voice information, the access control device 1 outputs a voice command that the user voice information matches successfully, and outputs the voice command of the user to cooperate with the face recognition.
  • the access control device 1 when the second voice information is successfully matched with the first voice information, the access control device 1 outputs a prompt voice: "Your door opening instruction is correct, please aim at the camera for facial image collection, thank you. Cooperate.”
  • the access control device 1 acquires second face information.
  • the facial recognition process is not initiated until the second speech information matches the first speech information. In this way, it not only saves resources, but also improves efficiency, while also providing double protection, which is more secure and reliable.
  • the access control device 1 can acquire the second facial information through an imaging device in communication with the access control device 1, and the imaging device 15 can also be installed in the access control device 1
  • the imaging device 15 can also be installed in the access control device 1
  • other methods may also be employed.
  • the method further includes:
  • the access control device 1 When the second face information is unsuccessfully matched with the first face information, the access control device 1 outputs a voice command that the user face information fails to match.
  • the access control device 1 when the second face information is unsuccessfully matched with the first face information, the access control device 1 outputs a prompt voice: "Your face recognition failed.”
  • the access control device 1 may prompt the user to continue collecting the facial image to continue facial recognition, or the access control device 1 You can do nothing, here you can set it according to the specific use environment.
  • the access control device 1 matches the second facial information with the first facial information.
  • the access control device 1 can match the second facial information with the first facial information in many ways. In view of the fact that the facial recognition technology is prior art, the present invention I will not repeat them here.
  • the access control device 1 performs a door opening operation.
  • the method further includes:
  • the access device 1 detects the switching state of the door.
  • the access control device 1 receives the inquiry command corresponding to the preset door closing language input by the user, the corresponding voice command is output according to the switch state.
  • the access control device 1 monitors the on/off state of the door in real time.
  • the access control device 1 receives the inquiry command “Does the door closed?” corresponding to the preset closing word input by the user, the access control device 1 outputs a corresponding voice command according to the detected switch state of the door. .
  • the voice command "gate is closed, thank you”; when the door is not closed, the voice command is output "The door is not closed, please close the door again, thank you.”
  • the present invention can receive the feature information of the user sent by the server, the feature information includes the first voice information of the user and the first face information of the user; and acquire the second voice information; The second voice information is matched with the first voice information; when the second voice information is successfully matched with the first voice information, acquiring second face information; and the second face information is The first face information is matched; and when the second face information is successfully matched with the first face information, the door opening operation is performed. Therefore, the invention not only realizes multi-layer protection, is more safe and reliable, saves energy, realizes resource optimization processing, and is convenient to operate, has certain interest and customer participation, and enhances customer experience.
  • the door opening device 11 includes a receiving unit 100, an obtaining unit 101, a matching unit 102, an executing unit 103, an output unit 104, a changing unit 105, a transmitting unit 106, and a detecting unit 107.
  • the unit referred to in the present invention refers to a series of computer program segments that can be executed by the processor 13 and capable of performing fixed functions, which are stored in the memory 12. In the present embodiment, the functions of the respective units will be described in detail in the subsequent embodiments.
  • the receiving unit 100 receives the feature information of the user sent by the server 3, and the feature information includes the first voice information of the user and the first face information of the user.
  • the first voice information includes, but is not limited to, one or a combination of the following:
  • the voice features in the first voice information include a combination of one or more of the following: a tone of the user, a tone of the user, a loudness of the user, and the like.
  • the preset door opening term may be “Please open the door”, “Open the door with sesame”, etc., and the invention is not limited thereto.
  • the feature information may further include contact information of the terminal 5 of the user, for example, the mobile phone number of the user, and the like.
  • the modifying unit 105 may further modify the preset opening term in the first voice information, and a specific implementation manner is:
  • the receiving unit 100 receives an instruction to change a preset opening statement in the first voice information, and the acquiring unit 101 acquires a voice signal corresponding to the updated term input by the user.
  • the changing unit 105 changes the voice signal of the preset door opening term in the first voice information to the voice signal corresponding to the updated term.
  • the manner in which the receiving unit 100 receives an instruction to change a preset opening statement in the first voice information may include:
  • the receiving unit 100 acquires an instruction that the user touches a preset physical button or a preset virtual control.
  • the receiving unit 100 receives a voice instruction for changing a preset opening door in the first voice information.
  • the user can set the preset opening language according to the preference, which enhances the fun, and is more secure and brings a better use experience.
  • the method before the obtaining unit 101 acquires a voice signal corresponding to the updated term input by the user, the method further includes:
  • the obtaining unit 101 acquires contact information of the terminal 5 of the user, and according to the contact information, the sending unit 106 sends the verification information to the terminal 5 of the user.
  • the receiving unit 100 receives the verification information input by the user, and the matching unit 102 matches the received verification information with the transmitted verification information.
  • the obtaining unit 101 acquires a voice signal corresponding to the updated term input by the user.
  • the obtaining unit 101 acquires the mobile phone number of the user, and the sending unit 106 sends a verification code to the terminal 5 of the mobile phone number, for the user to input the sent verification code to the access control device. 1 to verify.
  • the receiving unit 100 receives the verification code input by the user, and the matching unit 102 matches the verification code input by the user with the transmitted verification code. If the verification code input by the user is successfully matched with the transmitted verification code, the obtaining unit 101 acquires a voice signal corresponding to the updated term input by the user.
  • the acquiring unit 101 acquires second voice information.
  • the second voice information includes, but is not limited to, one or a combination of the following:
  • the opening prompt in the second voice information and the voice feature in the second voice information includes a combination of one or more of the following: a tone color of the user corresponding to the second voice information, a tone of the user corresponding to the second voice information, and the second voice information. Corresponding user's loudness, etc.
  • the acquisition unit 101 may acquire the second voice information through a sound collection device 14 in communication with the access control device 1, and the sound collection device 14 may also be installed in the In the access device 1, of course, in other embodiments, other methods may be employed.
  • the matching unit 102 matches the second voice information with the first voice information.
  • the matching unit 102 matches the second voice information with the first voice information, and the matching unit 102 opens the second voice information.
  • the term is matched with a preset opening statement in the first voice message.
  • the matching unit 102 compares the voice feature in the second voice information with the first The speech features in a speech message are matched.
  • the voice features in the first voice information and the voice features in the second voice information include, but are not limited to, a combination of one or more of the following: tone, pitch, loudness Wait.
  • the matching unit 102 determines the second voice information and the first The voice information is matched successfully.
  • the matching unit 102 determines the second voice information and the first Voice message matching failed.
  • the matching unit 102 determines the second voice information and the first voice information. The match failed.
  • the error range may be set by the access control device 1 according to well-known empirical values involved in the related art in the field of speech recognition, and the present invention is not limited thereto.
  • the method further includes:
  • the output unit 104 When the matching of the second voice information with the first voice information is unsuccessful, the output unit 104 outputs a voice command that the user voice information fails to match, and prompts the user to continue inputting voice for matching.
  • the output unit 104 outputs a prompt voice: "Your door opening instruction is incorrect, please re-enter the door opening command, thank you for your cooperation.”
  • the output unit 104 when the second voice information is successfully matched with the first voice information, the output unit 104 outputs a voice command that the user voice information matches successfully, and outputs the voice command of the user to cooperate with the face recognition.
  • the output unit 104 outputs a prompt voice: "Your door opening instruction is correct, please aim at the camera for facial image collection, thank you. Cooperate.”
  • the acquiring unit 101 acquires second face information.
  • the facial recognition process is not initiated until the second speech information matches the first speech information. In this way, it not only saves resources, but also improves efficiency, while also providing double protection, which is more secure and reliable.
  • the acquisition unit 101 may acquire the second facial information through an imaging device 15 in communication with the access control device 1, and the imaging device 15 may also be installed in the access control device. 1 in.
  • the imaging device 15 may also be installed in the access control device. 1 in.
  • other methods may also be employed.
  • the method further includes:
  • the output unit 104 When the matching of the second face information with the first face information is unsuccessful, the output unit 104 outputs a voice instruction that the user face information fails to match.
  • the output unit 104 outputs a prompt voice: "Your face recognition failed.”
  • the output unit 104 may prompt the user to continue the collection of the facial image to continue facial recognition, or the output unit 104 may No action is taken, which can be set here depending on the specific usage environment.
  • the matching unit 102 matches the second face information with the first face information.
  • the matching unit 102 can match the second facial information with the first facial information in many ways. In view of the fact that the facial recognition technology is prior art, the present invention I will not repeat them here.
  • the execution unit 103 When the second face information is successfully matched with the first face information, the execution unit 103 performs a door opening operation.
  • the method further includes:
  • the detecting unit 107 detects the switching state of the door.
  • the output unit 104 outputs a corresponding voice command according to the switch state.
  • the detecting unit 107 performs real-time monitoring on the switching state of the door.
  • the output unit 104 outputs a corresponding voice command according to the detected switching state of the door. . Specifically, when the door has been closed, the output unit 104 outputs a voice command "The door is closed, thank you"; when the door is not closed, the output unit 104 outputs a voice command "The door is not closed, please re- Close, thank you.”
  • the present invention can receive the feature information of the user sent by the server, the feature information includes the first voice information of the user and the first face information of the user; and acquire the second voice information; The second voice information is matched with the first voice information; when the second voice information is successfully matched with the first voice information, acquiring second face information; and the second face information is The first face information is matched; and when the second face information is successfully matched with the first face information, the door opening operation is performed. Therefore, the invention not only realizes multi-layer protection, is more safe and reliable, saves energy, realizes resource optimization processing, and is convenient to operate, has certain interest and customer participation, and enhances customer experience.
  • FIG. 5 is a schematic structural view of an access control device according to a preferred embodiment of the present invention.
  • the access control device 1 is a device capable of automatically performing numerical calculation and/or information processing according to an instruction set or stored in advance, and the hardware includes, but not limited to, a microprocessor, an application specific integrated circuit (ASIC). ), Field-Programmable Gate Array (FPGA), Digital Signal Processor (DSP), embedded devices, etc.
  • ASIC application specific integrated circuit
  • FPGA Field-Programmable Gate Array
  • DSP Digital Signal Processor
  • the access control device 1 can also be, but is not limited to, any electronic product that can interact with a user through a keyboard, a mouse, a remote controller, a touch panel, or a voice control device, such as an intelligent embedded device.
  • the network in which the access control device 1 is located includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (VPN), and the like.
  • the Internet includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (VPN), and the like.
  • VPN virtual private network
  • the access device 1 includes, but is not limited to, a memory 12, a processor 13, and a computer program stored in the memory 12 and operable on the processor 13, such as Open the door. It will be understood by those skilled in the art that the schematic diagram is merely an example of the access control device 1 and does not constitute a limitation of the access control device 1, and may include more or less components than those illustrated, or some components may be combined, or different. Components such as the access device 1 may also include input and output devices, network access devices, buses, and the like.
  • the processor 13 may be a central processing unit (CPU), or may be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.
  • the general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like, and the processor 13 is an operation core and a control center of the access control device 1, and connects the entire access control device by using various interfaces and lines. Each part of 1 and an operating system of the access control device 1 and various installed applications, program codes, and the like.
  • the processor 13 executes an operating system of the access control device 1 and various types of installed applications.
  • the processor 13 executes the application to implement the steps in the various door opening method embodiments described above, such as steps S10, S11, S12, S13, S14, and S15 shown in FIG.
  • the processor 13 implements the functions of each module/unit in each device embodiment when executing the computer program, for example, receiving feature information of a user sent by the server, where the feature information includes the user's a voice information and the first facial information of the user; acquiring second voice information; matching the second voice information with the first voice information; and when the second voice information and the first voice Acquiring second face information when the information matching is successful; matching the second face information with the first face information; and performing when the second face information is successfully matched with the first face information Open the door.
  • the computer program can be partitioned into one or more modules/units, which are stored in the memory 12 and executed by the processor 13 to complete the present invention.
  • the one or more modules/units may be a series of computer program instruction segments capable of performing a particular function, the instruction segments being used to describe the execution of the computer program in the access control device 1.
  • the computer program may be divided into a receiving unit 100, an obtaining unit 101, a matching unit 102, an executing unit 103, an output unit 104, a changing unit 105, a transmitting unit 106, and a detecting unit 107.
  • the memory 12 can be used to store the computer program and/or module by running or executing a computer program and/or module stored in the memory 12, and recalling data stored in the memory 12, Various functions of the access control device 1 are implemented.
  • the memory 12 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; Stores data created based on the use of the phone (such as audio data, phone book, etc.).
  • the memory 12 may include a high-speed random access memory, and may also include a non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SMC), and a secure digital (Secure Digital, SD).
  • a non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SMC), and a secure digital (Secure Digital, SD).
  • SMC smart memory card
  • SD Secure Digital
  • Card flash card, at least one disk storage device, flash device, or other volatile solid state storage device.
  • the memory 12 can be an external memory and/or an internal memory of the access device 1. Further, the memory 12 may be a circuit having a storage function in a physical form, such as a RAM (Random-Access Memory), a FIFO (First In First Out), or the like. Alternatively, the memory 12 may also be a memory having a physical form such as a memory stick, a TF card, or the like.
  • RAM Random-Access Memory
  • FIFO First In First Out
  • the memory 12 may also be a memory having a physical form such as a memory stick, a TF card, or the like.
  • the sound collection device 14 is configured to collect the second voice information, and the sound collection device 14 may be an element such as a microphone.
  • the imaging device 15 is configured to collect the second facial information, and the imaging device 15 may be a camera or the like.
  • the modules/units integrated by the access device 1 can be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product. Based on such understanding, the present invention implements all or part of the processes in the foregoing embodiments, and may also be completed by a computer program to instruct related hardware.
  • the computer program may be stored in a computer readable storage medium. The steps of the various method embodiments described above may be implemented when the program is executed by the processor.
  • the computer program comprises computer program code, which may be in the form of source code, object code form, executable file or some intermediate form.
  • the computer readable medium may include any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM). , random access memory (RAM, Random Access Memory), electrical carrier signals, telecommunications signals, and software distribution media. It should be noted that the content contained in the computer readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in a jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, computer readable media Does not include electrical carrier signals and telecommunication signals.
  • the memory 12 in the access control device 1 stores a plurality of instructions to implement a method of opening a door
  • the processor 13 can execute the plurality of instructions to: receive a feature of a user sent by the server.
  • Information, the feature information includes first voice information of the user and first facial information of the user; acquiring second voice information; and matching the second voice information with the first voice information; Acquiring the second facial information when the second voice information is successfully matched with the first voice information; matching the second facial information with the first facial information; and when the second facial information is When the first facial information is successfully matched, the door opening operation is performed.
  • the processor 13 further executes a plurality of instructions including:
  • the voice feature in the first voice information and the voice feature in the second voice information include a combination of one or more of the following: tone, pitch, and loudness;
  • the processor 13 further executes a plurality of instructions including:
  • the voice instruction that the user facial information matches fails is output.
  • the processor 13 further executes a plurality of instructions including:
  • the processor 13 further executes a plurality of instructions including:
  • the voice signal corresponding to the updated term input by the user is acquired.
  • the processor 13 further executes a plurality of instructions including:
  • modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional module in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of hardware plus software function modules.

Abstract

A door opening method and device, an access control device, and a computer readable storage medium. The door opening method comprises: receiving characteristic information concerning a user sent by a server, the characteristic information comprising first voice information of the user and first facial information of the user (S10); obtaining second voice information (S11); comparing the second voice information with the first voice information (S12); if the second voice information successfully matches the first voice information, acquiring second facial information (S13); comparing the second facial information with the first facial information (S14); and if the second facial information successfully matches the first facial information, performing a door opening operation (S15). The present invention realizes multiple-level protection, provides safety and reliability, whilst also saving energy, and realizes resource optimization., Furthermore, the present invention facilitates operations, and provides convenience, certain fun and user interaction, improving user experience.

Description

开门方法及装置、门禁装置和计算机可读存储介质Door opening method and device, access device and computer readable storage medium
本申请要求于2017年09月30日提交中国专利局,申请号为201710917206.4、发明名称为“开门方法及装置、门禁装置和计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to Chinese Patent Application No. 201710917206.4, entitled "Opening Method and Device, Access Control Device and Computer-Readable Storage Media", filed on September 30, 2017, the entire contents of which are hereby incorporated by reference. The citations are incorporated herein by reference.
技术领域Technical field
本发明涉及安全防护技术领域,尤其涉及一种开门方法及装置、门禁装置和计算机可读存储介质。The present invention relates to the field of security protection technologies, and in particular, to a method and device for opening a door, an access device, and a computer readable storage medium.
背景技术Background technique
近年来,酒店智能化越来越普及,但是现有的酒店智能开锁系统,一般为常规指纹解锁、密码解锁等。例如:所述酒店设备基于所获取的入住确认信息,分配与所述入住确认信息中的房间信息相对应的第一开锁密码,并将所述房间信息的状态改为入住状态。所述酒店设备将所述房间信息和所述第一开锁密码发送给对应的移动设备,并将所述入住状态和所述第一开锁密码发送给对应所述房间信息的门锁终端。所述门锁终端接收来自移动设备的第二开锁密码,所述门锁终端根据所述入住状态,匹配所述第一开锁密码及所述第二开锁密码,并根据匹配结果确定是否开门。另外,所述酒店设备还可以基于所获取的入住结束信息,将所分配的相应房间的所述第一开锁密码予以注销,并同时将所述房间信息的状态从入住状态转出,并将转出后的状态发送至所述门锁终端,进而,所述门锁终端确定所述第一开锁密码为无效密码。In recent years, hotel intelligence has become more and more popular, but the existing hotel intelligent unlocking system is generally used for conventional fingerprint unlocking and password unlocking. For example, the hotel device allocates a first unlocking password corresponding to the room information in the check-in confirmation information based on the acquired check-in confirmation information, and changes the state of the room information to a check-in state. The hotel device sends the room information and the first unlocking password to a corresponding mobile device, and sends the check-in state and the first unlocking password to a door lock terminal corresponding to the room information. The door lock terminal receives a second unlocking password from the mobile device, and the door lock terminal matches the first unlocking password and the second unlocking password according to the check-in state, and determines whether to open the door according to the matching result. In addition, the hotel equipment may also cancel the first unlock password of the allocated corresponding room based on the acquired check-in information, and simultaneously transfer the status of the room information from the check-in state, and then turn The outgoing status is sent to the door lock terminal, and further, the door lock terminal determines that the first unlock password is an invalid password.
以上常规指纹解锁及密码解锁均存在一定的缺点,当酒店采用常规指纹解锁时,由于指纹信息容易被复制盗用,安全性有待进一步提高。而密码解锁需要客户提供密码,每次开门前用户都需要找到密码才能进行解锁,给用户带来不便。The above conventional fingerprint unlocking and password unlocking have certain shortcomings. When the hotel uses conventional fingerprint unlocking, the fingerprint information is easily copied and stolen, and the security needs to be further improved. The password unlocking requires the customer to provide a password. Before opening the door, the user needs to find the password to unlock it, which brings inconvenience to the user.
发明内容Summary of the invention
鉴于以上内容,有必要提供一种开门方法及装置、门禁装置和计算机可读存储介质,不仅能实现多层防护,更加安全可靠,同时节省了能源,实现了资源优化处理,且方便操作,具有一定的趣味性和客户参与性,增强了客 户体验感。In view of the above, it is necessary to provide a door opening method and device, an access control device and a computer readable storage medium, which can realize multi-layer protection, is more safe and reliable, saves energy, realizes resource optimization processing, and is convenient to operate, A certain level of fun and customer engagement enhances the customer experience.
一种开门方法,应用于门禁装置中,所述门禁装置与服务器相通信,所述方法包括:A door opening method is applied to an access control device, wherein the access control device communicates with a server, the method comprising:
接收所述服务器发送的用户的特征信息,所述特征信息包括所述用户的第一语音信息及所述用户的第一面部信息;Receiving feature information of the user sent by the server, where the feature information includes first voice information of the user and first face information of the user;
获取第二语音信息;Obtaining second voice information;
将所述第二语音信息与所述第一语音信息进行匹配;Matching the second voice information with the first voice information;
当所述第二语音信息与所述第一语音信息匹配成功时,获取第二面部信息;Obtaining second face information when the second voice information is successfully matched with the first voice information;
将所述第二面部信息与所述第一面部信息进行匹配;及Matching the second facial information with the first facial information; and
当所述第二面部信息与所述第一面部信息匹配成功时,执行开门操作。When the second face information is successfully matched with the first face information, the door opening operation is performed.
根据本发明优选实施例,所述将所述第二语音信息与所述第一语音信息进行匹配包括:According to a preferred embodiment of the present invention, the matching the second voice information with the first voice information comprises:
将所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语进行匹配;Matching the opening prompt in the second voice information with a preset opening prompt in the first voice information;
当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语相同时,将所述第二语音信息中的语音特征与所述第一语音信息中的语音特征进行匹配,所述第一语音信息中的语音特征及所述第二语音信息中的语音特征包括以下一种或者多种的组合:音色、音调、响度;When the opening prompt in the second voice information is the same as the preset opening prompt in the first voice information, performing the voice feature in the second voice information and the voice feature in the first voice information Matching, the voice feature in the first voice information and the voice feature in the second voice information include a combination of one or more of the following: tone, pitch, and loudness;
当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差在误差范围内时,确定所述第二语音信息与所述第一语音信息匹配成功;或者Determining that the second voice information is successfully matched with the first voice information when an error of a voice feature in the second voice information and a voice feature in the first voice information is within an error range; or
当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差不在误差范围内时,确定所述第二语音信息与所述第一语音信息匹配失败;或者Determining that the second voice information fails to match the first voice information when the error of the voice feature in the second voice information and the voice feature in the first voice information is not within an error range; or
当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语不相同时,确定所述第二语音信息与所述第一语音信息匹配失败。When the opening prompt in the second voice information is different from the preset opening prompt in the first voice information, determining that the second voice information matches the first voice information fails.
根据本发明优选实施例,所述方法还包括:According to a preferred embodiment of the present invention, the method further includes:
当所述第二语音信息与所述第一语音信息匹配不成功时,输出所述用户语音信息匹配失败的语音指令,并提示所述用户继续输入语音进行匹配;或者When the matching of the second voice information with the first voice information is unsuccessful, outputting the voice command that the user voice information matches the failure, and prompting the user to continue inputting voice for matching; or
当所述第二语音信息与所述第一语音信息匹配成功时,输出所述用户语音信息匹配成功的语音指令,并输出所述用户配合面部识别的语音指令;或者When the second voice information is successfully matched with the first voice information, outputting the voice command that the user voice information matches successfully, and outputting the voice command of the user to cooperate with the face recognition; or
当所述第二面部信息与所述第一面部信息匹配不成功时,输出所述用户面部信息匹配失败的语音指令。When the matching of the second facial information with the first facial information is unsuccessful, the voice instruction that the user facial information matches fails is output.
根据本发明优选实施例,所述方法还包括:According to a preferred embodiment of the present invention, the method further includes:
接收对所述第一语音信息中的预设开门用语进行更改的指令;Receiving an instruction to change a preset opening statement in the first voice information;
获取用户输入的更新后的用语对应的语音信号;Obtaining a voice signal corresponding to the updated term input by the user;
将所述第一语音信息中的预设开门用语的语音信号更改为更新后的用语对应的语音信号。And changing a voice signal of the preset door opening term in the first voice information to a voice signal corresponding to the updated term.
根据本发明优选实施例,在获取用户输入的更新后的用语对应的语音信号之前,所述方法还包括:According to a preferred embodiment of the present invention, before acquiring the voice signal corresponding to the updated term input by the user, the method further includes:
获取所述用户的终端的联系信息;Obtaining contact information of the terminal of the user;
根据所述联系信息,发送验证信息至所述用户的终端;Sending verification information to the terminal of the user according to the contact information;
接收用户输入的验证信息;Receiving verification information input by the user;
将接收的验证信息与发送的验证信息进行匹配;Matching the received verification information with the sent verification information;
当接收的验证信息与发送的验证信息匹配成功时,获取用户输入的更新后的用语对应的语音信号。When the received verification information is successfully matched with the transmitted verification information, the voice signal corresponding to the updated term input by the user is acquired.
根据本发明优选实施例,所述方法还包括:According to a preferred embodiment of the present invention, the method further includes:
检测门的开关状态;Detecting the switch state of the door;
当接收到所述用户输入的预设关门用语对应的询问指令时,根据所述开关状态,输出相应的语音指令。When an inquiry command corresponding to the preset closing term input by the user is received, a corresponding voice command is output according to the switch state.
一种开门装置,运行于门禁装置中,所述门禁装置与服务器相通信,所述装置包括:A door opening device, operating in an access device, the door device communicating with a server, the device comprising:
接收单元,用于接收所述服务器发送的用户的特征信息,所述特征信息包括所述用户的第一语音信息及所述用户的第一面部信息;a receiving unit, configured to receive feature information of a user sent by the server, where the feature information includes first voice information of the user and first face information of the user;
获取单元,用于获取第二语音信息;An acquiring unit, configured to acquire second voice information;
匹配单元,用于将所述第二语音信息与所述第一语音信息进行匹配;a matching unit, configured to match the second voice information with the first voice information;
所述获取单元,还用于当所述第二语音信息与所述第一语音信息匹配成功时,获取第二面部信息;The acquiring unit is further configured to acquire second face information when the second voice information is successfully matched with the first voice information;
所述匹配单元,还用于将所述第二面部信息与所述第一面部信息进行匹配;及The matching unit is further configured to match the second facial information with the first facial information; and
执行单元,用于当所述第二面部信息与所述第一面部信息匹配成功时,执行开门操作。And an execution unit, configured to perform a door opening operation when the second face information is successfully matched with the first face information.
根据本发明优选实施例,所述匹配单元将所述第二语音信息与所述第一语音信息进行匹配包括:According to a preferred embodiment of the present invention, the matching unit matching the second voice information with the first voice information includes:
将所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用 语进行匹配;Matching the opening prompt in the second voice information with a preset opening prompt in the first voice information;
当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语相同时,将所述第二语音信息中的语音特征与所述第一语音信息中的语音特征进行匹配,所述第一语音信息中的语音特征及所述第二语音信息中的语音特征包括以下一种或者多种的组合:音色、音调、响度;When the opening prompt in the second voice information is the same as the preset opening prompt in the first voice information, performing the voice feature in the second voice information and the voice feature in the first voice information Matching, the voice feature in the first voice information and the voice feature in the second voice information include a combination of one or more of the following: tone, pitch, and loudness;
当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差在误差范围内时,确定所述第二语音信息与所述第一语音信息匹配成功;或者Determining that the second voice information is successfully matched with the first voice information when an error of a voice feature in the second voice information and a voice feature in the first voice information is within an error range; or
当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差不在误差范围内时,确定所述第二语音信息与所述第一语音信息匹配失败;或者Determining that the second voice information fails to match the first voice information when the error of the voice feature in the second voice information and the voice feature in the first voice information is not within an error range; or
当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语不相同时,确定所述第二语音信息与所述第一语音信息匹配失败。When the opening prompt in the second voice information is different from the preset opening prompt in the first voice information, determining that the second voice information matches the first voice information fails.
根据本发明优选实施例,所述装置还包括:According to a preferred embodiment of the present invention, the apparatus further includes:
输出单元,用于当所述第二语音信息与所述第一语音信息匹配不成功时,输出所述用户语音信息匹配失败的语音指令,并提示所述用户继续输入语音进行匹配;或者当所述第二语音信息与所述第一语音信息匹配成功时,输出所述用户语音信息匹配成功的语音指令,并输出所述用户配合面部识别的语音指令;或者当所述第二面部信息与所述第一面部信息匹配不成功时,输出所述用户面部信息匹配失败的语音指令。An output unit, configured to: when the second voice information is unsuccessful to match the first voice information, output a voice command that the user voice information fails to match, and prompt the user to continue to input voice for matching; or When the second voice information is successfully matched with the first voice information, outputting the voice command that the user voice information matches successfully, and outputting the voice command of the user to cooperate with the face recognition; or when the second face information and the location When the first facial information matching is unsuccessful, the voice instruction that the user facial information matches fails is output.
根据本发明优选实施例,所述装置还包括:According to a preferred embodiment of the present invention, the apparatus further includes:
所述接收单元,还用于接收对所述第一语音信息中的预设开门用语进行更改的指令;The receiving unit is further configured to receive an instruction to change a preset opening statement in the first voice information;
所述获取单元,还用于获取用户输入的更新后的用语对应的语音信号;The acquiring unit is further configured to acquire a voice signal corresponding to the updated term input by the user;
更改单元,用于将所述第一语音信息中的预设开门用语的语音信号更改为更新后的用语对应的语音信号。And a changing unit, configured to change a voice signal of the preset door opening term in the first voice information to a voice signal corresponding to the updated term.
根据本发明优选实施例,在所述获取单元获取用户输入的更新后的用语对应的语音信号之前,所述装置还包括:According to a preferred embodiment of the present invention, before the acquiring unit acquires the voice signal corresponding to the updated term input by the user, the device further includes:
所述获取单元,还用于获取所述用户的终端的联系信息;The obtaining unit is further configured to acquire contact information of the terminal of the user;
发送单元,用于根据所述联系信息,发送验证信息至所述用户的终端;a sending unit, configured to send, according to the contact information, verification information to a terminal of the user;
所述接收单元,还用于接收用户输入的验证信息;The receiving unit is further configured to receive verification information input by the user;
所述匹配单元,还用于将接收的验证信息与发送的验证信息进行匹配;The matching unit is further configured to match the received verification information with the sent verification information;
所述获取单元,还用于当接收的验证信息与发送的验证信息匹配成功时,获取用户输入的更新后的用语对应的语音信号。The acquiring unit is further configured to: when the received verification information and the sent verification information match successfully, acquire a voice signal corresponding to the updated term input by the user.
根据本发明优选实施例,所述装置还包括:According to a preferred embodiment of the present invention, the apparatus further includes:
检测单元,用于检测门的开关状态;a detecting unit, configured to detect a switch state of the door;
所述输出单元,还用于当接收到所述用户输入的预设关门用语对应的询问指令时,根据所述开关状态,输出相应的语音指令。The output unit is further configured to output a corresponding voice instruction according to the switch state when receiving an inquiry command corresponding to the preset door closing language input by the user.
一种门禁装置,所述门禁装置包括:An access control device includes:
处理器;及Processor; and
存储器,存储在所述存储器中的指令被所述处理器执行以实现所述开门方法。A memory, instructions stored in the memory are executed by the processor to implement the method of opening the door.
一种计算机可读存储介质,所述计算机可读存储介质中存储的指令被门禁装置中的处理器执行以实现所述开门方法。A computer readable storage medium, the instructions stored in the computer readable storage medium being executed by a processor in an access device to implement the door opening method.
由以上技术方案可以看出,本发明接收所述服务器发送的用户的特征信息,所述特征信息包括所述用户的第一语音信息及所述用户的第一面部信息,可见,所述第一语音信息和所述第一面部信息均为所述用户的语音信息和面部信息,用于后续开门验证的基础。在开门的过程中,先获取第二语音信息,该第二语音信息可能来自于所述用户本身,也可能来自于所述用户以外的其他人;将所述第二语音信息与所述第一语音信息进行匹配;当所述第二语音信息与所述第一语音信息匹配成功时,说明所述第二语音信息与所述第一语音信息相同或极其相似,被初步判断与所述用户为同一人,但是为了保证安全,做出以下进一步确认:获取第二面部信息,将所述第二面部信息与所述第一面部信息进行匹配,当所述第二面部信息与所述第一面部信息匹配成功时,执行开门操作,这样根据语音、面部两方面对开门人信息进行验证,以确定开门人是否为有权开门的用户,不仅实现了多层防护、更加安全可靠。而且,因为面部信息的匹配需要以语音信息的匹配为前提,不需要多重验证的同时启动,这样节省了能源,实现了资源优化处理,且方便操作,具有一定的趣味性和客户参与性,增强了客户体验感。It can be seen from the above technical solution that the present invention receives the feature information of the user sent by the server, and the feature information includes the first voice information of the user and the first facial information of the user, which is visible. A voice message and the first face information are voice information and face information of the user, and are used as a basis for subsequent door opening verification. In the process of opening the door, the second voice information may be acquired first, the second voice information may be from the user itself, or may be from other people than the user; and the second voice information is related to the first The voice information is matched; when the second voice information is successfully matched with the first voice information, the second voice information is identical or extremely similar to the first voice information, and is initially determined to be The same person, but in order to ensure security, the following further confirmation is made: acquiring second face information, matching the second face information with the first face information, when the second face information and the first When the face information is successfully matched, the door opening operation is performed, so that the door opener information is verified according to both the voice and the face to determine whether the door opener is a user who has the right to open the door, and not only achieves multi-layer protection, but also is more secure and reliable. Moreover, because the matching of facial information needs to be based on the matching of voice information, it does not need to be activated at the same time, which saves energy, realizes resource optimization processing, and is convenient to operate, has certain interest and customer participation, and enhances A sense of customer experience.
附图说明DRAWINGS
图1是本发明实现开门方法的第一较佳实施例的应用环境图。1 is an application environment diagram of a first preferred embodiment of the method for achieving a door opening according to the present invention.
图2是本发明实现开门方法的第二较佳实施例的应用环境图。2 is a diagram showing an application environment of a second preferred embodiment of the method for achieving a door opening according to the present invention.
图3是本发明开门方法的较佳实施例的流程图。Figure 3 is a flow chart of a preferred embodiment of the method of opening a door of the present invention.
图4是本发明开门装置的较佳实施例的功能模块图。Figure 4 is a functional block diagram of a preferred embodiment of the door opening device of the present invention.
图5本发明实现开门方法的较佳实施例的门禁装置的结构示意图。FIG. 5 is a schematic structural view of an access control device according to a preferred embodiment of the present invention.
具体实施方式Detailed ways
为了使本发明的目的、技术方案和优点更加清楚,下面结合附图和具体实施例对本发明进行详细描述。The present invention will be described in detail below with reference to the drawings and specific embodiments.
如图1所示,图1是本发明实现开门方法的第一较佳实施例的应用环境图。所述应用环境图包括门禁装置1、服务器3及第一采集装置4。所述门禁装置1与所述服务器3相通信,所述服务器3与所述第一采集装置4相通信。As shown in FIG. 1, FIG. 1 is an application environment diagram of a first preferred embodiment of the method for implementing a door opening according to the present invention. The application environment diagram includes an access control device 1, a server 3, and a first collection device 4. The access device 1 is in communication with the server 3, and the server 3 is in communication with the first acquisition device 4.
在本发明的至少一个实施例中,所述开门方法应用于所述门禁装置1中,所述门禁装置1通过执行所述开门方法的相应操作指令以实现对门的开关操作。In at least one embodiment of the invention, the door opening method is applied to the access device 1, the door opening device 1 performing a switching operation of the door by executing a corresponding operational command of the door opening method.
在本发明的至少一个实施例中,所述服务器3通过所述第一采集装置4采集用户的特征信息,并将所述特征信息发送给所述门禁装置1,以供所述门禁装置1将所述特征信息作为后续开门验证的基础。In at least one embodiment of the present invention, the server 3 collects feature information of the user through the first collection device 4, and transmits the feature information to the access control device 1 for the access control device 1 to The feature information serves as the basis for subsequent door opening verification.
在本发明的至少一个实施例中,如图2所示,所述门禁装置1与用户的终端5相通信以便于后续对开门信息(例如开门用语)的修改。另外,所述第一采集装置4可以位于所述终端5中,这样用户可以通过所述终端5连接所述服务器3,便于用户信息的登录及修改等等。所述终端5可以通过所述第一采集装置4对用户的特征信息进行采集,并将所述特征信息发送给所述服务器3,再经由所述服务器3将所述特征信息发送给所述门禁装置1,或者是,所述终端5可以接受所述服务器3的授权,直接将所述特征信息发送给所述门禁装置1,本发明在此不作限制。In at least one embodiment of the invention, as shown in Figure 2, the access control device 1 is in communication with the user's terminal 5 to facilitate subsequent modification of the door opening information (e.g., door opening terms). In addition, the first collection device 4 can be located in the terminal 5, so that the user can connect to the server 3 through the terminal 5, facilitating login and modification of user information and the like. The terminal 5 may collect feature information of the user by using the first collecting device 4, and send the feature information to the server 3, and then send the feature information to the access control via the server 3. The device 1 or the terminal 5 can receive the authorization of the server 3 to directly send the feature information to the access device 1 , which is not limited herein.
如图3所示,是本发明开门方法的较佳实施例的流程图。根据不同的需求,该流程图中步骤的顺序可以改变,某些步骤可以省略。3 is a flow chart of a preferred embodiment of the method of opening a door of the present invention. The order of the steps in the flowchart may be changed according to different requirements, and some steps may be omitted.
所述开门方法应用于一个或者多个门禁装置1中,所述门禁装置1是一种能够按照事先设定或存储的指令,自动进行数值计算和/或信息处理的设备,其硬件包括但不限于微处理器、专用集成电路(Application Specific Integrated Circuit,ASIC)、可编程门阵列(Field-Programmable Gate Array,FPGA)、数字处理器(Digital Signal Processor,DSP)、嵌入式设备等。The door opening method is applied to one or more access control devices 1 which are devices capable of automatically performing numerical calculation and/or information processing according to preset or stored instructions, the hardware including but not It is limited to a microprocessor, an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a digital signal processor (DSP), an embedded device, and the like.
所述门禁装置1可以是任何一种可与用户进行人机交互的电子产品,例如,智能嵌入式设备等。所述门禁装置1所处的网络包括但不限于互联网、广域网、城域网、局域网、虚拟专用网络(Virtual Private Network,VPN)等。The access control device 1 can be any electronic product that can interact with a user, such as an intelligent embedded device or the like. The network in which the access control device 1 is located includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (VPN), and the like.
S10,所述门禁装置1接收所述服务器3发送的用户的特征信息,所述特征信息包括所述用户的第一语音信息及所述用户的第一面部信息。S10, the access control device 1 receives feature information of a user sent by the server 3, and the feature information includes first voice information of the user and first face information of the user.
在本发明的至少一个实施例中,所述第一语音信息包括,但不限于以下一种或者多种的组合:In at least one embodiment of the present invention, the first voice information includes, but is not limited to, one or a combination of the following:
所述第一语音信息中的预设开门用语、所述第一语音信息中的语音特征。所述语音特征包括以下一种或者多种的组合:所述用户的音色、所述用户的音调、所述用户的响度等。a preset opening statement in the first voice information, and a voice feature in the first voice information. The speech feature includes one or more of the following: a timbre of the user, a pitch of the user, a loudness of the user, and the like.
在本发明的至少一个实施例中,所述预设开门用语可以是“请开门”、“芝麻开门”等等,本发明不作限制。In at least one embodiment of the present invention, the preset door opening term may be “please open the door”, “open the door with sesame”, etc., and the invention is not limited thereto.
在本发明的至少一个实施例中,所述特征信息还可以包括所述用户的终端5的联系信息,例如:所述用户的手机号等。In at least one embodiment of the present invention, the feature information may further include contact information of the terminal 5 of the user, for example, the mobile phone number of the user, and the like.
在本发明的至少一个实施例中,所述门禁装置1还可以对所述第一语音信息中的预设开门用语进行更改,具体的一种实现方式为:In at least one embodiment of the present invention, the access control device 1 may further modify a preset opening statement in the first voice information, and a specific implementation manner is:
所述门禁装置1接收对所述第一语音信息中的预设开门用语进行更改的指令,并获取用户输入的更新后的用语对应的语音信号。所述门禁装置1将所述第一语音信息中的预设开门用语的语音信号更改为更新后的用语对应的语音信号。The access control device 1 receives an instruction to change a preset opening statement in the first voice information, and acquires a voice signal corresponding to the updated term input by the user. The access control device 1 changes a voice signal of a preset door opening term in the first voice information to a voice signal corresponding to the updated term.
优选地,所述门禁装置1接收对所述第一语音信息中的预设开门用语进行更改的指令的方式可以包括:Preferably, the manner in which the access control device 1 receives an instruction to change a preset opening statement in the first voice information may include:
(1)所述门禁装置1获取到所述用户触摸预设实体按键或预设虚拟控件的指令。(1) The access control device 1 acquires an instruction that the user touches a preset physical button or a preset virtual control.
(2)所述门禁装置1接收到更改所述第一语音信息中的预设开门用语的语音指令。(2) The access control device 1 receives a voice command for changing a preset door opening term in the first voice information.
这样,用户在使用过程中,可以根据喜好进行预设开门用语的设置,增强了趣味性,且更加安全,带来更好的使用体验。In this way, during the use process, the user can set the preset opening language according to the preference, which enhances the fun, and is more secure and brings a better use experience.
在本发明的至少一个实施例中,在所述门禁装置1获取用户输入的更新后的用语对应的语音信号之前,所述方法还包括:In at least one embodiment of the present invention, before the access control device 1 acquires a voice signal corresponding to the updated term input by the user, the method further includes:
所述门禁装置1获取所述用户的终端5的联系信息,根据所述联系信息,发送验证信息至所述用户的终端5。所述门禁装置1接收用户输入的验证信息,并将接收的验证信息与发送的验证信息进行匹配。当接收的验证信息与发送的验证信息匹配成功时,获取用户输入的更新后的用语对应的语音信号。The access control device 1 acquires contact information of the terminal 5 of the user, and transmits verification information to the terminal 5 of the user according to the contact information. The access control device 1 receives the verification information input by the user, and matches the received verification information with the transmitted verification information. When the received verification information is successfully matched with the transmitted verification information, the voice signal corresponding to the updated term input by the user is acquired.
例如:所述门禁装置1获取所述用户的手机号码,并向所述手机号码的终端5发送一个验证码,以供所述用户输入所述发送的验证码到所述门禁装置1进行验证。所述门禁装置1接收所述用户输入的验证码,并将所述用户输入的验证码与发送的验证码进行匹配。如果所述用户输入的验证码与所述发送的验证码匹配成功,则所述门禁装置1获取用户输入的更新后的用语对应的语音信号。For example, the access control device 1 acquires the mobile phone number of the user, and sends a verification code to the terminal 5 of the mobile phone number for the user to input the transmitted verification code to the access control device 1 for verification. The access control device 1 receives the verification code input by the user, and matches the verification code input by the user with the transmitted verification code. If the verification code input by the user is successfully matched with the transmitted verification code, the access control device 1 acquires a voice signal corresponding to the updated term input by the user.
S11,所述门禁装置1获取第二语音信息。S11. The access control device 1 acquires second voice information.
在本发明的至少一个实施例中,所述第二语音信息包括,但不限于以下一种或者多种的组合:In at least one embodiment of the present invention, the second voice information includes, but is not limited to, one or a combination of the following:
所述第二语音信息中的开门用语、所述第二语音信息中的语音特征。所述语音特征包括以下一种或者多种的组合:所述第二语音信息对应的用户的音色、所述第二语音信息对应的用户的音调、所述第二语音信息对应的用户的响度等。The opening prompt in the second voice information and the voice feature in the second voice information. The voice feature includes a combination of one or more of the following: a tone color of the user corresponding to the second voice information, a tone of the user corresponding to the second voice information, a loudness of the user corresponding to the second voice information, and the like. .
在本发明的至少一个实施例中,所述门禁装置1可以通过与所述门禁装置1相通信的声音采集装置14获取所述第二语音信息,所述声音采集装置14还可以安装于所述门禁装置1中,当然,在其他实施例中,也可以采取其他方式。In at least one embodiment of the present invention, the access control device 1 can acquire the second voice information through a sound collection device 14 in communication with the access control device 1, and the sound collection device 14 can also be installed in the In the access device 1, of course, in other embodiments, other methods may be employed.
S12,所述门禁装置1将所述第二语音信息与所述第一语音信息进行匹配。S12. The access control device 1 matches the second voice information with the first voice information.
在本发明的至少一个实施例中,所述门禁装置1将所述第二语音信息与所述第一语音信息进行匹配的步骤包括:将所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语进行匹配。In at least one embodiment of the present invention, the step of the access control device 1 matching the second voice information with the first voice information includes: opening an opening term in the second voice information and the The default opening words in a voice message are matched.
优选地,当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语相同时,将所述第二语音信息中的语音特征与所述第一语音信息中的语音特征进行匹配。Preferably, when the opening prompt in the second voice information is the same as the preset opening prompt in the first voice information, the voice feature in the second voice information and the first voice information are The voice features are matched.
在本发明的至少一个实施例中,所述第一语音信息中的语音特征及所述第二语音信息中的语音特征包括,但不限于以下一种或者多种的组合:音色、音调、响度等。In at least one embodiment of the present invention, the voice features in the first voice information and the voice features in the second voice information include, but are not limited to, a combination of one or more of the following: tone, pitch, loudness Wait.
具体地,当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差在误差范围内时,所述门禁装置1确定所述第二语音信息与所述第一语音信息匹配成功。Specifically, when the error of the voice feature in the second voice information and the voice feature in the first voice information is within an error range, the access control device 1 determines the second voice information and the first The voice information is matched successfully.
或者是,当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差不在误差范围内时,所述门禁装置1确定所述第二语音信息与所述第一语音信息匹配失败。Or, when the error of the voice feature in the second voice information and the voice feature in the first voice information is not within an error range, the access control device 1 determines the second voice information and the first Voice message matching failed.
或者是,当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语不相同时,所述门禁装置1确定所述第二语音信息与所述第一语音信息匹配失败。Alternatively, when the opening prompt in the second voice information is different from the preset opening prompt in the first voice information, the access control device 1 determines the second voice information and the first voice information. The match failed.
在本发明的至少一个实施例中,所述误差范围可以由所述门禁装置1根据语音识别领域中相关技术所涉及的公知的经验值进行设置,本发明在此不作限制。In at least one embodiment of the present invention, the error range may be set by the access control device 1 according to well-known empirical values involved in the related art in the field of speech recognition, and the present invention is not limited thereto.
在本发明的至少一个实施例中,所述方法还包括:In at least one embodiment of the invention, the method further includes:
当所述第二语音信息与所述第一语音信息匹配不成功时,所述门禁装置1输出所述用户语音信息匹配失败的语音指令,并提示所述用户继续输入语音进行匹配。When the matching of the second voice information with the first voice information is unsuccessful, the access control device 1 outputs a voice command that the user voice information fails to match, and prompts the user to continue inputting voice for matching.
例如:当所述第二语音信息与所述第一语音信息匹配不成功时,所述门禁装置1输出提示语音:“您的开门指令有误,请重新输入开门指令,谢谢您的配合”。For example, when the second voice information is unsuccessful to match the first voice information, the access control device 1 outputs a prompt voice: "Your door opening instruction is incorrect, please re-enter the door opening command, thank you for your cooperation."
或者是,当所述第二语音信息与所述第一语音信息匹配成功时,所述门禁装置1输出所述用户语音信息匹配成功的语音指令,并输出所述用户配合面部识别的语音指令。Alternatively, when the second voice information is successfully matched with the first voice information, the access control device 1 outputs a voice command that the user voice information matches successfully, and outputs the voice command of the user to cooperate with the face recognition.
例如:当所述第二语音信息与所述第一语音信息匹配成功时,所述门禁装置1输出提示语音:“您的开门指令正确,请您对准摄像头进行面部图像的采集,谢谢您的配合”。For example, when the second voice information is successfully matched with the first voice information, the access control device 1 outputs a prompt voice: "Your door opening instruction is correct, please aim at the camera for facial image collection, thank you. Cooperate."
S13,当所述第二语音信息与所述第一语音信息匹配成功时,所述门禁装置1获取第二面部信息。S13. When the second voice information is successfully matched with the first voice information, the access control device 1 acquires second face information.
在本发明的至少一个实施例中,在所述第二语音信息与所述第一语音信息匹配之前,不启动面部识别过程。这样,既节省了资源,又提高了效率,同时还提供了双重保护,更加安全可靠。In at least one embodiment of the invention, the facial recognition process is not initiated until the second speech information matches the first speech information. In this way, it not only saves resources, but also improves efficiency, while also providing double protection, which is more secure and reliable.
在本发明的至少一个实施例中,所述门禁装置1可以通过与所述门禁装置1相通信的摄像装置获取所述第二面部信息,所述摄像装置15还可以安装在所述门禁装置1中,当然,在其他实施例中,也可以采取其他方式。In at least one embodiment of the present invention, the access control device 1 can acquire the second facial information through an imaging device in communication with the access control device 1, and the imaging device 15 can also be installed in the access control device 1 Of course, in other embodiments, other methods may also be employed.
在本发明的至少一个实施例中,所述方法还包括:In at least one embodiment of the invention, the method further includes:
当所述第二面部信息与所述第一面部信息匹配不成功时,所述门禁装置1输出所述用户面部信息匹配失败的语音指令。When the second face information is unsuccessfully matched with the first face information, the access control device 1 outputs a voice command that the user face information fails to match.
例如:当所述第二面部信息与所述第一面部信息匹配不成功时,所述门禁装置1输出提示语音:“您的面部识别失败”。For example, when the second face information is unsuccessfully matched with the first face information, the access control device 1 outputs a prompt voice: "Your face recognition failed."
优选地,在所述门禁装置1输出所述用户面部信息匹配失败的语音指令后,所述门禁装置1可以提示用户继续进行面部图像的采集以继续进行面部识别,或者是,所述门禁装置1可以不执行任何操作,此处可以根据具体使用环境进行设置。Preferably, after the access control device 1 outputs the voice instruction that the user face information fails to match, the access control device 1 may prompt the user to continue collecting the facial image to continue facial recognition, or the access control device 1 You can do nothing, here you can set it according to the specific use environment.
S14,所述门禁装置1将所述第二面部信息与所述第一面部信息进行匹配。S14. The access control device 1 matches the second facial information with the first facial information.
在本发明的至少一个实施例中,所述门禁装置1将所述第二面部信息与所述第一面部信息进行匹配的方式可以有很多种,鉴于面部识别技术是现有技术,本发明在此不再赘述。In at least one embodiment of the present invention, the access control device 1 can match the second facial information with the first facial information in many ways. In view of the fact that the facial recognition technology is prior art, the present invention I will not repeat them here.
S15,当所述第二面部信息与所述第一面部信息匹配成功时,所述门禁装置1执行开门操作。S15. When the second facial information is successfully matched with the first facial information, the access control device 1 performs a door opening operation.
在本发明的至少一个实施例中,所述方法还包括:In at least one embodiment of the invention, the method further includes:
所述门禁装置1检测门的开关状态。当所述门禁装置1接收到所述用户输入的预设关门用语对应的询问指令时,根据所述开关状态,输出相应的语音指令。The access device 1 detects the switching state of the door. When the access control device 1 receives the inquiry command corresponding to the preset door closing language input by the user, the corresponding voice command is output according to the switch state.
例如:所述门禁装置1对门的开关状态进行实时监测。当所述门禁装置1接收到所述用户输入的预设关门用语对应的询问指令“门关好了没?”时,所述门禁装置1根据检测到的门的开关状态,输出相应的语音指令。具体地,当门已经关好时,输出语音指令“门已关好,谢谢”;当门未关好时,输出语音指令“门没关好,请重新关门,谢谢”。For example, the access control device 1 monitors the on/off state of the door in real time. When the access control device 1 receives the inquiry command “Does the door closed?” corresponding to the preset closing word input by the user, the access control device 1 outputs a corresponding voice command according to the detected switch state of the door. . Specifically, when the door has been closed, the voice command "gate is closed, thank you"; when the door is not closed, the voice command is output "The door is not closed, please close the door again, thank you."
综上所述,本发明能接收所述服务器发送的用户的特征信息,所述特征信息包括所述用户的第一语音信息及所述用户的第一面部信息;获取第二语音信息;将所述第二语音信息与所述第一语音信息进行匹配;当所述第二语音信息与所述第一语音信息匹配成功时,获取第二面部信息;将所述第二面部信息与所述第一面部信息进行匹配;及当所述第二面部信息与所述第一面部信息匹配成功时,执行开门操作。因此,本发明不仅能实现了多层防护,更加安全可靠,同时节省了能源,实现了资源优化处理,且方便操作,具有一定的趣味性和客户参与性,增强了客户体验感。In summary, the present invention can receive the feature information of the user sent by the server, the feature information includes the first voice information of the user and the first face information of the user; and acquire the second voice information; The second voice information is matched with the first voice information; when the second voice information is successfully matched with the first voice information, acquiring second face information; and the second face information is The first face information is matched; and when the second face information is successfully matched with the first face information, the door opening operation is performed. Therefore, the invention not only realizes multi-layer protection, is more safe and reliable, saves energy, realizes resource optimization processing, and is convenient to operate, has certain interest and customer participation, and enhances customer experience.
如图4所示,本发明开门装置的较佳实施例的功能模块图。所述开门装置11包括接收单元100、获取单元101、匹配单元102、执行单元103、输出单元104、更改单元105、发送单元106及检测单元107。本发明所称的单元是指一种能够被处理器13所执行并且能够完成固定功能的一系列计算机程序段,其存储在存储器12中。在本实施例中,关于各单元的功能将在后续的实施例中详述。4 is a functional block diagram of a preferred embodiment of the door opening device of the present invention. The door opening device 11 includes a receiving unit 100, an obtaining unit 101, a matching unit 102, an executing unit 103, an output unit 104, a changing unit 105, a transmitting unit 106, and a detecting unit 107. The unit referred to in the present invention refers to a series of computer program segments that can be executed by the processor 13 and capable of performing fixed functions, which are stored in the memory 12. In the present embodiment, the functions of the respective units will be described in detail in the subsequent embodiments.
接收单元100接收所述服务器3发送的用户的特征信息,所述特征信息包括所述用户的第一语音信息及所述用户的第一面部信息。The receiving unit 100 receives the feature information of the user sent by the server 3, and the feature information includes the first voice information of the user and the first face information of the user.
在本发明的至少一个实施例中,所述第一语音信息包括,但不限于以下一种或者多种的组合:In at least one embodiment of the present invention, the first voice information includes, but is not limited to, one or a combination of the following:
所述第一语音信息中的预设开门用语、所述第一语音信息中的语音特征。所述第一语音信息中的语音特征包括以下一种或者多种的组合:所述用户的音色、所述用户的音调、所述用户的响度等。a preset opening statement in the first voice information, and a voice feature in the first voice information. The voice features in the first voice information include a combination of one or more of the following: a tone of the user, a tone of the user, a loudness of the user, and the like.
在本发明的至少一个实施例中,所述预设开门用语可以是“请开门”、 “芝麻开门”等等,本发明不作限制。In at least one embodiment of the present invention, the preset door opening term may be “Please open the door”, “Open the door with sesame”, etc., and the invention is not limited thereto.
在本发明的至少一个实施例中,所述特征信息还可以包括所述用户的终端5的联系信息,例如:所述用户的手机号等。In at least one embodiment of the present invention, the feature information may further include contact information of the terminal 5 of the user, for example, the mobile phone number of the user, and the like.
在本发明的至少一个实施例中,更改单元105还可以对所述第一语音信息中的预设开门用语进行更改,具体的一种实现方式为:In at least one embodiment of the present invention, the modifying unit 105 may further modify the preset opening term in the first voice information, and a specific implementation manner is:
所述接收单元100接收对所述第一语音信息中的预设开门用语进行更改的指令,获取单元101获取用户输入的更新后的用语对应的语音信号。所述更改单元105将所述第一语音信息中的预设开门用语的语音信号更改为更新后的用语对应的语音信号。The receiving unit 100 receives an instruction to change a preset opening statement in the first voice information, and the acquiring unit 101 acquires a voice signal corresponding to the updated term input by the user. The changing unit 105 changes the voice signal of the preset door opening term in the first voice information to the voice signal corresponding to the updated term.
优选地,所述接收单元100接收对所述第一语音信息中的预设开门用语进行更改的指令的方式可以包括:Preferably, the manner in which the receiving unit 100 receives an instruction to change a preset opening statement in the first voice information may include:
(1)所述接收单元100获取到所述用户触摸预设实体按键或预设虚拟控件的指令。(1) The receiving unit 100 acquires an instruction that the user touches a preset physical button or a preset virtual control.
(2)所述接收单元100接收到更改所述第一语音信息中的预设开门用语的语音指令。(2) The receiving unit 100 receives a voice instruction for changing a preset opening door in the first voice information.
这样,用户在使用过程中,可以根据喜好进行预设开门用语的设置,增强了趣味性,且更加安全,带来更好的使用体验。In this way, during the use process, the user can set the preset opening language according to the preference, which enhances the fun, and is more secure and brings a better use experience.
在本发明的至少一个实施例中,在所述获取单元101获取用户输入的更新后的用语对应的语音信号之前,所述方法还包括:In at least one embodiment of the present invention, before the obtaining unit 101 acquires a voice signal corresponding to the updated term input by the user, the method further includes:
所述获取单元101获取所述用户的终端5的联系信息,根据所述联系信息,发送单元106发送验证信息至所述用户的终端5。所述接收单元100接收用户输入的验证信息,匹配单元102将接收的验证信息与发送的验证信息进行匹配。当接收的验证信息与发送的验证信息匹配成功时,所述获取单元101获取用户输入的更新后的用语对应的语音信号。The obtaining unit 101 acquires contact information of the terminal 5 of the user, and according to the contact information, the sending unit 106 sends the verification information to the terminal 5 of the user. The receiving unit 100 receives the verification information input by the user, and the matching unit 102 matches the received verification information with the transmitted verification information. When the received verification information is successfully matched with the transmitted verification information, the obtaining unit 101 acquires a voice signal corresponding to the updated term input by the user.
例如:所述获取单元101获取所述用户的手机号码,所述发送单元106向所述手机号码的终端5发送一个验证码,以供所述用户输入所述发送的验证码到所述门禁装置1进行验证。所述接收单元100接收所述用户输入的验证码,所述匹配单元102将所述用户输入的验证码与发送的验证码进行匹配。如果所述用户输入的验证码与所述发送的验证码匹配成功,则所述获取单元101获取用户输入的更新后的用语对应的语音信号。For example, the obtaining unit 101 acquires the mobile phone number of the user, and the sending unit 106 sends a verification code to the terminal 5 of the mobile phone number, for the user to input the sent verification code to the access control device. 1 to verify. The receiving unit 100 receives the verification code input by the user, and the matching unit 102 matches the verification code input by the user with the transmitted verification code. If the verification code input by the user is successfully matched with the transmitted verification code, the obtaining unit 101 acquires a voice signal corresponding to the updated term input by the user.
所述获取单元101获取第二语音信息。The acquiring unit 101 acquires second voice information.
在本发明的至少一个实施例中,所述第二语音信息包括,但不限于以下一种或者多种的组合:In at least one embodiment of the present invention, the second voice information includes, but is not limited to, one or a combination of the following:
所述第二语音信息中的开门用语、所述第二语音信息中的语音特征。所 述第二语音信息中的语音特征包括以下一种或者多种的组合:所述第二语音信息对应的用户的音色、所述第二语音信息对应的用户的音调、所述第二语音信息对应的用户的响度等。The opening prompt in the second voice information and the voice feature in the second voice information. The voice feature in the second voice information includes a combination of one or more of the following: a tone color of the user corresponding to the second voice information, a tone of the user corresponding to the second voice information, and the second voice information. Corresponding user's loudness, etc.
在本发明的至少一个实施例中,所述获取单元101可以通过与所述门禁装置1相通信的声音采集装置14获取所述第二语音信息,所述声音采集装置14还可以安装于所述门禁装置1中,当然,在其他实施例中,也可以采取其他方式。In at least one embodiment of the present invention, the acquisition unit 101 may acquire the second voice information through a sound collection device 14 in communication with the access control device 1, and the sound collection device 14 may also be installed in the In the access device 1, of course, in other embodiments, other methods may be employed.
所述匹配单元102将所述第二语音信息与所述第一语音信息进行匹配。The matching unit 102 matches the second voice information with the first voice information.
在本发明的至少一个实施例中,所述匹配单元102将所述第二语音信息与所述第一语音信息进行匹配的步骤包括:所述匹配单元102将所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语进行匹配。In at least one embodiment of the present invention, the matching unit 102 matches the second voice information with the first voice information, and the matching unit 102 opens the second voice information. The term is matched with a preset opening statement in the first voice message.
优选地,当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语相同时,所述匹配单元102将所述第二语音信息中的语音特征与所述第一语音信息中的语音特征进行匹配。Preferably, when the opening prompt in the second voice information is the same as the preset opening prompt in the first voice information, the matching unit 102 compares the voice feature in the second voice information with the first The speech features in a speech message are matched.
在本发明的至少一个实施例中,所述第一语音信息中的语音特征及所述第二语音信息中的语音特征包括,但不限于以下一种或者多种的组合:音色、音调、响度等。In at least one embodiment of the present invention, the voice features in the first voice information and the voice features in the second voice information include, but are not limited to, a combination of one or more of the following: tone, pitch, loudness Wait.
具体地,当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差在误差范围内时,所述匹配单元102确定所述第二语音信息与所述第一语音信息匹配成功。Specifically, when the error of the voice feature in the second voice information and the voice feature in the first voice information is within an error range, the matching unit 102 determines the second voice information and the first The voice information is matched successfully.
或者是,当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差不在误差范围内时,所述匹配单元102确定所述第二语音信息与所述第一语音信息匹配失败。Or, when the error between the voice feature in the second voice information and the voice feature in the first voice information is not within an error range, the matching unit 102 determines the second voice information and the first Voice message matching failed.
或者是,当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语不相同时,所述匹配单元102确定所述第二语音信息与所述第一语音信息匹配失败。Alternatively, when the opening prompt in the second voice information is different from the preset opening prompt in the first voice information, the matching unit 102 determines the second voice information and the first voice information. The match failed.
在本发明的至少一个实施例中,所述误差范围可以由所述门禁装置1根据语音识别领域中相关技术所涉及的公知的经验值进行设置,本发明在此不作限制。In at least one embodiment of the present invention, the error range may be set by the access control device 1 according to well-known empirical values involved in the related art in the field of speech recognition, and the present invention is not limited thereto.
在本发明的至少一个实施例中,所述方法还包括:In at least one embodiment of the invention, the method further includes:
当所述第二语音信息与所述第一语音信息匹配不成功时,输出单元104输出所述用户语音信息匹配失败的语音指令,并提示所述用户继续输入语音进行匹配。When the matching of the second voice information with the first voice information is unsuccessful, the output unit 104 outputs a voice command that the user voice information fails to match, and prompts the user to continue inputting voice for matching.
例如:当所述第二语音信息与所述第一语音信息匹配不成功时,所述输 出单元104输出提示语音:“您的开门指令有误,请重新输入开门指令,谢谢您的配合”。For example, when the matching of the second voice information with the first voice information is unsuccessful, the output unit 104 outputs a prompt voice: "Your door opening instruction is incorrect, please re-enter the door opening command, thank you for your cooperation."
或者是,当所述第二语音信息与所述第一语音信息匹配成功时,所述输出单元104输出所述用户语音信息匹配成功的语音指令,并输出所述用户配合面部识别的语音指令。Alternatively, when the second voice information is successfully matched with the first voice information, the output unit 104 outputs a voice command that the user voice information matches successfully, and outputs the voice command of the user to cooperate with the face recognition.
例如:当所述第二语音信息与所述第一语音信息匹配成功时,所述输出单元104输出提示语音:“您的开门指令正确,请您对准摄像头进行面部图像的采集,谢谢您的配合”。For example, when the second voice information is successfully matched with the first voice information, the output unit 104 outputs a prompt voice: "Your door opening instruction is correct, please aim at the camera for facial image collection, thank you. Cooperate."
当所述第二语音信息与所述第一语音信息匹配成功时,所述获取单元101获取第二面部信息。When the second voice information is successfully matched with the first voice information, the acquiring unit 101 acquires second face information.
在本发明的至少一个实施例中,在所述第二语音信息与所述第一语音信息匹配之前,不启动面部识别过程。这样,既节省了资源,又提高了效率,同时还提供了双重保护,更加安全可靠。In at least one embodiment of the invention, the facial recognition process is not initiated until the second speech information matches the first speech information. In this way, it not only saves resources, but also improves efficiency, while also providing double protection, which is more secure and reliable.
在本发明的至少一个实施例中,所述获取单元101可以通过与所述门禁装置1相通信的摄像装置15获取所述第二面部信息,所述摄像装置15还可以安装在所述门禁装置1中。当然,在其他实施例中,也可以采取其他方式。In at least one embodiment of the present invention, the acquisition unit 101 may acquire the second facial information through an imaging device 15 in communication with the access control device 1, and the imaging device 15 may also be installed in the access control device. 1 in. Of course, in other embodiments, other methods may also be employed.
在本发明的至少一个实施例中,所述方法还包括:In at least one embodiment of the invention, the method further includes:
当所述第二面部信息与所述第一面部信息匹配不成功时,所述输出单元104输出所述用户面部信息匹配失败的语音指令。When the matching of the second face information with the first face information is unsuccessful, the output unit 104 outputs a voice instruction that the user face information fails to match.
例如:当所述第二面部信息与所述第一面部信息匹配不成功时,所述输出单元104输出提示语音:“您的面部识别失败”。For example, when the second face information is not successfully matched with the first face information, the output unit 104 outputs a prompt voice: "Your face recognition failed."
优选地,在所输出单元104输出所述用户面部信息匹配失败的语音指令后,所述输出单元104可以提示用户继续进行面部图像的采集以继续进行面部识别,或者是,所述输出单元104可以不执行任何操作,此处可以根据具体使用环境进行设置。Preferably, after the output unit 104 outputs the voice instruction that the user face information fails to match, the output unit 104 may prompt the user to continue the collection of the facial image to continue facial recognition, or the output unit 104 may No action is taken, which can be set here depending on the specific usage environment.
所述匹配单元102将所述第二面部信息与所述第一面部信息进行匹配。The matching unit 102 matches the second face information with the first face information.
在本发明的至少一个实施例中,所述匹配单元102将所述第二面部信息与所述第一面部信息进行匹配的方式可以有很多种,鉴于面部识别技术是现有技术,本发明在此不再赘述。In at least one embodiment of the present invention, the matching unit 102 can match the second facial information with the first facial information in many ways. In view of the fact that the facial recognition technology is prior art, the present invention I will not repeat them here.
当所述第二面部信息与所述第一面部信息匹配成功时,执行单元103执行开门操作。When the second face information is successfully matched with the first face information, the execution unit 103 performs a door opening operation.
在本发明的至少一个实施例中,所述方法还包括:In at least one embodiment of the invention, the method further includes:
检测单元107检测门的开关状态。当所述接收单元100接收到所述用户输入的预设关门用语对应的询问指令时,所述输出单元104根据所述开关状 态,输出相应的语音指令。The detecting unit 107 detects the switching state of the door. When the receiving unit 100 receives an inquiry command corresponding to the preset closing term input by the user, the output unit 104 outputs a corresponding voice command according to the switch state.
例如:所述检测单元107对门的开关状态进行实时监测。当所述接收单元100接收到所述用户输入的预设关门用语对应的询问指令“门关好了没?”时,所述输出单元104根据检测到的门的开关状态,输出相应的语音指令。具体地,当门已经关好时,所述输出单元104输出语音指令“门已关好,谢谢”;当门未关好时,所述输出单元104输出语音指令“门没关好,请重新关门,谢谢”。For example, the detecting unit 107 performs real-time monitoring on the switching state of the door. When the receiving unit 100 receives the inquiry command “Does the door closed?” corresponding to the preset closing word input by the user, the output unit 104 outputs a corresponding voice command according to the detected switching state of the door. . Specifically, when the door has been closed, the output unit 104 outputs a voice command "The door is closed, thank you"; when the door is not closed, the output unit 104 outputs a voice command "The door is not closed, please re- Close, thank you."
综上所述,本发明能接收所述服务器发送的用户的特征信息,所述特征信息包括所述用户的第一语音信息及所述用户的第一面部信息;获取第二语音信息;将所述第二语音信息与所述第一语音信息进行匹配;当所述第二语音信息与所述第一语音信息匹配成功时,获取第二面部信息;将所述第二面部信息与所述第一面部信息进行匹配;及当所述第二面部信息与所述第一面部信息匹配成功时,执行开门操作。因此,本发明不仅能实现了多层防护,更加安全可靠,同时节省了能源,实现了资源优化处理,且方便操作,具有一定的趣味性和客户参与性,增强了客户体验感。In summary, the present invention can receive the feature information of the user sent by the server, the feature information includes the first voice information of the user and the first face information of the user; and acquire the second voice information; The second voice information is matched with the first voice information; when the second voice information is successfully matched with the first voice information, acquiring second face information; and the second face information is The first face information is matched; and when the second face information is successfully matched with the first face information, the door opening operation is performed. Therefore, the invention not only realizes multi-layer protection, is more safe and reliable, saves energy, realizes resource optimization processing, and is convenient to operate, has certain interest and customer participation, and enhances customer experience.
如图5所示,是本发明实现开门方法的较佳实施例的门禁装置的结构示意图。FIG. 5 is a schematic structural view of an access control device according to a preferred embodiment of the present invention.
所述门禁装置1是一种能够按照事先设定或存储的指令,自动进行数值计算和/或信息处理的设备,其硬件包括但不限于微处理器、专用集成电路(Application Specific Integrated Circuit,ASIC)、可编程门阵列(Field-Programmable Gate Array,FPGA)、数字处理器(Digital Signal Processor,DSP)、嵌入式设备等。The access control device 1 is a device capable of automatically performing numerical calculation and/or information processing according to an instruction set or stored in advance, and the hardware includes, but not limited to, a microprocessor, an application specific integrated circuit (ASIC). ), Field-Programmable Gate Array (FPGA), Digital Signal Processor (DSP), embedded devices, etc.
所述门禁装置1还可以是但不限于任何一种可与用户通过键盘、鼠标、遥控器、触摸板或声控设备等方式进行人机交互的电子产品,例如,智能嵌入式设备等。The access control device 1 can also be, but is not limited to, any electronic product that can interact with a user through a keyboard, a mouse, a remote controller, a touch panel, or a voice control device, such as an intelligent embedded device.
所述门禁装置1所处的网络包括但不限于互联网、广域网、城域网、局域网、虚拟专用网络(Virtual Private Network,VPN)等。The network in which the access control device 1 is located includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (VPN), and the like.
在本发明的一个实施例中,所述门禁装置1包括,但不限于,存储器12、处理器13,以及存储在所述存储器12中并可在所述处理器13上运行的计算机程序,例如开门程序。本领域技术人员可以理解,所述示意图仅仅是门禁装置1的示例,并不构成对门禁装置1的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件,例如所述门禁装置1还可以包括输入输出设备、网络接入设备、总线等。In one embodiment of the invention, the access device 1 includes, but is not limited to, a memory 12, a processor 13, and a computer program stored in the memory 12 and operable on the processor 13, such as Open the door. It will be understood by those skilled in the art that the schematic diagram is merely an example of the access control device 1 and does not constitute a limitation of the access control device 1, and may include more or less components than those illustrated, or some components may be combined, or different. Components such as the access device 1 may also include input and output devices, network access devices, buses, and the like.
所称处理器13可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等,所述处理器13是所述门禁装置1的运算核心和控制中心,利用各种接口和线路连接整个门禁装置1的各个部分,及执行所述门禁装置1的操作系统以及安装的各类应用程序、程序代码等。The processor 13 may be a central processing unit (CPU), or may be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like, and the processor 13 is an operation core and a control center of the access control device 1, and connects the entire access control device by using various interfaces and lines. Each part of 1 and an operating system of the access control device 1 and various installed applications, program codes, and the like.
所述处理器13执行所述门禁装置1的操作系统以及安装的各类应用程序。所述处理器13执行所述应用程序以实现上述各个开门方法实施例中的步骤,例如图2所示的步骤S10、S11、S12、S13、S14及S15。The processor 13 executes an operating system of the access control device 1 and various types of installed applications. The processor 13 executes the application to implement the steps in the various door opening method embodiments described above, such as steps S10, S11, S12, S13, S14, and S15 shown in FIG.
或者,所述处理器13执行所述计算机程序时实现上述各装置实施例中各模块/单元的功能,例如:接收所述服务器发送的用户的特征信息,所述特征信息包括所述用户的第一语音信息及所述用户的第一面部信息;获取第二语音信息;将所述第二语音信息与所述第一语音信息进行匹配;当所述第二语音信息与所述第一语音信息匹配成功时,获取第二面部信息;将所述第二面部信息与所述第一面部信息进行匹配;及当所述第二面部信息与所述第一面部信息匹配成功时,执行开门操作。Alternatively, the processor 13 implements the functions of each module/unit in each device embodiment when executing the computer program, for example, receiving feature information of a user sent by the server, where the feature information includes the user's a voice information and the first facial information of the user; acquiring second voice information; matching the second voice information with the first voice information; and when the second voice information and the first voice Acquiring second face information when the information matching is successful; matching the second face information with the first face information; and performing when the second face information is successfully matched with the first face information Open the door.
示例性的,所述计算机程序可以被分割成一个或多个模块/单元,所述一个或者多个模块/单元被存储在所述存储器12中,并由所述处理器13执行,以完成本发明。所述一个或多个模块/单元可以是能够完成特定功能的一系列计算机程序指令段,该指令段用于描述所述计算机程序在所述门禁装置1中的执行过程。例如,所述计算机程序可以被分割成接收单元100、获取单元101、匹配单元102、执行单元103、输出单元104、更改单元105、发送单元106及检测单元107。Illustratively, the computer program can be partitioned into one or more modules/units, which are stored in the memory 12 and executed by the processor 13 to complete the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing a particular function, the instruction segments being used to describe the execution of the computer program in the access control device 1. For example, the computer program may be divided into a receiving unit 100, an obtaining unit 101, a matching unit 102, an executing unit 103, an output unit 104, a changing unit 105, a transmitting unit 106, and a detecting unit 107.
所述存储器12可用于存储所述计算机程序和/或模块,所述处理器13通过运行或执行存储在所述存储器12内的计算机程序和/或模块,以及调用存储在存储器12内的数据,实现所述门禁装置1的各种功能。所述存储器12可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器12可以包括高速随机存取存储器,还可以包括非易失性存储器,例如硬盘、内存、插接式硬盘,智能存储卡(Smart Media Card,SMC), 安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)、至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 12 can be used to store the computer program and/or module by running or executing a computer program and/or module stored in the memory 12, and recalling data stored in the memory 12, Various functions of the access control device 1 are implemented. The memory 12 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; Stores data created based on the use of the phone (such as audio data, phone book, etc.). In addition, the memory 12 may include a high-speed random access memory, and may also include a non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SMC), and a secure digital (Secure Digital, SD). Card, flash card, at least one disk storage device, flash device, or other volatile solid state storage device.
所述存储器12可以是门禁装置1的外部存储器和/或内部存储器。进一步地,所述存储器12可以是集成电路中没有实物形式的具有存储功能的电路,如RAM(Random-Access Memory,随机存取存储器)、FIFO(First In First Out,)等。或者,所述存储器12也可以是具有实物形式的存储器,如内存条、TF卡(Trans-flash Card)等等。The memory 12 can be an external memory and/or an internal memory of the access device 1. Further, the memory 12 may be a circuit having a storage function in a physical form, such as a RAM (Random-Access Memory), a FIFO (First In First Out), or the like. Alternatively, the memory 12 may also be a memory having a physical form such as a memory stick, a TF card, or the like.
所述声音采集装置14用于采集所述第二语音信息,所述声音采集装置14可以是麦克风等元件。The sound collection device 14 is configured to collect the second voice information, and the sound collection device 14 may be an element such as a microphone.
所述摄像装置15用于采集所述第二面部信息,所述摄像装置15可以是摄像头等。The imaging device 15 is configured to collect the second facial information, and the imaging device 15 may be a camera or the like.
所述门禁装置1集成的模块/单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明实现上述实施例方法中的全部或部分流程,也可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一计算机可读存储介质中,该计算机程序在被处理器执行时,可实现上述各个方法实施例的步骤。其中,所述计算机程序包括计算机程序代码,所述计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述计算机可读介质可以包括:能够携带所述计算机程序代码的任何实体或装置、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、电载波信号、电信信号以及软件分发介质等。需要说明的是,所述计算机可读介质包含的内容可以根据司法管辖区内立法和专利实践的要求进行适当的增减,例如在某些司法管辖区,根据立法和专利实践,计算机可读介质不包括电载波信号和电信信号。The modules/units integrated by the access device 1 can be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product. Based on such understanding, the present invention implements all or part of the processes in the foregoing embodiments, and may also be completed by a computer program to instruct related hardware. The computer program may be stored in a computer readable storage medium. The steps of the various method embodiments described above may be implemented when the program is executed by the processor. Wherein, the computer program comprises computer program code, which may be in the form of source code, object code form, executable file or some intermediate form. The computer readable medium may include any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM). , random access memory (RAM, Random Access Memory), electrical carrier signals, telecommunications signals, and software distribution media. It should be noted that the content contained in the computer readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in a jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, computer readable media Does not include electrical carrier signals and telecommunication signals.
结合图3,所述门禁装置1中的所述存储器12存储多个指令以实现一种开门方法,所述处理器13可执行所述多个指令从而实现:接收所述服务器发送的用户的特征信息,所述特征信息包括所述用户的第一语音信息及所述用户的第一面部信息;获取第二语音信息;将所述第二语音信息与所述第一语音信息进行匹配;当所述第二语音信息与所述第一语音信息匹配成功时,获取第二面部信息;将所述第二面部信息与所述第一面部信息进行匹配;及当所述第二面部信息与所述第一面部信息匹配成功时,执行开门操作。Referring to FIG. 3, the memory 12 in the access control device 1 stores a plurality of instructions to implement a method of opening a door, and the processor 13 can execute the plurality of instructions to: receive a feature of a user sent by the server. Information, the feature information includes first voice information of the user and first facial information of the user; acquiring second voice information; and matching the second voice information with the first voice information; Acquiring the second facial information when the second voice information is successfully matched with the first voice information; matching the second facial information with the first facial information; and when the second facial information is When the first facial information is successfully matched, the door opening operation is performed.
根据本发明优选实施例,所述处理器13还执行多个指令包括:According to a preferred embodiment of the present invention, the processor 13 further executes a plurality of instructions including:
将所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语进行匹配;Matching the opening prompt in the second voice information with a preset opening prompt in the first voice information;
当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语相同时,将所述第二语音信息中的语音特征与所述第一语音信息中的语音特征进行匹配,所述第一语音信息中的语音特征及所述第二语音信息中的语音特征包括以下一种或者多种的组合:音色、音调、响度;When the opening prompt in the second voice information is the same as the preset opening prompt in the first voice information, performing the voice feature in the second voice information and the voice feature in the first voice information Matching, the voice feature in the first voice information and the voice feature in the second voice information include a combination of one or more of the following: tone, pitch, and loudness;
当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差在误差范围内时,确定所述第二语音信息与所述第一语音信息匹配成功;或者Determining that the second voice information is successfully matched with the first voice information when an error of a voice feature in the second voice information and a voice feature in the first voice information is within an error range; or
当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差不在误差范围内时,确定所述第二语音信息与所述第一语音信息匹配失败;或者Determining that the second voice information fails to match the first voice information when the error of the voice feature in the second voice information and the voice feature in the first voice information is not within an error range; or
当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语不相同时,确定所述第二语音信息与所述第一语音信息匹配失败。When the opening prompt in the second voice information is different from the preset opening prompt in the first voice information, determining that the second voice information matches the first voice information fails.
根据本发明优选实施例,所述处理器13还执行多个指令包括:According to a preferred embodiment of the present invention, the processor 13 further executes a plurality of instructions including:
当所述第二语音信息与所述第一语音信息匹配不成功时,输出所述用户语音信息匹配失败的语音指令,并提示所述用户继续输入语音进行匹配;或者When the matching of the second voice information with the first voice information is unsuccessful, outputting the voice command that the user voice information matches the failure, and prompting the user to continue inputting voice for matching; or
当所述第二语音信息与所述第一语音信息匹配成功时,输出所述用户语音信息匹配成功的语音指令,并输出所述用户配合面部识别的语音指令;或者When the second voice information is successfully matched with the first voice information, outputting the voice command that the user voice information matches successfully, and outputting the voice command of the user to cooperate with the face recognition; or
当所述第二面部信息与所述第一面部信息匹配不成功时,输出所述用户面部信息匹配失败的语音指令。When the matching of the second facial information with the first facial information is unsuccessful, the voice instruction that the user facial information matches fails is output.
根据本发明优选实施例,所述处理器13还执行多个指令包括:According to a preferred embodiment of the present invention, the processor 13 further executes a plurality of instructions including:
接收对所述第一语音信息中的预设开门用语进行更改的指令;Receiving an instruction to change a preset opening statement in the first voice information;
获取用户输入的更新后的用语对应的语音信号;Obtaining a voice signal corresponding to the updated term input by the user;
将所述第一语音信息中的预设开门用语的语音信号更改为更新后的用语对应的语音信号。And changing a voice signal of the preset door opening term in the first voice information to a voice signal corresponding to the updated term.
根据本发明优选实施例,所述处理器13还执行多个指令包括:According to a preferred embodiment of the present invention, the processor 13 further executes a plurality of instructions including:
获取所述用户的终端的联系信息;Obtaining contact information of the terminal of the user;
根据所述联系信息,发送验证信息至所述用户的终端;Sending verification information to the terminal of the user according to the contact information;
接收用户输入的验证信息;Receiving verification information input by the user;
将接收的验证信息与发送的验证信息进行匹配;Matching the received verification information with the sent verification information;
当接收的验证信息与发送的验证信息匹配成功时,获取用户输入的更新 后的用语对应的语音信号。When the received verification information is successfully matched with the transmitted verification information, the voice signal corresponding to the updated term input by the user is acquired.
根据本发明优选实施例,所述处理器13还执行多个指令包括:According to a preferred embodiment of the present invention, the processor 13 further executes a plurality of instructions including:
检测门的开关状态;Detecting the switch state of the door;
当接收到所述用户输入的预设关门用语对应的询问指令时,根据所述开关状态,输出相应的语音指令。When an inquiry command corresponding to the preset closing term input by the user is received, a corresponding voice command is output according to the switch state.
具体地,所述处理器13对上述指令的具体实现方法可参考图3对应实施例中相关步骤的描述,在此不赘述。For details, refer to the description of the related steps in the corresponding embodiment of FIG. 3, and the details are not described here.
在本发明所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。In the several embodiments provided by the present invention, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division, and the actual implementation may have another division manner.
所述作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本发明各个实施例中的各功能模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能模块的形式实现。In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of hardware plus software function modules.
对于本领域技术人员而言,显然本发明不限于上述示范性实施例的细节,而且在不背离本发明的精神或基本特征的情况下,能够以其他的具体形式实现本发明。It is apparent to those skilled in the art that the present invention is not limited to the details of the above-described exemplary embodiments, and the present invention can be embodied in other specific forms without departing from the spirit or essential characteristics of the invention.
因此,无论从哪一点来看,均应将实施例看作是示范性的,而且是非限制性的,本发明的范围由所附权利要求而不是上述说明限定,因此旨在将落在权利要求的等同要件的含义和范围内的所有变化涵括在本发明内。不应将权利要求中的任何附关联图标记视为限制所涉及的权利要求。Therefore, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the invention is defined by the appended claims instead All changes in the meaning and scope of equivalent elements are included in the present invention. Any accompanying drawings in the claims should not be construed as limiting the claim.
此外,显然“包括”一词不排除其他单元或步骤,单数不排除复数。系统权利要求中陈述的多个单元或装置也可以由一个单元或装置通过软件或者硬件来实现。第二等词语用来表示名称,而并不表示任何特定的顺序。In addition, it is to be understood that the word "comprising" does not exclude other elements or steps. A plurality of units or devices recited in the system claims can also be implemented by a unit or device by software or hardware. The second word is used to denote the name and does not denote any particular order.
最后应说明的是,以上实施例仅用以说明本发明的技术方案而非限制,尽管参照较佳实施例对本发明进行了详细说明,本领域的普通技术人员应当理解,可以对本发明的技术方案进行修改或等同替换,而不脱离本发明技术方案的精神和范围。It should be noted that the above embodiments are only for explaining the technical solutions of the present invention and are not intended to be limiting, and the present invention will be described in detail with reference to the preferred embodiments. Modifications or equivalents are made without departing from the spirit and scope of the invention.

Claims (10)

  1. 一种开门方法,应用于门禁装置中,所述门禁装置与服务器相通信,其特征在于,所述方法包括:A door opening method is applied to an access control device, wherein the access control device communicates with a server, wherein the method comprises:
    接收所述服务器发送的用户的特征信息,所述特征信息包括所述用户的第一语音信息及所述用户的第一面部信息;Receiving feature information of the user sent by the server, where the feature information includes first voice information of the user and first face information of the user;
    获取第二语音信息;Obtaining second voice information;
    将所述第二语音信息与所述第一语音信息进行匹配;Matching the second voice information with the first voice information;
    当所述第二语音信息与所述第一语音信息匹配成功时,获取第二面部信息;Obtaining second face information when the second voice information is successfully matched with the first voice information;
    将所述第二面部信息与所述第一面部信息进行匹配;及Matching the second facial information with the first facial information; and
    当所述第二面部信息与所述第一面部信息匹配成功时,执行开门操作。When the second face information is successfully matched with the first face information, the door opening operation is performed.
  2. 如权利要求1所述的开门方法,其特征在于,所述将所述第二语音信息与所述第一语音信息进行匹配包括:The method of opening a door according to claim 1, wherein the matching the second voice information with the first voice information comprises:
    将所述第二语音信息中的预设开门用语与所述第一语音信息中的开门用语进行匹配;Matching a preset opening prompt in the second voice information with an opening prompt in the first voice information;
    当所述第二语音信息中的预设开门用语与所述第一语音信息中的开门用语相同时,将所述第二语音信息中的语音特征与所述第一语音信息中的语音特征进行匹配,所述第二语音信息中的语音特征及所述第一语音信息中的语音特征包括以下一种或者多种的组合:音色、音调、响度;When the preset opening prompt in the second voice information is the same as the opening prompt in the first voice information, performing the voice feature in the second voice information and the voice feature in the first voice information Matching, the voice feature in the second voice information and the voice feature in the first voice information include a combination of one or more of the following: tone, pitch, and loudness;
    当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差在误差范围内时,确定所述第二语音信息与所述第一语音信息匹配成功;或者Determining that the second voice information is successfully matched with the first voice information when an error of a voice feature in the second voice information and a voice feature in the first voice information is within an error range; or
    当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差不在误差范围内时,确定所述第二语音信息与所述第一语音信息匹配失败;或者Determining that the second voice information fails to match the first voice information when the error of the voice feature in the second voice information and the voice feature in the first voice information is not within an error range; or
    当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语不相同时,确定所述第二语音信息与所述第一语音信息匹配失败。When the opening prompt in the second voice information is different from the preset opening prompt in the first voice information, determining that the second voice information matches the first voice information fails.
  3. 如权利要求1或2所述的开门方法,其特征在于,所述方法还包括:The method of opening a door according to claim 1 or 2, wherein the method further comprises:
    当所述第二语音信息与所述第一语音信息匹配不成功时,输出所述用户语音信息匹配失败的语音指令,并提示所述用户继续输入语音进行匹配;或者When the matching of the second voice information with the first voice information is unsuccessful, outputting the voice command that the user voice information matches the failure, and prompting the user to continue inputting voice for matching; or
    当所述第二语音信息与所述第一语音信息匹配成功时,输出所述用户语音信息匹配成功的语音指令,并输出语音指令提醒用户进行面部识别;或者When the second voice information is successfully matched with the first voice information, outputting the voice command that the user voice information matches successfully, and outputting a voice command to prompt the user to perform face recognition; or
    当所述第二面部信息与所述第一面部信息匹配不成功时,输出所述用户面部信息匹配失败的语音指令。When the matching of the second facial information with the first facial information is unsuccessful, the voice instruction that the user facial information matches fails is output.
  4. 如权利要求1所述的开门方法,其特征在于,所述方法还包括:The method of opening a door according to claim 1, wherein the method further comprises:
    接收对所述第一语音信息中的预设开门用语进行更改的指令;Receiving an instruction to change a preset opening statement in the first voice information;
    获取用户输入的更新后的用语对应的语音信号;Obtaining a voice signal corresponding to the updated term input by the user;
    将所述第一语音信息中的预设开门用语的语音信号更改为更新后的用语对应的语音信号。And changing a voice signal of the preset door opening term in the first voice information to a voice signal corresponding to the updated term.
  5. 如权利要求4所述的开门方法,其特征在于,在获取用户输入的更新后的用语对应的语音信号之前,所述方法还包括:The method of claim 4, wherein the method further comprises: before acquiring the voice signal corresponding to the updated term input by the user, the method further comprising:
    获取所述用户的终端的联系信息;Obtaining contact information of the terminal of the user;
    根据所述联系信息,发送验证信息至所述用户的终端;Sending verification information to the terminal of the user according to the contact information;
    接收用户输入的验证信息;Receiving verification information input by the user;
    将接收的验证信息与发送的验证信息进行匹配;Matching the received verification information with the sent verification information;
    当接收的验证信息与发送的验证信息匹配成功时,获取用户输入的更新后的用语对应的语音信号。When the received verification information is successfully matched with the transmitted verification information, the voice signal corresponding to the updated term input by the user is acquired.
  6. 如权利要求1所述的开门方法,其特征在于,所述方法还包括:The method of opening a door according to claim 1, wherein the method further comprises:
    检测门的开关状态;Detecting the switch state of the door;
    当接收到所述用户输入的预设关门用语对应的询问指令时,根据所述开关状态,输出相应的语音指令。When an inquiry command corresponding to the preset closing term input by the user is received, a corresponding voice command is output according to the switch state.
  7. 一种开门装置,运行于门禁装置中,所述门禁装置与服务器相通信,其特征在于,所述装置包括:A door opening device running in an access device, the access device communicating with a server, wherein the device comprises:
    接收单元,用于接收所述服务器发送的用户的特征信息,所述特征信息包括所述用户的第一语音信息及所述用户的第一面部信息;a receiving unit, configured to receive feature information of a user sent by the server, where the feature information includes first voice information of the user and first face information of the user;
    获取单元,用于获取第二语音信息;An acquiring unit, configured to acquire second voice information;
    匹配单元,用于将所述第二语音信息与所述第一语音信息进行匹配;a matching unit, configured to match the second voice information with the first voice information;
    所述获取单元,还用于当所述第二语音信息与所述第一语音信息匹配成功时,获取第二面部信息;The acquiring unit is further configured to acquire second face information when the second voice information is successfully matched with the first voice information;
    所述匹配单元,还用于将所述第二面部信息与所述第一面部信息进行匹配;及The matching unit is further configured to match the second facial information with the first facial information; and
    执行单元,用于当所述第二面部信息与所述第一面部信息匹配成功时,执行开门操作。And an execution unit, configured to perform a door opening operation when the second face information is successfully matched with the first face information.
  8. 如权利要求7所述的开门装置,其特征在于,所述匹配单元将所述第二语音信息与所述第一语音信息进行匹配包括:The door opening device of claim 7, wherein the matching unit matching the second voice information with the first voice information comprises:
    将所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语进行匹配;Matching the opening prompt in the second voice information with a preset opening prompt in the first voice information;
    当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语相同时,将所述第二语音信息中的语音特征与所述第一语音信息中的语音特征进行匹配,所述第一语音信息中的语音特征及所述第二语音信息中的语 音特征包括以下一种或者多种的组合:音色、音调、响度;When the opening prompt in the second voice information is the same as the preset opening prompt in the first voice information, performing the voice feature in the second voice information and the voice feature in the first voice information Matching, the voice feature in the first voice information and the voice feature in the second voice information include a combination of one or more of the following: tone, pitch, and loudness;
    当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差在误差范围内时,确定所述第二语音信息与所述第一语音信息匹配成功;或者Determining that the second voice information is successfully matched with the first voice information when an error of a voice feature in the second voice information and a voice feature in the first voice information is within an error range; or
    当所述第二语音信息中的语音特征与所述第一语音信息中的语音特征的误差不在误差范围内时,确定所述第二语音信息与所述第一语音信息匹配失败;或者Determining that the second voice information fails to match the first voice information when the error of the voice feature in the second voice information and the voice feature in the first voice information is not within an error range; or
    当所述第二语音信息中的开门用语与所述第一语音信息中的预设开门用语不相同时,确定所述第二语音信息与所述第一语音信息匹配失败。When the opening prompt in the second voice information is different from the preset opening prompt in the first voice information, determining that the second voice information matches the first voice information fails.
  9. 一种门禁装置,其特征在于,所述门禁装置包括:An access control device, wherein the access control device comprises:
    处理器;及Processor; and
    存储器,存储在所述存储器中的指令被所述处理器执行以实现如权利要求1至6中任意一项所述开门方法。A memory, the instructions stored in the memory are executed by the processor to implement the method of opening a door according to any one of claims 1 to 6.
  10. 一种计算机可读存储介质,其特征在于:所述计算机可读存储介质中存储的指令被门禁装置中的处理器执行以实现如权利要求1至6中任意一项所述开门方法。A computer readable storage medium, characterized in that the instructions stored in the computer readable storage medium are executed by a processor in an access control device to implement the method of opening a door according to any one of claims 1 to 6.
PCT/CN2018/085634 2017-09-30 2018-05-04 Door opening method and device, access control device, and computer readable storage medium WO2019062122A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710917206.4A CN107680221A (en) 2017-09-30 2017-09-30 Door opening method and device, entrance guard device and computer-readable recording medium
CN201710917206.4 2017-09-30

Publications (1)

Publication Number Publication Date
WO2019062122A1 true WO2019062122A1 (en) 2019-04-04

Family

ID=61139044

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/085634 WO2019062122A1 (en) 2017-09-30 2018-05-04 Door opening method and device, access control device, and computer readable storage medium

Country Status (2)

Country Link
CN (1) CN107680221A (en)
WO (1) WO2019062122A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107680221A (en) * 2017-09-30 2018-02-09 深圳前海弘稼科技有限公司 Door opening method and device, entrance guard device and computer-readable recording medium
CN110969555A (en) * 2018-09-30 2020-04-07 上海柠睿企业服务合伙企业(有限合伙) Multilevel information auditing method, device, system, terminal, server and medium
CN109949822A (en) * 2019-03-31 2019-06-28 联想(北京)有限公司 Signal processing method and electronic equipment
CN112132996A (en) * 2019-06-05 2020-12-25 Tcl集团股份有限公司 Door lock control method, mobile terminal, door control terminal and storage medium
CN110288745A (en) * 2019-07-17 2019-09-27 移康智能科技(上海)股份有限公司 A kind of structure of intelligent door
CN112489276A (en) * 2019-08-23 2021-03-12 银河水滴科技(北京)有限公司 Gate inhibition control method and device based on gait recognition and storage medium
CN111429638B (en) * 2020-04-13 2021-10-26 重庆匠技智能科技有限公司 Access control method based on voice recognition and face recognition
CN115273287A (en) * 2022-08-03 2022-11-01 杭州恒生数字设备科技有限公司 Bluetooth lock unlocking method and system and Bluetooth lock

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070198849A1 (en) * 2001-06-05 2007-08-23 Sensory, Incorporated Client-server security system and method
CN103996228A (en) * 2014-05-12 2014-08-20 深圳市威富多媒体有限公司 Entrance guard barrier gate management method based on voice and human face identification, and device
CN106653033A (en) * 2016-10-28 2017-05-10 努比亚技术有限公司 Voice unlocking device, terminal and method
CN106920303A (en) * 2017-01-21 2017-07-04 云丁网络技术(北京)有限公司 A kind of method for unlocking and its intelligent door lock system based on speech recognition
CN107221331A (en) * 2017-06-05 2017-09-29 深圳市讯联智付网络有限公司 A kind of personal identification method and equipment based on vocal print
CN107680221A (en) * 2017-09-30 2018-02-09 深圳前海弘稼科技有限公司 Door opening method and device, entrance guard device and computer-readable recording medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070198849A1 (en) * 2001-06-05 2007-08-23 Sensory, Incorporated Client-server security system and method
CN103996228A (en) * 2014-05-12 2014-08-20 深圳市威富多媒体有限公司 Entrance guard barrier gate management method based on voice and human face identification, and device
CN106653033A (en) * 2016-10-28 2017-05-10 努比亚技术有限公司 Voice unlocking device, terminal and method
CN106920303A (en) * 2017-01-21 2017-07-04 云丁网络技术(北京)有限公司 A kind of method for unlocking and its intelligent door lock system based on speech recognition
CN107221331A (en) * 2017-06-05 2017-09-29 深圳市讯联智付网络有限公司 A kind of personal identification method and equipment based on vocal print
CN107680221A (en) * 2017-09-30 2018-02-09 深圳前海弘稼科技有限公司 Door opening method and device, entrance guard device and computer-readable recording medium

Also Published As

Publication number Publication date
CN107680221A (en) 2018-02-09

Similar Documents

Publication Publication Date Title
WO2019062122A1 (en) Door opening method and device, access control device, and computer readable storage medium
CN108320752A (en) Cloud Voiceprint Recognition System and its method applied to community gate inhibition
WO2020164273A1 (en) Conference management method and related device based on voiceprint recognition
KR101218297B1 (en) System and Method for Controlling Door Lock
US11922950B2 (en) Audio-based access control
US20160330199A1 (en) Fallback identity authentication techniques
TW201525754A (en) Method, apparatus and system of identity authentication
US10867612B1 (en) Passive authentication through voice data analysis
US10440018B2 (en) Authentication workflow management
US11836455B2 (en) Bidirectional call translation in controlled environment
CN109389711A (en) Gate inhibition's unlocking method, device, equipment and medium based on living things feature recognition
CN107533598B (en) Input method and device of login password of application program and terminal
KR20110138856A (en) System and method for processing opening and shutting door-lock using one-time bar code, door-lock device
CN108734838A (en) It is a kind of that there is the smart lock based on video raw body signature verification device
SE1650416A1 (en) Secure storage of fingerprint related elements
CN108877098B (en) Cardless withdrawal method, device, system, storage medium and electronic equipment
CN110149618B (en) Intelligent device access method, device, equipment and medium based on voiceprint authorization
US9946860B1 (en) Systems and methods for allowing administrative access
US20200220869A1 (en) Systems and methods for contactless authentication using voice recognition
WO2021135549A1 (en) Service item processing permissions authorization method and apparatus, computer device, and storage medium
CN109461237A (en) A kind of intelligent door lock equipment and its method for carrying out message prompting
WO2016058540A1 (en) Identity authentication method and apparatus and storage medium
WO2020125260A1 (en) Identity authentication method and device, storage medium, and electronic apparatus
WO2018006330A1 (en) Method and system for unlocking intelligent entrance guard based on identity card
CN114005208B (en) Access control method, device, equipment and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18862939

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 16/09/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18862939

Country of ref document: EP

Kind code of ref document: A1