CN111401160A

CN111401160A - Hotel authentication management method, system and platform and hotel PMS system

Info

Publication number: CN111401160A
Application number: CN202010140105.2A
Authority: CN
Inventors: 戴军忠; 熊高琰; 张散集; 王晓伟; 白建军; 张明扬; 郭庆
Original assignee: Beijing Sankuai Online Technology Co Ltd
Current assignee: Beijing Sankuai Online Technology Co Ltd
Priority date: 2020-03-03
Filing date: 2020-03-03
Publication date: 2020-07-10

Abstract

The application discloses a hotel authentication management method, a hotel PMS system, a hotel self-service check-in system, a hotel security management platform, computer equipment and a computer readable storage medium, which can quickly perform identity verification and authentication on a user in hotel service; based on the service ordering content of the user in the hotel, the use authority of the user to each area or service is determined by taking the face characteristics and the physical features of the user image as judgment conditions, the hotel intelligent management is carried out by taking the image characteristics as authentication conditions, the identity of the user is rapidly identified, and the authentication reliability is improved; different judgment rules are set for different areas and services of the hotel, the accuracy required by the safety and identity judgment of each area is ensured, and the maintenance on the safety of the user and the safety of the hotel is further increased.

Description

Hotel authentication management method, system and platform and hotel PMS system

Technical Field

The application relates to the technical field of intelligent authentication, in particular to a hotel authentication management method, a hotel PMS system, a hotel self-service check-in system, a hotel safety management platform, computer equipment and a computer readable storage medium.

Background

The intelligent hotel is an intelligent management scheme derived in the atmosphere of popularization of the hotel and improvement of the trip rate of a large number of groups, and the intelligent technology is adopted to replace the traditional identity verification, privacy information protection, entertainment facility service and the like in the interaction aiming at the hotel and the guests.

In a complex hotel environment, the accuracy of determining the identity of a user is at the heart of ensuring customer security, upon which authorization for the user to move within the store, such as an open area, is performed. In the existing authentication mode, the authentication of activities such as opening of a guest room door, entrance guard of a hotel and the like is usually based on matching and authorization of objects such as an IC card, a magnetic card, a bracelet and the like and a door lock, and facial recognition is adopted for authentication in part of intelligent hotels. The common IC card authentication mode increases the requirement of authorized object storage for a user person, and needs to bear the management cost of manpower and material resources for a hotel; in the mode of adopting the face identification authentication, the authentication condition is high, the process is time-consuming, and the condition of inaccurate judgment caused by face shielding and the like may exist.

Disclosure of Invention

In view of the above disadvantages of the related art, an object of the present application is to provide a hotel authentication management method, a hotel PMS system, a hotel self-service check-in system, a hotel security management platform, a computer device, and a computer readable storage medium, so as to solve the problems in the prior art.

To achieve the above and other related objects, a first aspect of the present application provides a hotel authentication management method, including the following steps: obtaining reservation information of a user, and inquiring to obtain matched order information according to the reservation information; acquiring the on-site human face features of the user to check the user identity of the order information and acquire the physical features of the user; after passing the identity verification of the user, associating the physical features of the user with the face features; and confirming check-in information of a user, updating the order state, and authorizing at least one hotel authority to the user, wherein the hotel authority is associated with the face image or/and the physical feature.

In certain embodiments of the first aspect of the present application, the subscription information includes at least one of credential information, correspondence information, order number, name, and unit name.

In certain embodiments of the first aspect of the present application, the step of obtaining live facial features of the user to verify the user identity of the order information comprises: acquiring a field face image of a user; uploading the face image to an information management service system at the cloud end, so that the information management service system can match the face image with the prestored face characteristics; and receiving a user identity verification result sent by the information management service system.

In certain embodiments of the first aspect of the present application, the step of obtaining live facial features of the user to verify the user identity of the order information comprises: acquiring a field face image of a user and certificate information of the user; uploading the face image and the certificate information to an information management service system at the cloud end, so that the information management service system obtains corresponding reservation information from data according to the certificate information and matches the face image with face features in the reservation information; and receiving a user identity verification result sent by the information management service system.

In certain embodiments of the first aspect of the present application, the hotel authentication management method further comprises the steps of: and extracting the characteristics of the obtained face image, or extracting the characteristics of the obtained face image by the information management service system so as to be matched with the prestored face characteristics.

In certain embodiments of the first aspect of the present application, the step of obtaining the physical characteristics of the user comprises: determining a target user on site; acquiring an image containing the target user; extracting physical features of the target user from the image, wherein the physical features comprise one or more of clothing features, posture features, skin color features, hair features, gait features and ethnic sac features.

In certain embodiments of the first aspect of the present application, the step of determining a target user of the site comprises: and determining the target user according to the detection position of the target user on the spot or the limb behavior of the target user on the spot.

In certain embodiments of the first aspect of the present application, the step of determining a target user of the site comprises: the method comprises the steps that a target user on site is determined through a monitoring camera device arranged in a hotel lobby, and the monitoring camera device is in communication connection with a PMS (permanent magnet system) of the hotel or an information management service system of a cloud.

In certain embodiments of the first aspect of the present application, the granting of the at least one hotel privilege to the user is by at least one of: sending authorization information to terminal equipment of a user, wherein the authorization information comprises character information or two-dimensional code information; sending authorization information to terminal equipment of hotel management personnel, wherein the authorization information comprises text information or two-dimensional code information; or sending authorization information to at least one authentication device of the hotel, wherein the authentication device comprises: one or more of a room door lock, a room electricity-taking switch, an elevator floor control device and a hotel article control device.

In certain embodiments of the first aspect of the present application, the hotel permission includes a first permission and a second permission, the first permission is associated with a face image, or the first permission is associated with a face image and a physical feature; the second authority is related to a face image or a physical feature image, and the first authority is higher than the second authority.

In certain embodiments of the first aspect of the present application, the first jurisdiction is applicable to at least one hotel service jurisdiction in a door unlock, VIP service area, conference room, restaurant and bar, and the second jurisdiction is applicable to at least one hotel service jurisdiction in an elevator, fitness activity area, leisure activity area, parent-child activity area, reading room and laundry.

The present application also provides in a second aspect a hotel PMS system, comprising: the query unit is used for querying and obtaining matched order information according to the obtained reservation information; the identity authentication unit is used for verifying the identity of the user according to the acquired human face features; the association unit is used for associating the acquired physical features of the user with the face features after the user identity verification is passed; and the authorization unit is used for confirming the check-in information of the user, updating the order state and authorizing at least one hotel authority to the user, wherein the hotel authority is associated with the face image or/and the physical feature.

In certain embodiments of the second aspect of the present application, the hotel PMS system further comprises a recording unit for recording a usage log of the at least one hotel right when the user uses the authorized at least one hotel right.

In some embodiments of the second aspect of the present application, the hotel PMS system further includes an interface unit, connected to at least one camera device configured on the hotel site, for acquiring a face image of the user or a physical feature of the user acquired by the at least one camera device.

In certain embodiments of the second aspect of the present application, the at least one camera device is configured at a designated authentication location of the hotel, the designated authentication location including one or more of an elevator hall, a room doorway, a VIP service area, a conference room, a restaurant, a gym, a recreational activity area, a parent-child activity area, a viewing room, and a laundry room.

In some embodiments of the second aspect of the present application, the hotel PMS system further includes an interface unit, connected to the information management server configured at the cloud, for acquiring the order information sent by the information management server.

In certain embodiments of the second aspect of the present application, the authorization unit is communicatively connected to a plurality of authentication devices in the hotel, the authentication devices comprising: one or more of a room door lock, a room electricity-taking switch, an elevator floor control device and a hotel article control device.

In certain embodiments of the second aspect of the present application, the hotel permission comprises a first permission and a second permission, the first permission is associated with a face image, or the first permission is associated with a face image and a physical feature; the second authority is related to a face image or a physical feature image, and the first authority is higher than the second authority.

In certain embodiments of the second aspect of the present application, the first jurisdiction is applicable to at least one hotel service jurisdiction in a door unlock, VIP service area, conference room, restaurant and bar, and the second jurisdiction is applicable to at least one hotel service jurisdiction in an elevator, fitness activity area, recreational activity area, parent-child activity area, reading room and laundry.

The present application also provides, in a third aspect, a self-service check-in system for hotels, comprising: the system comprises a camera device, a processing device and a processing device, wherein the camera device is used for acquiring a video or an image of a hotel check-in site, and the video or the image comprises the physical characteristics of a target user; self-service registration equipment, with camera device communication connection includes: the query unit is used for querying and obtaining matched order information according to the obtained reservation information; the face recognition unit is used for acquiring a field face image of a target user so as to perform user identity verification matched with the order information; the association unit is used for associating the acquired physical characteristics of the user with the face image after the user identity verification is passed; and the authorization unit is used for confirming the check-in information of the user, updating the order state and authorizing at least one hotel authority to the user, wherein the hotel authority is associated with the face image or/and the physical feature.

The present application further provides, in a fourth aspect, a hotel security management system, comprising: the system comprises a first camera device, a second camera device and a third camera device, wherein the first camera device is arranged at a hotel check-in site and used for acquiring a video or an image of the hotel check-in site, and the video or the image comprises the physical and physical characteristics of a target user; the second camera device is arranged at an authentication position appointed by the hotel and used for acquiring the physical characteristics of a target user in the authentication position; a hotel PMS system as described in any embodiment of the second aspect of the present application or a self-service check-in device as described in any embodiment of the third aspect of the present application.

In certain embodiments of the fourth aspect of the present application, the hotel security management system further comprises a plurality of authentication devices disposed in the hotel and communicatively connected to the PMS system or the self-service check-in device, the authentication devices comprising: one or more of a room door lock, a room electricity-taking switch, an elevator floor control device and a hotel article control device.

In certain embodiments of the fourth aspect of the present application, the authentication location designated by the hotel comprises one or more of an elevator lobby, an elevator interior, a room doorway, a VIP service area, a conference room, a restaurant, a gym, a leisure activity area, a parent-child activity area, a reading room, and a laundry room.

The present application further provides in a fifth aspect a hotel security management platform, comprising: an information management server; at least one hotel security management system as described in any embodiment of the fourth aspect of the present application.

The present application further provides, in a sixth aspect, a computer device comprising: storage means for storing at least one program; and the processing device is connected with the storage device and used for executing the at least one program so as to coordinate the storage device to execute and realize the hotel authentication management method according to any implementation mode of the first aspect of the application.

The present application further provides in a seventh aspect a computer-readable storage medium storing at least one program which, when invoked, implements the hotel authentication management method as described in any of the embodiments of the first aspect of the present application.

To sum up, the hotel authentication management method, the hotel PMS system, the hotel self-service check-in system, the hotel security management platform, the computer device and the computer readable storage medium provided by the application have the following beneficial effects: the identity verification and authentication can be quickly carried out on the user in the hotel service; based on the service ordering content of the user in the hotel, the use authority of the user to each area or service is determined by taking the face characteristics and the physical features of the user image as judgment conditions, the hotel intelligent management is carried out by taking the image characteristics as authentication conditions, the identity of the user is rapidly identified, and the authentication reliability is improved; different judgment rules are set for different areas and services of the hotel, the accuracy required by the safety and identity judgment of each area is ensured, and the maintenance on the safety of the user and the safety of the hotel is further increased.

Drawings

The specific features of the invention to which this application relates are set forth in the appended claims. The features and advantages of the invention to which this application relates will be better understood by reference to the exemplary embodiments described in detail below and the accompanying drawings. The brief description of the drawings is as follows:

fig. 1 is a schematic flow chart of the hotel authentication management method according to an embodiment of the present application.

Fig. 2 is a schematic flow chart of the hotel authentication management method according to an embodiment of the present application.

Fig. 3 is a schematic flow chart of the hotel authentication management method according to an embodiment of the present application.

Fig. 4 is a flowchart illustrating an embodiment of a hotel authentication management method according to the present application.

Figure 5 shows a simplified structural schematic diagram of the hotel PMS system of the present application in one embodiment.

Fig. 6 is a simplified schematic diagram of the hotel self-check-in system of the present application in one embodiment.

Figure 7 is a simplified block diagram of the hotel security management system of the present application in one embodiment.

Figure 8 is a simplified block diagram of the hotel security management platform of the present application in one embodiment.

FIG. 9 is a simplified block diagram of a computer device according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application is provided for illustrative purposes, and other advantages and capabilities of the present application will become apparent to those skilled in the art from the present disclosure.

In the following description, reference is made to the accompanying drawings that describe several embodiments of the application. It is to be understood that other embodiments may be utilized and that mechanical, structural, electrical, and operational changes may be made without departing from the spirit and scope of the present disclosure. The following detailed description is not to be taken in a limiting sense, and the scope of embodiments of the present application is defined only by the claims of the issued patent. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. Spatially relative terms, such as "upper," "lower," "left," "right," "lower," "below," "lower," "above," "upper," and the like, may be used herein to facilitate describing one element or feature's relationship to another element or feature as illustrated in the figures.

Although the terms first, second, etc. may be used herein to describe various elements or parameters in some instances, these elements or parameters should not be limited by these terms. These terms are only used to distinguish one element or parameter from another element or parameter. For example, a first image capture device may be referred to as a second image capture device, and similarly, a second image capture device may be referred to as a first image capture device, without departing from the scope of the various described embodiments. The first and second imaging devices are both described as one imaging device, but they are not the same imaging device unless the context clearly dictates otherwise.

Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.

In a hotel security management scheme, multiple activities in a hotel area, such as elevator floors, unlocked guest room doors, restaurants, or fitness rooms, are generally authorized to be performed by a party who confirms the identity of a user as a corresponding identity of a guest based on security requirements. In order to reduce the tedious procedures in which a user performs a plurality of activities, there is an identity confirmation based on facial recognition of a client, thereby judging a subsequent operation authority given to a recognizer. In the scheme based on the face identification right determination, the requirement on image acquisition is high, the user pose is required to be limited in the range capable of acquiring the face, and the authentication condition for judgment is high.

Please refer to fig. 1, which is a flowchart illustrating an embodiment of a hotel security management method according to the present application. As shown in fig. 1, the method comprises the steps of:

in step S100, the subscription information of the user is obtained, and the matched order information is obtained according to the subscription information.

The booking information of the user, namely the booking information or the ordering information indicating the service content of the user in the hotel in the order information, and the corresponding user personal identity information for distinguishing the user, wherein the service content in the booking information is usually in an unused state. In order information matching, matching order information can be queried and determined in the hotel order management system according to user identity information in the reservation information, such as a certificate identification number (e.g., an identity card number or a passport number), or order information, such as an order number.

In the context of hotel security management, the user generally refers to a resident performing business transaction such as long-term and short-term check-in at a hotel, and is particularly directed to a user whose business content performed at the hotel needs to be preceded by an authentication check-in according to legal regulations or management policies.

Specifically, in an implementation manner, the booking information is acquired by a hotel PMS system (Property management system) or an information management service system, and corresponding order information is queried or retrieved in an order system according to the acquired booking information. The hotel PMS system or the information management service system comprises an online order system which stores different types of orders of various services in the hotel, or the hotel PMS system or the information management service system is connected with the online order system through an interface and can input information to the online order system for retrieval. In another implementation, the booking information, which may be provided by the target user, is entered directly into the hotel's online ordering system. In an embodiment, the hotel PMS system generally communicates with the cloud service system through an OTA (Online Travel Agent) platform, and in an actual implementation scenario, the hotel may also be a hotel merchant registered or resident on the OTA platform.

In some embodiments, the subscription information includes at least one of credential information, correspondence information, order number, name, and unit name. The reservation information is mainly information with an identification function for determining the identity of the user, such as certificate information, or information unique to the content in the order system, such as an order number, but not limited to the above description, and in some embodiments, other information that can be used to query and match the order, such as portrait information, a pin code of a SIM card, and a ticket number of an airline ticket can also be used as the reservation information.

The types of documents from which the document information can be obtained include identity cards, passports, drivers licenses, military certificates, student certificates, and the like. The certificate information and the user have a unique corresponding relationship, for example, for a single user, the unique certificate information, passport information, driver license information and the like are provided, and order information associated with the certificate information of the user is acquired based on the original binding relationship between the certificate information and the user. The certificate information mainly comprises identification numbers in the certificate, namely personal ID, and each identification number in the corresponding certificate management system has no repeatability, so that the user corresponding to the ID can be determined.

The communication information comprises communication identification numbers such as a mobile phone number, a fixed number, a mail address and the like of the user, and the user order and the user matching are searched for through the communication information based on the correspondence between the user and the communication information.

In some embodiments, the order in the corresponding hospitality management system may be queried directly according to an order number obtained from the user.

In some embodiments, querying the matching order information is based on the user's name or unit name. The authentication information in the order information comprises the name of the target user, and the order information containing the name of the user is acquired and checked by taking the name as a retrieval condition so as to realize the correspondence between the order information and the user. Or, the identity information for authentication in the order information is a unit name, the order containing the corresponding unit name is inquired and matched in the hotel order management system through the unit name, and the subsequent check matching is performed.

The reservation information may be obtained by, but not limited to, scanning an image, handwriting or keyboard input, reading by a card reader or shooting by a camera. Specifically, the booking information can be input by a user on the hotel self-service check-in device, and the input mode can be handwriting or keyboard input, or is obtained based on a specific format picture for identifying the stored information such as the two-dimensional code or the bar code; still further, the reservation information may be manually entered at the hospitality service front.

In step S110, the on-site facial features of the user are obtained to check the user identity of the order information, and the physical features of the user are obtained.

Referring to fig. 2, a flow chart illustrating the steps of obtaining the on-site human face features of the user to check the user identity of the order information according to an embodiment is shown.

In step S200, a live face image of the user is acquired. The on-site face image of the user is the face image of the user obtained in the stage of order matching and business determining of the user, such as the face image obtained at the hotel check-in and check-in front desk. Specifically, the on-site human face image of the user can be acquired by an image acquisition device, and the image acquisition device can be a camera device, a monitoring device or a human face recognition intelligent device comprising a camera module.

The face image is at least one image containing the face of the user or a frame of image shot by the image containing the face of the user, and the face images can be face images of the user under different shooting angles and different illumination conditions.

In step S210, the face image is uploaded to an information management service system in the cloud, so that the information management service system matches the face image with a pre-stored face feature. Basic hardware and software resources of the hotel are stored in the cloud information management service system, and acquired face feature information is reserved. The image acquisition device uploads the field face image acquired in step S200 to an information management service system at the cloud, and matches the acquired face feature information, i.e., the pre-stored face features, with the field face image.

The pre-stored face features may be face features of a user handling a service in the hotel system again or many times, and features extracted from face images collected in previous services, such as a past check-in experience, retained in the hotel system before the order information check of step S110 in fig. 1 is performed.

The pre-stored face features may set a certain storage rule, and in some embodiments, for a user who has a consumption history in a hotel, the pre-stored face features may include a field face image feature acquired by the user in order verification each time in a business history, or may be updated in compliance with a check-in condition of the user in the hotel, for example, the pre-stored face features are set as the field face image features of the user acquired in the latest consumption history, that is, the information management service system in the cloud is updated in compliance with acquisition time coverage for the face features of the user. In some embodiments, the pre-stored face features are further provided with a constraint rule of a retention time duration, and if a time interval between a current verification stage and a previous consumption in a service history is greater than a preset time threshold for the same user who consumes for multiple times, the pre-stored face images cannot be used for matching again, so that inaccurate matching or errors caused by changes of the face features after the time interval are avoided.

In some embodiments, the pre-stored facial features are obtained based on credential information in the user's subscription information. Specifically, the information management service system at the hotel cloud is in butt joint with a public security system port corresponding to a certificate system such as an identity card or a passport, face information in the certificate information of the public security system can be acquired based on the certificate information in the user reservation information, feature extraction is performed on the face information in the certificate information, and pre-stored face features are acquired to be matched with on-site face images.

The hotel cloud information management service system provides data and data storage and operation space by means of a network or the internet, the system works including information collection, transmission, processing and storage, and is supported by cloud computing and cloud storage technologies, so that the hotel cloud information management service system is an overall management and operation system of a cloud computing background data center.

In some embodiments, the information management service system performs feature extraction processing on the received face image, and performs search comparison with a pre-stored face feature template in the storage data of the management system based on the extracted image features to obtain a matched pre-stored face feature.

The face features comprise feature vectors which are obtained by detecting key points of the face and are connected with the key point coordinates in series, local features of all the key points and texture features of face regions. In some embodiments, the facial features include inter-class variations and intra-class variations. The inter-class variation is the difference of the human face characteristics of different people, such as different human face characteristic templates prestored in an information management service system of a hotel; the intra-class features are differences between faces of the same individual under different conditions, such as feature differences caused by changes of conditions such as different expression states, hairstyles, ambient lighting conditions and the like. The face features prestored in the information management service system comprise face features of different users in historical data, and for each user, the prestored face features comprise face features of the users under the change in the class.

The method for acquiring the on-site human face image features comprises a knowledge-based characterization method and an algebraic feature or statistical learning-based characterization method, and the information management service system of the cloud performs feature calculation and extraction. Specifically, in an implementation manner, the information management service system describes and acquires feature data, such as distances, curvatures, angles and the like between features, of a face organ shape description and an organ in a face image acquired on site, takes geometric description of a structural relationship between the local parts and the local parts as face features, compares the acquired feature data with a pre-stored face feature template in stored data, and outputs pre-stored face features of which similarity thresholds exceed set thresholds in the stored data, thereby acquiring an identity information judgment result of a face on site.

Specifically, in an implementation manner, feature data, such as distances, curvatures, angles and the like between feature points, are obtained by describing the shape description of a human face organ and the distance between organs in a human face image obtained on site, geometric description of a structural relationship between a local part and a local part is used as a human face feature, the obtained feature data is compared with a pre-stored human face feature template in stored data, and pre-stored human face features with similarity thresholds exceeding set thresholds in the stored data are output, so that an identity information judgment result of a human face on site is obtained. In some embodiments, the image acquisition device, the human face verification device, or another computing device with a data processing function performs feature extraction on the acquired human face image, and transmits the acquired feature data to the cloud information management service system.

In some embodiments, the information management service system performs feature extraction on a face image acquired in the field, and matches the face image with a pre-stored face feature template.

In step S220, a user identity verification result sent by the information management service system is received. Specifically, the matched feature template of the on-site face image in the information management service system and the confirmed matching result are sent to a self-service check-in device or a front desk of the hotel, and the self-service check-in device or the front desk receives and displays the identity verification result of the user. If the pre-stored face features with the similarity exceeding the set threshold exist and the matching result is confirmation, the identity verification result of the target user is set to pass the verification, and then the subsequent authentication operation can be carried out.

In some embodiments, after the user identity verification passes, in step S220, a step of updating the corresponding successfully matched pre-stored facial features in the historical data with the facial features of the verified live facial image is further included. And the updated face features are stored in an information management service system.

In some embodiments, when there is no pre-stored face feature whose similarity exceeds the set threshold in the information management service system database in the cloud in step S210, the displayed identity verification result is failed, and in this state, the identity verification result is obtained by subsequently collecting the certificate information of the user, for example, performing a human identity verification based on the user identity certificate, performing feature extraction and comparison verification on the field face image and the certificate image, and then receiving the identity verification result sent by the information management service system by the hotel self-service check-in device or the front desk. The document image is an identity card image, a passport image, or the like obtained in a document system, such as a public security system, based on reading a document.

Referring to fig. 3, a flow chart illustrating the steps of obtaining the on-site human face features of the user to check the user identity of the order information according to an embodiment is shown.

In step S300, a live face image of the user and certificate information of the user are acquired.

The on-site face image of the user is the face image of the user obtained in the stage of identity verification before the user enters the hotel, such as the face image obtained at the hotel check-in foreground. Specifically, the on-site human face image of the user can be acquired by an image acquisition device, and the image acquisition device can be a camera device, a monitoring device or a human face recognition intelligent device comprising a camera module.

The user certificate information is user certificate information acquired on the spot based on a certificate entity provided by the user, such as certificate information of an identity card. In some embodiments, the acquisition of the field face image and the reading of the certificate information are simultaneously realized based on a human-certificate checking device, a data platform of the human-certificate checking device is connected with the information management service system, and the feature extraction calculation of the field face image and the certificate image can be performed by the human-certificate checking device or by the information management service system after receiving the image data.

Specifically, the human card verification device comprises an image acquisition device such as an external camera, a card reading device such as an identity card reader, a computer and the like. The card reading device can scan and read the certificate to obtain the certificate information including the certificate image. The image acquisition device is used for acquiring images or videos containing human faces, and the image acquisition device can comprise a human face detection module and is used for capturing human face images when the human faces are detected to be located in a preset shooting area.

In step S310, the face image and the certificate information are uploaded to an information management service system in a cloud, so that the information management service system obtains corresponding reservation information from a database according to the certificate information and matches the face image with the face features in the database.

In some embodiments, the certificate information is uploaded to an information management service system in the cloud by a human certificate verification device, a corresponding information type in the reservation information is extracted in the information management service system according to the certificate information, for example, the reservation information includes a certificate identification code, and the certificate identification code acquired after the image recognition of the device is read or shot by a card reader of the human certificate verification device is acquired to inquire and match a corresponding user order; meanwhile, the face image information in the certificate information is acquired, and the information management service system performs feature extraction on the acquired face image to form a face feature template for verification of the certificate.

The face information in the certificate information is obtained based on a public security system database connected with a port of an information management service system, after the certificate identification code is read or identified, the identification code in the obtained certificate information is uploaded to the information management service system, the information management service system obtains corresponding certificate information comprising a face image in the public security system database by taking the identification code as a retrieval condition, and meanwhile, the certificate information obtained in the public security system is also used for being compared with entity certificate information of a user, such as name verification. And carrying out image processing on the retrieved face image to obtain a feature template for comparing the on-site face image.

The information management service system also extracts the characteristics of the received field face image, compares the characteristic template of the certificate face with the field image characteristic image, and obtains the identity judgment result of the field face according to the preset comparison rule and the condition whether the similarity between the characteristic images exceeds the set threshold value.

In some embodiments, the reservation information includes facial image information of the user, for example, in the order reservation stage, the identity information input by the user includes an input facial image. And acquiring the face image information in the reservation information based on the order information matched with the acquired certificate information. And transmitting the face image information in the reservation information to a hotel information management service system, extracting features, and forming a pre-stored feature template for image comparison. In one implementation mode, the facial features in the reservation information are associated with the reservation information, and the facial features matched in the information management service system can be obtained simultaneously based on the input reservation information for inquiring the matched order; and (3) extracting the features of the on-site face image of the user, namely performing feature matching with the face features in the order information to obtain an identity judgment result of the on-site face.

In step S320, a user identity verification result sent by the information management service system is received. And the user identity verification result is sent to a hotel foreground or an autonomous check-in device and is displayed so as to indicate to execute subsequent authentication operation.

The identity verification result is used for showing that the field face object is an object of specified service content in the reservation information, and the validity of the user identity is confirmed in the identity verification based on the butt joint of the certificate system and a public security prevention and control system such as a public security system.

In some embodiments, step S320 further includes a step of storing the feature information of the successfully matched live face image as the historical image feature in the information management service system. And for the user who passes the verification of the witness or the verification of the comparison between the live image and the image in the reservation information, storing the feature map of the live image information as a feature template in a database of the information management service system, wherein the live image of the same user can be a plurality of images, and the live image of the same user is stored as a face feature map template of the same user under different conditions of change in the class after image processing.

In some embodiments, the image acquisition device, the human evidence verification device, or another computing device with a data processing function performs feature extraction on the acquired human face image, and transmits the acquired feature data to the cloud information management service system.

In some embodiments, the acquired image is transmitted to an information management service system, image processing is performed by the information management service system to obtain image features, and the obtained image features are stored in a corresponding storage database.

Specifically, in a practical manner, the acquisition of the face features includes position calculation of key points and face angle detection, and a plurality of received face pictures can be screened based on detection angles. In the step of acquiring the positions of the key points, a face area is firstly positioned in a face image, and then the key points are identified in the positioned face area. The key point identification can be carried out by a neural network, and the identified key points are accurately positioned after the initial positions of the key points are obtained. By accurately positioning the key point information, the description of the positions of the key points and the description of the distances between the key points, such as cosine distances and Euclidean distances, can be obtained, and corresponding face features can be obtained.

Referring to fig. 1, in step S110, while obtaining the live face features of the user for identity verification, the method further includes a step of obtaining the physical features of the user.

Please refer to fig. 4, which is a flowchart illustrating steps of obtaining a user appearance feature in the hotel authentication management method according to an embodiment of the present application.

In step S400, a target user on the scene is determined. The target user is the target user who performs identity verification on site, and the position area of the target user is obtained by performing target detection on the target user.

In some embodiments, the step of determining the target user of the scene comprises: and determining the target user according to the detection position of the target user on the spot or the limb behavior of the target user on the spot. The detection position of the target user on the spot can be sensed based on a sensor in the hotel, and the initial positioning of the position area of the target user is obtained, so that the subsequent body appearance image acquisition of the target user is facilitated. In one implementation, the process of obtaining the determination of the field location of the target user is performed in an identity verification state, a range for detecting the target user is pre-selected based on the location of the identity verification device, such as a foreground region or a self-help check-in device region, users in the region are screened, and the target user is determined by judging the distance range between the target user and the identity verification device or the foreground.

The method for determining the target user can also be obtained according to the action track of the target user, namely, the action of the target user is judged according to the limb action of the target user. In one implementation mode, a video containing a target user is obtained through a camera device, the target user who is performing or has performed identity verification is identified based on understanding of semantic content of images of one or more frames of the video, and the target user is determined as the target user who acquires the physical features in the subsequent steps.

In some embodiments, the surveillance camera may detect and locate the target user during the process of capturing images of the hotel lobby, for example, the surveillance camera including an image processing device or interfacing with a computing device having image processing capabilities.

In some embodiments, the step of determining the target user of the scene comprises: the method comprises the steps that a target user on site is determined through a monitoring camera device arranged in a hotel lobby, and the monitoring camera device is in communication connection with a PMS (permanent magnet system) of the hotel or an information management service system of a cloud.

The monitoring camera device obtains videos of live users in a hotel lobby area or other areas subjected to identity verification instantly, the videos are uploaded to a PMS (personal computer system) of the hotel or an information management server at the cloud side, and video image content processing is carried out on the videos, the PMS or the information management server is used for executing calculation processes such as graph segmentation, setting a positioning frame for an identified target user, carrying out image semantic understanding and the like, so that behavior content and position of each user in monitoring camera shooting are determined; and determining a corresponding target user needing to acquire the physical characteristics based on the action content of the object in the acquired video.

The camera device is a device for providing a two-dimensional or three-dimensional image according to a preset pixel resolution. Each three-dimensional image represents an obstacle image in a shot view field range by using depth data acquired by a preset pixel position, wherein the depth data of each pixel in each three-dimensional image comprises: angle information and distance information between each pixel point and the obstacle measurement point determined based on the position of each pixel in the three-dimensional image. Each two-dimensional image represents an obstacle image in a shot view field range by using color data acquired by a preset pixel position, wherein the color data of each pixel position in each two-dimensional image comprises: single color data or color data; such as grayscale data, R data, G data, B data, RGB data, or the like. Examples of the two-dimensional image include a Bayer image, an RGB image, a grayscale image, and the like. Here, the image pickup apparatus includes, but is not limited to: an image pickup device including a CCD, an image pickup device including a CMOS, an image pickup device including an area array depth measuring unit, an image pickup device (such as a ToF sensor) integrated with the area array depth measuring unit and an infrared sensor, and the like.

The image pickup device can be used for picking up one or more of a single image, a continuous image sequence, a discontinuous image sequence, a video and the like. In some embodiments, the mobile device stores the captured image in a local storage medium or transmits the captured image to an external device for storage, wherein the communication connection comprises a wired or wireless communication connection. The storage medium may include read-only memory, random-access memory, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, flash memory, a usb disk, a removable hard disk, or any other medium that can be used to store the desired program code in the form of instructions or data structures and that can be accessed.

The PMS system is a comprehensive management system of the hotel, typically a human-computer interaction system, and includes a computing device having a processing function and a human-computer interaction module, and in some embodiments, the PMS system is a cloud-based PMS system. The property content managed by the PMS system comprises hotel customer data, the current state of hotel business, the state of house resources and a series of operations for realizing dynamic business change such as guest reservation to check-in, financial reconciliation and the like. In some embodiments, the PMS system integrates a hotel back-office system, and may utilize hotel industry applications and property infrastructure equipment, as well as the hotel's preset integration of invoices for different service content.

The communication connection is a connection mode which establishes connection between different devices based on a certain communication protocol or other matching rules and realizes data transmission and information exchange, and comprises connection established by pairing identification information between a remote terminal and a target object terminal. The communication protocol is a rule to be followed for realizing communication or service between the devices, and the protocol defines the format of a data unit, the connection mode of an information unit and the sending and receiving time sequence of the information so as to ensure the identification and transmission of the information between the devices; the communication protocols include TCP/IP, NETBEUI and IPX/SPX. The identification information is used for determining attributes of different terminal devices, such as unique device identification codes, so as to determine that the connection terminal is correctly corresponding, and then realize data transmission between subsequent terminal devices.

In step S410, an image containing the target user in step S400 is acquired. And acquiring an image containing the target user based on the determined target user on the site. Including but not limited to visible light images, infrared images, depth images, and video or video frames.

In some embodiments, the step of acquiring the image of the target user is performed by a monitoring camera device disposed in a hotel lobby, after the target user is determined by an image processing device or a computing device connected to the monitoring camera device, the image acquired by the monitoring camera device is processed, an image frame including the target user is acquired in a video or an image including the target user is selected from a plurality of images, and the image including the target user is subjected to target segmentation for subsequent feature extraction of the target user.

In some embodiments, the PMS system of the hotel or the information management service system in the cloud selects an image containing the determined target user from the uploaded videos or images, and performs subsequent processing on the selected image. Specifically, the PMS system or the information management service system screens out, for a specific target user, an image or a video frame including the target user corresponding to the acquired image based on the on-site target user determined in step S400, and establishes an image library for the target user. For the images in the image library, images which are easy to perform feature extraction analysis of the target user can be selected optionally through quality evaluation, and parameters of the quality evaluation include but are not limited to image illumination, angle of the target user, image resolution, definition and the like.

In some embodiments, the monitoring camera device, the PMS system, or the information management service system performs object segmentation on the filtered image or video frame including the target user, obtains a location frame including the target user, and segments the location frame in the image through an area corresponding to the target user. In one implementation, in acquiring an image of a target user of a surveillance video, specifically, the surveillance video capturing apparatus, the PMS system, or the information management server may predict each frame of the video through key point prediction, and obtain a transformation parameter through comparing a template with a frame image to obtain an RIO (region of interest) for performing target segmentation, so as to obtain an image region corresponding to the target user; in addition, the target segmentation is to obtain a feature map corresponding to the frame image based on the feature extraction of the frame image of the video, and perform semantic segmentation based on the feature map to obtain a target segmentation result of the frame image.

In step S420, a physical feature of the target user is obtained from the image obtained in step S410, wherein the physical feature includes one or more of a clothing feature, a posture feature, a skin color feature, a hair feature, a gait feature, and a bursa feature. Specifically, the step of obtaining the physical characteristics may be performed by a camera device, a hotel PMS system, or a cloud information management service system.

The physical characteristics of the target user comprise static characteristics and dynamic characteristics of color characteristics, texture characteristics, shape characteristics and spatial relationship characteristics, can be used for indicating the visual characteristics presented by the target user in static and dynamic states, and can be embodied as quantifiable templates such as coordinates, vectors, RGB numerical values and the like for comparison. The physical characteristics comprise natural physical characteristics of the target user, such as externally visible characteristics of the face, the body type, the height, the human posture in different states and the like, and replaceable characteristics of clothing or carried objects of the user and the like.

The clothing features are overall clothing features of target users, including full-length clothing such as coats, trousers, shoes and the like, and personal detail accessories such as scarves and the like, and include shape features, color features, texture features and the like of clothing. Specifically, the clothing features are replaceable, namely, the clothing features are changed due to the clothing of the target user and have timeliness. In some embodiments, the target user's right to dress features has a certain timeliness; for example, in the permission rule corresponding to the clothing feature of the target user, the permission corresponding to the clothing feature of the target user is decreased after a set time interval with the feature acquisition time as a starting point.

In some embodiments, when the physical characteristics of the target user are obtained in step S420, the clothing characteristics of the target user are associated with other physical characteristics, such as the posture characteristics and the skin color characteristics of the user, and the clothing characteristics are not used as independent physical characteristics to determine the user authority, but are used as one of the physical characteristics for identification of the target user in different scenes.

The physical state features are visible outline features of the target user at different shooting angles, namely positions of key points of the body and spatial position relations among the key points, and bone key point information obtained through analysis, and the feature map templates corresponding to the physical state features can be used for distinguishing the target user with different physical parameters such as height, shape and human posture. The visible features of the shape include local features, global features, and contour features included in the image processing. The skeletal key point information is obtained by recognizing the motion of the human body posture, in certain implementation modes, image features are extracted from a single image, interframe optical flow track information is extracted from a plurality of images, and the recognized motion is obtained from the feature information and the optical flow track information based on a feature coding algorithm.

In some embodiments, the image of the target user acquired in step S410 is a visible light image and a depth map, and the key point information of the human skeleton is obtained through the depth information of the depth map and the shape information of the visible light map, so as to obtain the posture feature of the human body. Or, the image of the target user acquired in step S410 is an RGBD image, and the corresponding posture feature is obtained by processing the RGBD image.

The skin color feature mainly includes a color feature and a texture feature of the skin of the target user, and in some embodiments, the skin color feature may be one of determination conditions for identification of the target user. In one implementation, the skin color feature of the target user is data formed by quantifying skin color in a target user image obtained by a monitoring camera device. For example, the skin tone may be represented as RGB values, and the skin tone feature value is represented as a numerical distribution in a naked skin area of the target user; for the same target user, the skin color features may be represented as different values in different naked regions, such as the target user's face skin color value is different from the hand skin color value, or the skin color feature values in the face or hand region may be unevenly distributed, such as the skin color values at the forehead and cheek are different.

The hair features comprise the hair style and the hair color features of the target user, and specifically can be expressed as feature vectors of position relations between the position coordinates of key points and the shape key points of the hair of the target user, and the color features and the texture features of the hair color and the hair texture of different hair areas. The feature template formed by the hair features is obtained by the hair part of the target user under at least one shooting angle.

The gait characteristics are obtained based on the analysis of the motion state of the target user, generally, the gait characteristics corresponding to different individuals are different, and factors such as the muscle strength, the tendon and bone length, the bone density, the visual sensitivity, the coordination ability, the experience, the weight, the gravity center, the degree of damaged muscle or bone and the like of the target user influence different individuals to show different posture rules in the walking process. The gait features can represent the physical body types of the target users, such as height, leg bones, muscles, joints and other physiological features and walking postures, and therefore identity recognition comparison can be carried out on the basis of the body type parameters and the walking postures and the gait feature templates.

In some embodiments, the gait features are obtained by monitoring and shooting videos of the target user, or obtained according to images of multiple target users during walking, and the gait features are obtained by analyzing mainly on the basis of the law embodied in motion of human joints in the videos or images, and forming a gait template which can be used for identification of the target user.

In some embodiments, the Gait features are obtained based on a Gait Energy map (GEI), the pedestrian position is detected in a frame Image including a target user, the target is segmented to obtain a pedestrian mask or a pedestrian contour, a geometric fixed point is set or a geometric center is adopted to align the images, and then the masks of different frame images are added and averaged to obtain the Gait Energy map.

The bag-moving characteristic is the characteristic of carried objects such as luggage, packages, backpacks and the like carried by a target user in identity verification. The bag-moving feature is mainly used for being associated with other physical features of the target user, and different types of physical features are jointly used as authentication conditions for subsequent identification of the target user. The travel bag features comprise shape features, color features and texture features of the carried object. And based on the target user image acquired in the step S410, performing feature extraction on the travel bag type carried object of the target user to form a travel bag type feature template associated with the target user.

In some embodiments, in step S420, the method further includes a step of storing and marking the obtained physical characteristics of the target user in a database, and when the obtained physical characteristics are multiple, the multiple physical characteristics are associated with each other or have the same identification information, so as to ensure that different types of physical characteristics stored in the database belong to the same user for the same target user.

With continued reference to fig. 1, in step S120, after passing the identity verification of the user, the physical feature of the user is associated with the facial feature. Specifically, the face features are face features of a live face image of the user obtained in step S110, and after identity verification, the physical features obtained in step S110 are associated with the face features subjected to the identity verification of the user.

In one embodiment, the hotel PMS system or the information management service system adds identification information to the face features and the physical features subjected to identity verification, and the identification information can determine that the face features and the physical features belong to the same target user in corresponding order information.

In some embodiments, the hotel PMS system or the information management service system stores the facial and physical characteristics in the same data folder for association, forming a characteristics database with target user personally identifying information in step S120.

In some embodiments, the hotel PMS system or the information management service system binds the facial features and the physical features together to form a feature template for the target user.

In step S130, check-in information of the user is confirmed, the order status is updated, and at least one hotel right is authorized to the user, where the hotel right is associated with the face image or/and the physical feature.

After the identity verification, the service contents ordered by the user in the hotel, such as the type of the room entering, the time of the leaving, and the like, are checked, and the order state is updated from the preset state to the state of the room entering in the order system. The updating of the order status can be based on manual input or selection in the order system, or the status updating of the corresponding order is completed by the hotel PMS system or the information management service system after the identity verification is completed.

The hotel permission is an area use permission and a hotel article use permission for a target user to move in a hotel area, such as a door opening and closing permission for hotel rooms in a private area, a hotel elevator riding permission in a public area, and a use permission for a special service area, such as an access permission for a gymnasium, a swimming pool, a hotel restaurant and the like, and is mainly expressed in the form of whether the restriction of area access control, ladder access control and the like is allowed or not. The hotel permission is divided according to the regional setting of the hotel.

The hotel permission is a dynamic permission, namely a permission with certain timeliness. The permission of the target user for activities in the hotel is matched with the corresponding hotel service content in the order information, when the service content appointed by the target user is used, the permission can be ended, for example, the permission for opening the personal guest room is not provided after the service of the target user is returned. For example, the applicable permissions of the target user for the same area may change within the living time of the hotel, for example, the permission information changes with the service subscription condition of the target user at the hotel, when the target user extends the check-in period in the hotel check-in period, the permission of the hotel permission for the target user for the use of the hotel area and the use of hotel articles is extended accordingly.

And the step of granting at least one hotel permission to the user is continued until the user checks the identity of the user and checks the identity of the user, and different hotel permission information is granted to the user corresponding to the use of the user in different areas of the hotel during the activity of the user in the restaurant.

In some embodiments, the hotel permission is synchronized with the order information, and when the order information is updated, the hotel permission is also updated. In some embodiments, the hotel permission information includes the identity information of the target user or other order information such as the corresponding order number, and the corresponding hotel permission information can be acquired by retrieving the order information, and then the hotel permission information is associated with the face feature or the body feature of the target user, or the hotel permission information is associated with the face feature or the body feature of the target user. Wherein the face feature and the feature have been correlated in step S120.

In some embodiments, the step of associating the hotel permission with the face image or/and the physical feature is implemented by a PMS system or an information management server of the hotel.

The hotel permission and face image or/and physical feature association mode comprises the steps that the face image or the physical feature is set as a judgment condition in the hotel permission, the face image or/and the physical feature is used as a feature template for authorization judgment, and when the similarity of the face image or the physical feature of a subsequently received image and the feature template exceeds a set threshold, the user in the image is granted the corresponding hotel permission. And for different types of physical features and face images in the feature template, the use authorities of different hotel areas can be respectively associated, and the threshold value for similarity judgment is independently set.

In some embodiments, the authorizing the at least one hotel authority to the user includes sending authorization information to a terminal device of the user, where the authorization information includes text information or two-dimensional code information.

In some implementations, the authorization information is sent by the hotel PMS system or the information management service system to the terminal device of the user. And the terminal equipment of the user is in communication connection with the hotel PMS system or the information management service system. Specifically, the mobile device of the user may be associated with the hotel PMS system or the information management service system in advance by connecting to Wi-Fi, bluetooth, or by registering. For example, when the user makes a reservation on a room reservation platform provided by a hotel, the user associates the identification information (e.g., name, mobile phone number, identification number, etc.) including the user, the identification information (e.g., IP address, MAC address, etc.) of the mobile device used for performing the current reservation operation, and a hotel area corresponding to order information in the hotel PMS system or the information management service system.

The terminal device refers to a terminal of which the far end needs to be accessed to a transmission network, and is generally a client (an initiating terminal), and the device types include ATM, POS, network terminals and the like; an apparatus for inputting a program and data to a computer or receiving a result of processing by the computer via a communication facility is generally a general-purpose computer input/output apparatus with a communication processing control function attached thereto, and includes a communication interface control device and a dedicated or selected input/output device. Generally alternative input and output devices are: keyboards, card readers, paper tape readers, optical character or mark identifiers, speech recognizers, serial or line printers, displays, card punches, paper tape punches, speech synthesizers, floppy disks, tape drives, disk drives, and the like. The terminal equipment comprises portable terminal equipment and wearable equipment, such as an interactive terminal with a communication processing function, such as a smart phone and a smart watch.

Generally, the portable terminal device further includes a removable storage medium or memory, a user interface, a device ID, and in some embodiments, the terminal device may communicate with the hotel PMS system or the information management service system through a loaded application.

The authorization information is decoding information or unlocking information required by activities in the hotel area, and is used for releasing regional access control and ladder control or determining the opening state of the area and unlocking the use of hotel articles such as a storage box.

After the permission of the hotel is granted to the target user based on the human body image or/and the physical signs, the permission of the hotel is granted by sending authorization information to the terminal equipment of the target user. The text information of the authorization information comprises one or a combination of several of various optical characters such as Arabic numerals, language characters such as Chinese characters, English letters, Greek letters, special symbols and the like. The two-dimension code information is mainly a recognizable bar code image, and the input equipment or the photoelectric scanning equipment can read the authorization information through recognizing the two-dimension code image and realize automatic information processing, so that the granted information can be authenticated.

In some embodiments, the authorizing the at least one hotel authority to the user includes sending authorization information to a terminal device of a hotel manager, where the authorization information includes text information or two-dimensional code information. The terminal equipment of the hotel manager comprises portable terminal equipment, network terminals and the like with display interfaces or equipment capable of reading information. In some embodiments, after the target user completes the identity verification, the hotel manager receives the corresponding authorization information, and the target user obtains the authorization information from the hotel manager.

In some implementations, the authorization information is sent by the hotel PMS system or the information management service system to a terminal device of a hotel manager. And the terminal equipment of the hotel manager is in communication connection with the hotel PMS system or the information management service system.

In some embodiments, the manner of authorizing the user for at least one hotel privilege comprises sending authorization information to at least one authentication device of the hotel, the authentication device comprising: one or more of a room door lock, a room electricity-taking switch, an elevator floor control device and a hotel article control device. In some implementations, the authorization information is sent by the hotel PMS system or the information management service system to an authentication device, and the authentication device is in communication connection with the hotel PMS system or the information management service system.

The authentication equipment of the hotel is arranged in different areas of the hotel and used for verifying whether the user has the right of activity in the corresponding area. By sending the authorization information to the authentication device, the subsequent authentication can be continuously realized. After receiving the authorization information, the authentication device can correspondingly change the restrictions of regional access control, elevator access control and the like into an open state.

The authentication equipment comprises one or more of a room door lock, a room power-taking switch, an elevator floor control device and a hotel article control device. The room door lock comprises a hotel guest room door lock and a public area activity room such as a gymnasium, a swimming pool, a hotel court and an entertainment room door lock, and can be unlocked for a target user after authorized information is obtained. In some embodiments, the unlocked state of the room door lock is time-efficient, and the room door lock returns to the disabled state after a certain set length of time after authorization without opening the room door.

The room power-taking switch is an indoor power supply control device, and in some embodiments, the power-taking switch receives authorization information and adjusts an indoor power supply to be in a power-taking state.

The elevator floor control device is a control device used by the elevator, such as forbidden elevator, and when the elevator floor control device receives authorization information, the elevator can be correspondingly changed into an open state or a standby use state. In some embodiments, the authority information received by the elevator floor control device includes floor information corresponding to the user's room, for example, after the order status is changed to the check-in status, the elevator floor control device sets the arrival floor as the default user's room floor number in the authorization process of the elevator floor control device based on the room floor information in the user's order information.

The hotel article control device comprises a control device of equipment in a hotel room, such as an indoor safety box and a storage box, and also comprises an article control device of public areas of the hotel outside the room, such as clothes cleaning equipment, drying equipment and the like. In some embodiments, the order information includes usage ordering information for hotel supplies, the hotel PMS system or the information management service system grants a usage right to a target user corresponding to the order based on the usage ordering information for the hotel supplies in the order information, and after user identity verification is completed, authorization information is sent to the hotel supply control device, and the hotel supply control device identifies and authenticates the authorization information and changes the authorization information into a usable state.

In some embodiments, the hotel privilege comprises a first privilege and a second privilege.

The first authority is related to the face image, or the first authority is related to the face image and the physical feature. Specifically, the first authority takes the face image or the face image and the physical characteristics as a judgment condition, and in subsequent authentication, the authority for using the hotel area or the hotel articles corresponding to the first authority needs to acquire the face image or the face image and the physical characteristics as a judgment standard for judging whether to send authorization information.

In some embodiments, because the face image and the physical features can be simultaneously used as the authentication condition of the first authority, when the face image and the physical features are collected, the requirement for the face image can be correspondingly reduced, and the subsequent authentication can be completed. For example, the face image features and the body features obtained by processing the live images are compared with the face image features and the body features in the feature template in the user identity verification stage, and the user identity of the live images is jointly judged based on the similarity respectively corresponding to the two kinds of features so as to determine whether to send the authorization information.

The second authority is related to the face image or the physical feature image, and specifically, the region to which the second authority is applicable can be judged whether to send the authorization information after the face image or the physical feature image is obtained in the authentication. Therefore, in practical use, the amount of calculation required by the authentication device corresponding to the second authority in authentication is reduced or the identification speed is faster,

if the first authority has to use the face image as a judgment to judge whether to send the authorization information, the identification result of the target user identity obtained by the judgment rule of the first authority has higher confidence coefficient than the identity identification result under the second authority.

In some embodiments, the first privilege applies to at least one hotel service privilege of door unlock, VIP service area, conference room, restaurant, and bar.

The area corresponding to the first right is an area with higher security level or higher user privacy, such as a user house area corresponding to a guest room door lock, a storage area of a safe in a hotel room, or a service area for special ordering, such as a VIP service area, a conference room, a restaurant and a bar, and is mainly characterized in that identity information of a user needs to be determined to obtain a scene of ordering content of the hotel service corresponding to the order.

In some scenarios, the authentication of the bar area consists in an identity confirmation of the target user to obtain information such as the age of the target user to determine whether to open the bar area for the target user.

The second permission is applicable to at least one hotel service permission of an elevator, a body-building activity area, a leisure activity area, a parent-child activity area, a reading room and a laundry. The area where the second right is applicable is mainly a public area which can be used by a preset common user for check-in of the hotel, for example, after the hotel checks in an ordering room, the hotel enjoys the use of areas such as a fitness activity area and a reading room in the check-in package, and a necessary use area such as an elevator for passage in the hotel.

In some embodiments, each region in the hotel is provided with a monitoring camera device, so that the human body image is easy to collect, and the authentication condition corresponding to the second authority is low, if the authentication condition is low, the judgment can be carried out only by the physical and physical characteristics, so that the applicable region of the second authority can easily reach the judgment condition in the authentication, and the authentication speed is high.

In summary, based on the hotel authentication management method provided by the first aspect of the present application, the identity verification and authentication can be performed on the user quickly in the hotel service; based on the service ordering content of the user in the hotel, the use authority of the user to each area or service is determined by taking the face characteristics and the physical features of the user image as judgment conditions, the hotel intelligent management is carried out by taking the image characteristics as authentication conditions, the identity of the user is rapidly identified, and the authentication reliability is improved; different judgment rules are set for different areas and services of the hotel, the accuracy required by the safety and identity judgment of each area is ensured, and the maintenance on the safety of the user and the safety of the hotel is further increased.

In a second aspect, the present application further provides a hotel PMS system, please refer to fig. 5, which is a simplified schematic structural diagram of an embodiment of the hotel PMS system of the present application. As shown in the figure, the PMS system includes a query unit 11, an identity authentication unit 12, an association unit 13, and an authorization unit 14.

The hotel PMS system is a comprehensive management system of a hotel, generally a human-computer interaction system, and includes a computing device having a processing function and a human-computer interaction module. The property content managed by the PMS system comprises hotel customer data, the current state of hotel business, the state of house resources and a series of operations for realizing dynamic business change such as guest reservation to check-in, financial reconciliation and the like. In some embodiments, the PMS system integrates a hotel back-office system, and may utilize hotel industry applications and property infrastructure equipment, as well as the hotel's preset integration of invoices for different service content.

In an embodiment, the hotel PMS system generally communicates with the cloud service system through an OTA (Online Travel Agent) platform, and in an actual implementation scenario, the hotel may also be a hotel merchant registered or resident on the OTA platform.

In a specific application scenario, the querying unit 11, the identity authentication unit 12, the association unit 13, and the authorization unit 14 may be software modules or devices, and these software modules or devices may be deployed on a server, or a virtual machine on the server, or a container on the server. In addition, the software modules may be deployed on the same server or different servers according to actual needs, but are not limited to the above examples.

The query unit 11 is configured to query the obtained matched order information according to the obtained predetermined information.

In some embodiments, the query unit directly queries the corresponding order in the hotel management system according to the order number.

In some embodiments, the hotel PMS system further includes an interface unit 17, connected to the information management server configured at the cloud, for acquiring the order information sent by the information management server.

Specifically, in some embodiments, the order system is disposed in the cloud information management server, and the hotel PMS system realizes data transmission with the cloud information management server through the interface unit. Based on the interface unit 17, the corresponding order information can be retrieved from the information management server in the cloud.

The hotel cloud information management server provides data and data storage and operation space by means of a network or the internet, system work comprises information collection, transmission, processing and storage, cloud computing and cloud storage technologies are used as supports, and the hotel cloud information management server is an integral management and operation system of a cloud computing background data center.

In some embodiments, the Cloud-based information management Service server, for example, a Cloud-based server, includes a Public Cloud (Public Cloud) server and a Private Cloud (Private Cloud) server, where the Public or Private Cloud server includes Software-as-a-Service (SaaS), Platform-as-a-Service (PaaS), Infrastructure-as-a-Service (IaaS), and the like. The private cloud service end is used for example for a Mei Tuo cloud computing service platform, an Array cloud computing service platform, an Amazon cloud computing service platform, a Baidu cloud computing platform, a Tencent cloud computing platform and the like. The server may also be formed by a distributed or centralized cluster of servers. For example, the server cluster is composed of at least one entity server. Each entity server is provided with a plurality of virtual servers, each virtual server runs at least one functional module in the hotel information management server, and the virtual servers are communicated with each other through a network.

The identity authentication unit 12 is configured to perform user identity verification according to the obtained face features. The identity authentication unit 12 has an image processing function, and can obtain corresponding image features based on images or videos or directly read feature templates. The identity authentication unit 12 obtains an identity verification result by pre-storing the face features corresponding to the on-site user image.

The method for acquiring the on-site human face image features by the identity authentication unit 12 comprises a knowledge-based characterization method and an algebraic feature or statistical learning-based characterization method, and the information management service system of the cloud performs feature calculation and extraction. Specifically, in an implementation manner, the information management service system describes and acquires feature data, such as distances, curvatures, angles and the like between features, of a face organ shape description and an organ in a face image acquired on site, takes geometric description of a structural relationship between the local parts and the local parts as face features, compares the acquired feature data with a pre-stored face feature template in stored data, and outputs pre-stored face features of which similarity thresholds exceed set thresholds in the stored data, thereby acquiring an identity information judgment result of a face on site.

The on-site face image of the user is the face image of the user obtained in the stage of order matching and business determining before the user enters the hotel, such as the face image obtained at the hotel check-in front desk. Specifically, the on-site human face image of the user can be acquired by an image acquisition device, and the image acquisition device can be a camera device, a monitoring device or a human face recognition intelligent device comprising a camera module.

The live images of the same user can be multiple images, and the live images of the same user can be stored as face feature image templates of the same user under different conditions of changing in the class after image processing.

The scene face image is at least one image containing the face of the user or a frame intercepted by the image containing the face of the user, when the face images are multiple or multiple frames, the multiple face images can be the face images of the user under different shooting angles and different illumination conditions.

In some embodiments, the pre-stored face features are pre-stored face features within a hotel PMS system. The pre-stored face features may set a certain storage rule, and in some embodiments, for a user having a consumption history in a hotel, the pre-stored face features may include a live face image feature acquired by the user in order verification each time in a business history, or may be updated in compliance with a user's stay history in the hotel, for example, the pre-stored face features are set as the live face image features of the user acquired in the latest consumption history, that is, the information management service system in the cloud is updated in compliance with the acquisition time coverage of the user's face features. In some embodiments, the pre-stored face features are further provided with a constraint rule of a retention time duration, and if a time interval between a current verification stage and a previous consumption in a service history is greater than a preset time threshold for the same user who consumes for multiple times, the pre-stored face images cannot be used for matching again, so that inaccurate matching or errors caused by changes of the face features after the time interval are avoided.

In some embodiments, the pre-stored facial features are obtained based on credential information in the user's subscription information. Specifically, the hotel PMS system is in butt joint with a public security system port corresponding to a certificate system such as an identity card or a passport, face information in certificate information of the public security system can be acquired based on the certificate information in the user reservation information, feature extraction is performed on the face information in the certificate information, and pre-stored face features are acquired to be matched with on-site face images.

The user certificate information is user certificate information acquired on the spot based on a certificate entity provided by the user, such as certificate information of an identity card. In some embodiments, the acquisition of the on-site face image and the reading of the document information are simultaneously achieved based on a human-image verification device, a data platform of the human-image verification device is connected with the information management service system, and the feature extraction calculation of the on-site face image and the document image can be performed by the human-image verification device, or the feature extraction can be performed after the identity authentication unit 12 receives the image data.

The face image information in the certificate information is obtained based on a public security system database connected with a port of an information management service system, after the certificate identification code is read or identified, the identification code in the obtained certificate information is uploaded to the information management service system, the information management service system obtains corresponding certificate information comprising the face image in the public security system database by taking the identification code as a retrieval condition, and meanwhile, the certificate information obtained in the public security system is also used for being compared with entity certificate information of a user, such as name verification. And carrying out image processing on the retrieved face image to obtain a feature template for comparing the on-site face image.

The identity authentication unit 12 performs feature extraction processing on the received face image, and performs search comparison with a pre-stored face feature template in the storage data of the management system based on the extracted image features to obtain matched pre-stored face features.

The face features comprise feature vectors which are obtained by detecting key points of the face and are connected with the key point coordinates in series, local features of all the key points and texture features of face regions. In some embodiments, the facial features include inter-class variations and intra-class variations. The inter-class variation is the difference of the face features of different people, such as different face feature templates prestored in a hotel PMS system; the intra-class features are differences between faces of the same individual under different conditions, such as feature differences caused by changes of conditions such as different expression states, hairstyles, ambient lighting conditions and the like. The face features pre-stored in the hotel PMS system comprise face features of different users in historical data, and for each user, the pre-stored face features comprise face features of the users changing within the category.

In one implementation, the step of acquiring the human face features based on the image by the identity authentication unit 12 includes: and calculating the positions of the key points and detecting the face angles, and screening a plurality of received face pictures based on the detection angles. In the step of acquiring the positions of the key points, a face area is firstly positioned in a face image, and then the key points are identified in the positioned face area. The key point identification can be carried out by a neural network, and the identified key points are accurately positioned after the initial positions of the key points are obtained. By accurately positioning the key point information, the description of the positions of the key points and the description of the distances between the key points, such as cosine distances and Euclidean distances, can be obtained, and corresponding face features can be obtained.

In one implementation, the identity authentication unit 12 obtains feature data, such as distances, curvatures, angles, and the like between feature points, from the description of the shape of a face organ and the description of the distance between organs in a face image obtained in the field, and takes geometric description of the structural relationship between local parts as the face features, then compares the obtained feature data with a pre-stored face feature template in stored data, and outputs pre-stored face features in the stored data, in which a similarity threshold exceeds a set threshold, thereby obtaining the result of determining the identity information of the face in the field.

The identity authentication unit 12 compares the pre-stored face features with the face features of the field face image, if the similarity exceeds a set threshold value, and the matching result is confirmation, the identity verification result of the target user is set to pass verification, and in some embodiments, after the user identity verification passes, the identity authentication unit 12 further updates the corresponding successfully matched pre-stored face features in the historical data by using the face features of the field face image passing verification. And the updated face features are stored in the hotel PMS or a cloud information management server which is in butt joint with the hotel PMS through an interface unit.

In some embodiments, the identity authentication unit 12 may further send the identity verification result to a hotel foreground or a hotel self-help check-in device or a terminal device connected to the hotel PMS system in a communication manner or an information management server configured in a cloud based on the connection of the interface unit 17.

The association unit 13 is configured to associate the obtained physical characteristics of the user with the facial characteristics after passing the user identity verification.

The physical characteristics of the user are acquired based on the field user image shot by the camera device, and specifically, the physical characteristics can be extracted from the field image by the camera device or a hotel PMS system or a cloud information management server. Wherein the physical characteristics include one or more of clothing characteristics, posture characteristics, skin color characteristics, hair characteristics, gait characteristics, and bursa characteristics.

In some embodiments, when obtaining the physical characteristics of the target user, the processing unit or the camera device in the hotel PMS system associates the clothing characteristics of the target user with other physical characteristics such as the posture characteristics and the skin color characteristics of the user, and the clothing characteristics are not used as independent physical characteristics to determine the user authority, but are used as one of the physical characteristics for identifying the target user in different scenes.

In some embodiments, the image of the target user acquired by the camera device in the user identity verification process is a visible light image and a depth map, and the key point information of the human skeleton is obtained through the depth information of the depth map and the shape information of the visible light map to obtain the posture characteristics of the human body. Or, the image of the target user acquired by the camera device in the user identity verification process is an RGBD image, and the corresponding posture characteristic is obtained by processing the RGBD image.

In some embodiments, the Gait features are obtained based on a Gait Energy map (GEI), the pedestrian position is detected in a frame Image including a target user, the target is segmented to obtain a pedestrian mask or a pedestrian contour, a geometric fixed point is set or a geometric center is adopted to align the frame Image, and then the masks of different frame images are added and averaged to obtain the Gait Energy map.

The bag-moving characteristic is the characteristic of carried objects such as luggage, packages, backpacks and the like carried by a target user in identity verification. The bag-moving feature is mainly used for being associated with other physical features of the target user, and different types of physical features are jointly used as authentication conditions for subsequent identification of the target user. The travel bag features comprise shape features, color features and texture features of the carried object. And performing feature extraction on the travel capsule type carrying object of the target user based on the target user image acquired in the identity verification process to form a travel capsule type feature template associated with the target user.

In some embodiments, after the camera device, the hotel PMS system, or the cloud information management server obtains the physical characteristics, the method further includes the step of storing and marking the obtained physical characteristics of the target user in a database, and when the obtained physical characteristics are multiple, the multiple physical characteristics are associated with each other or have the same identification information, so as to ensure that different types of physical characteristics stored in the database belong to the same user for the same target user.

After the identity verification, the association unit 13 associates the physical features in the identity verification stage with the human face features subjected to the identity verification by the user.

In one embodiment, the association unit 13 adds identification information to the identity verified face feature and the physical feature, and the identification information can determine that the face feature and the physical feature belong to the same target user in the corresponding order information.

In some embodiments, the association unit 13 stores the facial features and physical features in the same data folder for association to form a feature database with personal identification information of the target user.

In some embodiments, the association unit 13 binds the facial features and physical features together to form a feature template for the target user.

The authorization unit 14 is configured to confirm check-in information of a user and update an order status, and authorize at least one hotel right to the user, where the hotel right is associated with the face image or/and the physical feature.

After the identity verification, the service contents such as the type of a room, the time of the room, the time of leaving, etc. ordered by the user at the hotel can be checked at the hotel reception desk, and the authorization unit 14 updates the order status from the predetermined status to the check-in status in the order system. The updating of the status of the orders may be based on manual input or selection in the order system, whereby the authorization unit completes the status update of the respective order.

The hotel permission is a dynamic permission, namely a permission with certain timeliness. The permission of the target user for performing activities in the hotel is matched with the corresponding ordering content in the order information, when the service content appointed by the target user is used, the permission can be ended, for example, the target user does not have the opening permission for the personal guest room after handling the room returning. For example, the applicable permissions of the target user for the same area may change within the living time of the hotel, for example, the permission information changes with the service subscription condition of the target user at the hotel, when the target user extends the check-in period in the hotel check-in period, the permission of the hotel permission for the target user for the use of the hotel area and the use of hotel articles is extended accordingly.

The step of granting the user at least one hotel permission continues until the user checks the identity of the user and checks the check-in process, and the authorization unit 14 grants different hotel permission information to the user corresponding to the user's use of different areas of the hotel during the user's activity in the restaurant.

In some embodiments, the hotel permission is synchronized with the order information, and when the order information is updated, the hotel permission is also updated. In some embodiments, the hotel permission information includes the identity information of the target user or other order information such as the corresponding order number, and the corresponding hotel permission information can be acquired by retrieving the order information, and then the associating unit associates the hotel permission information with the face feature or the body feature of the target user, or associates the hotel permission information with the face feature or the body feature of the target user. Wherein the face feature and the feature are correlated by the correlation unit.

The authorization unit 14 performs authorization in a manner including: and when the similarity between the subsequently received image and the face image or the body feature of the feature template exceeds a set threshold, the user in the image is granted with the corresponding hotel authority. The authorization unit can set rules of feature comparison, for example, for different types of physical features and facial images in the feature template, the usage rights of different hotel areas can be respectively associated, and thresholds for similarity judgment are independently set.

Specifically, the manner of granting the user at least one hotel right by the authorization unit 14 includes sending authorization information to the terminal device of the user, sending authorization information to the terminal device of the hotel manager, and sending authorization information to the hotel authentication device. For specific implementation, reference may be made to the corresponding implementation in the embodiment shown in fig. 1, which is not described herein again.

In some embodiments, the hotel PMS system further comprises a recording unit 15 for recording a usage log of the at least one hotel right when the user uses the authorized at least one hotel right. The recording unit selects to store events related to hotel permissions. The event is mainly the use condition of the hotel authority, and includes but is not limited to the unlocking condition, time, user position, authentication equipment information for authentication, shooting device information for obtaining images, images of the user in different areas of the hotel for hotel authority verification and obtained based on image extraction, hotel authority historical records updated based on order information, and the like when the user is granted the hotel authority to unlock areas or hotel articles.

In some embodiments, the hotel PMS system further includes an interface unit 16, connected to the at least one camera device disposed on the hotel site, for acquiring the facial image of the user or the physical feature of the user acquired by the at least one camera device. The interface unit may be used to enable information transfer between different devices, modules, or systems.

In some embodiments, the at least one camera is configured at a designated authentication location of the hotel, the designated authentication location including one or more of an elevator hall, a room doorway, a VIP service area, a conference room, a restaurant, a gym, a recreational activity area, a parent activity area, a reading room, and a laundry room.

In some embodiments, the designated authentication location is determined by the hotel PMS system, and a correspondence between hotel areas and camera devices is formed based on the selected authentication location, and each authentication device is determined to be in the view frame of the camera device. For example, the authentication positions inside and outside the elevator correspond to different camera devices respectively, and images of the inside and outside areas of the elevator door are obtained respectively to determine the forbidden state of the elevator; as another example, a plurality of authentication positions may be provided in the laundry room to correspond to different laundry devices.

In some embodiments, the authorization unit 14 is communicatively connected to a plurality of authentication devices in the hotel, the authentication devices including: one or more of a room door lock, a room electricity-taking switch, an elevator floor control device and a hotel article control device.

The authentication device takes the authority information sent by the authorization unit 14 as a prohibition condition, usually, at least a camera device at the designated authentication position obtains a face image or/and a whole body image of a user, and performs feature extraction on the image or transmits the image to a hotel PMS for feature acquisition, and the authorization unit compares the obtained features with a pre-stored special template based on a preset judgment rule, thereby sending authorization information to the authentication device corresponding to the camera device.

The room door lock comprises a hotel guest room door lock and a public area activity room such as a gymnasium, a swimming pool, a hotel court and an entertainment room door lock, and can be unlocked for a target user after authorized information is obtained. In some embodiments, the unlocked state of the room door lock is time-efficient, and the room door lock returns to the disabled state after a certain set length of time after authorization without opening the room door.

The hotel article control device comprises a control device of equipment in a hotel room, such as an indoor safety box and a storage box, and also comprises an article control device of public areas of the hotel outside the room, such as clothes cleaning equipment, drying equipment and the like. In some embodiments, the order information includes usage ordering information for hotel supplies, the authorization unit grants a usage right to a target user corresponding to the order based on the usage ordering information for the hotel supplies in the order information, and after user identity verification is completed, the authorization information is sent to the hotel supply control device, and the hotel supply control device identifies and authenticates the authorization information and changes the authorization information into a usable state.

In some embodiments, the hotel permission comprises a first permission and a second permission, the first permission is related to a face image, or the first permission is related to the face image and a physical feature; the second authority is related to a face image or a physical feature image, and the first authority is higher than the second authority.

In some embodiments, the first jurisdiction is applicable to at least one hotel service jurisdiction for door unlocking, a VIP service area, a conference room, a restaurant, and a bar, and the second jurisdiction is applicable to at least one hotel service jurisdiction for an elevator, a fitness activity area, a leisure activity area, a parent-child activity area, a reading room, and a laundry room.

The area where the second right is applicable is mainly a public area which can be used by a preset common user for check-in of the hotel, for example, after the hotel checks in an ordering room, the hotel enjoys the use of areas such as a fitness activity area and a reading room in the check-in package, and a necessary use area such as an elevator for passage in the hotel.

In a third aspect, the present application further provides a self-service check-in system for a hotel, please refer to fig. 6, which is a simplified schematic structural diagram of an embodiment of the self-service check-in system for a hotel of the present application. As shown in the figure, the hotel self-service check-in system includes a camera 21 and a self-service registration device 22.

The camera device 21 is used for acquiring a video or an image of a hotel check-in site, wherein the video or the image contains the physical characteristics of a target user. In one implementation, the camera 21 is disposed in a hotel lobby, and the camera 21 is configured to obtain an image of an identity verification stage performed by a user before the user enters the hotel lobby. The self-service registration device 22 is in communication connection with the camera device 21, and the camera device 21 can transmit live images or videos or processed image data based on instructions of the self-service registration device 22.

The self-service registration device 22 comprises: an inquiry unit 221, a face recognition unit 222, an association unit 223, and an authorization unit 224.

The query unit 221 is configured to query the obtained reservation information to obtain matched order information; the face recognition unit 222 is configured to obtain a field face image of a target user for performing user identity verification matching with the order information; specifically, please refer to fig. 1 for the embodiment, which shows similar principles and technical effects, and will not be described herein again.

The associating unit 223 is configured to associate the obtained physical characteristics of the user with the face image after passing the user identity verification. The physical characteristics are obtained by processing an image or an image including the user obtained in the user identity verification stage, and specifically, the physical characteristics and the obtaining mode thereof include any one of the embodiments shown in fig. 4, which is not described herein again.

In one embodiment, the associating unit 223 adds identification information to the identity verified face feature and the physical feature, and the identification information can determine that the face feature and the physical feature belong to the same target user in the corresponding order information.

In some embodiments, the association unit 223 stores the facial features and physical features in the same data folder for association to form a feature database with the target user's personal identification information.

In some embodiments, the associating unit 223 binds the facial features and physical features together to form a feature template for the target user.

The authorization unit 224 is configured to confirm the check-in information of the user and update the order status, and authorize at least one hotel right to the user, where the hotel right is associated with the face image or/and the physical feature.

After the identity verification, the service contents such as the type of a room, the time of the room, the time of leaving, etc. ordered by the user at the hotel may be checked at the hotel reception desk, and the authorization unit 224 updates the order status from the predetermined status to the check-in status in the order system. The updating of the status of the orders may be based on manual input or selection in the order system, whereby the authorization unit completes the status update of the respective order.

The step of granting the user at least one hotel permission continues until the user checks the identity of the user and checks the check-in process, and the authorizing unit 224 grants the user different hotel permission information corresponding to the user's use of different areas of the hotel during the user's activity in the restaurant.

The authorization unit 224 performs authorization in a manner including: and when the similarity between the subsequently received image and the face image or the body feature of the feature template exceeds a set threshold, the user in the image is granted with the corresponding hotel authority. The authorization unit can set rules of feature comparison, for example, for different types of physical features and facial images in the feature template, the usage rights of different hotel areas can be respectively associated, and thresholds for similarity judgment are independently set.

In particular, the manner of granting the user with at least one hotel right by the authorization unit 224 includes sending authorization information to the terminal device of the user, sending authorization information to the terminal device of the hotel manager, and sending authorization information to the hotel authentication device. For specific implementation, reference may be made to the corresponding implementation in the embodiment shown in fig. 1, which is not described herein again.

In some embodiments, the authorization unit 224 is communicatively connected to a plurality of authentication devices in the hotel, the authentication devices including: one or more of a room door lock, a room electricity-taking switch, an elevator floor control device and a hotel article control device.

The authentication device takes the authority information sent by the authorization unit 224 as a prohibition condition, usually, at least a camera device at a designated authentication position acquires a face image or/and a whole body image of a user, and performs feature extraction on the image or transmits the image to a hotel PMS for feature acquisition, and the authorization unit compares the acquired features with a pre-stored special template based on a preset judgment rule, thereby sending authorization information to the authentication device corresponding to the camera device. The designated authentication location comprises one or more of an elevator room, an elevator, a room doorway, a VIP service area, a conference room, a restaurant, a gym, a leisure activity area, a parent-child activity area, a reading room and a laundry.

The camera device 21 and the self-service registration device 22 cooperate to perform order management, check-in identity, and intelligent authentication for check-in to and exit from a store for a user, and in particular, please refer to the embodiment described with reference to fig. 5, which has similar principles and technical effects, and will not be described herein again.

In a fourth aspect, the present application further provides a hotel security management system, please refer to fig. 7, which is a simplified schematic structural diagram of the hotel security management system according to an embodiment of the present application. As shown, the hotel security management system includes: a first camera 31, a second camera 32, and a hotel PMS system 33 or a self-service check-in device 34.

The first camera device 31 is arranged at a hotel check-in site and used for acquiring a video or an image of the hotel check-in site, wherein the video or the image contains the physical characteristics of a target user; the second camera device 32 is arranged at an authentication position designated by a hotel and used for acquiring the physical characteristics of a target user in the authentication position; the hotel PMS system 33 is the hotel PMS system as described in the embodiment shown in fig. 5, and the self-service registration device 34 is the self-service registration device as described in the embodiment shown in fig. 6.

In some embodiments, the authentication location specified by the hotel includes one or more of an elevator hall, a room doorway, a VIP service area, a conference room, a restaurant, a gym, a recreational activity area, a parent-child activity area, a reading room, and a laundry room.

In some embodiments, the hotel security management system further comprises a plurality of authentication devices 35 disposed in the hotel and communicatively coupled to the PMS system or the self-service check-in device, the authentication devices 35 comprising: one or more of a room door lock, a room electricity-taking switch, an elevator floor control device and a hotel article control device.

In some embodiments, the authentication device 35 is communicatively connected to the hotel PMS system 33 or the self-service check-in device 34. The authentication device 35 uses the authority information sent by the hotel PMS system 33 or the self-service registration device 34 as a prohibition condition, generally, at least a camera device at the designated authentication position obtains a face image or/and a whole body image of the user, and performs feature extraction on the image or transmits the image to the hotel PMS system 33 or the self-service registration device 34 for feature acquisition, and the hotel PMS system 33 or the self-service registration device 34 compares the obtained features with a pre-stored special template based on a preset judgment rule, thereby sending the authorization information of the hotel authority to the authentication device 35 corresponding to the second camera device 32.

Specifically, after the identity verification, the service contents ordered by the user in the hotel, such as the type of a room entering, the time of the leaving, and the like, may be checked at the hotel reception desk, and the hotel PMS system 33 or the self-service registration device 34 updates the order state from the predetermined state to the state of the room entering in the order system. The updating of the status of the orders may be based on manual input or selection in the order system, whereby the authorization unit completes the status update of the respective order.

The step of granting the user at least one hotel permission continues until the user checks the identity of the user and checks the check-in process, and the hotel PMS system 33 or the self-service registration device 34 grants different hotel permission information to the user corresponding to the user's use of different areas of the hotel during the user's activities in the restaurant.

The authorization method of the hotel PMS system 33 or the self-service registration device 34 includes: and when the similarity between the subsequently received image and the face image or the body feature of the feature template exceeds a set threshold, the user in the image is granted with the corresponding hotel authority. The authorization unit can set rules of feature comparison, for example, for different types of physical features and facial images in the feature template, the usage rights of different hotel areas can be respectively associated, and thresholds for similarity judgment are independently set.

In particular, the manner in which the hotel PMS system 33 or the self-service check-in device 34 grants at least one hotel right to the user includes sending authorization information to the terminal device of the user, sending authorization information to the terminal device of the hotel manager, and sending authorization information to the hotel authentication device. For specific implementation, reference may be made to the corresponding implementation in the embodiment shown in fig. 1, which is not described herein again.

The second authority is related to the face image or the physical feature image, and specifically, the region to which the second authority is applicable can be judged whether to send the authorization information after the face image or the physical feature image is obtained in the authentication. Therefore, in practical use, the amount of calculation required for authentication by the authentication device 35 corresponding to the second authority is reduced or the identification speed is faster,

Specifically, the first camera device 31, the second camera device 32, the authentication device 35, the hotel PMS system 33, or the self-service registration device 34 perform information processing on the whole process of service reservation, check-in, and leaving from the hotel of the user in the hotel, mainly include identity verification before check-in and intelligent authentication in the check-in process, specifically, please refer to the embodiments corresponding to fig. 5 and 6, which have similar principles and technical effects, and are not described herein again.

In a fifth aspect, the present application further provides a hotel security management platform, please refer to fig. 8, which is a simplified schematic structural diagram of the hotel security management platform according to an embodiment of the present application. As shown, the hotel security management platform includes an information management server 41 and a hotel security management system 42.

In some embodiments of the present application, the information management server 41 may be disposed on one or more entity servers depending on various factors such as function, load, and the like. When distributed in a plurality of entity servers, the server may be composed of servers based on a cloud architecture. The Cloud-based information management server includes, for example, a Public Cloud (Public Cloud) server and a Private Cloud (Private Cloud) server, where the Public or Private Cloud server includes Software-as-a-Service (SaaS), Platform-as-a-Service (PaaS), Infrastructure-as-a-Service (IaaS), and the like. The private cloud service end is used for example for a Mei Tuo cloud computing service platform, an Array cloud computing service platform, an Amazon cloud computing service platform, a Baidu cloud computing platform, a Tencent cloud computing platform and the like. The server may also be formed by a distributed or centralized cluster of servers. For example, the server cluster is composed of at least one entity server. Each entity server is provided with a plurality of virtual servers, each virtual server runs at least one functional module in the hotel information management server, and the virtual servers are communicated with each other through a network.

The hotel security management system 42 may perform identity verification on a user who has made a service reservation or order in the hotel, acquire a facial feature and a physical feature of the user during the identity verification, and grant hotel permission to the corresponding user based on the service content of the user.

Specifically, after the identity verification, the service contents ordered by the user in the hotel, such as the type of the room entering, the time of the leaving, and the like, may be checked at the hotel reception desk, and the hotel security management system 42 updates the order status from the predetermined status to the state of the room entering in the order system. The updating of the status of the orders may be based on manual input or selection in the order system, whereby the authorization unit completes the status update of the respective order.

The step of granting the user at least one hotel permission continues until the user checks the identity of the user and checks the check-in process, and the hotel security management system 42 grants the user different hotel permission information corresponding to the user's use of different areas of the hotel during the user's activities in the restaurant.

The way of authorization performed by the hotel security management system 42 includes: and when the similarity between the subsequently received image and the face image or the body feature of the feature template exceeds a set threshold, the user in the image is granted with the corresponding hotel authority. The authorization unit can set rules of feature comparison, for example, for different types of physical features and facial images in the feature template, the usage rights of different hotel areas can be respectively associated, and thresholds for similarity judgment are independently set.

In particular, the manner in which the hotel security management system 42 grants at least one hotel privilege to the user includes sending authorization information to the user's terminal device, sending authorization information to the hotel manager terminal device, and sending authorization information to the hotel authentication device. For specific implementation, reference may be made to the corresponding implementation in the embodiment shown in fig. 1, which is not described herein again.

In some embodiments, the hotel security management system 42 is communicatively coupled to a plurality of authentication devices in the hotel, the authentication devices including: one or more of a room door lock, a room electricity-taking switch, an elevator floor control device and a hotel article control device.

The authentication device takes the authority information sent by the hotel security management system 42 as a prohibition-clearing condition, usually, at least a camera device at a designated authentication position obtains a face image or/and a whole body image of a user, and performs feature extraction on the image or transmits the image to a hotel PMS for feature acquisition, and the authorization unit compares the obtained features with a pre-stored special template based on a preset judgment rule, thereby sending authorization information to the authentication device corresponding to the camera device. The designated authentication location comprises one or more of an elevator room, an elevator, a room doorway, a VIP service area, a conference room, a restaurant, a gym, a leisure activity area, a parent-child activity area, a reading room and a laundry.

Specifically, the hotel security management system 42 is the hotel security management system according to any one of the embodiments shown in fig. 7.

In a sixth aspect, the present application further provides a computer device, please refer to fig. 9, which is a simplified structural diagram of the computer device according to an embodiment of the present application. As shown, the computer device comprises a storage means 51, a processing means 52.

In some embodiments, the storage 51 is, for example, network attached storage accessed via RF circuitry or external ports and a communications network, which may be the Internet, one or more intranets, a local area network (L AN), a wide area network (W L AN), a storage local area network (SAN), or the like, or a suitable combination thereof.

In some embodiments, the storage device 51 may further include a Volatile Memory (Volatile Memory), such as a Random Access Memory (RAM); the Memory may also include a Non-Volatile Memory (Non-Volatile Memory), such as a Read-Only Memory (ROM), a flash Memory (flash Memory), a Hard Disk Drive (HDD), or a Solid-State Drive (SSD).

The processing device 52 may coordinate the storage device 51 to execute the hotel authentication management method as described in any one of the embodiments shown in fig. 1 to 4.

In some embodiments, the processing device 52 comprises an integrated circuit chip having signal processing capabilities; or a general purpose processor which may be a microprocessor, or any conventional processor such as a Central Processing Unit (CPU). For example, the Digital Signal Processor (DSP), Application Specific Integrated Circuit (ASIC), discrete gate or transistor logic device, discrete hardware component, may implement or execute the methods, steps, and logic blocks disclosed in the embodiments of the present application, for example, the hotel authentication management method described in any embodiment in fig. 1 to fig. 4.

The present application further provides, in a seventh aspect, a computer-readable storage medium, which stores at least one program, where the at least one program, when invoked, implements the hotel authentication management method according to any one of the embodiments described in fig. 1 to 4.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application.

In addition, if the instructions are transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DS L), or wireless technologies such as infrared, radio, and microwave, for example, then the coaxial cable, fiber optic cable, twisted pair, DS L, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium.

In one or more exemplary aspects, the functions described in the computer program of the data processing method described herein may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. The steps of a method or algorithm disclosed herein may be embodied in a processor-executable software module, which may be located on a tangible, non-transitory computer-readable and/or writable storage medium. Tangible, non-transitory computer readable and writable storage media may be any available media that can be accessed by a computer.

The flowcharts and block diagrams in the figures described above of the present application illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the application. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical concepts disclosed in the present application shall be covered by the claims of the present application.

Claims

1. A hotel authentication management method is characterized by comprising the following steps:

obtaining reservation information of a user, and inquiring to obtain matched order information according to the reservation information;

acquiring the on-site human face features of the user to check the user identity of the order information and acquire the physical features of the user;

after passing the identity verification of the user, associating the physical features of the user with the face features;

and confirming check-in information of a user, updating the order state, and authorizing at least one hotel authority to the user, wherein the hotel authority is associated with the face image or/and the physical feature.

2. The hotel authentication management method as recited in claim 1, wherein the reservation information comprises at least one of certificate information, communication information, order number, name, and unit name.

3. The hotel authentication management method as claimed in claim 1, wherein the step of obtaining the on-site human face feature of the user to check the user identity of the order information comprises:

acquiring a field face image of a user;

uploading the face image to an information management service system at the cloud end, so that the information management service system can match the face image with the prestored face characteristics;

and receiving a user identity verification result sent by the information management service system.

4. The hotel authentication management method as claimed in claim 1, wherein the step of obtaining the on-site human face feature of the user to check the user identity of the order information comprises:

acquiring a field face image of a user and certificate information of the user;

uploading the face image and the certificate information to an information management service system at the cloud end, so that the information management service system obtains corresponding reservation information from data according to the certificate information and matches the face image with face features in the reservation information;

5. The hotel authentication management method according to claim 3 or 4, further comprising the steps of: and extracting the characteristics of the obtained face image, or extracting the characteristics of the obtained face image by the information management service system so as to be matched with the prestored face characteristics.

6. The hotel authentication management method as recited in claim 1, wherein the step of obtaining the physical characteristics of the user comprises:

determining a target user on site;

acquiring an image containing the target user;

extracting physical features of the target user from the image, wherein the physical features comprise one or more of clothing features, posture features, skin color features, hair features, gait features and ethnic sac features.

7. The hotel authentication management method as recited in claim 1, wherein the step of determining the target user on site comprises: and determining the target user according to the detection position of the target user on the spot or the limb behavior of the target user on the spot.

8. The hotel authentication management method as recited in claim 1, wherein the step of determining the target user on site comprises: the method comprises the steps that a target user on site is determined through a monitoring camera device arranged in a hotel lobby, and the monitoring camera device is in communication connection with a PMS (permanent magnet system) of the hotel or an information management service system of a cloud.

9. The hotel authentication management method as recited in claim 1, wherein the granting of the user at least one hotel permission is at least one of:

sending authorization information to terminal equipment of a user, wherein the authorization information comprises character information or two-dimensional code information;

sending authorization information to terminal equipment of hotel management personnel, wherein the authorization information comprises text information or two-dimensional code information; or

Sending authorization information to at least one authentication device of the hotel, the authentication device comprising: one or more of a room door lock, a room electricity-taking switch, an elevator floor control device and a hotel article control device.

10. The hotel authentication management method according to claim 1, wherein the hotel right comprises a first right and a second right, the first right is related to a face image, or the first right is related to the face image and a physical feature; the second authority is related to a face image or a physical feature image, and the first authority is higher than the second authority.

11. The hotel authentication management method as recited in claim 1, wherein the first right is applicable to at least one hotel service right of door unlocking, VIP service area, conference room, restaurant and bar, and the second right is applicable to at least one hotel service right of elevator, fitness activity area, leisure activity area, parent-child activity area, reading room and laundry.

12. A hotel PMS system, comprising:

the query unit is used for querying and obtaining matched order information according to the obtained reservation information;

the identity authentication unit is used for verifying the identity of the user according to the acquired human face features;

the association unit is used for associating the acquired physical features of the user with the face features after the user identity verification is passed;

and the authorization unit is used for confirming the check-in information of the user, updating the order state and authorizing at least one hotel authority to the user, wherein the hotel authority is associated with the face image or/and the physical feature.

13. The hotel PMS system of claim 12, further comprising a recording unit for recording a usage log of the at least one hotel right when the user uses the authorized at least one hotel right.

14. The hotel PMS system according to claim 12, further comprising an interface unit connected to the at least one camera device disposed at the hotel site for obtaining the facial image of the user or the physical characteristics of the user captured by the at least one camera device.

15. The hotel PMS system of claim 14, wherein the at least one camera is configured at a designated authentication location of the hotel, the designated authentication location comprising one or more of an elevator hall, a room doorway, a VIP service area, a conference room, a restaurant, a gym, a recreational activities area, a parent activities area, a viewing room, and a laundry room.

16. The hotel PMS system according to claim 12, further comprising an interface unit connected to the information management server configured in the cloud, for obtaining the order information sent by the information management server.

17. The hotel PMS system of claim 12, wherein the authorization unit is communicatively connected to a plurality of authentication devices in the hotel, the authentication devices comprising: one or more of a room door lock, a room electricity-taking switch, an elevator floor control device and a hotel article control device.

18. The hotel PMS system of claim 12, wherein the hotel permissions include a first permission and a second permission, the first permission being associated with a facial image or the first permission being associated with a facial image and a physical feature; the second authority is related to a face image or a physical feature image, and the first authority is higher than the second authority.

19. The hotel PMS system of claim 18, wherein the first jurisdiction is for at least one hotel service jurisdiction of a door unlock, a VIP service area, a conference room, a restaurant, and a bar, and the second jurisdiction is for at least one hotel service jurisdiction of an elevator, a fitness activity area, a recreational activity area, a parent-child activity area, a viewing room, and a laundry room.

20. A self-service check-in system of a hotel, comprising:

the system comprises a camera device, a processing device and a processing device, wherein the camera device is used for acquiring a video or an image of a hotel check-in site, and the video or the image comprises the physical characteristics of a target user;

self-service registration equipment, with camera device communication connection includes:

the face recognition unit is used for acquiring a field face image of a target user so as to perform user identity verification matched with the order information;

the association unit is used for associating the acquired physical characteristics of the user with the face image after the user identity verification is passed;

21. A hotel security management system, comprising:

the system comprises a first camera device, a second camera device and a third camera device, wherein the first camera device is arranged at a hotel check-in site and used for acquiring a video or an image of the hotel check-in site, and the video or the image comprises the physical and physical characteristics of a target user;

the second camera device is arranged at an authentication position appointed by the hotel and used for acquiring the physical characteristics of a target user in the authentication position;

the hotel PMS system of claim 12 or the self-service check-in device of claim 20.

22. The hotel security management system of claim 21, further comprising a plurality of authentication devices disposed in the hotel and communicatively coupled to the PMS system or the self-service check-in device, the authentication devices comprising: one or more of a room door lock, a room electricity-taking switch, an elevator floor control device and a hotel article control device.

23. The hotel security management system of claim 21, wherein the hotel designated authentication location comprises one or more of an elevator lobby, an elevator interior, a room doorway, a VIP service area, a conference room, a restaurant, a gym, a recreational activity area, a parent-child activity area, a reading room, and a laundry.

24. A hotel security management platform, comprising:

an information management server;

at least one hotel security management system as set forth in claim 21.

25. A computer device, comprising:

storage means for storing at least one program;

processing means connected to the storage means for executing the at least one program to coordinate the storage means to execute and implement the hotel authentication management method according to any one of claims 1 to 12.

26. A computer-readable storage medium, characterized by storing at least one program which, when invoked, implements the hotel authentication management method of any of claims 1-12.