CN107194835B

CN107194835B - Hotel reception robot system

Info

Publication number: CN107194835B
Application number: CN201710537843.9A
Authority: CN
Inventors: 朱明�
Original assignee: Individual
Current assignee: Individual
Priority date: 2017-07-04
Filing date: 2017-07-04
Publication date: 2020-11-03
Anticipated expiration: 2037-07-04
Also published as: CN107194835A

Abstract

The invention discloses a reception robot system for a hotel reception desk, which comprises: the first information acquisition module acquires hotel and guest information; the first identification processing module sends out prompt tones to indicate the resident to carry out the input operation of the identity information of the resident through the user operation equipment; the second information acquisition module acquires hotel room state information displayed on the display screen; the second identification processing module identifies the collected hotel room state information; the method comprises the steps that user operation equipment obtains resident identity information input by a resident; the main control module determines room information for the resident according to the acquired identity information of the resident and the determined hotel room state information; and the mechanical arm operation module issues the house card to the resident according to the determined room information. The embodiment of the invention can utilize the computer program to complete the operation flow of the hotel reception waiter operating the hotel reception desk computer, and realizes the effective combination of computer vision, artificial intelligence technology and the hotel industry.

Description

Hotel reception robot system

Technical Field

The invention relates to the technical field of computer processing, in particular to a hotel reception desk robot system.

Background

With the rapid development of the hotel industry, economic and fast hotels mainly based on short-term accommodation services are under unprecedented development. Currently, economical hotels have already occupied a large market share of the hospitality industry.

In an economical hotel, the operation of reception and check-in of the hotel reception desk usually has a fixed flow. Based on the corresponding fixed processing flow, most of the current economical hotels use the corresponding hotel management system to carry out reception operation by the front desk staff. Due to the particularity of hotel services, staff responsible for reception work is usually required to be arranged in a hotel reception desk for 24 hours, and the labor cost of the hotel is increased.

With the development of computer intelligence technology, some technical schemes for integrally applying modern intelligent facilities to realize hotel management appear at present. However, this technique suffers from the problem of requiring payment of high conversion costs, which are generally unacceptable for thin, multi-market, economical hotels. Moreover, for a general economic hotel, many intelligent functions in modern intelligent facilities for a large hotel cannot be effectively utilized at all. Therefore, the existing hotel intelligent facilities cannot provide corresponding services for the economical hotels.

Disclosure of Invention

The invention aims to provide a reception robot system for a reception desk of a hotel, so that an intelligent reception system which is low in implementation cost and can save labor cost can be conveniently provided for an economical hotel.

The purpose of the invention is realized by the following technical scheme:

a hotel reception front desk robot system, comprising:

the first information acquisition module comprises a camera and is used for acquiring hotel and guest information;

the first identification processing module is used for sending out a prompt tone after the first information acquisition module acquires the hotel guest information, wherein the prompt tone is used for indicating the guest to carry out the guest identity information input operation through user operation equipment;

the second information acquisition module comprises a camera and is used for acquiring hotel room state information displayed on a display screen, and the hotel room state information is used for indicating the room number of each room of the hotel and the state of whether the room is empty;

the second identification processing module is used for identifying the hotel room status information acquired by the second information acquisition module;

the user operation equipment is used for acquiring the identity information of the resident input by the resident;

the main control module is used for determining room information for the resident according to the resident identity information acquired by the user operation equipment and the hotel room state information determined by the second identification processing module;

and the mechanical arm operation module is used for issuing room cards to the tenants according to the room information determined by the main control module.

After the master control module determines the room information for the resident, if the resident does not pay the house fee, the master control module needs to prompt the resident to execute payment operation through the user operation equipment, and after receiving the successful payment information sent by the user operation equipment, the master control module informs the mechanical arm operation module to issue the house card to the resident.

The system further comprises POS machine equipment, when the master control module determines room information for the resident, if the resident does not pay the house fee, the POS machine equipment is operated through the mechanical arm operation module, the resident is prompted to input payment information through voice, and when the resident finishes payment, the mechanical arm operation module is informed to issue a house card to the resident.

The system also comprises a text file server which is used for storing the identity information of the resident sent by the user operation equipment as a text file and transmitting the text file to the main control module, and storing the room information determined for the resident sent by the main control module as a text file and transmitting the text file to the user operation equipment.

The system also comprises an interface operation module which is used for simulating a keyboard and a mouse to control the hotel management system according to the instruction of the main control module.

The main control module judges whether the resident is a scheduled resident or no scheduled resident according to the resident identity information acquired by the user operation equipment, and respectively performs different processing operations:

for a preset resident, inquiring whether preset information of the resident exists or not, if so, outputting the room information of the resident, otherwise, prompting a user that no preset exists;

and judging whether the scheduled resident has an empty room or not, if so, outputting the room information determined for the resident, and otherwise, prompting the user that the resident has no empty room.

The process of inquiring whether the predetermined information of the resident exists includes:

the camera acquires an original registration bar image of the preset resident information, the processed original registration bar image is matched with a template image generated according to the resident identity information, and only when the matching is successful, the preset information of the resident is determined to exist; wherein the original registration bar image information is an image containing all predetermined tenant name information.

The processing for judging whether the empty room exists comprises the following steps:

searching the stored current room state diagram to determine whether an empty room meeting the room type requirement exists, wherein the room state diagram is distinguished and marked with whether each room is idle through different color values;

when the existence of the empty room is determined, the method further comprises the following steps: and identifying the room number information marked in the icon corresponding to the selected vacant room in the room state diagram as the room information by a template matching method.

The system further comprises:

and for the preset resident, after the room information of the resident is output, judging whether the house fee is paid or not, if so, informing the mechanical arm operation module to issue a house card to the resident, and if not, determining that the resident does not pay the house fee.

After issuing the house card to the guest, the system further comprises: and playing a prompt tone to inform the resident of finishing the check-in processing process.

According to the technical scheme provided by the invention, the hotel reception front desk robot system provided by the embodiment of the invention is used for developing and compiling a program for automatic reception operation aiming at the existing hotel management system of the current economic hotel, sending an instruction to simulate a keyboard and mouse to operate a front desk computer, obtaining an image of a screen by using a camera, identifying related information by using a computer vision library, distributing house cards by using a mechanical arm and completing corresponding system operation so as to complete the operation flow of operating the hotel reception waiter on the hotel reception front desk computer, not only can the combination of the computer vision and artificial intelligence technology with the hotel industry be realized, but also the economic hotel can obtain intelligent service function provision without spending huge transformation and upgrade costs, and attract customers.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.

Fig. 1 is a first schematic structural diagram of a system according to an embodiment of the present invention;

FIG. 2 is a second schematic structural diagram of a system according to an embodiment of the present invention;

FIG. 3 is a schematic workflow diagram of a system according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a room state provided by an embodiment of the invention;

fig. 5 is a gray scale image and a binary image obtained in the room number identification process according to the embodiment of the present invention;

FIG. 6 is a graph of contour extraction obtained during room number identification provided by an embodiment of the present invention;

fig. 7 is a cut-out digital picture obtained in the room number identification process provided by the embodiment of the present invention;

fig. 8 is a schematic diagram of an identification result obtained in the room number identification process according to the embodiment of the present invention;

FIG. 9 is a template diagram of names obtained during a predefined name recognition process provided by embodiments of the present invention;

FIG. 10 is an original registration bar image obtained during a predefined name identification process provided by an embodiment of the present invention;

fig. 11 is a binarized image of fig. 10 obtained during a predetermined name recognition process according to an embodiment of the present invention;

fig. 12 is a template image obtained in a predetermined name recognition process provided by an embodiment of the present invention;

fig. 13 is a binarized image of fig. 12 obtained during a predetermined name recognition process according to an embodiment of the present invention;

fig. 14 is an image obtained by successful matching in the process of recognizing the predetermined name according to the embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention are clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.

Today, the hotel industry, which is dominated by short-term lodging services, is gaining unprecedented development. If the computer vision technology is used as a service reception robot for the hotel foreground, a large number of hotel foreground reception personnel can be liberated, namely, each key core capability of the intelligent robot is combined with the hotel industry, so that great value is generated and innovation and breakthrough are brought.

Considering that the reception check-in operation of the hotel reception desk has a fixed flow, the computer can be facilitated to program the reception check-in operation. Based on the situation, the embodiment of the invention is the existing hotel management system for most of the current economic hotels, and can develop and write the program for automatic reception operation. A keyboard and mouse operation foreground computer (namely, a hotel computer provided with a hotel management system) is simulated by sending a serial port instruction, an image displayed by a hotel computer screen is obtained by a camera, room state information, a preset name and a reserved room number displayed on the screen are identified by using an OPENCV computer vision library, a room card can be distributed and a POS machine can be paid by clicking by using a mechanical arm, and the operation flow of the whole system is formed.

Embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.

The embodiment of the invention provides a hotel reception robot system, the specific implementation structure of which is shown in fig. 1 and can include:

the first information acquisition module comprises a camera and is used for acquiring hotel guest information so as to automatically detect whether a guest comes to a hotel front desk to handle check-in procedures;

the first identification processing module is used for sending out a prompt tone after the first information acquisition module acquires the hotel guest information, wherein the prompt tone is used for indicating the guest to carry out guest identity information input operation through user operation equipment, and the prompt tone comprises information such as the name, the contact way and whether a room or a required room type is reserved for the guest;

the second information acquisition module comprises a camera and is used for acquiring hotel room state information displayed on a display screen of a hotel computer, wherein the hotel room state information is used for indicating the room number of each room of the hotel and the state of whether the room is empty or not, and the room needing to be checked is selected for the resident according to the corresponding room state information;

the second identification processing module is used for identifying the hotel room state information acquired by the second information acquisition module and finding out an idle room which meets the demand of the resident for the resident;

and the mechanical arm operation module is used for issuing the house card to the resident according to the room information determined by the main control module, namely after the room information is determined for the resident and the resident finishes payment, the house card writing operation can be performed on the resident and the house card is issued to the resident, and in the card writing and issuing process, the mechanical arm contained by the mechanical arm operation module performs the house card grabbing and conveying operation.

Further, after the master control module determines the room information for the resident, if the resident does not pay the house fee, the host is prompted to execute the payment operation through the user operation device. The householder can pay the house fee in an electronic payment mode such as a payment treasure mode and a WeChat payment mode, also can pay the house fee in a card swiping mode, and informs the mechanical arm operation module to issue the house card to the householder after receiving the successful payment information sent by the user operation equipment.

The system can also comprise POS machine equipment, when the master control module determines the room information for the resident, if the resident does not pay the house fee, the POS machine equipment is operated by the mechanical arm operation module (namely, the amount of the house fee to be paid by the resident is input on the POS machine equipment), the resident is prompted to input payment information (namely, a payment password) by voice, and when the resident finishes payment, the mechanical arm operation module is informed to issue the house card to the resident.

In order to facilitate the identification processing of the first identification processing module and the second identification processing module, the system may further include a text file server for storing the identity information of the resident sent from the user operation device as a text file and transmitting the text file to the main control module, and storing the room information determined for the resident sent from the main control module as a text file and transmitting the text file to the user operation device. And the first identification processing module and the second identification processing module execute corresponding identification processing operations under the control of the main control module.

The system also comprises an interface operation module which is used for simulating a keyboard and a mouse to operate the hotel management system (namely the hotel management system in the hotel computer) according to the instruction of the main control module.

In the system provided in the embodiment of the present invention, the main control module determines, according to the identity information of the guest obtained by the user operation device, that the guest is a predetermined guest or no predetermined guest, and performs different processing operations:

(1) for a preset resident, inquiring whether preset information of the resident exists or not, if so, outputting the room information of the resident, otherwise, prompting a user that no preset exists;

the process of inquiring whether the predetermined information of the resident exists may include:

the camera acquires an original registration bar image of the preset resident information, the processed original registration bar image is matched with a template image generated according to the resident identity information, and only when the matching is successful, the preset information of the resident is determined to exist; the original registration bar image information may be an image including name information of all predetermined tenants, and the template image may be an image generated by names of tenants who have entered the check-in procedure as needed, the names being input by the user operation device.

(2) Judging whether a vacant room exists or not for no scheduled resident, if so, outputting the room information determined for the resident, otherwise, prompting a user that no vacant room exists;

the processing procedure of judging whether there is an empty room may include:

The system provided by the embodiment of the invention can further comprise the following processing steps:

Further, after issuing the house card to the resident, the system may further include: and playing a prompt tone to inform the resident of finishing the check-in processing process.

The embodiment of the invention combines the current situation of an economical and quick hotel, designs the reception robot based on the existing hotel management system, can utilize a computer program to complete the operation process of operating the computer of the hotel reception waiter on the hotel reception desk, can realize the combination of computer vision and artificial intelligence technology with the hotel industry, enables the economical hotel to obtain intelligent service function without spending huge modification and upgrade costs, and attracts customers and consumers. Moreover, the scale of the economical quick hotel is huge, so the hotel reception robot system provided by the embodiment of the invention has a great value and a wide application prospect.

For the purpose of facilitating an understanding of the embodiments of the present invention, the following detailed description will be given of the operation and processing procedures of the embodiments of the present invention in a specific application process with reference to the accompanying drawings.

The whole set of robot system (namely the hotel reception robot system) provided by the embodiment of the invention can comprise a tablet personal computer (namely user operation equipment) which is used for receiving information input by the operation of a resident and returning a two-dimensional code of a payment treasure so that the resident (namely the resident) can input payment information and the like; one camera (namely a first information acquisition module) is used for detecting a human face, and the other camera (namely a second information acquisition module) is used for aiming at a computer display screen of the hotel management system so as to obtain information (such as room state information and the like) of the hotel management system; two UARM mechanical arms (namely mechanical arm modules), one is used for distributing house cards, and the other is used for operating the keys of the POS machine; and the host equipment (host for short) is used for controlling the realization of the whole foreground reception processing flow, and comprises the main control module (namely a main control program), a first identification processing module and a second identification processing module.

Specifically, above-mentioned panel computer and camera can be placed at the proscenium of hotel to in the back that the camera detected the people's face, can play the prompt tone suggestion tenant at the panel computer input information (check-in information). The other camera is aimed at a display screen of a hotel computer to obtain a room state diagram displayed on the computer display screen. A mechanical arm is placed on one side of the counter for dispensing house cards. The other side is provided with a POS machine and a mechanical arm for inputting the amount of money so that the resident can pay by swiping a card.

Specifically, the structure of whole hotel reception robot system is as shown in fig. 2, and the system in fig. 2 is hotel management system, can operate hotel management system in order to accomplish corresponding reception processing through hotel reception robot system, and corresponding hotel reception robot system can include four modules, is respectively: identification module, communication module, arm module and interface operation module, wherein:

(1) the identification module, which is equivalent to the first identification processing module and the second identification processing module, may be specifically subdivided into a module for visitor identification, room status identification, room number identification, predetermined name identification, and the like.

(2) The communication module is used for communication between the tablet personal computer and the host and the server, the communication process can comprise four functions of tablet uploading, tablet downloading, host uploading and host downloading, and the server is used for generating a text file from the received information for the tablet or the host to download and apply;

the server can be specifically an HTTP server, namely the HTTP server is used as a link, file transmission and information communication are realized based on the communication module, so that the tablet personal computer can upload information to the HTTP server and download information from the HTTP server by using the communication module, and the host equipment can upload information to the HTTP server and download information from the HTTP server.

Specifically, after acquiring check-in information filled by the resident, the tablet computer transmits the check-in information to the HTTP server and stores the check-in information in a text file. The host program (i.e., host module) in the host device downloads the text file from the HTTP server and reads the guest information. The main control program sends the room query result to the HTTP server, the room query result is also stored in the text file, the tablet personal computer can download the text file, the room state query result is read, the two-dimensional code picture of the pay treasure containing the room price is displayed on the tablet personal computer, and after payment, the result is returned to the host device.

Downloading text files from an HTTP server may use Windows' API, wininet (which can help implement three common Internet protocols), so that the downloading of text files can be done using its function of receiving files from an HTTP server.

Uploading information to the HTTP server may use a third party library CURL, which is an open source tool that uses URL syntax to enable file transfers. Sending the information to the HTTP server and saving the information in a specified text file can be accomplished with the help of the encapsulated functions in the library.

(3) The mechanical arm module is used for operating the mechanical arm to touch the POS machine and operating the mechanical arm to manufacture the distribution room card;

specifically, the main control program in the host device controls the moving mechanical arm in a serial communication mode, that is, a moving instruction is sent to the mechanical arm control chip through a serial port to control the movement of the mechanical arm control chip. When the mechanical arm is controlled to move, firstly, a serial port needs to be opened, serial port parameters are set, and instructions are written into the serial port. When the program is closed (i.e. the control of the movement of the mechanical arm is stopped), the serial port needs to be closed first.

When the house card needs to be distributed through the mechanical arm, the mechanical arm is needed to suck the house card from the house card book, the house card is moved to the card manufacturing device and is placed down, the main control program in the host device sends an instruction for writing the house card, after the house card is written, a resident is prompted to take away the house card, and the mechanical arm returns to the position of the house card book.

(4) The interface operation module is used for simulating the operation of a keyboard and a mouse by using a simulation keyboard and a mouse, tabulating and storing the positions of buttons of an interface (namely the interface on a hotel computer screen) of the hotel management system, wherein the stored information is used as reference information for the movement of the mouse;

the method specifically comprises the step of simulating the movement, clicking and key pressing operation of a mouse keyboard on a computer screen of a hotel by utilizing a mouse and keyboard simulating device. The keyboard and mouse simulator may be a keyboard and mouse simulator KMA1, which has 3 external interfaces: COM port, keyboard interface and mouse interface, wherein:

com port: also called serial port or Rs232 interface, is used for receiving the order information, connect with com port of the computer; the parameters of the interface are configured as: baud rate 9600, data bit 8, stop bit 1, no parity.

A keyboard interface: namely, the keyboard signal output port is directly connected with a ps2 keyboard interface of a computer or connected with a keyboard interface at one end of ps2 of a ps 2-usb conversion line.

Mouse interface: namely a mouse signal output port, which is directly connected with a ps2 mouse interface of a computer or connected with a mouse interface at one end of ps2 of a ps 2-to-usb conversion line.

The COM port of the corresponding analog keyboard and mouse device is connected with a host (computer) containing a main control program, the keyboard interface and the mouse interface are connected with a hotel computer, and the main control program in the host device can realize the function of simulating the keyboard and mouse operation by using the instruction by sending the instruction to the serial port. The instructions sent by the main control program comprise keyboard instructions and mouse instructions. The format of the corresponding instruction needs to conform to the following communication protocol of hardware:

the keyboard instruction starts with a capital letter K and is divided into two actions of pressing and bouncing up the keyboard, wherein pressing is used for on-code, and bouncing is used for off-code. If the key A is pressed, the pressing instruction is [ K1C ], and the bounce instruction is [ KF01C ].

The mouse command can be divided into a mouse click command and a mouse movement command, which are started by capital letter M, for example, a left mouse button press command is [ MDL ], and a pop-up command is [ MUL ]. The mouse moving instruction is divided into 8 directions, namely up, down, left, right, left up, left down, right up and right down. If the down shift command is [ MM21], "2" indicates that "1" indicates the pixel shift distance, and the pixel shift distance must be between 1 and 99 for a single command.

When the analog keyboard and mouse device is applied, the main control program needs to start the serial port first and set serial port parameters, such as the sizes of input and output buffers, read-write timeout time, baud rate, data bits, stop bits and the like. After the setting is finished, the command can be written into the serial port buffer area so as to be convenient for sending the command, and when the application of the analog keyboard and mouse equipment is stopped, the serial port needs to be closed firstly.

The mouse moving instruction needs to indicate parameters of specific moving distance and direction, and the mode for determining the parameters of the corresponding moving distance and direction includes: the positions of all buttons of the management system in the hotel computer on the screen (interface Button positions on the hotel computer screen) are stored in a document file, and the Button positions of the current mouse and the positions of the target buttons are compared through a Button model to determine the corresponding parameters of the moving distance and the moving direction. And then, adjusting the parameters of the moving distance and the moving direction into a format conforming to a communication protocol through an algorithm so that the instruction receiving party can identify the corresponding parameters, thereby controlling and executing the corresponding simulation operation.

Based on the structural diagram of the whole system shown in fig. 2, a corresponding foreground reception processing flow is shown in fig. 3, and may specifically include the following steps:

step (1) detecting the residents;

specifically, a camera provided in the front desk detects whether or not a guest arrives. And if the resident is detected to arrive, prompting the resident to input information on the tablet through voice.

Step (2), the tablet acquires information and sends the acquired information input by the resident to a server (the server generates a resident information file according to the information input by the resident), so that the host downloads the resident information file from the server;

the information in the tenant information file includes: order identification number, predetermined name (empty if no reservation), check-in type and mobile phone number, etc.;

and (3) judging the types of the residents, and respectively carrying out subsequent processing according to different types of the residents:

in the process of judging the type of the resident, the type information of the resident can be extracted specifically according to the information in the resident information file, the resident is divided into the scattered resident and the preset resident, and the subsequent execution steps are different according to the type of the resident;

(31) the type of the resident is a loose guest

Extracting the appointed demand house type from the check-in information filled by the resident through the flat plate, inquiring and identifying a house state diagram, if an empty house is detected, prompting by voice, handling registration check-in, and continuing the next step, namely executing the step (4); otherwise, the voice prompts that the house is not empty of the house type, and the step (1) is returned.

(32) The type of tenant is predetermined:

the host computer extracts a preset name from the check-in information filled by the resident through the flat panel, inquires and identifies a preset column, if the preset is detected, the host computer prompts and handles the registration check-in by voice, and continues the next step, namely, the step (4) is executed; otherwise, the voice prompts that the reservation of the name is not found, and the step (1) is returned.

Step (4) perfecting check-in information;

the method specifically comprises the step of filling information such as names, identity card numbers, mobile phone numbers, the number of stay days and the like of the residents into an order page of the hotel system.

Paying the sum of money;

according to the payment mode selected by the resident, the branch payment (or WeChat payment, etc.) and the bank card payment. The two-dimensional code containing the payment amount is displayed on the flat plate in the Payment mode; and (4) the bank card payment can move the mechanical arm to click the POS machine to carry out corresponding operation, and the step (6) is executed after the visitor completes payment.

Step (6) distributing house cards;

moving the mechanical arm, sucking the house card to a card maker, making the house card for the resident by the card maker, sucking the house card to a counter after the making is finished, and releasing the house card to the resident;

optionally, a corresponding deposit slip may be provided for the resident in this step, and the deposit slip may be automatically printed and issued to the resident by the robot arm after the payment operation is completed.

And (7) prompting the resident to finish the check-in operation program through voice.

The processing function specifically performed by the identification module will be further described below.

Specifically, the identification functions that the first identification processing module and the second identification processing module included in the identification module can implement may include: visitor identification, room state identification, room number identification and predetermined name identification, wherein:

(1) visitor identification

A camera placed in the foreground, with its direction facing outward, takes a picture every predetermined time (e.g. 0.1 second). Graying the obtained picture (namely the picture) to obtain a grayscale image, carrying out histogram equalization on the grayscale image, carrying out face detection on the image, and if the face is detected within a range of 2 meters from the camera, storing all the detected faces in a vector container. By judging the state of the container, the detection result can be obtained, and the detection operation of the resident is realized, namely: if the container is not empty, the next operation is carried out, and if the container is not empty, the visitor is present; if the container is empty, it indicates that there is no guest.

(2) Room state identification

The room state diagram displayed on the computer screen of the hotel is that when the rooms are in different room states, the colors displayed in the rooms are different. Therefore, according to the color of each room on the room status diagram, whether the room is empty can be known.

The corresponding room status map can be as shown in fig. 4, the room number, the position of the room on the room status map and the corresponding room type can be saved in the document file during the application process, when the resident needs a certain room type, the room status map can be searched, and whether the resident is empty can be judged according to the color information on the room status map. If the empty room of the room type exists, the room number of the first empty room conforming to the room type can be returned. And if not, carrying out voice prompt.

Referring to fig. 4, a pure color region at the lower right corner of a room state diagram can be specifically cut into an ROI (region of interest) region, and since an empty room is white, the ROI region is averaged for each channel. Considering that the image obtained by the camera may have chromatic aberration, the average values of the three channels are averaged again and the variance is made. And setting a threshold value, and identifying whether the empty house of the house type exists or not according to the average value and the variance.

(3) Room number identification

In the house number identification process, the numbers of the printed form can be specifically identified by using an OPENCV template matching method, which mainly comprises two processing steps: and extracting and identifying the ROI. The ROI extraction is to separate an interested region from an original image, and the identification is to classify and identify the digital information of the extracted ROI region.

Specific processing steps of ROI extraction and identification may include:

(31) preprocessing images

The original image is converted into a gray image, so that the original three-channel picture is changed into a single-channel picture, and the image dimensionality is reduced. And converting the gray scale image into a binary image, setting a threshold value, setting the pixel point higher than the threshold value to be 255, and setting the pixel point lower than or equal to the threshold value to be 0. The gray scale map and the binary map after the corresponding processing are respectively shown in fig. 5, the left side is the gray scale map, and the right side is the binary map.

(32) Detecting and extracting contours

The outline of the connectable region in the binary image is represented by a series of points, returning a sequence of points. The sequence of points may form a pattern and enclose a connected region. When the findContours function is used for extracting the outline, the outline which only searches and extracts the outermost layer needs to be set.

After the contours are detected, each contour is traversed by an iterator, and a minimum matrix surrounding each contour is found. The corresponding profile extraction map is shown in fig. 6.

(33) Sorting out numerical sequences and cutting

The minimum matrix surrounding each number is arranged in order of the coordinates of the center position. After finishing the arrangement, dividing the original image into ROI areas according to the information surrounded by the matrix. The picture obtained by cutting each number is shown in fig. 7.

(34) Identifying numbers

Template images from numbers 0 to 9 are made and stored in advance, a template matching method is used for distributing the ROI image of each number to be identified in the figure 7 and each number from 0 to 9, pixel points are traversed and compared one by one, and the number with the highest matching degree is found out to serve as an identification result. The matching algorithm used may be a normalized squared error matching method. After the above processing operation is performed, a recognition result of a string of numbers can be obtained, as shown in fig. 8. (4) Predefined name recognition

In the process of name recognition, a template matching method can be adopted to recognize print characters, and the process is divided into two processing processes of template making and recognition, wherein:

the template making means that after the resident fills in the preset name on the flat plate, the master control program receives the preset name information and makes a template picture according to characters of the preset name. The template making method is to print out characters on a blank picture and save the name template picture, and the made name template is shown as figure 9. Because the number of the Chinese characters is huge, all the Chinese characters cannot be made into templates in advance, and even if the Chinese characters are made into the templates, traversing the templates one by one for each Chinese character of the name consumes a lot of time, which is unacceptable for hotel reception desks needing to be quickly registered. Thus, after the name information is obtained from the tablet, the predetermined name is made into a template at runtime, and pixel-by-pixel matching is performed on the original registration bar image (i.e., the original image of the predetermined tenant information, which includes the name information of all the predetermined tenants) using the template. And obtaining the result of the preset query according to the set threshold value.

After the template picture is made, the original registration bar image obtained by the camera from the computer display screen is called, as shown in fig. 10, the original registration bar image is converted into a gray scale image, and then the gray scale image is converted into a binary image, as shown in fig. 11, so that the purposes of reducing the image dimensionality and reducing the image operation complexity are achieved. Meanwhile, the template picture shown in fig. 9 is also processed in the same way, so that the template picture is converted into a binary picture. The original image of the template picture is shown in fig. 12, the original image of the template picture is subjected to binarization processing, and the image with the character size being realigned is shown in fig. 13.

After the images shown in fig. 11 and 13 are obtained, the image shown in fig. 13 is traversed on the image shown in fig. 11 pixel by pixel, the best matching position is found, and the matching value of the position is compared with the set threshold value. The threshold is set to half the average of the matching result matrix. If the threshold condition is met, the matched preset name is considered to be found, and the rectangle of the matched position is displayed. If not, the matched preset name is not found. The matching method used may be a normalized squared error matching method. Specifically, an image successfully obtained based on the above-described matching of fig. 11 and 13 is shown in fig. 14.

Through the provided identification processing modes, the corresponding visitor identification, room state identification, room number identification and preset name identification can be accurately carried out. Thereby facilitating the smooth proceeding of the check-in processing after identification.

The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A hotel reception desk robot system, comprising:

the mechanical arm operation module is used for issuing room cards to the tenants according to the room information determined by the main control module;

judging whether a vacant room exists or not for no scheduled resident, if so, outputting the room information determined for the resident, otherwise, prompting a user that no vacant room exists; the processing for judging whether the empty room exists comprises the following steps:

2. The system of claim 1, wherein after the master control module determines the room information for the tenant, if the tenant does not pay the house fee, the master control module further prompts the tenant to perform a payment operation through the user operation device, and after receiving a payment success message sent by the user operation device, the master control module notifies the robot arm operation module to issue the house card to the tenant.

3. The system of claim 1, further comprising a POS device, wherein after the master control module determines room information for the guest, if the guest does not pay for the house fee, the POS device is further operated by the robot operating module, and the guest is prompted to input payment information by voice, and after the guest completes payment, the robot operating module is notified to issue a house card to the guest.

4. The system as claimed in claim 1, further comprising a text file server for storing the identity information of the resident transmitted from the user operating device as a text file and transmitting the text file to the main control module, and storing the room information determined for the resident transmitted from the main control module as a text file and transmitting the text file to the user operating device.

5. The system of claim 1, further comprising an interface operation module for simulating a keyboard and a mouse to control the hospitality management system according to the instructions of the main control module.

6. The system as claimed in claim 1, wherein the process of inquiring whether the predetermined information of the resident exists comprises:

7. The system of claim 1, further comprising:

8. The system of claim 1, wherein after issuing the house card to the guest, the system further comprises: and playing a prompt tone to inform the resident of finishing the check-in processing process.