JP5157595B2 - Customer service system and customer service method - Google Patents

Description

  The present invention relates to a service system and method using a robot, and more particularly to control for appropriately determining the order of service when there are a plurality of persons to be serviced.

  In recent years, robots that perform customer service such as greetings, guidance, and utterance of guidance information have been developed in exhibition facilities and corporate buildings. In such a customer service system using a robot, various situations encountered by the robot must be assumed and control capable of coping with this must be constructed. For example, when there are a plurality of persons to be served in the facility, it is necessary to determine the order in which the robot is to serve customers for these persons.

  The following conventional invention is disclosed regarding the process for determining the order of customer service in the customer service system using the robot as described above. The system according to the conventional invention is an acceptance guidance system including a robot that moves autonomously and a guidance operation control unit that controls a guidance operation of the robot, and the guidance operation control unit includes an environment in which the robot moves. A map information database that holds the map information, robot position acquisition means for acquiring robot position information for specifying the position of the robot, and visitor detection means for specifying the position of the visitor and acquiring visitor position information; Guidance information management means for creating and managing the visitor guidance information based on the map information, the robot position information and the visitor position information, and instructing the robot to perform a guidance operation based on the guidance information Guidance operation instruction means to enable the visitor to visit the visitor while the robot is guiding the visitor. There even if a plurality are, are to be able to direct efficient guidance operation to the robot (see Patent Document 1).

In addition, as another conventional invention, an interactive sales promotion information communication system (see Patent Document 2) including a step of specifying a person's interest in the transmitted sales promotion information segment, a video in which the interests of a plurality of viewers gather. A video display device (see Patent Document 3) that detects the image content based on the viewer's line-of-sight information and face image position information, and determines the degree of concentration on the video content displayed on the subject's monitor. A video display system for selecting video content to be displayed (see Patent Document 4), a correspondence relationship that associates work and priority of execution order with respect to work is stored, and the order of execution of work is obtained from the priority table An interpersonal service robot (see Patent Document 5) determined based on the priority of work is disclosed.
JP 2004-299026 A Special table 2003-517642 gazette JP 2006-119408 A JP 2006-277192 A JP 2004-216528 A

  However, in the system disclosed in Patent Document 1, the order of service for a plurality of persons is mainly based on the map information of the environment (area) in which the robot moves, the position information of the robot, and the position information of the visitors. Since the order is determined on the basis of the order, it is often the case that customers are ordered in order from the visitors closest to the robot, and there is a problem that a person with high interest is served after a person with low interest. In addition, in this conventional system, in order to detect the location information of visitors, etc., a plurality of cameras must be installed in places other than the robot, and there is a problem that the installation cost becomes excessive.

  SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to make it possible for a customer service system or method using a robot to determine a customer service order in consideration of each person's interest in a robot when there are a plurality of persons to be serviced. To do.

  The present invention for solving the above-described problems is a customer service system for serving a person in a region by a robot that can move autonomously in a predetermined region, and collecting image information in the region. An interest level determination unit that determines an interest level of the person existing in the region with respect to the robot based on image information collected by the imaging unit, and an interest level determined by the interest level determination unit And a service scheduling means for determining the order in which the robot performs service with a person existing in the area.

  In this way, in the present invention, when determining the order of service for a plurality of persons, the interest level of each person is taken into account, so that a person with a high degree of interest is served after a person with a low level of interest. It is possible to prevent problems and provide a service with high satisfaction for visitors.

  Further, the image processing apparatus includes a face detection unit that detects information related to a human face existing in the region based on the image information collected by the imaging unit, and the interest level determination unit is detected by the face detection unit. It is preferable that the degree of interest is determined based on information.

  Moreover, it is preferable that the said interest level determination means determines the said interest level based on the face direction or gaze direction of the said person detected by the said face detection means.

  Further, the image processing apparatus includes operation recognition means for recognizing the movement of a person existing in the area based on the image information collected by the imaging means, and the interest level determination means includes the information recognized by the action recognition means. It is preferable that the degree of interest is determined based on this.

  Here, as an operation to be recognized, for example, an operation of raising a hand, an operation of waving a hand, and the like can be considered.

  And a sound collecting means for collecting sound information in the area, and a sound recognition means for recognizing a sound emitted by a person existing in the area based on the sound information collected by the sound collecting means, It is preferable that the interest level determination means determines the interest level based on information recognized by the voice recognition means.

  Here, for example, words such as “I'm sorry” can be considered as the speech to be recognized.

  In addition, it comprises face authentication means for determining whether or not a person existing in the region is a specific person based on information detected by the face detection means, and the service scheduling means includes the face authentication means It is preferable that the order in which the robot is to serve customers on the person existing in the area is determined based on the information authenticated by.

  As a result, it is possible to deal with important customers by taking special measures. For example, it is possible to determine whether or not the person in the area is an important customer by recording the face information of the important customer in the database and comparing it with the face information of the person in the area. In addition, the person existing in the area changes from moment to moment, but such a fluid change of the person also temporarily accumulates the face authentication means and the face information of the person in the area. By using the database, it is possible to grasp the change of persons in the area.

  The present invention is also a customer service method for serving a person existing in a region by a robot that can move autonomously in a predetermined region, and collecting image information in the region by an imaging unit And, based on the image information collected by the imaging means, a step of determining the interest level of the person existing in the region by the interest level determination means, and the interest determined by the interest level determination means And a step of determining the order in which the robot contacts the person existing in the area by the service scheduling means based on the degree.

  In this way, in the present invention, when determining the order of service for a plurality of persons, the interest level of each person is taken into account, so that a person with a high degree of interest is served after a person with a low level of interest. It is possible to prevent problems and provide a service with high satisfaction for visitors.

  And a step of detecting information related to a person's face existing in the region by a face detection unit based on the image information collected by the imaging unit, wherein the interest level determination unit includes the face detection unit. Preferably, the degree of interest is determined based on the information detected by.

  Moreover, it is preferable that the said interest level determination means determines the said interest level based on the face direction or gaze direction of the said person detected by the said face detection means.

  And a step of recognizing the motion of a person existing in the region by the motion recognition unit based on the image information collected by the imaging unit, wherein the interest level determination unit is recognized by the motion recognition unit. Preferably, the degree of interest is determined based on the information obtained.

  Here, as an operation to be recognized, for example, an operation of raising a hand, an operation of waving a hand, and the like can be considered.

  Further, the step of collecting the sound information in the area by the sound collecting means and the sound emitted by the person existing in the area is recognized by the sound recognition means based on the sound information collected by the sound collecting means. It is preferable that the interest level determination unit determines the level of interest based on information recognized by the voice recognition unit.

  Here, for example, words such as “I'm sorry” can be considered as the speech to be recognized.

  Further, based on the information detected by the face detection means, the face authentication means determines whether or not a person existing in the area is a specific person, the service scheduling means It is preferable that the order in which the robot is to serve a person existing in the area is determined based on the information authenticated by the face authentication means.

  As a result, it is possible to deal with important customers by taking special measures. For example, it is possible to determine whether or not the person in the area is an important customer by recording the face information of the important customer in the database and comparing it with the face information of the person in the area. In addition, the person existing in the area changes from moment to moment, but such a fluid change of the person also temporarily accumulates the face authentication means and the face information of the person in the area. By using the database, it is possible to grasp the change of persons in the area.

  The interest level determination means, the customer service scheduling means, the face detection means, the motion recognition means, the voice recognition means, and the face authentication means are a central processing unit (CPU), storage means (ROM, RAM, HDD). Etc.), an input / output port (I / O), etc., and comprising a computer or a similar device in which a predetermined program is stored in the storage means in order to realize the above-mentioned specific action of each means It is. The imaging means is a known video camera or the like that can collect image information including a moving image, and the sound collecting means is a known microphone or the like that detects a change in sound pressure and collects it as audio information. It is.

  As described above, according to the present invention, when there are a plurality of persons to be serviced, the order of service is determined in consideration of each person's interest in the robot. It becomes possible to provide. Further, the present invention can be realized without installing a plurality of image pickup means (cameras), which is advantageous in terms of cost.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. In FIG. 1, the example of the use condition of the customer service system 1 which concerns on this invention is shown. The customer service system 1 includes a robot 2, a control server 3, an operator terminal 4, and the like.

  The robot 2 performs various customer service acts on persons a, b, c, d, e, and f in the customer service area where the system 1 performs customer service in exhibition facilities, corporate buildings, and the like. In this embodiment, the autonomous operation mechanism 10, the camera 11, the microphone 12, the speaker 13, the ECU 14, and the like are provided. Autonomous operation mechanism 10 has various human-like works by means of moving the robot 2 main body in the form of wheel drive, bipedal walking, etc., joints provided in the hands, arms, torso, neck, etc., actuators, etc. It can be configured by appropriately using various techniques that are well-known and include means for enabling the above. The camera 11 is a well-known device for collecting image information, and is installed in the main body of the robot 2. Note that the installation position of the camera 11 is not limited to the portion corresponding to the eyes of the robot 2, and may be, for example, the trunk. The microphone 12 is a well-known device for collecting audio information, and is installed in the main body of the robot 2. The speaker 13 is a known device that transmits a synthesized predetermined sound to the outside, and is installed in the robot 2 body. The ECU 14 includes a central processing unit (CPU), storage means (ROM, RAM, HDD, etc.), an input / output port (I / O), and the like. The ECU 14 operates according to various programs stored in the storage means. The operation mechanism 10, the camera 11, the microphone 12, the speaker 13, and other necessary devices are controlled.

  The control server 3 is a computer system comprising a central processing unit (CPU), storage means (ROM, RAM, HDD, etc.), input / output ports (I / O), etc. Signals can be transmitted to and received from the ECU 14 and the operator terminal 4 of the robot 2. Various programs and databases for controlling the robot 2 are recorded in the control server 3, and various signals necessary for controlling the robot 2 are transmitted from the control server 3 to the ECU 14 of the robot 2. By the operation performed on the operator terminal 4, it is possible to make appropriate changes to the program and database in the control server 3.

  In FIG. 2, the structure of the customer service system 1 which concerns on this Embodiment is shown by the functional unit. The customer service system 1 includes an imaging unit 20, a sound collection unit 21, an interest level determination unit 23, a face authentication unit 24, a service scheduling unit 25, a robot operation control unit 26, and a database 27.

  The imaging unit 20 includes the camera 11 and collects the situation around the robot 2 as image information, and the collected image information is transmitted to an interest level determination unit 23 described later.

  The sound collecting means 21 is configured to include the microphone, and collects the situation around the robot 2 as sound information. The sound information collected here is transmitted to the interest level determining means 23 described later.

  The interest level determination means 23 is based on the information collected by the imaging means 20 and the sound collection means 21, and the robot 2 (or customer service) of each person a, b, c, d, e, f in the customer service area. (A specific method for determining the interest level will be described later). The interest level determination unit 23 includes a face detection unit 30, a motion recognition unit 31, and a voice recognition unit 32.

  The face detection unit 30 determines whether or not a human face exists in the image information collected by the imaging unit 20. Information (face information) recognized as a face by the face detection means 30 is used for interest level determination processing by the interest level determination means 23 described later, and is transmitted to the face authentication means 24 described later. The face detection process is now well known and will not be described in detail. For example, features such as two-dimensional, three-dimensional, and color features of a human face are set in advance, and this setting is performed. There is a method of comparing a value with an actual detection value, and such a well-known technique can be used as appropriate in the present invention. Further, this face detection process can also detect the gaze and face orientation of each person, and the detection result is used in the interest level determination process by the interest level determination means 23 described later. Note that the method of detecting the line of sight and the face orientation is now well known, and for example, the technique disclosed in Patent Document 3 can be used.

  The action recognition means 31 recognizes what action (gesture) the person a, b, c, d, e, f is performing based on the image information collected by the imaging means 20. is there. The motion recognized by the motion recognition means 31 is used for interest level determination processing by the interest level determination means 23 described later. The motion recognition process is currently well known and will not be described in detail. For example, a signal change peculiar to the motion of a person raising or shaking a hand is set in advance. There are methods such as comparison with actual detection values, and such known techniques can be used as appropriate in the present invention.

  The voice recognition means 32 is based on the voice information collected by the sound collection means 21, and if the person a, b, c, d, e, f is uttering, What kind of contents are determined. The voice detected by the voice recognition unit 32 and its contents are used for interest level determination processing by the interest level determination unit 23 described later. The voice recognition process is now well known and will not be described in detail. For example, the sound pressure change of pronunciation of a specific word such as “I'm sorry” is set in advance, and this set value There is a method of comparing the actual detection value and the actual detection value, and such a well-known technique can be used as appropriate in the present invention.

  The face authentication means 24 compares the individual face information detected by the face detection means 30 with the information recorded in the database 27 to grasp the replacement of persons in the customer service area or find a specific person. It is something to do. The face authentication process is now well known and will not be described in detail. For example, the face information recorded in the database and the face information actually detected are two-dimensional, three-dimensional, and color. There is a method of judging the difference between them by comparing features such as these, and in the present invention, such well-known techniques can be used as appropriate.

  The customer service scheduling unit 25 determines the order of customer service for each person a, b, c, d, e, f based on the determination results of the interest level determination unit 23 and the face authentication unit 24. This specific process will also be described later.

  The robot operation control unit 26 determines and executes the final operation of the robot 2 based on various conditions including the processing result by the customer scheduling unit 25. For example, the robot operation control unit 26 and the speaker of the robot 2 are determined. A control signal is output to 13, and operations such as approach to a person a, b, c, d, e, f, gesture gesture, utterance of guidance, and guidance to a predetermined place are executed.

  The database 27 stores various information necessary for the operation of the system 1, and has a temporary database 35 and a fixed database 36 as particularly related to the characteristic part of the present invention. The temporary database 35 stores fluid information relating to the customer service area of the system 1 and will be described later. As will be described later, the persons a, b, c, d, e, serving as customer service objects existing in the customer service area. Information about f is temporarily stored. The fixed database 36 stores information related to, for example, important customer face information, personal information, and customer service methods.

  In FIG. 3, the process of the entire customer service system 1 having the above-described configuration is shown by a flowchart. First, based on the image information collected by the imaging means 20 (camera 11), face detection processing is performed by the face detection means 30 (S101). In this face detection process, it is determined whether or not a face image exists in the detected image information, and if it exists, those face images are collected individually.

  Next, when the face image detected in step S101 is not in the temporary database 35, the face image is newly stored in the temporary database 35 (S102). Further, among the face images stored in the temporary database 35, those not included in the face image detected in step S101 are deleted from the temporary database 35 (S103).

  Next, in the degree-of-interest determination process (S104) described later, the degree of interest is individually determined for the persons a, b, c, d, e, and f corresponding to each face information. In the customer service scheduling process (S105), which will be described later, the customer service order for the persons a, b, c, d, e, and f in the customer service area is determined based on the degree of interest. Then, based on the order of service determined in the service scheduling process (S105) and the condition determined by the predetermined process not described here, a process of determining the operation of the robot 2 is executed (S106). Further, the face information of the person who has finished the customer service as described above is deleted from the temporary database 35 (S107), and the routine exits (returns to S101).

  FIG. 4 shows the interest level determination process S104. First, interest levels C1, C2,..., Cn are assigned to face images (persons 1, 2,..., N) registered in the temporary database 35, that is, present in the customer service area (S201).

  Next, an interest level determination loop (S202) for determining the interest levels C1, C2,..., Cn for each person 1, 2,. This loop is executed until completion for all persons 1, 2,. First, it is determined whether or not a certain person n is in the certain area S (see FIG. 1) (S203). If it is determined that the person n is not in the certain area S (N), this person n (in FIG. 1) is determined. If the interest level Cn of the person in the state shown by f) is set to 0 (S204), and it is determined that the person is in the certain area S (Y), then whether or not the face of the person n faces the robot 2 Is determined (S205).

  If it is determined in step S205 that the face does not face the robot 2 (N), the interest level Cn of this person n (the person shown in d in FIG. 1) is set to 1 (S206), When it is determined that the face is facing the robot 2 (Y), it is then determined whether or not the line of sight of the person n is facing the robot 2 (S207).

  If it is determined in step S207 that the line of sight is not facing the robot 2 (N), the interest level Cn of this person n (the person shown in e in FIG. 1) is set to 2 (S208). If it is determined that the line of sight is facing the robot 2 (Y), then this person n utters a predetermined gesture (for example, raising a hand, waving his hand) or utterance (for example, "I'm sorry"). ) Is determined (S209).

  If it is determined in step S209 that a predetermined gesture or utterance has not been made (N), the interest level Cn of this person n (the person shown in b and c in FIG. 1) is set to 3. (S210) and the time at this time (when it is determined that the line of sight is facing the robot 2) is registered (S211), and when it is determined that a predetermined gesture or utterance is being performed (Y) The interest level Cn of this person n (the person in the state shown in FIG. 1a) is set to 4 (S212).

  According to the degree-of-interest determination process S104, the higher the degree of interest Cn is set as the person n takes an action that seems to be more interested in the robot 2 (customer service). That is, when the person n is not in the fixed region S, the interest level Cn = 0, and when the person n is in the fixed region S and the face is not facing the robot 2, the interest level Cn = 1, Is directed to the robot 2 and the line of sight is not directed to the robot 2, the degree of interest Cn = 2, the face is in the fixed area S, the face is directed to the robot 2, and the line of sight is directed to the robot 2. If the gesture or utterance is not made, the degree of interest Cn = 3, the face is facing the robot 2, the line of sight is facing the robot 2, and the predetermined gesture or utterance is made. In this case, the degree of interest Cn = 4. The degree of interest Cn affects the customer service scheduling process (S105) described later.

  FIG. 5 shows the customer service scheduling process (S105). In this routine, the following service scheduling loop (S301) is executed until all the persons 1, 2,..., N are completed. First, it is determined whether the person n is a special person registered in the fixed database 36 (S302). This determination can be made by determining whether the face information of the person n matches the face information of a special person recorded in the fixed database 36.

  If it is determined in step S302 that the person n is a special person (Y), the order of customer service and the customer service method are determined based on predetermined registration items recorded in the fixed database 36. (S303). For example, when the person n is an important customer, the order of customer service is the first, and processing such as guiding to a special room is performed. On the other hand, if it is determined in step S302 that the person n is not a special person (N), the interest level Cn set in the interest level determination process S104 is sorted in descending order (descending order). The order of waiting for the person n is determined (S304).

  Next, it is determined whether or not the interest level Cn set for the person n is 3 (S305). If it is determined that the interest level Cn is 3 (Y), the interest level determination process S104 is performed. The time Tn set in step S211 is sorted in ascending order (ascending order) (S306). When the degree of interest Cn = 3, the order of customer service is determined in the order of the time Tn, that is, the time when the person n turns the line of sight toward the robot 2 in the earliest order.

  According to the service scheduling process S105, it is possible to receive a service first from a person n who has a high degree of interest Cn.

  The service order table 50 shown in FIG. 6 shows the service order assigned to each person a, b, c, d, e, f (see FIG. 1) by the above processing. In the customer service order table 50, the face position column 51 indicates the position of the face information detected by the face detection means 30 (see FIG. 2) as a coordinate point of a three-dimensional coordinate axis set in the service area. The distance column 52 indicates whether or not each person a, b, c, d, e, f is within a certain area S from the robot 2. Information shown in the face position column 51 and the position of the robot 2 Determined based on information. In this example, it is shown that the person f is outside the fixed region S (see FIG. 1). The face orientation field 53 indicates a person whose face is facing (approximately) in the direction of the robot 2 among the persons a, b, c, d, and e in the fixed area S. The determination is made based on the face information of each person a, b, c, d, e detected. In this example, it is determined that the person d does not face the robot 2 in the direction. The line-of-sight column 54 indicates a person who is looking toward the robot 2 among the persons a, b, c, and e determined that the face is facing in the direction of the robot 2 (approximately). The determination is made based on the face information of each person a, b, c, e detected by the detection means 30. In this example, it is determined that the person e does not look at the robot 2. The time column 55 indicates the time at which each person a, b, c pointing the line of sight toward the robot 2 starts to point the line of sight at the robot 2, and each person a, It is determined based on the face information of b and c and predetermined clock means. In this example, it is shown that the time when the person b started to turn his gaze more than the persons a and c is 1 minute later. The gesture column 56 indicates whether or not a predetermined gesture among the persons a, b, and c who are looking at the robot 2, that is, an action of raising a hand or an action of waving a hand. It is determined by the recognition means 31. In this example, it is shown that only the person “a” is raising his / her hand. The customer service order column 57 indicates the customer service order of the persons a, b, c, d, e, and f determined based on the information shown in the columns 51 to 56, and the service scheduling. Determined by means 25. In this example, it is shown that customer service is performed in the order of person a → c → b → e → d → f.

  As described above, according to the customer service system 1 shown in the present embodiment, even when there are a plurality of people in the customer service area, the customer service order is determined according to the interest level of each person. Thereby, it becomes possible to receive a preferential service from a person with a high degree of interest. Further, in the present system 1, it is not necessary to install a plurality of cameras in the environment, so that installation costs and the like can be kept low.

It is the schematic which shows the example of the installation state of the customer service system which concerns on this invention. It is a block diagram which shows the functional structure of the customer service system which concerns on this invention. It is a flowchart which shows the flow of the whole control of the customer service system which concerns on this invention. It is a flowchart which shows the flow of an interest degree determination process. It is a flowchart which shows the flow of a customer service scheduling process. It is a figure which shows the example of the customer service order with respect to the several person determined by the customer service system which concerns on this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Customer service system 2 Robot 3 Control server 4 Operator terminal 20 Imaging means 21 Sound collection means 23 Interest degree determination means 24 Face authentication means 25 Service scheduling means 26 Robot motion control means 27 Database 30 Face detection means 31 Motion recognition means 32 Voice recognition means 35 Temporary database 36 Fixed database

Claims (8)

A customer service system that uses a robot that can move autonomously within a predetermined area to serve a person in the area,
Imaging means for collecting image information in the region;
Interest level determination means for determining the level of interest of the person existing in the region based on the image information collected by the imaging unit,
Based on the interest level determined by the interest level determination unit, a service scheduling unit that determines an order in which the robot performs service to a person existing in the area;
Face detection means for detecting information related to the face of a person existing in the region based on image information collected by the imaging means;
With
The interest level determination means determines the interest level based on the information detected by the face detection means,
The degree-of-interest determination means determines the degree of interest based on the face direction or line-of-sight direction of the person detected by the face detection means ,
The customer service scheduling means determines the order in which the customer who exists in the area performs customer service in the order from the earliest time when the person existing in the area turns his / her line of sight toward the robot,
Hospitality system. Based on the image information collected by the imaging means, comprising an action recognition means for recognizing the action of a person existing in the area;
The interest level determination means determines the interest level based on information recognized by the motion recognition means.
The customer service system according to claim 1 . Sound collecting means for collecting audio information in the area;
A voice recognition means for recognizing a voice emitted by a person existing in the area based on the voice information collected by the sound collection means;
With
The interest level determination means determines the interest level based on information recognized by the voice recognition means.
The customer service system according to claim 1 or 2 . A face authentication unit for determining whether a person existing in the region is a specific person based on information detected by the face detection unit;
The service scheduling means determines an order in which the robot performs service to a person existing in the area based on the information authenticated by the face authentication means.
The customer service system according to any one of claims 1 to 3 . A customer service method for serving a person existing in a region by a robot that can move autonomously in a predetermined region,
Collecting image information in the region by an imaging means;
Determining an interest level of the person existing in the region by the interest level determination means based on the image information collected by the imaging means;
Determining, based on the interest level determined by the interest level determination means, a service scheduling means by which the robot performs customer service for a person existing in the area; and
Detecting information related to a person's face existing in the region by a face detection unit based on the image information collected by the imaging unit;
Have
The interest level determination means determines the interest level based on the information detected by the face detection means,
The degree-of-interest determination means determines the degree of interest based on the face direction or line-of-sight direction of the person detected by the face detection means,
The customer service scheduling means determines the order in which the customer who exists in the area performs customer service in the order from the earliest time when the person existing in the area turns his / her line of sight toward the robot,
Customer service method. Recognizing the motion of a person existing in the region by the motion recognition means based on the image information collected by the imaging means;
The interest level determination means determines the interest level based on information recognized by the motion recognition means.
The customer service method according to claim 5 . Collecting voice information in the area by sound collecting means;
Recognizing a voice emitted by a person existing in the area by a voice recognition means based on the voice information collected by the sound collection means;
Have
The interest level determination means determines the interest level based on information recognized by the voice recognition means.
The customer service method according to claim 5 or 6 . Based on the information detected by the face detection means, the face authentication means determines whether or not a person existing in the region is a specific person,
The service scheduling means determines an order in which the robot performs service to a person existing in the area based on the information authenticated by the face authentication means.
The customer service method according to any one of claims 5 to 7 .

Images