WO2021192313A1

WO2021192313A1 - Seat guidance device, system, method, and non-transitory computer-readable medium having program stored therein

Info

Publication number: WO2021192313A1
Application number: PCT/JP2020/014375
Authority: WO
Inventors: 鈴木　浩司
Original assignee: 日本電気株式会社
Priority date: 2020-03-27
Filing date: 2020-03-27
Publication date: 2021-09-30

Abstract

Provided are seat guidance device, system, method, and program with which it is possible to present an appropriate seat in a free seating scheme. This seat guidance device (100) comprises: an authentication control unit (102) which causes an authentication device (200) having stored therein registered facial feature information of multiple visitors to perform face authentication on a first image captured of a specific visitor at a prescribed location within a prescribed facility; an identification unit (103) which, in the case of a successful face authentication, identifies a history of past reserved-seat purchases made by said specific visitor; a determination unit (104) which determines a probable seat on the basis of the specified purchase history and seating information (111) that defines an arrangement of multiple seats in the facility; and an output unit (105) which outputs guidance information indicating the probable seat.

Description

Non-transitory computer-readable medium containing seat guidance devices, systems, methods and programs

The present invention relates to a non-transitory computer-readable medium in which a seat guidance device, a system, a method and a program are stored.

Patent Document 1 discloses a technique related to an office seat presentation system that selects an office seat candidate from a plurality of office seats arranged in an office area and presents the office seat candidate to a user.

Note that Patent Document 2 discloses a technique for identifying a group attribute of a plurality of persons included in a photographed image. The group attribute is, for example, a parent and child, a couple, and the like.

International Publication No. 2019/163543 Japanese Unexamined Patent Publication No. 2011-248548

Here, there is a problem that it is difficult to determine an appropriate seat for unreserved seats in a facility with a large number of seats. It should be noted that Patent Document 1 cannot solve this problem.

This disclosure is made to solve such problems, and an object of the present disclosure is to provide a seat guidance device, a system, a method, and a program capable of presenting an appropriate seat in a non-reserved seat. ..

The seat guidance device according to the present disclosure performs face recognition on the first captured image of a specific visitor at a predetermined point in a predetermined facility with respect to an authentication device that stores registered face feature information of a plurality of visitors. Authentication control means to be authenticated, specific means for specifying the purchase history of past reserved seats in the specific visitor when the face recognition is successful, seat information defining the arrangement of a plurality of seats in the facility, and the identification. It is provided with a determination means for determining a seat candidate based on the purchased purchase history and an output means for outputting guidance information indicating the seat candidate.

The seat guidance device according to the present disclosure is a storage means for storing registered facial feature information of a plurality of visitors, and the registered facial feature information for a first photographed image of a specific visitor at a predetermined point in a predetermined facility. The authentication means for performing face recognition using the above, the specific means for specifying the past purchase history of reserved seats by the specific visitor when the face recognition is successful, and the arrangement of a plurality of seats in the facility are defined. A determination means for determining a seat candidate based on the seat information and the purchase history, and an output means for outputting guidance information indicating the seat candidate are provided.

The seat guidance system according to the present disclosure is an authentication device including a seat guidance device, a storage means for storing registered face feature information of a plurality of visitors, and an authentication means for performing face authentication using the registered face feature information. When the seat guidance device makes the authentication device perform face authentication on the first photographed image of a specific visitor at a predetermined point in a predetermined facility and succeeds in the face authentication. , The past purchase history of reserved seats in the specific visitor is specified, seat candidates are determined based on the seat information defining the arrangement of a plurality of seats in the facility and the specified purchase history, and the seat candidates are determined. It outputs the guidance information indicating.

In the seat guidance method according to the present disclosure, a computer uses an authentication device that stores registered face feature information of a plurality of visitors to face the first photographed image of a specific visitor at a predetermined point in a predetermined facility. When the authentication is performed and the face recognition is successful, the past purchase history of reserved seats in the specific visitor is specified, and the seat information defining the arrangement of a plurality of seats in the facility and the specified purchase history are used. A seat candidate is determined based on the above, and guidance information indicating the seat candidate is output.

In the seat guidance method according to the present disclosure, a computer that stores registered facial feature information of a plurality of visitors uses the registered facial feature information for the first photographed image of a specific visitor at a predetermined point in a predetermined facility. When the face recognition is performed using the face recognition and the face recognition is successful, the purchase history of the reserved seats in the past by the specific visitor is specified, and the seat information defining the arrangement of a plurality of seats in the facility and the specified purchase are specified. A seat candidate is determined based on the history, and guidance information indicating the seat candidate is output.

The seat guidance program according to the present disclosure is an authentication device that stores registered face feature information of a plurality of visitors in a computer, and faces the first photographed image of a specific visitor at a predetermined point in a predetermined facility. The process of performing authentication, the process of specifying the past purchase history of reserved seats by the specific visitor when the face recognition is successful, the seat information defining the arrangement of a plurality of seats in the facility, and the identification. The process of determining a seat candidate based on the purchased purchase history and the process of outputting guidance information indicating the seat candidate are executed.

In the seat guidance program according to the present disclosure, the registered facial feature information of the first photographed image of a specific visitor at a predetermined point in a predetermined facility is stored in a computer that stores the registered facial feature information of a plurality of visitors. The process of performing face recognition using the face recognition, the process of specifying the past purchase history of reserved seats by the specific visitor when the face recognition is successful, and the seat information defining the arrangement of a plurality of seats in the facility. The process of determining a seat candidate based on the specified purchase history and the process of outputting guidance information indicating the seat candidate are executed.

The present disclosure can provide seat guidance devices, systems, methods, and programs that can present appropriate seats in unreserved seats.

It is a block diagram which shows the structure of the seat guidance device which concerns on this Embodiment 1. It is a flowchart which shows the flow of the seat guidance method in Embodiment 1. It is a block diagram which shows the structure of the seat guide device which concerns on this Embodiment 2. It is a block diagram which shows the structure of the seat guidance system which concerns on this Embodiment 3. It is a block diagram which shows the structure of the authentication apparatus which concerns on this Embodiment 3. It is a flowchart which shows the flow of the face information registration process which concerns on this Embodiment 3. It is a flowchart which shows the flow of the face recognition processing which concerns on this Embodiment 3. It is a block diagram which shows the structure of the face recognition terminal which concerns on this Embodiment 3. It is a block diagram which shows the structure of the user terminal which concerns on this Embodiment 3. It is a block diagram which shows the structure of the seat guide device which concerns on this Embodiment 3. It is a sequence diagram which shows the flow of the seat guidance method which concerns on this Embodiment 3. It is the schematic which shows the example of facility X. It is the schematic which illustrates the route specified by the seat guidance system which concerns on this Embodiment 3. It is a block diagram which shows the structure of the seat guidance system which concerns on this Embodiment 4. It is the schematic which shows the outline of the operation of the seat guidance system which concerns on this Embodiment 4. It is a block diagram which shows the structure of the seat guidance system which concerns on this Embodiment 5.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals, and duplicate explanations are omitted as necessary for the sake of clarity of explanation.

<Embodiment 1>
FIG. 1 is a block diagram showing a configuration of a seat guidance device 100 according to the first embodiment. The seat guidance device 100 includes an authentication control unit 102, a specific unit 103, a determination unit 104, and an output unit 105. The seat guidance device 100 is connected to a network 500 (not shown). The network 500 may be wired or wireless. An authentication device 200 (not shown) is connected to the network 500.

The authentication control unit 102 causes the authentication device 200 to perform face recognition on the first captured image of a specific visitor U at a predetermined point Y in the facility X. Here, it is assumed that the authentication device 200 stores facial feature information of a plurality of visitors. Facility X is, for example, a baseball field, an athletics field, or the like.

The identification unit 103 specifies the past purchase history of reserved seats of the specific visitor U when the authentication control unit 102 succeeds in face recognition. The determination unit 104 determines a seat candidate based on the seat information 111 that defines the arrangement of a plurality of seats in the predetermined facility X and the specified purchase history. The seat information 111 may include information about the aisle in the facility. For example, the determination unit 104 may extract the seat request of the visitor U from the history information 112 that associates the visitor with the purchase history of the reserved seat in the past, and determine the seat candidate according to the extraction result. .. The seat request is, for example, a request to sit in a seat on the aisle side or a request to sit in a seat in front of facility X. The history information 112 may be a purchase history of reserved seats in a facility different from the facility X.

The output unit 105 outputs guidance information indicating the seat candidate determined by the determination unit 104. The guidance information may be information indicating seat candidates in the seating chart based on the seat information 111. The output unit 105 may output the guidance information to the face recognition terminal, or may output the guidance information to the user terminal possessed by the visitor.

FIG. 2 is a flowchart showing the flow of the seat guidance method according to the first embodiment. First, the authentication control unit 102 performs face recognition on the first captured image of a specific visitor U at a predetermined point Y in the facility X with respect to the authentication device 200 that stores the registered face feature information of a plurality of visitors. Let it be done (step S101). It is assumed that at least the face area of the user U is captured in the first captured image. Next, when the face authentication is successful in step S101, the specific unit 103 specifies the purchase history of the specific visitor U (step S102). Next, the determination unit 104 determines a seat candidate based on the seat information 111 and the purchase history (step S103). Finally, the output unit 105 outputs guidance information indicating the seat candidate (step S104).

As mentioned above, until now, it was not possible to present appropriate seats to visitors. On the other hand, the seat guidance device according to the present embodiment can present an appropriate seat candidate based on the past history of reserved seat purchases of the visitors identified by face recognition.

The seat guidance device 100 includes a processor, a memory, and a storage device as a configuration (not shown). Further, the storage device stores a computer program in which the processing of the seat guidance method according to the present embodiment is implemented. Then, the processor reads the computer program from the storage device into the memory and executes the computer program. As a result, the processor realizes the functions of the authentication control unit 102, the identification unit 103, the determination unit 104, and the output unit 105.

Alternatively, the authentication control unit 102, the specific unit 103, the determination unit 104, and the output unit 105 may each be realized by dedicated hardware. Further, a part or all of each component of each device may be realized by a general-purpose or dedicated circuitry, a processor, or a combination thereof. These may be composed of a single chip or may be composed of a plurality of chips connected via a bus. A part or all of each component of each device may be realized by a combination of the above-mentioned circuit or the like and a program. Further, as a processor, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), or the like can be used.

Further, when a part or all of each component of the seat guidance device 100 is realized by a plurality of information processing devices and circuits, the plurality of information processing devices and circuits may be centrally arranged. It may be distributed. For example, the seat guidance device, the circuit, and the like may be realized as a form in which each of the client-server system, the cloud computing system, and the like is connected via a communication network. Further, the function of the seat guidance device 100 may be provided in the SaaS (Software as a Service) format.

<Embodiment 2>
The second embodiment is a modification of the first embodiment described above. The seat guidance device 100 according to the first embodiment performs personal authentication with an external authentication device 200. On the other hand, the seat guidance device 100 according to the second embodiment performs personal authentication inside the device.

FIG. 3 is a block diagram showing the configuration of the seat guidance device 100 according to the second embodiment. The seat guidance device 100 includes a storage unit 110, an authentication unit 102a, a specific unit 103, a determination unit 104, and an output unit 105. Since the functions of the identification unit 103, the determination unit 104, and the output unit 105 are the same as those in the first embodiment, the description thereof will be omitted.

The storage unit 110 according to the second embodiment stores the registered face feature information of a plurality of visitors. The authentication unit 102a according to the second embodiment performs face authentication for the first captured image using a plurality of registered face feature information stored in the storage unit 110.

The flow of the seat guidance method according to the second embodiment is the same as that in FIG. However, in step S101, the authentication unit 102a performs face authentication using the registered face feature information on the first captured image.

As described above, the same effect as that of the above-described first embodiment can be obtained by the second embodiment as well.

<Embodiment 3>
The third embodiment is a specific example of the first embodiment described above. FIG. 4 is a block diagram showing a configuration of the seat guidance system 600a according to the third embodiment. The seat guidance system 600a includes a seat guidance device 100a, an authentication device 200, a face recognition terminal 300, and a user terminal 400. Each of the seat guidance device 100a, the authentication device 200, the face recognition terminal 300, and the user terminal 400 is connected via the network 500. In the third embodiment, it is assumed that the registered face feature information of a plurality of visitors is registered in the authentication device 200 in advance.

The seat guidance device 100a authenticates the face of the visitor U at the facility X and outputs a seat candidate for the visitor U. Each function of the seat guidance device 100a will be described later. The authentication device 200 has a face information DB 210. The face feature DB 210 stores the user ID and the face feature information of the user in association with each other. The face information DB 210 is also referred to as a storage unit. Further, the authentication device 200 collates the face image or face feature information included in the request with the face feature information of each user in response to the face authentication request received from the outside, and returns the collation result to the requester. ..

The face recognition terminal 300 is a terminal device that authenticates the face of the visitor U at the facility X. The face recognition terminal 300 is, for example, digital signage. The face recognition terminal 300 may be installed, for example, at the entrance of the facility X. The face recognition terminal 300 displays guidance information indicating the seat candidates of the user U. The seat guidance system 600a may display guidance information on the user terminal 400.

The user terminal 400 is a terminal owned by the user U. The user terminal 400 is, for example, a mobile phone terminal, a smartphone, a tablet terminal, a PC (Personal Computer) on which or connected to a camera, or the like. The user terminal 400 transmits the registered image used for the face authentication of the user U to the authentication device 200, and requests the face information registration. The user terminal 400 may transmit the face feature information extracted from the registered image to the authentication device 200 to request the face information registration. The user terminal 400 may receive guidance information from the seat guidance device 100a.

That is, the user terminal 400 is a device that registers the face feature information extracted from the face image of the user U in the face information DB 210 before performing the face authentication described later. The user U may register the face feature information using a device other than the user terminal 400. For example, the user U may register the face feature information using a face authentication terminal or the like having a face information registration request function.

Next, the function of the authentication device 200 will be described in detail. FIG. 5 is a block diagram showing the configuration of the authentication device 200. The authentication device 200 includes the above-mentioned face information DB 210, a face detection unit 220, a feature point extraction unit 230, a registration unit 240, and an authentication unit 250.

The face detection unit 220 detects the face area included in the registered image for registering the face feature information and outputs it to the feature point extraction unit 230. The feature point extraction unit 230 extracts feature points from the face region detected by the face detection unit 220, and outputs face feature information to the registration unit 240. Here, the face feature information is a set of extracted feature points. Further, the feature point extraction unit 230 extracts the feature points included in the face image received from the seat guidance device 100a, and outputs the face feature information to the authentication unit 250.

The registration unit 240 newly issues a user ID when registering facial feature information. The registration unit 240 registers the issued user ID and the face feature information extracted from the registered image in the face information DB 210 in association with each other. The authentication unit 250 collates the face feature information extracted from the face image with the face feature information in the face information DB 210. The authentication unit 250 returns to the seat guidance device 100a whether or not the facial feature information matches. The presence or absence of matching of facial feature information corresponds to the success or failure of authentication.

FIG. 6 is a flowchart showing the flow of face information registration processing by the authentication device 200. First, the authentication device 200 acquires the registered image included in the face information registration request (step S201). For example, the authentication device 200 receives a face information registration request from a user terminal 400 or the like via a network 500. Next, the face detection unit 220 detects the face region included in the registered image (step S202). Next, the feature point extraction unit 230 extracts feature points from the face region detected in step S202, and outputs face feature information to the registration unit 240 (step S203). Finally, the registration unit 240 issues a user ID, associates the user ID with the face feature information, and registers the user ID in the face information DB 210 (step S204). The authentication device 200 may receive face feature information from the user terminal 400 or the like and register it in the face information DB 210 in association with the user ID.

FIG. 7 is a flowchart showing the flow of face recognition processing by the authentication device 200. First, the feature point extraction unit 230 acquires face feature information from the face image received from the seat guidance device 100a (step S301). For example, the authentication device 200 receives the face image from the seat guidance device 100a and extracts the face feature information as in steps S201 to S203. Alternatively, the authentication device 200 may receive facial feature information from the seat guidance device 100a. Next, the authentication unit 250 collates the acquired face feature information with the face information DB 210 (step S302). When the face feature information matches (Yes in step S303), the authentication unit 250 identifies the user ID of the user whose face feature information matches (step S304), and determines that the face authentication was successful and the identified user ID. Reply to the seat guidance device 100a (step S305). When there is no matching face feature information (No in step S303), the authentication unit 250 returns to the seat guidance device 100a that the face authentication has failed (step S306).

Next, the face recognition terminal 300 will be described in detail. The face recognition terminal 300 includes a photographing device such as a camera, a display device, and a computer as a hardware configuration. FIG. 8 is a block diagram showing the configuration of the face authentication terminal 300.

The face recognition terminal 300 includes the above-mentioned camera 310, and includes a storage unit 320, a communication unit 330, a display unit 340, and a control unit 350. The storage unit 320 is a storage device that stores a program for realizing each function of the face authentication terminal 300. The communication unit 330 is a communication interface with the network 500. The display unit 340 is the display device described above. The control unit 350 controls the hardware of the face recognition terminal 300. The control unit 350 includes a shooting control unit 351 and a display control unit 352.

The shooting control unit 351 shoots a user who controls the camera 310 to perform face authentication, and transmits the shot image to the seat guidance device 100a to perform face recognition. The captured image is an image including at least an image of the user's face.

The display control unit 352 displays guidance information in response to an instruction from the seat guidance device 100a. For example, the guidance information may be information displaying seat candidates in the seating chart. The seat guidance system 600a can use either the face recognition terminal 300 or the user terminal 400 as a device for displaying guidance information.

Next, the user terminal 400 will be described. The user terminal 400 is a mobile phone terminal or the like owned by the user. FIG. 9 is a block diagram showing the configuration of the user terminal 400. The user terminal 400 includes a camera 410, a storage unit 420, a communication unit 430, and a display unit 440. Further, the user terminal 400 includes a control unit 450 that controls the above-mentioned hardware. The control unit 450 includes a shooting control unit 451, a display control unit 452, and a registration unit 453.

The shooting control unit 451 shoots a user who controls the camera 410 and performs face registration, and outputs it to the registration unit 453. The captured image is an image including at least an image of the user's face. Further, the imaging control unit 451 may control the camera 410 to capture an image in the facility X. In such a case, the seat guidance device 100a can generate guidance information using the image in the facility X.

The display control unit 452 receives the guidance information from the seat guidance device 100a and displays the guidance information on the display unit 440, similarly to the display control unit 352 of the face authentication terminal 300. The seat guidance system 600a can use either the face recognition terminal 300 or the user terminal 400 as a device for displaying guidance information. The registration unit 453 requests the authentication device 200 to register the face information.

The flow of the face information registration process will be explained below. The shooting control unit 451 first controls the camera 410 and shoots a registered image of the user. Next, the registration unit 453 transmits a face information registration request including the registered image to the authentication device 200 via the network 500. The registration unit 453 may receive the registered user ID from the authentication device 200 as a registration result. The registration unit 453 may send a face information registration request including the face feature information extracted from the registered image to the authentication device 200.

Next, the function of the seat guidance device 100a will be described with reference to FIG. The seat guidance device 100a is an information processing device that outputs candidates for unreserved seats of the visitor U to the facility X, and is, for example, a server device realized by a computer. As shown in FIG. 10, the seat guidance device 100a includes a storage unit 110, a control unit 120, a memory 130, and a communication unit 140.

The storage unit 110 is a storage device for a hard disk, a flash memory, or the like. The control unit 120 controls each function included in the seat guidance device 100a. The memory 130 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information when the control unit 120 operates. The communication unit 140 is a communication interface with the network 500.

The storage unit 110 stores at least the seat guidance program 113, the seat information 111, and the history information 112. The seat guidance program 113 is a computer program in which the seat guidance method according to the present embodiment is implemented.

Seat information 111 is information that defines the arrangement of a plurality of seats in facility X. The seat information 111 may include route information regarding a route to each seat. The determination unit 124, which will be described later, determines a seat candidate based on the seat information 111. The determination unit 124 may further determine the route to the seat candidate based on the seat information 111. The history information 112 is information in which the user ID of the user who visits the facility X and the purchase history of the reserved seat in the past of the user are associated with each other. The determination unit 124, which will be described later, determines a seat candidate for which the user U who has visited the venue will be seated based on the history information 112.

The control unit 120 reads the seat guidance program 113 from the storage unit 110 into the memory 130 and executes the seat guidance program 113. As a result, the control unit 120 realizes the functions of the acquisition unit 127, the authentication control unit 122, the identification unit 123, the determination unit 124, the generation unit 126, and the output unit 125. The authentication control unit 122 is an example of the authentication control unit 102, the specific unit 123 is an example of the specific unit 103, the determination unit 124 is an example of the determination unit 104, and the output unit 125 is an example of the output unit 105. be.

The acquisition unit 127 acquires the first captured image captured by the face recognition terminal 300. The authentication control unit 122 causes the authentication device 200 to perform face recognition on the first captured image acquired by the acquisition unit 127. The identification unit 123 specifies the purchase history associated with the user U who has succeeded in face authentication in the history information 112.

The determination unit 124 extracts the seat request of the user U based on the history information 112, and determines the seat candidate according to the extraction result. For example, when the aisle-side seat is selected in the purchase history, the determination unit 124 extracts the aisle-side seat from the seat information 111 and determines it as a seat candidate. The determination unit 124 may extract the seat request of the user U from a plurality of past purchase histories of the user U.

Note that there may be one seat candidate or a plurality of seat candidates. When there are a plurality of seat candidates, the determination unit 124 may determine the priority of each seat candidate based on the purchase history. For example, when a request to sit on the aisle side seat is extracted from the history information 112, the determination unit 124 determines the priority so that the seat closer to the aisle side has a higher priority. Further, the determination unit 124 may further determine the movement route from the current position of the visitor U to the seat candidate by using a known search algorithm based on the seat information 111. Further, the determination unit 124 may determine the priority of each movement route. The priority may be determined according to, for example, the route length of the movement route.

The determination unit 124 may determine the seat candidate in consideration of the desired conditions input by the visitor U. The desired condition is, for example, a condition that the seat is close to the toilet, stairs, or aisle, or a condition regarding the position of the seat (center, edge, top and bottom).

Generation unit 126 generates guidance information indicating seat candidates. The guidance information may be information indicating seat candidates in the seating chart based on the seat information 111. When there are a plurality of seat candidates, the generation unit 126 may set the color of the seat candidates in the seating chart according to the priority. Further, the generation unit 126 may generate each seat candidate or a plurality of seating charts including each route as guidance information by arranging them in the order of priority.

The output unit 125 outputs the guidance information generated by the generation unit 126. The output destination may be the face authentication terminal 300 or the user terminal 400. For example, the output unit 125 may output the recommendation information to the user terminal 400 based on the user ID included in the authentication result received from the authentication device 200. Here, it is assumed that the user has already logged in to the user terminal 400 using the user ID.

Here, the output unit 125 may output a composite image obtained by synthesizing a photographed image of the seat group in the facility X by the user terminal 400 and an index image indicating a seat candidate as guidance information. The index image is, for example, an image of an arrow indicating the position of a seat. In such a case, first, the acquisition unit 127 acquires a photographed image of the seat group of the facility X from the user terminal. Next, the generation unit 126 synthesizes the captured image and the index image by using the technique of augmented reality. For example, the generation unit 126 may arrange an index image indicating a seat candidate by reading a marker such as a QR code (registered trademark) arranged on each seat from the photographed image.

FIG. 11 is a flowchart showing the operation of the seat guidance device 100a according to the present embodiment. First, the acquisition unit 127 of the seat guidance device 100a acquires the first captured image at the point Y of the user U who has visited from the face recognition terminal 300 (step S401). Next, the authentication control unit 122 of the seat guidance device 100a transmits a face authentication request to the authentication device 200 to perform face authentication (step S402). Next, the authentication control unit 122 of the seat guidance device 100a receives the success or failure of the authentication by the authentication device 200 and the user ID of the authenticated user U from the authentication device 200 as the authentication result (step S403).

Next, the authentication control unit 122 of the seat guidance device 100a determines whether or not the face authentication was successful based on the received face authentication result (step S404). When the face recognition fails (No in step S404), the seat guidance device 100a returns that the face recognition has failed (step S405).

When the face authentication is successful (Yes in step S404), the identification unit 123 of the seat guidance device 100a specifies the past purchase history associated with the user ID received in step S403 in the history information 112 (step S406). .. Next, the determination unit 124 determines a seat candidate based on the purchase history identified in step S406 (step S407).

Next, the generation unit 126 generates guidance information for guiding the seat candidate specified in step S407 (step S408). Finally, the output unit 125 outputs the guidance information generated in step S408 (step S409).

Next, a method of determining a seat candidate will be described with reference to FIG. Facility X shown in FIG. 12 is a stadium. Visitors to facility X move clockwise or counterclockwise through aisle 3, pass through any of gates g1-8, and are seated. In FIG. 12, blocks B1 to block B4 are a combination of a plurality of seats. The seats surround the competition area 5 of facility X. In addition, face

recognition terminals

300a, 300b, and 300c are installed in the facility X.

The visitor U who visited the facility X takes the first photographed image with the face recognition terminal 300a at the entrance 2. The authentication control unit 122 causes the authentication device 200 to perform face recognition on the first captured image. Next, the identification unit 123 specifies the history information of the past purchase associated with the visitor U.

The determination unit 124 determines a seat candidate from the seats that can be seated. Here, the shaded seats are assumed to have been seated by other visitors. It is assumed that the seats s1 of the block B1 and the seats s2 and s3 of the block B2 can be seated. For example, if the visitor U has purchased a reserved seat in the front row near the competition area 5 in the past, the determination unit 124 determines the seat candidate as the seat s3. On the other hand, if the visitor U has selected a seat close to the gates g1 to g8 in the past, the determination unit 124 determines the seat candidate as the seat s1. The decision unit 124 may determine the seat candidate according to the user U's one-time purchase history, or may determine the seat candidate in consideration of a plurality of purchase histories.

It is possible to determine whether or not each seat in the facility X can be seated, for example, according to the detection result of the seating sensor installed in each seat. In such a case, the determination unit 124 determines a seat candidate from the seats that do not detect seating. Further, the determination unit 124 may determine whether or not another visitor is sitting based on the photographed image taken in the facility X. Further, the determination unit 124 may determine a seat candidate from among a plurality of seats other than reserved seats.

Further, as described above, the determination unit 124 may determine the route to the seat candidate. When the seat s3 is determined as a seat candidate, the determination unit 124 determines, for example, the route 4 in FIG. 13 as the movement route. In such a case, the generation unit 126 may generate guidance information including the movement route, and the output unit 125 may output the guidance information including the movement route. The guidance information may include not only a guide map including a seating chart and a route, but also information on a seat number, a start time of a competition, etc., a view of the competition area 5 from the seat, and the like.

The visitor U can check the guidance information again using the face authentication terminal 300b while moving along the route 4. In this way, the visitor U confirms the guidance information on the face recognition terminal 300a at the entrance 2, and while moving along the guidance information, the visitor U uses another

face recognition terminal

300b or 300c to perform the guidance information again. You can check. Here, the

face recognition terminals

300b and 300c may receive guidance information from the seat guidance device 100a in the same manner as the face recognition terminal 300a.

Further, the face authentication terminal 300a may transmit the user ID of the visitor and the guidance information to the

face authentication terminals

300b and 300c in association with each other. In such a case, the

face recognition terminals

300b and 300c can present the guidance information to the visitor who has face-authenticated. In this way, the face recognition terminals may cooperate with each other to provide guidance information to the visitors.

The seat guidance device 100a may specify a route or assign a priority to a plurality of routes in consideration of the desired conditions of the visitor. The desired condition is, for example, whether or not to use a toilet, a shop, a smoking area, or the like. When using a toilet or the like, the seat guidance device 100a specifies a route for moving from the current location to a reserved seat via a point based on desired conditions.

Here, the seat guidance device 100a may specify the route in consideration of the waiting time of the toilet, the shop, the smoking area, and the like. For example, when there are a plurality of toilets in the facility X, the seat guidance device 100a may specify the route having the smallest total of the waiting time of the toilet and the travel time of the route.

Regarding shops, there are multiple shops in facility X, and each may sell different products. In such a case, the seat guidance device 100a goes through the shop, taking into consideration the team name supported by the visitor, whether or not alcohol is sold, the type of food the visitor likes, etc. as the desired conditions of the visitor. You can identify the route to do. The desired conditions may be input to the face recognition terminal 300a by the visitor, or may be extracted from the visitor's past purchase history or the information posted by the visitor on the SNS.

Also, the competition information about the competition you want to see may be the desired condition. In such a case, the seat guidance device 100a may determine a route in time for the competition desired to be viewed in consideration of the current time, the moving time of the aisle, the waiting time of the toilet, and the like. Here, the moving time of the passage may be determined according to the degree of congestion of the passage. Here, the seat guidance device 100a can determine the degree of congestion from the number of visitors, the photographed image of the aisle, and the like.

For example, assume that the current time is 10 o'clock, the start time of the 400m race is 10:05, and the start time of the 1000m race is 10:20. In such a case, the seat guidance device 100a presents a route to the seat after stopping at the shop or the toilet to the visitors who wish to see the 1000m race, and to the visitors who want to see the 400m race. On the other hand, a route for moving to a seat may be presented without stopping at a shop or the like.

In addition, the competition information may be information related to innings such as baseball. Here, the current inning can be estimated from the current time. For example, the seat guidance device 100a presents a route to a seat after stopping at a shop or a toilet to a visitor who wishes to view from the 5th table, and a visitor who wishes to view from the 4th table. You may present a route to move to a seat without stopping at a shop or the like.

Note that the seat guidance device 100a may output guidance information regarding one route or output guidance information regarding a plurality of routes based on the input of visitors or the past purchase history. The guidance information regarding the plurality of routes may include simulation results regarding the plurality of routes or a plurality of routes. The simulation result is a result of simulating the time of arrival at the reserved seat, the waiting time in the toilet or the shop, and the like. Visitors will be able to select the route they desire from multiple routes.

The seat guidance device 100a according to the present embodiment determines a seat candidate according to the past purchase history of reserved seats associated with the visitor specified by face recognition. Therefore, the visitor can be seated in a seat that meets the desired conditions.

<Embodiment 4>
The seat guidance system 600b according to the fourth embodiment analyzes the captured image in the facility X to determine the degree of congestion, and outputs a detour route according to the determination result. FIG. 14 is a block diagram showing the configuration of the seat guidance system 600b according to the fourth embodiment. A camera 700 is installed in the facility X. The camera 700 captures an image of the periphery of the route specified by the determination unit 124 of the seat guidance device 100a. A plurality of cameras 700 may be installed in the facility X.

The configuration diagram of the seat guidance device 100a according to this embodiment is the same as that in FIG. Hereinafter, the points different from the third embodiment will be described. The acquisition unit 127 acquires a second captured image around the path specified by the determination unit 124 from the camera 700. The determination unit 124 determines the degree of congestion from the second captured image acquired by the acquisition unit 127 by using a known image analysis technique. When the determined congestion degree is equal to or higher than a predetermined value, the determination unit 124 searches for a detour route and specifies the searched detour route as a movement route.

Next, the operation of the seat guidance system 600b will be specifically described with reference to FIG. It is assumed that the determination unit 124 determines the reserved seat s and determines the route 4b. Next, the acquisition unit 127 acquires a second captured image captured on the path 4b using the camera 700. The determination unit 124 determines whether or not the degree of congestion determined from the second captured image exceeds a predetermined value. The determination unit 124 may determine, for example, whether or not the number of people appearing in the second captured image exceeds a predetermined value. The determination unit 124 identifies the route 4a when the degree of congestion exceeds a predetermined value.

The determination unit 124 may specify a plurality of movement routes and assign priority to each movement route according to the degree of congestion. In such a case, the output unit 125 outputs a plurality of movement routes based on the priority. For example, the output unit 125 may output guidance information displayed in the seating chart with a route having a high priority as red and a route having a low priority as blue. Further, the output unit 125 may output a list in which guide maps including movement routes are arranged in order of priority.

The camera 700 may take a picture of the inside of each block. For example, when the determination unit 124 determines that the route going straight through the gate g5 is congested based on the second captured image, it bypasses the block B3 and moves from the competition area 5 side to the seats s. You may specify the route to go.

The seat guidance system 600b according to the fourth embodiment outputs a detour route based on the captured image on the specified route. Therefore, the seat guidance system 600b can appropriately guide visitors even when the aisles in the facility are congested.

<Embodiment 5>
The seat guidance system 600c according to the fifth embodiment identifies a member configuration from the first captured image, and determines a seat candidate in consideration of the member configuration. FIG. 16 is a block diagram showing a configuration of the seat guidance system 600c according to the fifth embodiment. The system configuration is the same as that of the third embodiment, but the face recognition terminal 300 photographs a plurality of people who have visited the facility X.

The configuration diagram of the seat guidance device 100a according to the fifth embodiment is the same as that of FIG. Hereinafter, the points different from the third embodiment will be described. The acquisition unit 127 acquires a first captured image including a plurality of persons from a face recognition terminal or the like. The authentication control unit 122 causes the authentication device 200 to perform face authentication for each of the plurality of face areas in the first captured image.

The identification unit 123 specifies a group attribute in a set of a plurality of persons who have succeeded in face recognition. Patent Document 2 describes a technique for identifying group attributes such as the number of people or the breakdown of adults, children, and gender from captured images.

The determination unit 124 further considers the group attributes specified by the specific unit 123 to determine seat candidates. For example, when the group attribute is specified for a family, the determination unit 124 determines a seat closer to the gates g1 to g8 as a seat candidate. Further, for example, when the determination unit 124 specifies the group attribute as a friendship, the determination unit 124 determines a seat closer to the competition area 5 as a seat candidate. The seat candidates are determined so that the members of the group can sit nearby.

The seat guidance system 600c according to the fifth embodiment selects seat candidates in consideration of group attributes. Therefore, the seat guidance system 600c can present a more appropriate seat to the visitors who are acting in a group.

In the above-described embodiment, the description is made as a hardware configuration, but the present invention is not limited to this. The present disclosure can also be realized by causing the CPU to execute a computer program.

In the above example, the program can be stored and supplied to a computer using various types of non-transitory computer readable medium. Non-temporary computer-readable media include various types of tangible storage mediums. Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, Includes CD-R / W, DVD (Digital Versatile Disc), semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be supplied to the computer by various types of temporary computer readable medium. Examples of temporary computer-readable media include electrical, optical, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

Note that this disclosure is not limited to the above embodiment, and can be appropriately modified without departing from the spirit. Further, the present disclosure may be carried out by appropriately combining the respective embodiments.

Although the invention of the present application has been described above with reference to the embodiments (and examples), the invention of the present application is not limited to the above-described embodiments (and examples). Various changes that can be understood by those skilled in the art can be made within the scope of the present invention in terms of the structure and details of the present invention.

Some or all of the above embodiments may also be described, but not limited to:
(Appendix 1)
An authentication control means for causing an authentication device that stores registered face feature information of a plurality of visitors to perform face recognition on the first captured image of a specific visitor at a predetermined point in a predetermined facility.
If the face recognition is successful, the specific means for identifying the past purchase history of reserved seats by the specific visitor and the specific means.
A determination means for determining a seat candidate based on the seat information that defines the arrangement of a plurality of seats in the facility and the specified purchase history.
An output means for outputting guidance information indicating the seat candidate and
Seat guidance device equipped with.
(Appendix 2)
The determination means is
The seat guidance device according to Appendix 1, which determines the seat candidate in consideration of the desired condition when the input of the desired condition regarding the seat candidate is received from the specific visitor.
(Appendix 3)
The seat guidance device is
A storage means for storing the seat information and the history information in which the visitor and the purchase history are associated with each other is further provided.
The determination means further determines the movement route from the current position of the specific visitor to the determined seat candidate.
The seat guidance device according to any one of Appendix 1 or 2, wherein the output means outputs the guidance information including the specified movement route.
(Appendix 4)
The determination means is
The degree of congestion is determined by analyzing the second captured image around the determined movement path.
The seat guidance device according to Appendix 3, which searches for a detour route and determines the searched detour route as the movement route when the degree of congestion is equal to or higher than a predetermined value.
(Appendix 5)
When a plurality of seat candidates are determined, the determination means determines the priority of each seat candidate according to the purchase history.
The seat guidance device according to any one of Appendix 1 to 4, wherein the output means outputs the guidance information indicating the plurality of seat candidates based on the priority.
(Appendix 6)
The determination means further identifies the movement route from the current position of the specific visitor to each of the seat candidates based on the seat information.
The output means includes the movement route corresponding to each seat candidate in the guidance information and outputs it.
The seat guidance device according to Appendix 5.
(Appendix 7)
The first captured image includes a plurality of persons.
The authentication control means causes the face authentication to be performed for each of the plurality of face regions in the first captured image.
The identification means identifies a group attribute in a set of persons who have succeeded in face recognition.
The determination means further considers the identified group attributes to determine the seat candidate.
The seat guidance device according to any one of Appendix 1 to 6.
(Appendix 8)
Further provided with an acquisition means for acquiring a third photographed image in which the seat group in the facility is photographed by the camera of the terminal of the specific visitor.
The output means causes the screen of the terminal to display a composite image obtained by synthesizing an index image showing the seat candidate at the position of the determined seat candidate in the third captured image as the guidance information. The seat guidance device according to any one of Appendix 1 to 7 to be output.
(Appendix 9)
The determination means determines the seat candidate according to the vacant seat information based on the detection result of the sensor attached to each of the plurality of seats.
The seat guidance device according to any one of Appendix 1 to 8.
(Appendix 10)
The seat guidance device according to any one of Supplementary note 1 to 8, wherein the determination means determines the seat candidate according to the vacant seat information based on the fourth photographed image of the seat group in the facility.
(Appendix 11)
A storage means for storing registered facial feature information of multiple visitors,
An authentication means for performing face recognition using the registered face feature information for the first photographed image of a specific visitor at a predetermined point in a predetermined facility, and
If the face recognition is successful, the specific means for identifying the past purchase history of reserved seats by the specific visitor and the specific means.
A determination means for determining a seat candidate based on the seat information that defines the arrangement of a plurality of seats in the facility and the specified purchase history.
An output means for outputting guidance information indicating the seat candidate and
Seat guidance device equipped with.
(Appendix 12)
The determination means is
The seat guidance device according to Appendix 11, which determines the seat candidate in consideration of the desired condition when the input of the desired condition regarding the seat candidate is received from the specific visitor.
(Appendix 13)
Seat guidance device and
An authentication device including a storage means for storing registered face feature information of a plurality of visitors and an authentication means for performing face recognition using the registered face feature information.
With
The seat guidance device is
The authentication device is made to perform face recognition on the first photographed image of a specific visitor at a predetermined point in a predetermined facility.
If the face recognition is successful, the purchase history of the reserved seat in the past by the specific visitor is specified, and the face recognition is performed.
Seat candidates are determined based on the seat information that defines the arrangement of a plurality of seats in the facility and the purchase history.
Outputs guidance information indicating the seat candidates,
Seat guidance system.
(Appendix 14)
The seat guidance device is
The seat guidance system according to Appendix 13, which determines the seat candidate in consideration of the desired condition when the input of the desired condition regarding the seat candidate is received from the specific visitor.
(Appendix 15)
The computer
A recognition device that stores registered face feature information of a plurality of visitors is made to perform face recognition on the first captured image of a specific visitor at a predetermined point in a predetermined facility.
If the face recognition is successful, the purchase history of the reserved seat in the past by the specific visitor is specified, and the face recognition is performed.
Seat candidates are determined based on the seat information that defines the arrangement of a plurality of seats in the facility and the purchase history.
Outputs guidance information indicating the seat candidates,
Seat guidance method.
(Appendix 16)
A computer that stores registered facial feature information of multiple visitors
Face recognition using the registered face feature information is performed on the first photographed image of a specific visitor at a predetermined point in a predetermined facility.
If the face recognition is successful, the purchase history of the reserved seat in the past by the specific visitor is specified, and the face recognition is performed.
Seat candidates are determined based on the seat information that defines the arrangement of a plurality of seats in the facility and the purchase history.
Outputs guidance information indicating the seat candidates,
Seat guidance method.
(Appendix 17)
On the computer
A process of having an authentication device that stores registered face feature information of a plurality of visitors perform face recognition on the first captured image of a specific visitor at a predetermined point in a predetermined facility.
When the face recognition is successful, the process of identifying the past purchase history of reserved seats by the specific visitor and the process of specifying the purchase history of the reserved seats in the past,
A process of determining a seat candidate based on the seat information that defines the arrangement of a plurality of seats in the facility and the purchase history.
A non-temporary computer-readable medium in which a seat guidance program for outputting a guidance information indicating a seat candidate and executing the seat guidance program is stored.
(Appendix 18)
A computer that stores registered facial feature information of multiple visitors
A process of performing face recognition using the registered face feature information for the first photographed image of a specific visitor at a predetermined point in a predetermined facility, and
When the face recognition is successful, the process of identifying the past purchase history of reserved seats by the specific visitor and the process of specifying the purchase history of the reserved seats in the past,
A process of determining a seat candidate based on the seat information that defines the arrangement of a plurality of seats in the facility and the purchase history.
A non-temporary computer-readable medium in which a seat guidance program for outputting a guidance information indicating a seat candidate and executing the seat guidance program is stored.

100, 100a, 100b, 100c Seat guidance device 110

Storage unit

102, 122 Authentication control unit

102a Authentication unit

103, 123

Specific unit

104, 124

Decision unit

105, 125 Output unit 106, 126 Generation unit 127 Acquisition unit 111 Seat information 112 History Information 113 Seat guidance program 130 Memory 140 Communication unit 200 Authentication device 210 Face information DB
220 Face detection unit 230 Feature point extraction unit 240 Registration unit 250

Authentication unit

300, 300a, 300b, 300c Face recognition terminal 310 Camera 320 Storage unit 330 Communication unit 340 Display unit 350 Control unit 351 Shooting control unit 352 Display control unit 400 User terminal 410 Camera 420 Storage unit 430 Communication unit 440 Display unit 450 Control unit 451 Shooting control unit 452 Display control unit 453 Registration unit 500

Network

600, 600a, 600b, 600c Seat guidance system

Claims

An authentication control means for causing an authentication device that stores registered face feature information of a plurality of visitors to perform face recognition on the first captured image of a specific visitor at a predetermined point in a predetermined facility.
If the face recognition is successful, the specific means for identifying the past purchase history of reserved seats by the specific visitor and the specific means.
A determination means for determining a seat candidate based on the seat information that defines the arrangement of a plurality of seats in the facility and the specified purchase history.
An output means for outputting guidance information indicating the seat candidate and
Seat guidance device equipped with.
The determination means is
The seat guidance device according to claim 1, wherein when the specific visitor receives an input of desired conditions regarding the seat candidate, the desired conditions are further taken into consideration to determine the seat candidate.
The seat guidance device is
A storage means for storing the seat information and the history information in which the visitor and the purchase history are associated with each other is further provided.
The determination means further determines the movement route from the current position of the specific visitor to the determined seat candidate.
The seat guidance device according to claim 1 or 2, wherein the output means outputs the guidance information including the specified movement route.
The determination means is
The degree of congestion is determined by analyzing the second captured image around the determined movement path.
The seat guidance device according to claim 3, wherein when the degree of congestion is equal to or higher than a predetermined value, a detour route is searched and the searched detour route is determined as the movement route.
When a plurality of seat candidates are determined, the determination means determines the priority of each seat candidate according to the purchase history.
The seat guidance device according to any one of claims 1 to 4, wherein the output means outputs the guidance information indicating the plurality of seat candidates based on the priority.
The determination means further identifies the movement route from the current position of the specific visitor to each of the seat candidates based on the seat information.
The output means includes the movement route corresponding to each seat candidate in the guidance information and outputs it.
The seat guidance device according to claim 5.
The first captured image includes a plurality of persons.
The authentication control means causes the face authentication to be performed for each of the plurality of face regions in the first captured image.
The identification means identifies a group attribute in a set of persons who have succeeded in face recognition.
The determination means further considers the identified group attributes to determine the seat candidate.
The seat guidance device according to any one of claims 1 to 6.
Further provided with an acquisition means for acquiring a third photographed image in which the seat group in the facility is photographed by the camera of the terminal of the specific visitor.
The output means causes the screen of the terminal to display a composite image obtained by synthesizing an index image showing the seat candidate at the position of the determined seat candidate in the third captured image as the guidance information. The seat guidance device according to any one of claims 1 to 7 to be output.
The determination means determines the seat candidate according to the vacant seat information based on the detection result of the sensor attached to each of the plurality of seats.
The seat guidance device according to any one of claims 1 to 8.
The seat guidance device according to any one of claims 1 to 8, wherein the determination means determines the seat candidate according to the vacant seat information based on the fourth photographed image of the seat group in the facility.
A storage means for storing registered facial feature information of multiple visitors,
An authentication means for performing face recognition using the registered face feature information for the first photographed image of a specific visitor at a predetermined point in a predetermined facility, and
If the face recognition is successful, the specific means for identifying the past purchase history of reserved seats by the specific visitor and the specific means.
A determination means for determining a seat candidate based on the seat information that defines the arrangement of a plurality of seats in the facility and the specified purchase history.
An output means for outputting guidance information indicating the seat candidate and
Seat guidance device equipped with.
The determination means is
The seat guidance device according to claim 11, wherein when the specific visitor receives an input of a desired condition regarding the seat candidate, the desired condition is further taken into consideration to determine the seat candidate.
Seat guidance device and
An authentication device including a storage means for storing registered face feature information of a plurality of visitors and an authentication means for performing face recognition using the registered face feature information.
With
The seat guidance device is
The authentication device is made to perform face recognition on the first photographed image of a specific visitor at a predetermined point in a predetermined facility.
If the face recognition is successful, the purchase history of the reserved seat in the past by the specific visitor is specified, and the face recognition is performed.
Seat candidates are determined based on the seat information that defines the arrangement of a plurality of seats in the facility and the specified purchase history.
Outputs guidance information indicating the seat candidates,
Seat guidance system.
The seat guidance device is
The seat guidance system according to claim 13, wherein when an input of a desired condition regarding the seat candidate is received from the specific visitor, the desired condition is further taken into consideration to determine the seat candidate.
The computer
A recognition device that stores registered face feature information of a plurality of visitors is made to perform face recognition on the first captured image of a specific visitor at a predetermined point in a predetermined facility.
If the face recognition is successful, the purchase history of the reserved seat in the past by the specific visitor is specified, and the face recognition is performed.
Seat candidates are determined based on the seat information that defines the arrangement of a plurality of seats in the facility and the specified purchase history.
Outputs guidance information indicating the seat candidates,
Seat guidance method.
A computer that stores registered facial feature information of multiple visitors
Face recognition using the registered face feature information is performed on the first photographed image of a specific visitor at a predetermined point in a predetermined facility.
If the face recognition is successful, the purchase history of the reserved seat in the past by the specific visitor is specified, and the face recognition is performed.
Seat candidates are determined based on the seat information that defines the arrangement of a plurality of seats in the facility and the specified purchase history.
Outputs guidance information indicating the seat candidates,
Seat guidance method.
On the computer
A process of having an authentication device that stores registered face feature information of a plurality of visitors perform face recognition on the first captured image of a specific visitor at a predetermined point in a predetermined facility.
When the face recognition is successful, the process of identifying the past purchase history of reserved seats by the specific visitor and the process of specifying the purchase history of the reserved seats in the past,
A process of determining a seat candidate based on the seat information that defines the arrangement of a plurality of seats in the facility and the specified purchase history.
A non-temporary computer-readable medium in which a seat guidance program for outputting a guidance information indicating a seat candidate and executing the seat guidance program is stored.
A computer that stores registered facial feature information of multiple visitors
A process of performing face recognition using the registered face feature information for the first photographed image of a specific visitor at a predetermined point in a predetermined facility, and
When the face recognition is successful, the process of identifying the past purchase history of reserved seats by the specific visitor and the process of specifying the purchase history of the reserved seats in the past,
A process of determining a seat candidate based on the seat information that defines the arrangement of a plurality of seats in the facility and the specified purchase history.
A non-temporary computer-readable medium in which a seat guidance program for outputting a guidance information indicating a seat candidate and executing the seat guidance program is stored.