JP2017211932A - Information processing device, information processing system, program and information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device or the like capable of improving the satisfaction of a visitor visiting an exhibition facility.SOLUTION: An information processing device 1 includes a storage part for storing attributes associated with a person, a place, and information on the place in association with one another in each attribute, an attribute discrimination part for discriminating an attribute from a person image, and a generation part for specifying the associated information with reference to the storage part in accordance with the discriminated attribute to generate guidance information. Since a visitor can be guided to a place corresponding to his/her individual attribute in this manner, the satisfaction of the visitor can be improved.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an information processing apparatus, an information processing system, a program, and an information processing method.

  Conventionally, in a facility such as a museum, a service for presenting an exhibition route created by a curator to a visitor is performed. However, the exhibition route was created mainly from an academic point of view, and was not satisfactory for visitors who did not have detailed knowledge about the exhibits.

  For example, Patent Document 1 discloses a terminal search system that individually guides and guides exhibits to individual visitors. According to Patent Document 1, a tour plan is created based on visitor information indicating a visitor's hobbies, preferences, and the like, and an exhibit is guided to the visitor via a terminal device.

JP2015-119261A

  However, Patent Document 1 only guides exhibits in consideration of the visitor's hobbies, preferences, and the like, and does not actively raise the interest of visitors to the exhibits.

  The present invention has been made under such circumstances, and an object of the present invention is to provide an information processing apparatus and the like that can improve the satisfaction of visitors who visit an exhibition facility.

  An information processing apparatus according to the present invention includes an attribute associated with a person, a location, and a storage unit that stores information on the location in association with each attribute, an attribute determination unit that determines an attribute from a person image, A generating unit configured to identify the related information with reference to the storage unit according to the determined attribute and generate guidance information.

  The information processing apparatus according to the present invention includes an output unit that outputs the generated guidance information to an external device.

  The information processing apparatus according to the present invention is characterized in that the place is a display place of an exhibit in a predetermined facility or a place where goods or services are provided, and the guidance information includes the display place or the supply place. To do.

  The information processing apparatus according to the present invention is characterized in that the guidance information includes a guidance route for guiding the plurality of places.

  An information processing apparatus according to the present invention includes an extraction unit that extracts appearance information related to a person's appearance based on the person image, and the attribute determination unit determines an attribute based on the extracted appearance information. To do.

An information processing apparatus according to the present invention includes an acquisition unit that acquires an image, sound, or waiting time of a person at the place, and emotion information that indicates the person's emotion based on the acquired image, sound, or waiting time. An estimation unit for estimation and a change unit for changing the guidance information according to the estimated emotion information are provided.

  The information processing apparatus according to the present invention is characterized in that the attribute determining unit determines attributes of a plurality of persons from the person image.

  An information processing system according to the present invention includes an attribute associated with a person, a location, and a storage unit that associates and stores information about the location for each attribute, an attribute determination unit that determines an attribute from a person image, A generating unit configured to identify the related information with reference to the storage unit according to the determined attribute and generate guidance information.

  The program according to the present invention stores an attribute associated with a person, a location, and information about the location in the storage unit in association with each attribute, determines an attribute from the person image, and according to the determined attribute The computer is caused to execute a process of identifying relevant information with reference to the storage unit and generating guidance information.

  The information processing method according to the present invention stores an attribute associated with a person, a location, and information about the location in the storage unit in association with each attribute, discriminates the attribute from the person image, and determines the discriminated attribute. Accordingly, the computer is caused to execute processing for identifying the relevant information with reference to the storage unit and generating guidance information.

  According to the present invention, it is possible to improve the satisfaction of visitors who visit an exhibition facility or the like.

It is a schematic diagram which shows the structural example of an information processing system. It is a block diagram which shows the structural example of a server. It is a block diagram which shows the structural example of a terminal. It is explanatory drawing which shows an example of the record layout of attribute DB. It is explanatory drawing which shows an example of the record layout of exhibition DB. It is explanatory drawing which shows an example of the record layout of an emotion table. It is explanatory drawing for demonstrating the discrimination | determination process of a visitor's personal attribute. It is explanatory drawing for demonstrating the specific process of an exhibit. It is explanatory drawing which shows an example of a map screen. It is explanatory drawing for demonstrating the description process of an exhibit. It is explanatory drawing for demonstrating the guidance change process based on emotion information. It is a flowchart which shows an example of the process sequence which a server performs. 6 is a block diagram illustrating a configuration example of a server according to Embodiment 2. FIG. It is explanatory drawing which shows an example of the record layout of facility DB which concerns on Embodiment 2. FIG. FIG. 10 is an explanatory diagram for explaining guidance processing according to the second embodiment. 10 is a flowchart illustrating an example of a processing procedure executed by a server according to the second embodiment. 10 is a block diagram illustrating a configuration example of a server according to Embodiment 3. FIG. It is explanatory drawing which shows an example of the record layout of attribute DB which concerns on Embodiment 3. FIG. It is explanatory drawing which shows an example of the record layout of goods DB which concerns on Embodiment 3. FIG. FIG. 10 is an explanatory diagram for explaining a group attribute discrimination process for visitors according to a third embodiment. FIG. 10 is an explanatory diagram for explaining guidance processing for products and the like according to Embodiment 3. FIG. 10 is an explanatory diagram for explaining guidance processing for products and the like according to Embodiment 3. 12 is a flowchart illustrating an example of a processing procedure executed by a server according to the third embodiment. It is a functional block diagram which shows operation | movement of the server of the form mentioned above.

Hereinafter, the present invention will be described in detail with reference to the drawings illustrating embodiments thereof.
(Embodiment 1)
FIG. 1 is a schematic diagram illustrating a configuration example of an information processing system. In the present embodiment, an explanation will be given by taking as an example an information processing system that guides an exhibit to a visitor who has visited the exhibition facility at an exhibition facility (eg, a museum) where the exhibit is displayed. The information processing system includes an information processing device 1, an information processing terminal 2, a reception device 3, a monitoring device 4, an AP (Access Point) 5, and the like that are connected to each other via a network N. The network N is the Internet, a LAN (Local Area Network) or the like.

  The information processing apparatus 1 is an information processing apparatus that stores various types of information and transmits and receives information via the network N. The information processing apparatus 1 is, for example, a server computer or a personal computer. In the present embodiment, the information processing apparatus 1 is assumed to be a server computer and is read as the server 1. The server 1 executes processing for guiding the exhibit to the visitors based on the individual visitor information acquired from the reception device 3.

  The information processing terminal 2 is a terminal device possessed by each visitor, and is, for example, a smartphone, a tablet terminal, a mobile phone, or the like. In the present embodiment, the information processing terminal 2 is assumed to be a smartphone, and will be read as the terminal 2 below for the sake of brevity. The terminal 2 acquires the guidance information for visitors generated by the server 1 and outputs a map screen and the like to be described later.

  The reception device 3 is a terminal device installed at the reception of the exhibition facility, and is, for example, a humanoid robot such as Pepper (registered trademark), an automatic reception device, or the like. In the present embodiment, it is assumed that the accepting device 3 is a humanoid robot. The reception device 3 performs an entrance reception process for a visitor, captures a person image of the visitor with a CCD (Charge Coupled Device) camera or the like, and transmits the individual visitor information including the person image to the server 1. The receiving device 3 may be a monitoring camera or the like instead of an information processing device such as a robot or a receiving machine.

  The monitoring device 4 is a monitoring device including a CCD camera, a speaker, and the like, for example, and is installed around the display place of each exhibit in the facility. The monitoring device 4 images a visitor viewing the exhibit and collects the voice of the visitor. AP 5 is a wireless access point, and one or a plurality of APs 5 are installed at predetermined locations in the exhibition facility. The AP 5 performs wireless communication with the terminal 2 and the like.

FIG. 2 is a block diagram illustrating a configuration example of the server 1. The server 1 includes a control unit 11, a storage unit 12, a communication unit 13, and a mass storage device 14.
The control unit 11 includes an arithmetic processing device such as a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The control unit 11 reads out and executes the program P stored in the storage unit 12 to perform various information processing or control processing related to the server 1.

  The storage unit 12 includes memory elements such as a RAM (Random Access Memory) and a ROM (Read Only Memory). The storage unit 12 stores a program P or data necessary for the control unit 11 to execute the processing according to the present embodiment. The storage unit 12 temporarily stores data and the like necessary for the control unit 11 to execute arithmetic processing.

  The communication unit 13 includes a processing circuit for performing processing related to communication, and transmits and receives information to and from the terminal 2 and the like via the network N.

The large-capacity storage device 14 is a large-capacity storage device including, for example, a hard disk. The large-capacity storage device 14 stores an attribute DB 141, an exhibition DB 142, an emotion table 143, and the like. The attribute DB 141 stores visitor attributes. The exhibition DB 142 stores an attribute associated with a person, a place in the exhibition facility, and information about the place in association with each attribute. In the present embodiment, the attribute associated with the person is the attribute of the exhibit, the place in the exhibition facility is the exhibit location of the exhibit, and the information related to the location is the information of the exhibit. The emotion table 143 is a table for estimating emotion information indicating a visitor's emotion.
In the present embodiment, the storage unit 12 and the mass storage device 14 may be configured as an integrated storage device. Further, the mass storage device 14 may be constituted by a plurality of storage devices. The mass storage device 14 may be an external storage device connected to the server 1.

  In the present embodiment, the server 1 is not limited to the above configuration. For example, an input unit that receives an operation input, a display unit that displays information related to the server 1, a reading unit that reads information stored in a portable storage medium, and the like May be included.

FIG. 3 is a block diagram illustrating a configuration example of the terminal 2. The terminal 2 includes a control unit 21, a storage unit 22, a communication unit 23, a display unit 24, an input unit 25, an audio output unit 26, and an imaging unit 27.
The control unit 21 includes an arithmetic processing unit such as a CPU or MPU, and performs various information processing or control processing related to the terminal 2 by reading and executing a program stored in the storage unit 22.
The storage unit 22 includes memory elements such as a RAM and a ROM, and stores programs or data necessary for the control unit 21 to execute processing. The storage unit 22 temporarily stores data and the like necessary for the control unit 21 to execute arithmetic processing.
The communication unit 23 includes an antenna, a communication processing circuit, and the like, and transmits and receives information to and from the server 1 and the like via the network N.

The display unit 24 has a screen such as a liquid crystal display or an organic EL (Electro Luminescence) display, and displays an image given from the control unit 21.
The input unit 25 is a touch panel or a push button provided on the display unit 24 and receives an operation input by a visitor. The input unit 25 notifies the control unit 21 of the operation content performed by the visitor.
The audio output unit 26 is a speaker or the like that outputs audio, and outputs audio in accordance with instructions from the control unit 21.
The imaging unit 27 includes a CCD camera or the like and captures an image. The captured image is stored in the storage unit 22.

  In the present embodiment, the terminal 2 is not limited to the above configuration, and may include, for example, a microphone or the like that accepts voice input.

FIG. 4 is an explanatory diagram showing an example of the record layout of the attribute DB 141. The attribute DB 141 includes a visitor column and an attribute column. The visitor column stores a visitor ID for identifying a visitor who visits the exhibition facility. The attribute column stores a visitor's personal attribute in association with the visitor ID. Specifically, the attribute column stores data relating to a plurality of attribute items determined from an image obtained by capturing an image of a visitor. For example, the attribute column stores data of each item such as the type of each part such as eyes, nose, mouth, etc., hairstyle, body shape, height, posture, age, sex, facial expression, clothes, etc. of the visitor.

  FIG. 5 is an explanatory diagram showing an example of the record layout of the exhibition DB 142. The exhibition DB 142 includes an exhibition column, a type column, an attribute column, an explanation column, a detailed explanation column, and a place column. The exhibition column stores an exhibition ID for identifying the exhibits displayed in the exhibition facility. The type column stores the type of exhibit in association with the exhibition ID. The attribute column stores the attribute associated with the person in association with the exhibition ID. Specifically, the attribute column stores the attribute of the exhibit so that it can be compared with the attribute of the person who guides the exhibit, that is, the visitor. For example, if the exhibit is a “human figure”, the attribute column stores the attributes of the exhibit for each attribute item, such as the type of each part of the face of the person drawn in the portrait, the hairstyle, and clothes. Has been. The attributes of the face part type, hairstyle, clothes, etc. of the person in the figure can be compared with the attributes of the visitors (see FIGS. 4 and 5). In the matching process described later, the server 1 compares the attribute of the exhibit with the attribute of the visitor, and determines the similarity between the appearance of the visitor and the exhibit, thereby identifying the exhibit to be guided to the visitor. . That is, the server 1 stores in the exhibition DB 142 the attributes associated with each exhibition item and associated with the person who is the guidance object of the exhibition, and the attribute of the visitor is the guidance object in the matching process described later. It is determined whether or not the exhibit is to be guided to the visitors by determining whether or not there is a similarity with the associated attribute. The server 1 stores the attribute representing the contents of the exhibit as an attribute associated with the person who is the guidance target, thereby determining the similarity between the appearance of the visitor and the exhibit, Exhibits that are similar in appearance will be identified and guided to the visitors. The explanation column stores explanation information for explaining the exhibit to the visitors in association with the exhibition ID. The explanation information is, for example, a voice, an image or the like for explaining the exhibit to the visitors. The detailed explanation column stores explanation information for performing more detailed explanation than the explanation information stored in the explanation column in association with the exhibition ID. The place column stores the exhibition place of the exhibit in the exhibition facility in association with the exhibition ID.

  FIG. 6 is an explanatory diagram showing an example of the record layout of the emotion table 143. The emotion table 143 includes an item string, a detail string, and a point string. The item string stores reference items that serve as references for estimating the emotion information of visitors. The detailed column stores detailed estimation criteria for each reference item in association with the reference item. Note that more detailed reference values relating to images, sound, time, and the like are stored in the detail column, but only an overview is shown in FIG. 6 for convenience. The point sequence stores points that are added or subtracted when the estimation criteria are satisfied in association with the estimation criteria. As will be described later, the server 1 calculates the point according to whether or not each estimation criterion is satisfied, thereby calculating the emotion information of the visitor, specifically, the satisfaction level.

FIG. 7 is an explanatory diagram for explaining the personal attribute determination process of a visitor. The outline of the processing executed by the information processing system will be described below. Hereinafter, for convenience of explanation, the processing entity of the server 1 is the control unit 11, and the processing entity of the terminal 2 is the control unit 21.
In FIG. 7, the example of the person image which the reception apparatus 3 imaged the visitor is shown. The reception device 3 is installed near the entrance of an exhibition facility, for example. The reception device 3 performs a predetermined entrance reception process for visitors who have entered the exhibition facility. For example, the accepting device 3 performs pre-registration of the terminal 2 via a communication device (not shown). Furthermore, the accepting device 3 captures a full body image of the visitor shown in FIG. The accepting device 3 transmits the captured person image to the server 1.

  The control unit 11 of the server 1 acquires a person image from the reception device 3. The control unit 11 determines the personal attribute of the visitor based on the acquired person image. Specifically, the control unit 11 extracts appearance information related to the appearance of the visitor based on the acquired person image, and determines the attributes of the visitor based on the appearance information.

For example, the control unit 11 determines the shape of each part such as eyes, nose, and mouth from the image,
Extract features such as position and size. The control unit 11 determines the type of each part from the extracted feature amount. Note that the type of face part is defined in advance in the program P. With the above processing, the control unit 11 determines the visitor attribute for the attribute item “face”.

  In addition, the control unit 11 determines the facial expression, age, sex, and the like of the visitor based on the feature amount extracted from the face part image. For example, the control unit 11 performs machine learning for extracting feature points, feature vectors, and the like from a sample image for a plurality of facial expression patterns such as “smile”, “true face”, and “tension”, and based on the learning model, the face of the visitor Discriminate facial expressions from images. Similarly, the control unit 11 performs machine learning for age, gender, and the like, and discriminates age, gender, etc. from the face image of the visitor. In addition, the control unit 11 determines the hairstyle of the visitor from the captured image.

  In addition, the control unit 11 extracts features such as the overall contour, height, width, position of each part (hand, foot, shoulder, etc.) from the image, and the body shape, height, posture of the visitor. And so on.

The control unit 11 also extracts feature quantities such as color, brightness, and shape for the clothes of the visitors, and determines attributes such as color and type (for example, a type such as a T-shirt and a Y-shirt). Note that the control unit 11 may determine a clothing pattern in addition to the color and type.
As described above, the control unit 11 extracts appearance information related to the face, body, clothes, and the like from the person image obtained by capturing the image of the visitor, and determines the attribute related to each attribute item. The control unit 11 stores the determined visitor attributes in the attribute DB 141.

FIG. 8 is an explanatory diagram for explaining the exhibit specifying process. The control unit 11 specifies the exhibits to be guided to the visitors from the exhibition DB 142 according to the attributes of the visitors determined above. Specifically, the control unit 11 performs matching processing that compares the attributes of the visitors with the attributes of the exhibits, and identifies exhibits having similarities.
For example, the control unit 11 randomly selects an attribute item from the visitor's attributes, and determines whether there is similarity for the attribute item. Here, it is assumed that the control unit 11 has selected the attribute item “face”. In this case, the control unit 11 refers to the exhibition DB 142, the type of each part such as a visitor's eyes, nose, mouth, etc., a person who is a copying medium such as a human figure or sculpture, and a person who is a photographed medium Are compared with the type of each part, and the similarity in the whole face is judged. The control unit 11 specifies a display object having a similarity, for example, a human figure on which a person similar to the face of the visitor is drawn. The control unit 11 performs the above-described matching process for each exhibit, and identifies exhibits that have similarities.

  In addition, although the control part 11 performed the matching process on the basis of one attribute item above, this Embodiment is not restricted to this. The control unit 11 may determine whether or not there are similarities for other attribute items such as “expression”, “clothes”, and “hairstyle”, and may determine whether or not they have overall similarities.

  The control unit 11 generates guide information for guiding the specified exhibit to the visitors. Specifically, the control unit 11 refers to the exhibition DB 142 and includes an exhibition location of the exhibit in the exhibition facility, a guide route of the exhibit in the exhibit facility, explanatory information for explaining each exhibit to the visitors, and the like. Guide information is generated. The explanation information will be described later.

  The control unit 11 reads the exhibition location of each exhibit from the exhibition DB 142. The control unit 11 generates a guide route according to the read exhibition place. For example, the control unit 11 refers to a map in the exhibition facility stored in advance in the storage unit 12 or the large-capacity storage device 14 and generates a guide route that connects the respective exhibition places with the shortest route.

FIG. 9 is an explanatory diagram showing an example of the map screen. The control unit 11 displays an exhibition place 9 indicated by a black circle.
1. A map screen including a guide route 92 indicated by a solid line is output to the terminal 2. The control unit 11 guides visitors to the exhibition place 91 by outputting a map screen to the terminal 2. Note that the control unit 11 may output not only the map screen but also voice data, text data, and the like related to the progress instruction. In addition, as indicated by a black circle in FIG. 9, the control unit 11 may display a visitor's position 93 on the map screen. In this case, for example, the AP 5 installed in the exhibition facility performs wireless communication with the terminal 2 and acquires the position information of the terminal 2 from the strength and direction of the communication radio wave. The control unit 11 of the server 1 acquires position information from the AP 5 and displays the visitor's position 93 on the map screen. Note that the terminal 2 may determine the position information of its own device and reflect it on the map screen. In addition, the control unit 11 determines the position information of the terminal 2 based on the wireless communication by the AP 5 as described above. For example, the communication with the Bluetooth (registered trademark) communication device, the communication related to GPS (Global Positioning System), the mobile phone base station The position information may be determined based on communication with the user.

  The control unit 11 of the server 1 determines whether or not the visitor has arrived in the vicinity of the exhibition place 91 for the exhibit. For example, the control unit 11 acquires the position information of the terminal 2 from the AP 5 as described above, and determines whether or not the terminal 2 is located within a predetermined range from the exhibition place 91 of the exhibit. When it is determined that the visitor has arrived near the exhibition place 91, the control unit 11 refers to the exhibition DB 142 and outputs the following explanation information to the terminal 2.

  FIG. 10 is an explanatory diagram for explaining the display process of the exhibit. Upon receiving the guidance information output from the server 1, the control unit 21 of the terminal 2 outputs audio and images for explaining the exhibit to the visitors as shown in FIG. The voice is a message that includes, for example, the appearance of the visitor being similar to the exhibit, and an overview of the exhibit. Moreover, the said image is an image which shows the specific location etc. of the exhibit which has similarity with the external appearance of a visitor, for example. As shown in FIG. 10, for example, the control unit 21 outputs a voice saying “This person looks just like you” at the beginning of the message, and then outputs a voice that briefly explains the outline of the exhibit. In addition, the control unit 21 highlights the place of the exhibit similar to the appearance of the visitor. In addition to the above, the control unit 21 may output, for example, music according to the exhibit to be guided. Moreover, although the control part 21 performed voice guidance with respect to a visitor above, it is needless to say that text guidance may be performed, for example.

  FIG. 11 is an explanatory diagram for explaining guidance change processing based on emotion information. As described above, the control unit 11 of the server 1 guides the exhibit that is specified according to the attributes of the visitors. Further, the control unit 11 appropriately changes the guidance information according to the reaction of the visitors who have received the guidance. Specifically, the control unit 11 estimates emotion information indicating the emotion of the visitor who has received the guidance, and performs a process of changing the guidance information according to the estimated emotion information.

  For example, the control unit 11 acquires the position information of the terminal 2, that is, the current position of the visitor in the same manner as described above, and measures the waiting time that the visitor is waiting at the exhibition place. Moreover, the control part 11 acquires the audio | voice which concerns on the image which imaged the visitor, the utterance of the visitor, etc. from the monitoring apparatus 4 installed near the present position of the visitor. The control unit 11 estimates the visitor's emotion information based on the acquired image, sound, and standby time of the visitor. For example, the control unit 11 estimates the degree of satisfaction of the visitor to the guidance based on the change in the facial expression of the visitor, the movement of the body, the voice, the waiting time, and the like.

For example, the control unit 11 extracts a feature amount of the face portion from the acquired image and observes a change in the facial expression of the visitor. The control unit 11 discriminates the facial expression by patterning the facial expression from the feature amount of the face image in the same manner as the attribute discrimination. For example, the control unit 11 compares the facial expression when the visitor receives the admission, that is, the facial expression stored in the attribute DB 141 with the facial expression when the output of the description information is finished. The control unit 11 refers to the emotion table 143 and calculates, for example, a point related to satisfaction based on the change in the facial expression. For example, let us consider a case where the face was “true face” at the time of entry, but “smile” was given at the end of output, that is, after receiving an explanation. In this case, the control unit 11 refers to the emotion table 143, and since “true face” is 0 point and “smile” is 2 points, 2 points of satisfaction are calculated for the change in the facial expression. In the above description, the control unit 11 estimates the visitor's emotion from the change in facial expression at the time of entrance and at the end of the explanation. And the above processing may be performed. Moreover, the control part 11 may estimate a visitor's emotion based not on the change of a facial expression but only on the facial expression at the present time, ie, the time of an explanation end.

  Further, the control unit 11 extracts feature amounts of body parts, for example, feature points and feature vectors related to hands, feet, shoulders, chests, and the like from the image. The control unit 11 determines the operation of the visitor based on the extracted feature quantity of the body part, for example, the operation such as whether or not the visitor is wearing arms, whether or not the cheek cane is worn. As in the case of facial expressions, the control unit 11 calculates the satisfaction level of the visitors in a point format according to the movements of the visitors. For example, the control unit 11 calculates the degree of satisfaction related to the motion by adding or subtracting the points related to each motion as adding 1 point if the arm is folded and subtracting 2 points if the arm is poor.

  Moreover, the control part 11 extracts the feature-values, such as a magnitude | size concerning the utterance of a visitor, a frequency, and conversation duration, from the acquired audio | voice, and estimates a visitor's emotion. For example, the control unit 11 performs machine learning that extracts feature amounts from sample sounds related to multiple patterns of emotions such as “laughter”, “joy”, and “anger”, and the feature amount of the model based on the learning process and the utterance speech of the visitor And the emotion of the visitor is estimated from the plurality of patterns. In addition, the control unit 11 extracts the words being spoken by the visitors from the acquired voice, and determines whether or not the words defined in the emotion table 143 have come out. For example, the control unit 11 determines whether a key phrase such as “interesting” or “boring” has come out. Based on the key phrase, the control unit 11 estimates the emotion of the visitor. The control unit 11 calculates the satisfaction degree in the point format as in the case of facial expressions and actions.

  Moreover, the control part 11 estimates a visitor's emotion based on the waiting time where the visitor waits in front of an exhibit. For example, when the visitor leaves the exhibition place in a short time, the control unit 11 estimates that the visitor is dissatisfied with the guidance. On the other hand, when it is in the vicinity of the exhibition place for a long time, the control unit 11 estimates that the visitor is satisfied with the guidance. In the same manner as described above, the control unit 11 calculates satisfaction points according to the length of the standby time.

  The control unit 11 changes the guide information according to the estimated emotion information. For example, the control unit 11 compares the satisfaction degree point with a predetermined first threshold value and a second threshold value smaller than the first threshold value, so that the visitor is satisfied with the guidance or dissatisfied. Or whether it is normal, not satisfied or dissatisfied. When it is determined that the calculated point is equal to or greater than the first threshold, the control unit 11 estimates that the visitor is satisfied with the guidance and is interested in the exhibit. In this case, the control unit 11 refers to the detailed description string in the exhibition DB 142 and outputs more detailed description information to the terminal 2 than the output description information.

  When it is determined that the calculated point is less than the second threshold, the control unit 11 estimates that the visitor is dissatisfied with the guidance and does not want to receive the current guidance. In this case, the control unit 11 corrects the guide information. For example, the control unit 11 changes the attribute item used for the exhibit specifying process to another attribute item, and corrects the exhibit guided to the visitors. When the exhibit is specified according to the attribute item “face” as described above, the control unit 11 selects another attribute item (for example, “clothes”), and the appearance and exhibit of the visitor according to the attribute item. Judge similarities with and identify other exhibits. The control unit 11 reads out the exhibition place 91 of the identified exhibit from the exhibition DB 142, and regenerates the guide route 92 related to the shortest route from the current position 93 of the visitor to each exhibition place 91. The control unit 11 re-outputs the guidance information including the exhibition place 91 and the guidance route 92 of the exhibit to the terminal 2.

  When it is determined that the point is less than the first threshold and greater than or equal to the second threshold, the control unit 11 does not indicate that the visitor is interested in the exhibit, but does not feel dissatisfied with the guidance. Estimated. The control unit 11 does not change the guide information and guides the next exhibit as it is to the visitors. The control unit 11 repeats the above processing until guidance is provided for all the exhibits specified from the exhibition DB 142. When the guidance process is performed for all exhibits, the control unit 11 ends the series of processes.

  In addition, although the control part 11 estimated the visitor's emotion information based on several elements, such as a visitor's facial expression, operation | movement, voice, waiting time, etc. above, this Embodiment is not restricted to this. For example, the control unit 11 may estimate emotion information based only on changes in the facial expressions of visitors. In this case, the control unit 11 does not calculate the points, and changes the guidance information using the change in the facial expression as a branching condition, for example, whether the visitor's facial expression has changed from “true face” to “smile” or “anger”. What is necessary is just to process.

FIG. 12 is a flowchart illustrating an example of a processing procedure executed by the server 1. Based on FIG. 12, the processing content which the server 1 performs is demonstrated.
The control unit 11 of the server 1 acquires a person image obtained by capturing an image of a visitor who has visited the exhibition facility from the reception device 3 (step S11). For example, the reception device 3 captures a whole body image of a visitor when a visitor who has visited the exhibition facility performs a predetermined reception process. The control unit 11 acquires the captured image of the visitor from the reception device 3.

  The control unit 11 extracts appearance information relating to the appearance of the visitors from the acquired person image (step S12). Specifically, the control unit 11 extracts features such as shape, size, position, color, brightness, etc. of the appearance of the visitor's face, hair, silhouette of the whole body, clothes, etc. from the person image. The control unit 11 determines the attributes of the visitors based on the extracted appearance information (step S13). For example, the control unit 11 determines the type, hairstyle, body shape, height, clothing color, type, and the like of each part of the face based on the extracted feature amount. Moreover, the control part 11 discriminate | determines a visitor's age, sex, a facial expression, etc. compared with the model data learned beforehand. The control unit 11 stores the determined personal attributes of the visitors in the attribute DB 141.

  The control unit 11 refers to the exhibition DB 142, and specifies information related to the location to be guided to the visitors, that is, exhibits, according to the determined attributes of the visitors (step S14). Specifically, the control unit 11 performs a matching process for comparing the attribute associated with the person stored in the exhibition DB 142, specifically, the attribute of each exhibit and the attribute of the visitor stored in the attribute DB 141, Judge the similarity between visitors' appearance and exhibits. For example, the control unit 11 randomly selects an attribute item that is a determination criterion for determining similarity, and determines similarity for the attribute item. For example, when the attribute item “face” is selected, the control unit 11 compares the type of each part such as the eyes, nose, and mouth of the visitor with the type of each part of the person image displayed in the exhibition facility, Determine similarity across faces. In addition, the control part 11 may judge similarity regarding all the items about the some attribute item discriminate | determined from the captured image. The control unit 11 identifies exhibits that are similar in appearance to the visitors.

  The control part 11 produces | generates the guidance information containing the exhibition place and guidance route of the specified exhibit, and outputs it to the terminal 2 (step S15). Specifically, the control unit 11 refers to the exhibition DB 142 and reads the display location of the exhibit in the exhibition facility. For example, the control unit 11 generates a guide route that connects display places of a plurality of exhibits with the shortest route. The control unit 11 outputs a map screen including the exhibition place of each exhibit and the generated guide route to the terminal 2. Note that the guidance information may include not only the exhibition location and the guidance route, but also, for example, voice for guiding visitors to the exhibition location.

  The control unit 11 determines whether or not the visitor has arrived near the display place of the exhibit (step S16). For example, the AP 5 installed in the exhibition facility communicates with the terminal 2 and acquires the position information of the terminal 2. The control unit 11 of the server 1 acquires the position information from the AP 5. The control unit 11 determines whether or not the terminal 2 is located within a predetermined range from the exhibition place of the exhibit. When it determines with not having arrived near the exhibition place (S16: NO), the control part 11 waits for a process. When it determines with having arrived near the exhibition place (S16: YES), the control part 11 outputs the explanatory information for explaining the said exhibit to a visitor to the terminal 2 (step S17). For example, the control unit 11 outputs to the terminal 2 explanatory information indicating that the appearance of the visitor and the exhibit have similarity. The control unit 21 of the terminal 2 acquires the explanation information from the server 1, displays an image of a place where the appearance of the visitor and the exhibit are similar, and explains the similarity, an outline of the exhibit, etc. The explanation voice to be output is output.

  The control unit 11 acquires the image, sound, and waiting time of the visitor at the exhibition place of the exhibit (step S18). Specifically, the control unit 11 acquires an image obtained by capturing an image of a visitor and a speech such as the utterance of the visitor from the monitoring device 4 installed in the vicinity of the exhibit location. In addition, the control unit 11 acquires the position information of the terminal 2 from the AP 5 or the like as described above, and measures the standby time.

  The control unit 11 estimates emotion information indicating the visitor's emotion based on the acquired image, sound, and standby time (step S19). For example, the control unit 11 extracts the feature amount of the face portion of the visitor from the acquired image, and determines the current facial expression. Further, the control unit 11 extracts feature points and feature vectors such as a visitor's hands and feet from the image, and discriminates the visitor's movement. Further, the control unit 11 extracts features such as the loudness and frequency of the visitors from the acquired voice, and discriminates the spoken words and the like. The control unit 11 refers to the emotion table 143 and estimates the emotion of the visitor based on the information such as the facial expression, motion, voice, waiting time, etc. of the visitor determined as described above. Specifically, the control unit 11 calculates the satisfaction level of the visitors in a point format. For example, the control unit 11 determines a change between the present visitor's facial expression and the visitor's facial expression at the time of admission, that is, the facial expression stored in the attribute DB 141, and refers to the emotion table 143 in a point format. calculate. In addition, the control unit 11 calculates points for each motion such as a hand, a foot, and a posture. In addition, the control unit 11 calculates points based on the voice feature amount, words uttered by the visitors, and the like. Moreover, the control part 11 calculates a point according to standby time. The control part 11 calculates | requires the total value of a point about each element, such as a facial expression and an action, and estimates emotion information which shows a visitor's emotion, for example, satisfaction.

  The control unit 11 determines whether or not the visitor is satisfied with the guidance according to the estimated emotion information (step S20). For example, the control unit 11 determines whether or not the point calculated above is equal to or greater than a predetermined first threshold value. When it determines with being satisfied (S20: YES), the control part 11 outputs more detailed description information to the terminal 2 than the description information output by step S17 (step S21). For example, the control unit 11 refers to the exhibition DB 142 and outputs a more detailed description stored in the detail column to the terminal 2. The control part 11 transfers a process to step S24.

When it determines with not being satisfied (S20: NO), the control part 11 determines whether a visitor is dissatisfied with guidance according to the emotion information estimated by step S19 (step S22). For example, the control unit 11 determines whether or not the point calculated above is less than a second threshold value that is smaller than the first threshold value. When it determines with dissatisfaction (S22: YES), the control part 11 corrects guidance information and outputs it to the terminal 2 (step S23). For example, the control unit 11 changes the attribute item used as the determination criterion in the specifying process in step S14, and specifies again the exhibit to be guided to the visitors. For example, when the attribute item “face” is selected in step S <b> 14, the control unit 11 reselects another attribute item “clothes” and identifies similar exhibits for the clothes. The control unit 11 reads the display location of the specified exhibit from the display DB 142, and regenerates the guide route from the current position of the visitor to each exhibit, thereby correcting the guide information. The control unit 11
The corrected guidance information is output to the terminal 2, and the process proceeds to step S24.

  When it determines with not being dissatisfied (S22: NO), the control part 11 determines whether guidance is complete | finished (step S24). For example, the control unit 11 determines whether or not the terminal 2 is located at the exhibition place of the last exhibit related to the guide route. When it determines with not complete | finishing (S24: NO), the control part 11 returns a process to step S16. When it determines with complete | finishing (S24: YES), the control part 11 complete | finishes a series of processes.

  In addition, although the server 1 produced | generated the guidance path | route for guiding an exhibit to a visitor above, this Embodiment is not restricted to this. For example, the server 1 does not generate a guide route, and a predetermined alert is generated when the terminal 2 is located within a predetermined range from the display place of the exhibit, that is, when a visitor who visits the exhibition facility approaches the exhibit. It is good also as outputting guidance, such as explanatory information, to the terminal 2 with a sound. That is, the server 1 may not perform the guide route generation process.

  Moreover, although the server 1 performed the process which discriminate | determines an attendee's attribute in the above, this Embodiment is not restricted to this. For example, the reception device 3 may determine the attribute of the visitor and notify the server 1 of the determination result. In this case, the reception device 3 functions as an attribute determination unit that determines the attributes of the visitors based on the person image. Further, the server 1 functions as a generation unit that specifies information related to an exhibition place, that is, an exhibit, according to the attribute of the visitor, and generates guidance information. That is, in the present embodiment, it is only necessary that the entire information processing system can execute a series of processes.

  Further, although the server 1 outputs the generated guidance information directly to the terminal 2 as described above, the present embodiment is not limited to this. For example, the server 1 may output data relating to the guidance information to the reception device 3 and display a QR code (registered trademark) on the display provided on the chest of the reception device 3 that is a humanoid robot. The terminal 2 recognizes the QR code by the imaging unit 27 and downloads the guide information. Even if it is the said structure, there exists an effect similar to the above.

  Moreover, although the server 1 specified the exhibit based on the similarity between the appearance of the visitor and the exhibit as described above, the present embodiment is not limited to this. For example, the server 1 may perform guidance processing according to age, such as guiding an exhibition for children to young visitors and an adult for middle-aged visitors. In other words, the server 1 only needs to be able to identify exhibits to be guided to the visitors according to the attributes of the visitors.

  As described above, according to the first embodiment, it is possible to improve the satisfaction of visitors who visit an exhibition facility.

  Further, according to the first embodiment, for example, by outputting guidance information to a terminal 2 such as a smartphone, visitors can easily receive guidance while visiting the exhibition facility.

  Further, according to the first embodiment, for example, appropriate guidance can be provided by displaying an exhibition place on a map screen.

  Further, according to the first embodiment, it is possible to automatically generate a guide route for exhibits according to the personal attributes of visitors.

  Further, according to the first embodiment, the exhibit to be guided is specified according to the appearance of the visitors. Visitors receive guidance on exhibits based on extremely familiar information such as their appearance, making it easier for visitors to be interested in the exhibits. As a result, the satisfaction level of the visitors can be improved.

  Moreover, according to this Embodiment 1, according to the response of the visitor who received guidance, detailed description output, a guidance route correction, etc. can be performed, and subsequent guidance can be changed flexibly.

(Embodiment 2)
In the present embodiment, a mode will be described in which not only the exhibits in the exhibition facility but also information related to other exhibits is guided according to the attributes of the visitors. In addition, about the content which overlaps with Embodiment 1, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  FIG. 13 is a block diagram illustrating a configuration example of the server 1 according to the second embodiment. In the present embodiment, a mode in which a tourist facility near the exhibition facility is guided according to the personal attributes of the visitors will be described. The mass storage device 14 according to the present embodiment stores a facility DB 144. The facility DB 144 stores information related to tourist facilities near the exhibition facility.

  FIG. 14 is an explanatory diagram illustrating an example of a record layout of the facility DB 144 according to the second embodiment. The facility DB 144 includes a facility column, a name column, an exhibition column, a type column, an attribute column, an introduction column, and a place column. The facility column stores a facility ID for identifying another facility outside the exhibition facility, for example, a tourist facility. The name column stores the name of the tourist facility in association with the facility ID. The exhibition row stores an exhibition ID for identifying the exhibits displayed at the tourist facility in association with the facility ID. The type column stores the type of exhibit in association with the exhibition ID. The attribute column stores the attribute associated with the person who is the guidance object, specifically the attribute of the exhibit, in association with the exhibition ID. The introduction column stores introduction information for introducing exhibits to visitors in association with exhibition IDs. The introduction information is, for example, data such as sound and image as in the explanation information of the first embodiment. The location column stores location information indicating the location of the tourist facility in association with the facility ID.

FIG. 15 is an explanatory diagram for explaining the guidance processing according to the second embodiment. Similar to the first embodiment, the control unit 11 performs a guide process for the exhibits displayed in the exhibition facility. The control part 11 performs the process which guides other tourist facilities to a visitor according to the attribute of a visitor after the said guidance end.
For example, the control unit 11 performs a matching process between the attribute of the visitor stored in the attribute DB 141 and the attribute of the exhibit exhibited in another tourist facility stored in the facility DB 144. Similar to the first embodiment, the matching process determines the similarity between the appearance of the visitors and the exhibits. The control unit 11 identifies exhibits that are similar in appearance to the visitors. The control unit 11 reads, from the facility DB 144, the name and location of the tourist facility where the identified exhibit is displayed, the introduction information of the identified exhibit, and the like.

  The control part 11 produces | generates the guidance information which guides the said tourist facility to a visitor. For example, as shown in FIG. 15, the control unit 11 displays on the terminal 2 an image of an exhibit determined to be similar to the appearance of the visitor, a name of a tourist facility where the exhibit is displayed, a location, and the like. An introductory message such as the fact that the exhibit is similar to the appearance of the visitor and the fact that the exhibit is displayed at the tourist facility being displayed is output to the terminal 2 by voice. For example, the control unit 11 may display not only the location of the tourist facility, but also the current location, that is, the traffic route from the exhibition facility that the visitor has visited to the tourist facility.

  Further, FIG. 15 illustrates a state where one tourist facility is guided, but the present embodiment is not limited to this. For example, the control unit 11 may identify exhibits related to a plurality of tourist facilities, generate guidance information for guiding the plurality of tourist facilities, and output the guidance information to the terminal 2. Thereby, the control part 11 can perform comprehensive sightseeing guidance including not only the exhibition facility visited by the visitor but also a plurality of other facilities.

FIG. 16 is a flowchart illustrating an example of a processing procedure executed by the server 1 according to the second embodiment. Based on FIG. 16, the processing content which the server 1 which concerns on this Embodiment performs is demonstrated.
When it determines with complete | finishing about the exhibit in an exhibition facility (S24: YES), the control part 11 performs the following processes. The control unit 11 specifies information related to the location to be guided to the visitors, specifically the exhibits of other facilities to be guided to the visitors according to the attributes of the visitors (step S201). Specifically, the control unit 11 reads information related to the attributes of the visitors from the attribute DB 141. The control unit 11 refers to the facility DB 144 and performs a matching process between the read attribute of the visitor and the attribute of the exhibit exhibited at another tourist facility. Specifically, the control unit 11 determines the similarity between the appearance of the visitors and the exhibits. The control unit 11 identifies exhibits from other tourist facilities that are similar in appearance to the visitors.

  The control unit 11 generates guide information for guiding other tourist facilities where the specified exhibits are displayed, and outputs the guide information to the terminal 2 (step S202). For example, the control unit 11 refers to the facility DB 144, information on the name and location of the tourist facility where the exhibit specified in step S201 is exhibited, and images, audio, etc. for introducing the exhibit to the visitor Read the introduction information. The control unit 11 generates guide information for guiding the tourist facility based on the read information. For example, the guide information includes an audio message indicating that an exhibit similar to the appearance of the visitor is being displayed, in addition to a display image indicating the name of an exhibit, a tourist facility, a location, and the like. The control unit 11 outputs guidance information to the terminal 2 and ends a series of processes.

  In addition, although the process which guides other facilities, such as an art museum, a museum, a zoo, to a visitor was described above, this Embodiment is not restricted to this. For example, the control unit 11 introduces a movie, a TV drama, a TV commercial, a comic, a magazine, or the like in which a person, character, or the like similar in appearance to the visitor appears according to an attribute determined from the appearance of the visitor. It is good. That is, the target to be guided by the control unit 11 is not limited to exhibits displayed in facilities such as sightseeing spots, but may be contents on a broad medium.

  As described above, according to the second embodiment, not only the exhibits displayed in the exhibition facility, but also the exhibits displayed in other facilities are guided to the visitors. Satisfaction can be further improved.

(Embodiment 3)
In the first embodiment, a form in which an exhibit such as a work of art is guided to visitors at an exhibition facility such as a museum. In the present embodiment, a form in which a commodity or service provided at each store is guided to a visitor in a commercial facility such as a shopping mall will be described. In addition, about the content which overlaps with Embodiment 1, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  The information processing system according to the present embodiment includes a server 1, a terminal 2, and the like as in the first embodiment. In the present embodiment, the reception device 3 is installed at the entrance and the like of a providing facility (commercial facility) that provides products or services, and the monitoring device 4 is installed at each store in the providing facility. Since other configurations are the same as those in the first embodiment, illustration of the configuration of the information processing system is omitted here.

FIG. 17 is a block diagram illustrating a configuration example of the server 1 according to the third embodiment. The large-capacity storage device 14 according to the present embodiment stores a product DB 145 instead of the exhibition DB 142. The product DB 145 stores an attribute associated with a person, a place in the providing facility, and information related to the place. In the present embodiment, an attribute associated with a person is an attribute of a product or service, a place in a providing facility is a providing place that provides each product or service, and information on the place is information on the product or service. It is. Information on products or services provided at each store is stored. Hereinafter, for convenience of explanation, goods or services are collectively referred to as goods or the like as appropriate.

  FIG. 18 is an explanatory diagram showing an example of a record layout of the attribute DB 141 according to the third embodiment. The attribute DB 141 according to the present embodiment includes a group column and a group attribute column. The group column stores a group ID for identifying the group of the visitor in association with the visitor ID. The group attribute column stores the attribute of each group in association with the group ID. For example, the group attribute is information indicating an overview of the relationship of each visitor such as “family”, “couple”, “friend”, and the like, and a detailed relationship related to the composition of each visitor within the group.

  FIG. 19 is an explanatory diagram illustrating an example of a record layout of the product DB 145 according to the third embodiment. The product DB 145 includes a store column, a product column, a type column, an attribute column, an explanation column, a detailed explanation column, and a place column. The store column stores a store ID for identifying each store. The product column stores a product ID for identifying a product and the like provided at each store in association with the store ID. The type column stores the type of product in association with the product ID. The attribute column stores, for each attribute item, an attribute associated with the person who is the guidance target, specifically, an attribute such as a product, in association with the product ID. For example, when the product is a shirt, attributes such as the color of the shirt, the type (type of T-shirt, Y-shirt, etc.) and the target sex of the product are stored. Similar to the exhibition DB 142, the explanation column and the detailed explanation column store explanation information for explaining each product to the visitors in association with the product ID. The location column stores the location of each store, that is, the location where the product is provided in association with the store ID.

  FIG. 20 is an explanatory diagram for explaining a group attribute discrimination process for visitors according to the third embodiment. The control unit 11 of the server 1 acquires a person image obtained by capturing a visitor from the reception device 3 as in the first embodiment, and determines the personal attribute of the visitor. Further, in the present embodiment, when a plurality of visitors are included in the person image captured by the accepting device 3, the control unit 11 determines the attributes of the plurality of visitors, that is, group attributes.

  Consider a case where a plurality of visitors are included in a captured image as shown in FIG. In this case, the control unit 11 extracts appearance information relating to the appearance of each visitor's face, body, clothes, etc., discriminates personal attributes, and stores them in the attribute DB 141. In addition, the control unit 11 determines group attributes of the plurality of visitors based on the extracted appearance information. For example, when the control unit 11 recognizes a plurality of faces from the image, the control unit 11 determines that the visitor is a group. The control unit 11 determines the group attribute based on the appearance information of each visitor. For example, the control unit 11 estimates the age from each visitor's face image and determines the age structure of the group. Based on the age structure, the control unit 11 determines whether the group is a “family” or the like. When it is determined that it is “family”, for example, the control unit 11 determines the family structure according to the age structure. Further, for example, when the control unit 11 determines that the ages are close, the genders of the two visitors are different, and they are holding hands, the control unit 11 determines whether the group is a “couple” or the like. As described above, the control unit 11 determines the group attribute based on the appearance information extracted from the image. The control unit 11 stores the determined group attribute in the attribute DB 141.

FIGS. 21 and 22 are explanatory diagrams for explaining guidance processing for products and the like according to the third embodiment. FIG. 21 conceptually shows the guidance process according to the personal attributes of the visitors. FIG. 22 conceptually shows the guidance process including the group attributes of visitors. In the case of FIG. 21, the control unit 11 of the server 1 specifies information on a place to be guided to the visitor, that is, a product or the like, according to the determined visitor attribute. For example, for the attribute items “clothes” and “gender”, the control unit 11 is similar in color, pattern, shape, type, etc. to the clothes worn by the visitors, and the target sex of the product is the same as the gender of the visitors. A certain product is specified from the product DB 145. Note that the above is an example, and for example, the control unit 11 may perform the specifying process including other personal attributes such as the age and body type of the visitors.

  The control unit 11 generates guidance information for guiding the specified product or the like. The control unit 11 reads from the product DB 145 the location of the store that provides the product, that is, the provision location 211 of the product. The control unit 11 generates a guidance route 212 for guiding visitors to the provision place 211 and outputs the guidance route 212 to the terminal 2. The control unit 11 acquires the visitor's position 213 from the AP 5 or the like installed in the providing facility. When the visitor arrives at the providing place 211, the control unit 11 outputs explanatory information to the terminal 2.

  The control unit 11 acquires information such as an image from the monitoring device 4 installed in the store, for example, and estimates emotion information. Specifically, the control unit 11 refers to the emotion table 143 and visits the guided clothes depending on the behavior of the visitor, for example, whether the visitor has picked up the clothes or whether the clothes have been tried on. Whether the person likes it. In the present embodiment, the illustration of the emotion table 143 is omitted for the sake of brevity. When it is estimated that the visitor likes the clothes, the control unit 11 further outputs detailed explanation information. In addition, for example, the control unit 11 likes the guided clothes depending on whether or not the visitor's line of sight is facing the clothes, whether or not a key phrase such as “not suitable” is extracted from the utterance, and the like. Estimate whether or not there was. In this case, the control unit 11 corrects the guide information. For example, as in the first embodiment, the control unit 11 changes the attribute item, identifies the product or the like again, determines the provision location 211, and corrects the guide route 212.

As shown in FIG. 22, the control unit 11 further performs guidance processing including the group attribute of the visitors. Specifically, the control unit 11 performs a matching process between group attributes such as attribute items “family” and “couple” and attributes such as products. For example, when the group is “family”, the control unit 11 specifies a family-oriented movie work for the service “movie”. Further, the control unit 11 compares the personal attribute “face” relating to the appearance of one visitor who is a member of the group with the attribute “face” of the character appearing in the movie to determine similarity, for example. . The control unit 11 specifies a movie work in which a character similar to the “face” of the visitor appears from the product DB 145, and generates guidance information. As shown in FIG. 22, the control unit 11 provides the terminal 2 with guidance information relating to a providing location 211 indicating the location of a movie theater showing the movie work, a guide route 212 to the movie theater, a description of the movie work, and the like. Output. In the above description, the service “movie” has been described as an example, but other services, products, and the like may be used.
In addition, although the control part 11 performed the process which considered both the personal attribute and the group attribute above, you may perform the process based only on a group attribute.

FIG. 23 is a flowchart illustrating an example of a processing procedure executed by the server 1 according to the third embodiment. Based on FIG. 23, the processing content which the server 1 which concerns on this Embodiment performs is demonstrated.
The control unit 11 of the server 1 acquires a person image obtained by capturing one or more visitors who have visited the providing facility from the reception device 3 (step S301). For example, the reception device 3 images a visitor who has visited the providing facility. In the present embodiment, when the visitor is a group, the reception device 3 images a plurality of visitors related to the group. The control unit 11 acquires one or more captured person images of the visitors from the reception device 3.

  The control unit 11 extracts appearance information relating to the appearance of the visitors from the acquired person image (step S302). Specifically, the control unit 11 extracts feature amounts such as shape, size, color, etc. from the image, with respect to the appearance of the visitor's face, hair, silhouette of the whole body, clothes, and the like. When a plurality of visitors are included in the acquired image, the control unit 11 extracts a feature amount for the appearance of each visitor.

The control unit 11 determines the personal attributes and group attributes of one or more visitors based on the extracted appearance information (step S303). For example, the control unit 11 determines the type of each part of the face, the hairstyle, the body shape, the color of clothes, and the like based on the extracted feature amount. Moreover, the control part 11 discriminate | determines a visitor's age, sex, a facial expression, etc. compared with the model data learned beforehand. When a plurality of visitors are included in the image acquired from the monitoring device 4, the control unit 11 determines a group attribute in addition to the personal attribute. For example, the control unit 11 estimates the relationship between a plurality of visitors based on the number of groups, the age configuration, and the like. The control unit 11 stores the individual attributes and group attributes of the determined visitors in the attribute DB 141.

  The control unit 11 refers to the product DB 145, and specifies information on a place to be guided to the visitor, that is, a product, etc., according to the determined individual attribute and group attribute of the visitor (step S304). Specifically, the control unit 11 performs a matching process that compares the attributes of the products and the like stored in the product DB 145 with the personal attributes of the visitors stored in the attribute DB 141, and the similarity between the appearance of the visitors and the products etc. Judging sex. In addition, the control unit 11 performs matching processing including not only the individual attributes of each visitor but also the group attributes, and identifies products and the like. Specifically, the control unit 11 determines a product or the like to be guided to the visitor of the group depending on the relationship of the visitor estimated as described above, that is, whether it is “family” or “couple”. Identify. For example, when the group is “family”, the control unit 11 specifies the service “movie” for the family.

  The control part 11 produces | generates the guidance information containing the provision place of the identified goods etc., and a guidance route, and outputs it to the terminal 2 (step S305). Specifically, the control unit 11 refers to the product DB 145 and reads the position of the store that provides the product in the providing facility. For example, the control part 11 produces | generates the guidance route which connects the provision place of several goods etc. with the shortest route. The control unit 11 outputs to the terminal 2 a map screen including the provided location of each read commodity and the generated guidance route.

  The control unit 11 determines whether or not the visitor has arrived at a place where goods or the like are provided (step S306). For example, the control unit 11 acquires the position information of the terminal 2 from the AP 5 or the like, and makes a determination according to whether or not the terminal 2 is located within a predetermined range from the place where the product is provided. When it determines with not having arrived at the provision place (S306: NO), the control part 11 waits for a process. When it determines with having arrived at the provision place (S306: YES), the control part 11 outputs the explanatory information for explaining the said goods etc. to a visitor to the terminal 2 (step S307). For example, the control unit 11 outputs to the terminal 2 explanatory information indicating that the appearance of the visitor and the product have similarity.

  The control unit 11 acquires the image, sound, and waiting time of the visitor at the provided place (step S308). Specifically, the control unit 11 acquires an image obtained by capturing an image of a visitor and a speech such as an utterance of the visitor from the monitoring device 4 installed in the store. Similarly to the above, the control unit 11 acquires the position information of the terminal 2 from the AP 5 and measures the standby time.

Based on the acquired image, sound, and standby time, the control unit 11 estimates emotion information indicating the emotion of the visitor (step S309). For example, the control unit 11 extracts information such as a visitor's facial expression, motion, voice, and waiting time from the acquired image and the like, and refers to the emotion table 143 to estimate the visitor's emotion. The control unit 11 determines whether the visitor is satisfied with the guidance according to the estimated emotion information (step S310). When it determines with being satisfied (S310: YES), the control part 11 outputs more detailed description information to the terminal 2 than the description information output by step S307 with reference to goods DB145 (step S311), and performs a process. The process proceeds to step S314. When it determines with not being satisfied (S310: NO), the control part 11 determines whether a visitor is dissatisfied with guidance according to the emotion information estimated by step S309 (step S312). When it determines with dissatisfaction (S312: YES), the control part 11 corrects guidance information and outputs it to the terminal 2 (step S313). For example, the control unit 11 changes the attribute item used as a criterion for determining the similarity of the attribute related to the specifying process in step S304, and specifies again the product or the like to be guided to the visitors. The control unit 11 reads the provided location of the specified product etc. from the product DB 145 and regenerates the guide route from the current location of the visitor to the provided location of each product etc., thereby correcting the guide information. The control unit 11 outputs the corrected guide information to the terminal 2, and the process proceeds to step S314.

  When it determines with not being dissatisfied (S312: NO), the control part 11 determines whether guidance is complete | finished (step S314). When it determines with not complete | finishing (S314: NO), the control part 11 returns a process to step S306. When it determines with complete | finishing (S314: YES), the control part 11 complete | finishes a series of processes.

  As described above, according to the third embodiment, the information processing system according to the first embodiment can be applied not only to an exhibition facility that exhibits exhibits but also to a provision facility that provides products and the like.

  Moreover, according to this Embodiment 3, appropriate guidance can be performed even if there are a plurality of visitors.

(Embodiment 4)
FIG. 24 is a functional block diagram showing the operation of the server 1 in the above-described form. When the control unit 11 executes the program P, the server 1 operates as follows. The storage unit 241 stores an attribute associated with a person, a location, and information regarding the location in association with each attribute. The attribute determination unit 242 determines an attribute from the person image. The generation unit 243 refers to the storage unit 241 according to the determined attribute, identifies the related information, and generates guidance information.

  The fourth embodiment is as described above, and the other parts are the same as those of the first to third embodiments. Therefore, the corresponding parts are denoted by the same reference numerals, and detailed description thereof is omitted.

  The embodiment disclosed this time is to be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the meanings described above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1 Server 11 Control Unit 12 Storage Unit P Program 13 Communication Unit 14 Mass Storage Device 141 Attribute DB
142 Exhibition DB
143 emotion table 144 facility DB
145 Product DB
2 Terminal 21 Control unit 22 Storage unit 23 Communication unit 24 Display unit 25 Input unit 26 Audio output unit 27 Imaging unit 3 Accepting device 4 Monitoring device 5 AP

Claims (10)

A storage unit that stores an attribute associated with a person, a location, and information on the location in association with each attribute;
An attribute discriminator for discriminating attributes from a person image;
An information processing apparatus comprising: a generation unit that refers to the storage unit according to the determined attribute to identify the related information and generates guidance information. The information processing apparatus according to claim 1, further comprising: an output unit that outputs the generated guidance information to an external device. The place is a place where exhibits are exhibited at a predetermined facility, or a place where goods or services are provided,
The information processing apparatus according to claim 1, wherein the guide information includes the exhibition place or the provision place. The information processing apparatus according to any one of claims 1 to 3, wherein the guide information includes a guide route that guides the plurality of places. An extraction unit that extracts appearance information related to the appearance of the person based on the person image;
The information processing apparatus according to claim 1, wherein the attribute determination unit determines an attribute based on the extracted appearance information. An acquisition unit for acquiring an image, sound or waiting time of a person in the place;
Based on the acquired image, sound, or standby time, an estimation unit that estimates emotion information indicating the emotion of the person;
The information processing apparatus according to claim 1, further comprising: a changing unit that changes the guidance information in accordance with the estimated emotion information. The information processing apparatus according to claim 3, wherein the attribute determination unit determines attributes of a plurality of persons from the person image. A storage unit that stores an attribute associated with a person, a location, and information on the location in association with each attribute;
An attribute discriminator for discriminating attributes from a person image;
An information processing system comprising: a generation unit that identifies relevant information with reference to the storage unit according to the determined attribute and generates guidance information. An attribute associated with a person, a location, and information on the location are associated with each attribute and stored in the storage unit.
Identify the attributes from the person image,
A program for causing a computer to execute a process of identifying relevant information by referring to the storage unit according to a determined attribute and generating guidance information. An attribute associated with a person, a location, and information on the location are associated with each attribute and stored in the storage unit.
Identify the attributes from the person image,
An information processing method characterized by causing a computer to execute a process of identifying related information by referring to the storage unit according to a determined attribute and generating guidance information.

Images