JP2017220181A - Guide display system, guide display method and guide display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a guide display system, a guide display method and a guide display program which give a user guide information on a route to a place where the user can improve comfort thereof.SOLUTION: A management server 20 comprises: a comfort information storage section 24 which stores candidate guiding destinations associated with comfort indices calculated through a multiple classification analysis with respect to variable values identified on the basis of a photograph image; and a control section 21 which is connected to a display section 11 and an imaging section 12 of a digital signage device 10. The control section 21 identifies: an object person in an image taken by the imaging section 12; a state of the object person on the basis of the photographed image of the object person; an existence of an accompanied person; and a candidate guiding destination with a high comfort index on the basis of the existence of the accompanied person and the state of the object person using the comfort information storage section 24. Then, the display section 11 outputs the identified candidate guiding destination.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a guidance display system, a guidance display method, and a guidance display program for providing guidance information to a user.

  Digital signage (digital signage) that transmits information using electronic display devices such as a display connected to a network is being used outdoors, in stores, public spaces, transportation facilities, and the like.

  In this digital signage, instead of sending the same advertisement to an unspecified number of people, a viewer target is set in consideration of the regional characteristics of the installation location, and an advertising message focused on a specific layer of the set target is transmitted. be able to. Furthermore, unlike printed matter, there is no need for replacement. In addition, since a moving image can be displayed, the degree of attention of the viewer can be increased, so that an excellent advertising effect can be expected.

  A technique for using such digital signage for a questionnaire is being studied (for example, see Patent Document 1). The digital signage system disclosed in this document includes a server that distributes content representing an advertisement and the like, and a touch panel, and has a display terminal that receives the distributed content and displays it on the touch panel. Here, the display terminal displays a questionnaire screen on the touch panel, receives an answer to the questionnaire through the operation of the touch panel by the accessor, and transmits the answer result to the server. Further, the server receives and stores the answer result.

  In addition, a technique for providing information suitable for a store visitor has been studied (see, for example, Patent Document 2). In the technique disclosed in this document, in-store information and store environment information are detected using a camera device and a sensor device installed in the store. And the condition information set based on the analysis result of a customer's action history which is the same attribute information as in-store information and store environment information is stored. The detected information and the condition information are compared with each other in the same attribute, it is determined whether or not a predetermined condition is satisfied, and the predetermined condition is associated with control information for controlling a predetermined device in the store Remember. When the determination unit determines that the predetermined condition is satisfied, the control information associated with the predetermined condition is extracted to control the predetermined device.

  In addition, a digital signage terminal for displaying contents corresponding to the number of viewers and groups has been studied (see, for example, Patent Document 3). The information display device disclosed in this document inputs information on viewers within a predetermined range, and determines the number of viewers and the group of viewers based on the input viewer information. Furthermore, the information display device selects content based on the viewer group and displays it on the display unit.

JP 2010-218489 A JP2015-55924A JP 2013-140196 A

  In order to revitalize outdoor areas adjacent to public spaces with high traffic and places with low usage frequency, users can be promoted to these places by promoting the advantages of the target places, holding events, giving incentives, etc. There was a need to guide. In this case, it is also possible to install the above-mentioned digital signage in a public space, display guidance regarding the surrounding area as a guidance destination, and perform guidance to the surrounding area.

  However, digital signage is viewed by various users. For this reason, it is desirable to provide information not only for a predetermined target layer but also for various user situations. Here, unless information is provided according to the user's situation, guidance and activation to the surrounding area is difficult. For example, in Patent Document 2, information related to a customer is provided by using customer attribute information such as gender. However, accurate guidance cannot be realized without considering not only customer attributes but also user comfort. Also, even when considering a group as described in Patent Document 3, it is difficult to provide guidance to a place where there is a feeling of comfort if the compatibility between the group and the guide destination is not good.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a guidance display system, a guidance display method, and a guidance display program for providing guidance information to a place where the user can improve comfort. Is to provide.

  The guidance display system for solving the above-described problem is comfort information in which a guide destination candidate associated with a comfort index calculated by multivariate analysis is recorded for a variable value specified based on a captured image. A storage unit and a control unit connected to the photographing unit and the display unit are provided. And the control unit identifies the subject in the image photographed by the photographing unit, identifies the personal situation based on the photographed image of the subject, identifies the presence or absence of the accompanying person of the subject, Using the comfort information storage unit, a guide destination candidate having a high comfort index is specified based on the result of specifying the presence or absence of the accompanying person and the situation of the person, and the candidate is output on the display unit. Thereby, it is possible to guide to a guidance destination that can improve a feeling of comfort in consideration of the user's personal situation and accompanying person's situation.

  In the guidance display system, the heart rate information calculated based on the photographed image of the target person is specified as the personal situation, and a guide destination candidate having a high comfort index is specified based on the heart rate information. Is preferred. Thereby, a guidance destination candidate can be selected in consideration of a user's mind and body state evaluated based on heart rate information (heart rate and heart rate variability). Here, the psychosomatic state index is an index that represents the user's preference for the accompanying person, the degree of tension, and the like.

  In the guidance display system, it is preferable that the human relationship between the target person and the accompanying person is specified, and a guidance destination candidate having a high comfort index is specified based on the human relationship. Thereby, a guidance destination candidate can be selected in consideration of the relationship with the accompanying person.

  In the guidance display system, it is preferable that weather information of a guidance destination candidate is acquired and a guidance destination candidate having a high comfort index is specified based on the weather information. Thereby, a guidance destination candidate can be selected in consideration of weather conditions.

-In the above guidance display system, it is preferable to specify the identity attribute based on the photographed image of the subject as the situation of the identity, and to identify the guide destination candidate having a high comfort index based on the identity attribute. . Thereby, a guidance destination candidate can be selected in consideration of the subject person's identity attribute.
-In the said guidance display system, it is preferable to specify the presence or absence of the target person's companion based on the said captured image. Thereby, a companion situation can be specified efficiently.

  ADVANTAGE OF THE INVENTION According to this invention, the guidance information to the place where a user's comfort feeling can be improved can be provided.

Explanatory drawing of the system of this embodiment. Explanatory drawing of the explanatory variable of multiple regression analysis. It is explanatory drawing of the data recorded on the memory | storage part of this embodiment, Comprising: (a) is a guidance destination information storage part, (b) is a sample information storage part, (c) is explanatory drawing of a comfort information storage part. Explanatory drawing of the process sequence of this embodiment. Explanatory drawing of the display screen of this embodiment.

  Hereinafter, an embodiment will be described with reference to FIGS. In the present embodiment, a description will be given as a guidance display system for providing a service for guiding a user to a predetermined place (neighboring stores, outdoors, etc.) using digital signage in a public space.

  In the present embodiment, as shown in FIG. 1, a digital signage device 10, a management server 20, and a weather information providing unit 30 are used. The digital signage device 10 and the weather information providing unit 30 are connected to the management server 20 via a network.

  The digital signage device 10 is a user interface that acquires various types of information related to a user's situation and the like and outputs information related to a guidance destination to the user. The digital signage device 10 includes a display unit 11 and a photographing unit 12. In the present embodiment, a touch panel display is used as the display unit 11. As a result, various types of information can be output to the user, and information can be acquired by user input. The photographing unit 12 photographs the front of the digital signage device 10. The digital signage device 10 can recognize the user in the photographed image and can specify various types of information regarding the user through image processing. Furthermore, the digital signage apparatus 10 has a communication function with the user terminal 40 such as a smartphone held by the user. And the digital signage apparatus 10 acquires the identification information of the user terminal 40 by this communication function. Thereby, the user who used the digital signage apparatus 10 can be specified.

  The weather information providing unit 30 is a weather measurement device that collects information related to the weather. The weather information providing unit 30 measures weather information (weather, temperature, humidity, wind speed, solar radiation, rainfall, etc.) in the surrounding area of the digital signage device 10. Then, the weather information providing unit 30 provides the measured weather information to the management server 20. As the weather information providing unit 30, a weather information site connected to the Internet can be used.

  The management server 20 is a computer that guides the user of the digital signage device 10 to a guidance destination. In the present embodiment, the user (target person) who guides the guidance destination is specified using the captured image captured by the digital signage device 10. The management server 20 includes a control unit 21, a guide destination information storage unit 22, a sample information storage unit 23, and a comfort information storage unit 24.

  The control unit 21 functions as a control unit including a CPU, a RAM, a ROM, and the like, and processes described later (target person identification stage, accompanying person identification stage, weather information acquisition stage, guidance destination extraction stage, recommendation processing stage, feedback Stage, process including analysis stage). By executing a guidance display program for this purpose, the target person specifying unit 211, the accompanying person specifying unit 212, the weather information acquiring unit 213, the guide destination selecting unit 214, the recommendation processing unit 215, the feedback unit 216, the analyzing unit 217, and the like Function.

  The target person specifying unit 211 executes processing for specifying a target person (user of the digital signage apparatus 10) who guides the guide destination using the captured image captured by the imaging unit 12 of the digital signage apparatus 10. Further, the target person specifying unit 211 executes processing for acquiring information related to the user's situation using the captured images (still images and moving images).

The accompanying person specifying unit 212 uses the captured image taken by the imaging unit 12 of the digital signage device 10 to execute a process of determining the situation of the accompanying person (the presence / absence of the accompanying person, the number of persons, etc.).
The weather information acquisition unit 213 executes processing for acquiring weather information measured by the weather information providing unit 30.

  The guide destination selection unit 214 performs a process of evaluating a guide destination candidate that guides the user based on the captured image and information acquired from the weather information providing unit 30 using the comfort function prediction function. This comfort function prediction function will be described later.

The recommendation processing unit 215 executes processing for outputting information on the evaluated guide destination candidates to the digital signage device 10.
The feedback unit 216 executes a process of acquiring evaluation information of the guidance destination from the user who visited the guidance destination.

  The analysis unit 217 executes processing for calculating a comfort index based on the evaluation information of the user who visited the guidance destination. In the present embodiment, a prediction function for predicting comfort is calculated by multiple regression analysis.

(Calculation of comfort prediction function)
First, a method for calculating a comfortableness prediction function will be described. Here, a function for predicting the comfort of the user is calculated based on the user situation, the accompanying person situation, the environmental situation, and the guiding party situation with respect to the guidance destination and the presence or absence of the accompanying person.

  As shown in FIG. 2, a prediction function for calculating comfort is generated. This prediction function is a function for calculating the objective variable (y) from a plurality of explanatory variables (x), partial regression coefficients (a), and intercepts (b). The partial regression coefficient (a) and the intercept (b) are calculated by multiple regression analysis of sample data.

As the objective variable, a comfort index is used, and as the explanatory variable (x), information obtained by quantifying the time, the user situation, the environment situation, the accompanying person situation, and the guidance destination candidate situation is used.
The time information is an evaluation value obtained by quantifying the use time. As this time information, a value identifying “holiday” or “weekday” obtained from the calendar of the system timer is used.

As user status information, user attribute information and psychosomatic state information are used.
The attribute information is an evaluation value obtained by quantifying the user's identity attribute. Here, as attribute information, information obtained by quantifying age (age group), gender, occupation (company employee, student, self-employed, housewife, etc.) is used. This attribute information is calculated by an image recognition process using a subject image photographed by the photographing unit 12.

  The psychosomatic state information is an evaluation value obtained by quantifying a user's likability and degree of tension with a companion. This psychosomatic state information is predicted based on heart rate information (heart rate, heart rate variability, etc.) calculated using the subject moving image captured by the imaging unit 12. For example, at the time of sympathetic nerve tension, in addition to the promoting action of the heart, fluctuations in the heart rate occur, and the change of the pulse wave associated therewith can be specified by an image, and the psychosomatic state can be evaluated.

Furthermore, the user status information includes eating and drinking status information, usage purpose information, and prior action status information.
The eating and drinking situation information is a correlation value between the eating and drinking history and the eating and drinking schedule and a feeling of comfort. For example, the degree of influence of food and drink such as coffee, tea, juices, alcohols, cakes and snacks on comfort is quantified. This eating and drinking situation information is calculated based on an answer to this question by asking a question about the eating and drinking situation in a questionnaire or the like performed in advance.

  The purpose of use information is a correlation value between the purpose of use of the guidance destination and the comfort. In the present embodiment, as the purpose of use information, a value obtained by quantifying the degree of influence of eating, drinking, tea, rest, waiting, conversation, reading, work, Internet use, etc. on the comfort is used. This usage purpose information is calculated based on an answer to this question by asking a question about the usage purpose in a questionnaire or the like that is conducted in advance.

  The prior behavior status information is a correlation value between the user's behavior before using the digital signage device 10 and the companion's status and comfort. In the present embodiment, a question about the pre-action situation is asked by a questionnaire or the like performed in advance, and the calculation is based on an answer to this question.

  The environmental status information is an evaluation value obtained by quantifying the weather at the guidance destination. In the present embodiment, information digitized based on weather information acquired from the weather information providing unit 30 is used. This environmental status information includes temperature, humidity, wind speed, solar radiation, rainfall, thermal sensation calculated based on questionnaires conducted in advance, airflow sensation calculated based on wind speed, sunshine sensation based on solar radiation, etc. The threshold for each season is determined based on the relationship between the indoor and outdoor guidance destinations.

  As the companion situation information, information on the companion situation (accompanying pattern) of the user is used. As the accompanying person's situation information, information obtained by quantifying the accompanying person's number of persons, human relationships, and the like is used. The accompanying person's situation information is calculated using the entire image photographed by the photographing unit 12. The human relationship is calculated based on the mental and physical state information of the user with the accompanying person.

  The guide destination candidate situation information is a correlation value between the situation at the place of the guide destination and the comfort. In the present embodiment, as the guidance destination candidate situation information, information obtained by quantifying place evaluation factors, comfort, and the like is used. This guide destination candidate situation information is calculated based on an answer to this question by asking a question about the guide destination candidate situation information in a questionnaire or the like that is performed in advance.

As the seat status information, a value obtained by quantifying the degree of influence of whether or not a seat can be selected and the presence or absence of staff guidance on comfort is used.
As the place evaluation factor information, a value obtained by evaluating the degree of influence of the feeling of openness, calmness, naturalness, liveliness, etc. on the comfort is used.

  As shown in FIG. 3A, guide destination candidate data 220 relating to a guide destination candidate for guiding a user is recorded in the guide destination information storage unit 22. This guide destination candidate data 220 is recorded when a guide destination candidate is registered. The guide destination candidate data 220 includes data related to a guide destination candidate identifier, a name, a description, a place, and a route.

  In the guide destination candidate identifier data area, data related to an identifier for specifying a guide destination candidate is recorded. In the present embodiment, a place in the vicinity of the place where the digital signage device 10 is installed is used as the guidance destination.

  In each of the name, description, and location data areas, data on the name, description, and location of the guidance destination candidate are recorded.

  In the route data area, data related to a route for moving from the place where the digital signage device 10 is installed to the guide destination candidate is recorded.

  As shown in FIG. 3B, sample data 230 for performing multiple regression analysis for generating a comfortableness prediction function is recorded in the sample information storage unit 23. This sample data 230 is recorded when a questionnaire regarding the comfort of explanatory variables and each guidance destination candidate is conducted and the questionnaire results are collected before the service is provided. Furthermore, after the start of provision of this service, it is added when guidance destination candidate information is provided to the user and feedback about the guidance destination is acquired. The sample data 230 includes data relating to sample identifiers, explanatory variables, and answer results.

In the sample identifier data area, data relating to an identifier for specifying a sample used for multiple regression analysis is recorded.
In the explanatory variable data area, data related to the evaluation values of the above-mentioned time, user status, accompanying status, and environmental status are recorded.
In the answer result data area, data on the visited destination and the comfort at the destination are recorded.

  As shown in FIG. 3C, the comfort information storage unit 24 records comfort feeling management data 240 including a prediction function for calculating a comfort index. The comfort management data 240 is recorded when a multiple regression analysis for calculating a comfort index is performed and a prediction function is calculated. The comfort management data 240 is configured by a regression formula (prediction function) for calculating a comfort index as an objective variable for each guide destination candidate and accompanying person pattern (one person, friends, lover, family, etc.).

Next, in the management server 20 configured as described above, a processing procedure for guiding a user to a guidance destination will be described with reference to FIGS.
(Comfort information recording process)
Before providing this service, sample data is input to the management server 20. This sample data includes information on explanatory variables and comfort (objective variables) necessary for multiple regression analysis for each guide destination candidate and accompanying person pattern. In this case, the control unit 21 of the management server 20 records the input sample data in the sample information storage unit 23. The analysis unit 217 of the control unit 21 performs multiple regression analysis using the sample data 230, and calculates a partial regression coefficient and an intercept of the prediction function for each guide destination candidate and accompanying person pattern. Then, the analysis unit 217 records the comfort management data 240 including the prediction function calculated for each guide destination candidate and the accompanying person pattern in the comfort information storage unit 24.

(Guidance processing for users)
Next, the guidance process for the user will be described with reference to FIG.
First, the control unit 21 of the management server 20 executes a user status acquisition process (step S1-1). Specifically, the subject identification unit 211 of the control unit 21 acquires a captured image from the imaging unit 12 of the digital signage device 10. Then, the target person specifying unit 211 specifies a person image included in the captured image. The target person specifying unit 211 calculates user situation information (explanatory variable value) using the captured image. Further, the target person specifying unit 211 acquires a moving image for the user specified in the captured image, and extracts heartbeat information by image processing of the moving image. Next, the target person specifying unit 211 calculates the mental and physical condition and outputs them to the display unit 11 of the digital signage device 10.
Then, when the target person specifying unit 211 detects an input desired to be used on the display unit 11, the accompanying person specifying unit 212 of the control unit 21 uses the image taken by the shooting unit 12 of the digital signage device 10 to accompany the target person specifying unit 211. The presence or absence of a person is determined. Here, the presence or absence of the accompanying person and the number of accompanying persons are determined based on the person image existing in the target person in the photographed image.

  In this case, the target person specifying unit 211 outputs a reading request of the user terminal 40 of the target person on the display unit 11 of the digital signage device 10. Then, the digital signage device 10 reads the terminal number of the user terminal 40 and transmits it to the management server 20. In this case, the control unit 21 of the management server 20 records the explanatory variable in the sample information storage unit 23 in association with the terminal number. Here, the terminal number of the user terminal 40 is used as a sample identifier, but the information is not limited to the terminal number as long as the information can identify each user.

  Next, the control unit 21 of the management server 20 executes a weather information acquisition process (step S1-2). Specifically, the weather information acquisition unit 213 of the control unit 21 acquires weather information from the weather information providing unit 30. Then, the weather information acquisition unit 213 adds the acquired weather information to the sample data 230.

  Next, the control unit 21 of the management server 20 executes a companion situation specifying process (step S1-3). Specifically, the accompanying person specifying unit 212 of the control unit 21 calculates an accompanying model based on the determined attribute of the accompanying person. For example, when one companion is detected, “friends” and “lovers” may be determined as companion relationships according to the level of tension in the subject's mind and body. On the other hand, when a plurality of companions are detected and tension is low in the subject's mind and body situation, the companion relationship may be determined as “family”. In this case, a topic about the accompanying person may be output to the display unit 11 of the digital signage device 10, and the accompanying person relationship may be determined based on a change in the mind-body condition (heart rate) at this time. Then, the accompanying person specifying unit 212 adds the determined accompanying relation to the sample data 230.

  Next, the control unit 21 of the management server 20 executes guidance destination candidate identification processing (step S1-4). Specifically, the guide destination selection unit 214 of the control unit 21 selects available guide destination candidates based on weather information. For example, in the case of bad weather such as rain or strong winds, indoor guidance destination candidates are extracted. The guidance destination selection unit 214 extracts the prediction function of the comfort management data 240 associated with the selected guidance destination candidate and the accompanying person pattern from the comfort information storage unit 24. Next, the guidance destination selection unit 214 substitutes the item value of the explanatory variable into each prediction function, and calculates a comfort index for each guidance destination candidate. Then, the guide destination selection unit 214 specifies the purpose of use using the guide destination candidate having the highest comfort index and the partial regression coefficient of the guide destination candidate.

Next, the control unit 21 of the management server 20 executes a recommendation process (step S1-5). Specifically, the recommendation processing unit 215 of the control unit 21 outputs information on the specified guidance destination candidate (comfortable place) and purpose of use (comfortable behavior) to the display unit 11 of the digital signage device 10. In this case, the recommendation processing unit 215 outputs a plurality of characters to be displayed on the display unit 11 and outputs recommendation information (guidance destination) on a timeline where one character selected by the user talks.
Note that the recommendation processing unit 215 may determine the character based on the user's captured image. In this case, the recommendation processing unit 215 holds a character determination table for determining a character corresponding to the attribute information of the user.

FIG. 5 is an explanatory diagram of a display screen 500 output to the display unit 11 of the digital signage apparatus 10. The display screen 500 includes a captured image field 510, a mind / body state display field 520, and a communication field 530.
In the captured image column 510, captured images captured by the capturing unit 12 are displayed. In the captured image, the target person is captured by the recognition frame 511 by face recognition. Furthermore, the accompanying person is captured by the recognition frame 512 by face recognition. In the present embodiment, a recognition frame 511 that captures the target person is displayed on the display screen 500. On the other hand, the recognition frame 512 that captured the accompanying person is not displayed.
Further, an estimated heart rate calculated from the captured image is displayed in the mind and body state display field 520.
And in the communication column 530, a character's conversation and a question are output by a timeline format. Here, explanatory variables that cannot be acquired in the captured image are output in question format, and the user's answer is acquired. Furthermore, weather information etc. are acquired, it is judged whether a guidance destination is indoor or outdoor from the threshold value of a weather condition, and a guidance destination with a high feeling of comfort is specified. Then, in the communication column 530, recommendation information including the guidance destination is output. For the guidance destination, the name, description, location, and route recorded in the guidance destination information storage unit 22 are displayed.

  When the user visits the guidance destination guided by the digital signage device 10 and performs feedback, the user accesses the management server 20 using the user terminal 40.

  In this case, the control unit 21 of the management server 20 executes a feedback process (step S1-6). Specifically, the feedback unit 216 of the control unit 21 of the management server 20 displays a questionnaire screen including a question regarding the guidance destination on the user terminal 40. Then, the feedback unit 216 acquires a questionnaire response from the user terminal 40. Next, the feedback unit 216 identifies the terminal identifier of the user terminal 40 that has received access, and the sample information storage unit 23 identifies the sample data 230 in which the terminal identifier is recorded in the sample identifier data area. Then, the feedback unit 216 additionally records the questionnaire response in the sample data 230.

  Next, the control part 21 of the management server 20 performs a multiple regression analysis process (step S1-7). Specifically, the analysis unit 217 of the control unit 21 performs multiple regression analysis using the sample data 230 including the newly collected questionnaire responses. Then, the analysis unit 217 calculates a comfort function prediction function, and updates the prediction function recorded in the comfort information storage unit 24.

According to the guidance display system of the present embodiment, the following effects can be obtained.
(1) In the present embodiment, the control unit 21 of the management server 20 executes guidance destination candidate identification processing (step S1-4). In this case, based on the user situation, the accompanying person situation, the environmental situation, and the guidance destination situation, a guidance destination that is comfortable for the user is guided. Therefore, a prediction function for calculating a comfort index is recorded in the comfort information storage unit 24. Thereby, it can guide to the place which can improve a feeling of comfort in consideration of a user's own or a companion's situation using digital signage device 10.

  (2) In the present embodiment, the control unit 21 of the management server 20 executes a user status acquisition process (step S1-1). Thereby, not only a user's attribute but a mind-and-body situation can be considered and a guidance destination candidate can be selected.

  (3) In the present embodiment, the control unit 21 of the management server 20 executes a weather information acquisition process (step S1-2). For example, when outdoors, the feeling of comfort varies depending on the time and weather conditions. Thereby, the guidance destination candidate which can improve a feeling of comfort according to a weather condition can be selected.

  (4) In the present embodiment, the control unit 21 of the management server 20 executes a companion situation specifying process (step S1-3). When a user is guided, the presence or absence of the accompanying person and the relationship with the accompanying person may greatly affect the comfort feeling. Thereby, the guidance destination candidate which can improve a feeling of comfort can be selected in consideration of the situation of the accompanying person.

  (5) In this embodiment, the control part 21 of the management server 20 performs a recommendation process (step S1-5). In this case, the display unit 11 outputs the recommendation information on the timeline where the character talks. Thereby, a user's interest can be heightened in a conversational form.

Moreover, you may change the said embodiment as follows.
In the above embodiment, the management server 20 includes the control unit 21, the guide destination information storage unit 22, the sample information storage unit 23, and the comfort information storage unit 24. The hardware configuration is not limited to these. For example, the comfortableness prediction function may be calculated only by a questionnaire conducted in advance. In this case, the sample information storage unit 23 is not necessary. Moreover, you may make it comprise the guidance destination information storage part 22 and the comfort feeling information storage part 24 by one information storage part.
In the above embodiment, the comfort index is used as the objective variable, and information obtained by quantifying the time, the user situation, the environmental situation, and the guidance destination candidate situation is used as the explanatory variable. The explanatory variables are not limited to these, and some of the above-described explanatory variables may be used, or other explanatory variables may be used. For example, it is possible to specify a user's belongings (food and drink, PC, books, etc.), clothes, etc. and use them as explanatory variables. In this case, the image of the belongings is recognized based on the photographed image of the user.

It is also possible to use the user's walking speed as an explanatory variable. In this case, the user takes a video up to the digital signage device 10 and calculates the walking speed based on the video. Here, it is possible to evaluate the conversation state with the accompanying person based on the moving image and use the conversation state as an explanatory variable.
Also, the user's position is specified by indoor / outdoor GPS through smartphone cooperation or the like, and it is possible to determine whether the user is walking outdoors or in an indoor air-conditioned space from the moving speed and position. It is also possible to make a recommendation by a multiple regression analysis of such explanatory variables and comfort.
Also, the comfort index may be calculated including the guidance route to the guidance destination. In this case, a comfort index is calculated independently for the visit destination candidate and the guidance route, and the visit destination and the guidance route are selected based on the total value (for example, the total value) of the both comfort indexes.

  -In above-mentioned embodiment, the accompanying person specific | specification part 212 uses the picked-up image image | photographed with the imaging | photography part 12 of the digital signage apparatus 10, and the process which determines a user's companion's condition (existence of a companion, the number of persons, etc.). Execute. As a method for specifying the accompanying person's situation, the digital signage device 10 may acquire information on the accompanying person input by the user and specify the presence or absence of the accompanying person.

  In the above-described embodiment, the control unit 21 of the management server 20 calculates a comfortable function prediction function based on the evaluation information of the user who visited the guidance destination. The calculation method of the prediction function is not limited to this. For example, the person in charge may calculate the prediction function manually based on the collected questionnaire responses.

  In the above embodiment, the user using the digital signage device 10 is specified using the user terminal 40. You may make it produce | generate the sample data 230 by a questionnaire etc., without specifying a user. Further, the method of using the user terminal 40 is not limited to the case of specifying the user. For example, it is possible to specify by image processing of an image obtained by photographing the user. In this case, a feature amount such as a user's face image is calculated, and the user is specified using the feature amount.

  In the above-described embodiment, heart rate information is calculated based on a photographed image of a user photographed by the digital signage device 10 to specify a mental and physical state. The method for specifying the state of mind and body is not limited to this. For example, the digital signage device 10 may communicate with the wearable terminal of the user and acquire the biometric information of the user from the wearable terminal. Furthermore, health status history information may be acquired from the wearable terminal, and guidance destination candidates may be narrowed down based on the user's health status.

  In the above embodiment, the control unit 21 of the management server 20 executes guidance destination candidate identification processing (step S1-4). Specifically, the guide destination selection unit 214 of the control unit 21 selects available guide destination candidates based on weather information. Here, the guide destination candidates may be narrowed down according to the status of the guide destination candidates. In this case, the congestion situation can be used as the guidance destination candidate situation. In this case, the management server 20 acquires the congestion status for each guide destination candidate. For example, in the case of a store, information on the waiting status is acquired. Further, in the case of a public space, a captured image of the public space is acquired, and congestion information is acquired by calculating the number of existing people using image recognition based on the captured image.

In the above embodiment, the control unit 21 of the management server 20 executes a recommendation process (step S1-5). Here, information on the guide destination candidate is output to the display unit 11 of the digital signage apparatus 10. Here, the higher-order factor at the time of specifying the guidance destination candidate may be output.
In this case, the recommendation processing unit 215 of the control unit 21 specifies three explanatory variables as higher-order factors from the one with the higher multiplication value of the partial regression coefficient and the item value in the specified guidance destination candidate.
And the recommendation process part 215 outputs the information regarding a high-order factor to the display part 11 of the digital signage apparatus 10 with the specified guidance destination candidate. Thereby, the user can grasp | ascertain the factor of recommendation.

In the above embodiment, guidance to nearby stores and public spaces is performed as a guide destination candidate. The scope of application of the present invention is not limited to this. For example, it can be applied to a space where people such as schools and hospitals gather.
In the above embodiment, a prediction function for predicting comfort is calculated by multiple regression analysis. If a prediction function for predicting comfort can be calculated based on the sample, the present invention is not limited to multiple regression analysis, and various multivariate analyzes can be used.

  In the above embodiment, the control unit 21 of the management server 20 executes feedback processing (step S1-6). In this case, the management server 20 acquires feedback using the user terminal 40. The method for obtaining feedback is not limited to this. For example, in the recommendation process (step S1-5), a unique number may be assigned as a sample identifier, and this unique number may be input at the time of feedback.

  In addition, a questionnaire form may be used after guidance, or a questionnaire terminal for inputting feedback to the guidance destination may be provided. When a questionnaire form is used, a questionnaire printed with a sample identifier at the time of guidance is provided to the user and collected later. Even when a questionnaire terminal is used, a questionnaire response regarding comfort is acquired based on the sample identifier assigned to the user. Furthermore, in this case, it is also possible to use the feature values of the user's face image taken by the digital signage apparatus 10 and the user's face image taken by the questionnaire terminal as sample identifiers.

DESCRIPTION OF SYMBOLS 10 ... Digital signage apparatus, 11 ... Display part, 12 ... Image pick-up part, 20 ... Management server, 21 ... Control part, 211 ... Target person specific part, 212 ... Accompanying person specific part, 213 ... Weather information acquisition part, 214 ... Guidance Point selection unit, 215 ... Recommendation processing unit, 216 ... Feedback unit, 217 ... Analysis unit, 22 ... Guidance destination information storage unit, 23 ... Sample information storage unit, 24 ... Comfort information storage unit, 30 ... Meteorological information provision unit, 40: User terminal.

Claims (8)

A comfort information storage unit that records a guide destination candidate associated with a comfort index calculated by multivariate analysis for a variable value specified based on a captured image;
A guidance display system including a control unit connected to an imaging unit and a display unit,
The control unit is
Identify the subject in the image captured by the imaging unit,
Based on the photographed image of the subject, identify the person's situation,
Identify the presence or absence of the subject's companion;
Guidance destination candidates having a high comfort index are specified based on the result of specifying the presence / absence of the accompanying person and the situation of the person using the comfort information storage unit, and the guidance unit outputs the guidance destination. Display system. As the person's situation, specify heart rate information calculated based on the subject's captured image,
The guidance display system according to claim 1, wherein a guidance destination candidate having a high comfort index is specified based on the heartbeat information. Identify the relationship between the subject and the companion,
The guidance display system according to claim 1 or 2, wherein a guidance destination candidate having a high comfort index is specified based on the human relationship. Get the weather information of the guide candidate,
The guidance display system according to any one of claims 1 to 3, wherein a guidance destination candidate having a high comfort index is specified based on the weather information. As the identity status, identify the identity attribute based on the subject's captured image,
The guidance display system according to any one of claims 1 to 4, wherein a guidance destination candidate having a high comfort index is specified based on the identity attribute.   6. The guidance display system according to any one of claims 1 to 5, wherein the presence / absence of a companion of the subject is specified based on the photographed image. A comfort information storage unit that records a guide destination candidate associated with a comfort index calculated by multivariate analysis for a variable value specified based on a captured image;
A method for performing guidance display using a guidance display system including a control unit connected to an imaging unit and a display unit,
The control unit is
Identify the subject in the image captured by the imaging unit,
Based on the photographed image of the subject, identify the person's situation,
Identify the presence or absence of the subject's companion;
Guidance destination candidates having a high comfort index are specified based on the result of specifying the presence / absence of the accompanying person and the situation of the person using the comfort information storage unit, and the guidance unit outputs the guidance destination. Display method. A comfort information storage unit that records a guide destination candidate associated with a comfort index calculated by multivariate analysis for a variable value specified based on a captured image;
A program for performing guidance display using a guidance display system including a control unit connected to an imaging unit and a display unit,
The control unit
Identify the subject in the image captured by the imaging unit,
Based on the photographed image of the subject, identify the person's situation,
Identify the presence or absence of the subject's companion;
Using the comfort information storage unit, based on the result of specifying the presence or absence of the accompanying person and the situation of the person, a guide destination candidate having a high comfort index is identified and functioned as a means for outputting on the display unit. Characteristic guidance display program.