JP2016095781A - Social distance determination system, social distance determination program and social distance determination method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system capable of automatically determining a social distance which an application gives to a user.SOLUTION: A registration data management section 36 of a server 30 identifies a piece of information (user reaction value) for identifying an affect of a user while the user uses an application based on a piece of sensor input information which is collected by an information collection unit 20 etc., and determines a relative social distance score among plural applications based on the user reaction value while the user uses plural applications.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a social distance determination device, a social distance determination program, and a social distance determination method.

  Continuous use of devices and services can be said to be a necessary element for all ICT (Information and Communications Technology). For example, even in an application (for example, a recommendation application) that shows information based on information about the user to the user, it is very important for the user to use it continuously.

  For users who use such applications, in applications where the “social distance” that means a sense of closeness to the service (a sense of distance in the mind) is far away, information based on excessive personal information etc. If presented, the application may be disgusted and hesitate to use it.

  For this reason, it is preferable that information suitable for the social distance between the user and the application can be provided. 2. Description of the Related Art Conventionally, a technique is known that shows a social distance as a numerical value by conducting a questionnaire or the like that interviews a user with the social distance felt by a plurality of question items (for example, Non-Patent Document 1). Etc.).

Yonnim Lee, Ohbyung Kwon, Intimacy, familiarity and continuance intention: An extended expectation-confirmation model in web-based services, Electronic Commerce Research and Applications 10, 2011.

  However, if a questionnaire or the like is executed to obtain the social distance between the user and the application, it takes time to create a questionnaire or input a reply.

  In one aspect, the present invention provides a social distance determination device, a social distance determination program, and a social distance determination method capable of automatically determining a social distance that a user feels for an application. With the goal.

  In one aspect, the social distance determination device specifies an information for specifying user's emotion while using the application, and specifies the user's emotion while using a plurality of applications. And a determination unit that determines a relative social distance between the plurality of applications based on the information.

  The social distance that the user feels for the application can be automatically determined.

It is a figure showing roughly the composition of the information presentation system concerning a 1st embodiment. FIG. 2A is a diagram illustrating a hardware configuration of the information processing terminal, and FIG. 2B is a diagram illustrating a hardware configuration of the server. It is a functional block diagram of each part of an information presentation system. FIG. 4A is a diagram illustrating a state of a user who uses the information processing terminal, and FIG. 4B is a front view of the information processing terminal. It is a flowchart which shows the process (user reaction value creation process) of the server which concerns on 1st Embodiment. FIG. 6A is a diagram showing a voice input data recording DB, and FIG. 6B is a diagram showing a skin conduction data recording DB. Fig.7 (a) is a figure which shows user reaction value recording DB, FIG.7 (b) is a figure which shows correspondence list DB. It is a flowchart which shows the process (social distance score calculation process) of the server which concerns on 1st Embodiment. It is a figure which shows social distance calculation type list DB. It is a figure which shows social distance score recording DB. It is a figure which shows information utilization restriction list DB. It is a figure which shows roughly the structure of the information presentation system which concerns on 2nd Embodiment. It is a figure which shows the utilization condition of the information presentation system of FIG. It is a figure which shows user reaction value recording DB which concerns on 2nd Embodiment. It is a flowchart which shows the process (relative social distance score calculation process) of the server which concerns on 2nd Embodiment. FIG. 16A is a diagram showing a relative social distance calculation type list DB, and FIG. 16B is a diagram showing a relative social distance score recording DB. It is a figure which shows unpleasant reaction DB. It is a figure which shows social distance score record DB which concerns on the modification 1. FIG. It is a figure which shows information utilization restriction list DB which concerns on the modification 1. FIG. It is a figure which shows information utilization restriction list DB which concerns on the modification 2. FIG.

<< First Embodiment >>
Hereinafter, a first embodiment of the information providing system will be described in detail with reference to FIGS. FIG. 1 schematically shows the configuration of an information providing system 100 according to the first embodiment.

  In the first embodiment, the word “society”, which originally means the distance between the person and the other group, is used as the word indicating the distance between the person and the machine, service, application, etc. Target distance ". This social distance is nurtured through the background and history of past exchanges, as well as the sense of distance between people. In the information providing system 100 according to the first embodiment, data related to a user's reaction is collected using a sensor or the like, a social distance to a certain application is determined from the collected data, and based on the social distance This is a system for controlling information provided from an application to a user. In the first embodiment, “familiarity” and “intimacy” used as an index representing the relationship between a user and a service in Non-Patent Document 1 are not distinguished. This is because any of these is an index representing the relationship between a user and a service cultivated through the background and background of the exchanges so far.

  As shown in FIG. 1, the information providing system 100 includes an information processing terminal 10, an information collecting device 20, and a server 30 as a social distance determining device. The information processing terminal 10 and the server 30 are connected to a network 80 such as a wireless communication line or the Internet. The information providing system 100 according to the first embodiment includes an information processing device (information processing terminal 10) on the side where the client software is arranged (user side) and an information processing device (server 30) on the side where the server software is arranged. ) Is a system that divides and implements the entire processing.

  The information processing terminal 10 is a terminal in which client software designed for a user is arranged, and is, for example, a smartphone as shown in FIG. The information processing terminal 10 may be any device that can process user information, and may be a mobile phone, a tablet-type terminal, a wearable mobile terminal, a PC (Personal Computer), a server, or the like.

  FIG. 2A shows the hardware configuration of the information processing terminal 10. As shown in FIG. 2A, the information processing terminal 10 includes a CPU (Central Processing Unit) 90, a ROM (Read Only Memory) 92, a RAM (Random Access Memory) 94, and a storage unit (here, an HDD (Hard Disk Drive). )) 96, a network interface 97, a display unit 93, an input unit 95, a portable storage medium drive 99, and the like. The display unit 93 includes a liquid crystal display as shown in FIG. 4B, and the input unit 95 includes a touch panel, a microphone that acquires a user's voice, an imaging device, and the like. In FIG. 4B, the reference numeral “95” is attached only to the microphone. Each component of the information processing terminal 10 is connected to a bus 98. In the information processing terminal 10, the CPU 90 executes a program stored in the ROM 92 or the HDD 96 or a program read from the portable storage medium 91 by the portable storage medium drive 99, thereby realizing the functions shown in FIG. The Specifically, in the information processing terminal 10, when the CPU 90 executes the program, the information collection unit 12 that senses the user's state, the information presented to the user is processed and managed, and the information presentation that stores the history The information processing terminal 10 is caused to function as the unit 14.

  For example, the information collection unit 12 acquires the audio data acquired by the input unit 95 and transmits the audio data to the server 30 in a state linked to the information processing terminal 10 (information collection unit 12). The voice data is managed in the server 30 (see the voice input data recording DB 40 in FIGS. 3 and 6A).

  The information presentation unit 14 presents information. For example, the information presenting unit 14 performs information presentation by an image (display on the display unit 93), information presentation by sound through a speaker, information presentation by stimulation to a tactile sense, and the like. Note that the type of information presented to the user depends on the specifications of the information presentation unit 14 (size of the display unit 93, allowable file type of the speaker, etc.). That is, the information processing terminal 10 performs information collection and information presentation on the assumption that the interface used for information presentation is confirmed.

  The information collection device 20 is a device that can communicate with the information processing terminal 10, and as an example, is assumed to be a wristband type device worn on an arm as shown in FIG. The information collecting device 20 may employ a hair band type device or the like instead of the wrist band type device. The information collection device 20 collects skin conduction data (skin electrical activity value) and transmits it to the information processing terminal 10 using a communication path such as Bluetooth (registered trademark) communication. The information processing terminal 10 transmits the received skin conduction data to the server 30. For the technology related to electrodermal activity values, see “affdex, Q sensor (Electrical electroactivity (EDA) sensor), http://qsensor-support.affectiva.com/, http://assistly-production.s3.amazonaws.com /168567/kb_article_attachments/30856/Q_User_Manual_20130329_original.pdf?AWSAccessKeyId=AKIAJNSFWOZ6ZS23BMKQ&Expires=1406699351&Signature=4lXmsO4t6XH%2FKG345KDwuHAGoDc%3D&response-content-disposition=fileQ%%% Yes.

  The data collected by the information collecting unit 12 and the information collecting device 20 is not limited to the above, and data for deriving a user reaction, for example, user recorded video, image, sound, biological signal, brain wave, etc. Can do. Depending on the data, a plurality of pieces of intermediate information for deriving the user response may be extracted from the data of one type of sensor. For example, in the case of a user-recorded video, information on the change in facial expression can be extracted by paying attention to the face part, and information on the change in posture of the user with respect to the information processing terminal 10 can be extracted by paying attention to the change in face size.

  The server 30 is an information processing apparatus in which server software is arranged, and aggregates and organizes user data to perform storage, sorting, and various calculations. Moreover, the server 30 manages content delivery simultaneously including control of the presentation form of the content delivered to a user.

  FIG. 2B shows the hardware configuration of the server 30. As shown in FIG. 2B, the server 30 includes a CPU 190, a ROM 192, a RAM 194, a storage unit (HDD or the like) 196, a network interface 197, a portable storage medium drive 199, and the like. Each component of the server 30 is connected to the bus 198. In the server 30, a program (including a social distance determination program) stored in the ROM 192 or the HDD 196, or a program read by the portable storage medium drive 199 from the portable storage medium 191 (including a social distance determination program). 3 is realized by the CPU 190 executing the above. Specifically, in the server 30, functions as an information collection processing management unit 32, an information presentation processing management unit 34 as a determination unit, a registration data management unit 36, and a display history management unit 38 by the CPU 190 executing a program. Is realized.

  The information collection processing management unit 32 receives sensor input information from the information collection unit 12 and manages it in the voice input data recording DB 40 and the skin conduction data recording DB 42. The information presentation process management unit 34 controls information presentation by the information presentation unit 14. The registered data management unit 36 calculates a social distance score based on information managed by the information collection processing management unit 32. The display history management unit 38 manages the display history of content. Here, information collection by the information collection processing management unit 32 and information presentation from the server 30 (information presentation processing management unit 34) to the information processing terminal 10 are performed according to the user. That is, information collection and information presentation are performed on the assumption that the user is confirmed. Details of each DB included in the server 30 will be described later.

  In the information processing terminal 10 and the server 30, a plurality of users (may be zero users) may be assigned to one device, or a plurality of software systems may be provided on one device. May be stored. That is, the server software and the client software may be implemented on one device. In addition, for example, the functions of one software system may be distributed to a plurality of devices, such as, for example, retaining some functions and some data separately on another device. Conversely, the functions expressed as a plurality of devices may be realized by one device.

(Processing by server 30)
The server 30 creates a user reaction value based on the sensor input information transmitted from the information collecting unit 12 of the information processing terminal 10, calculates a social distance score based on the user reaction value, Information corresponding to the target distance score is presented to the information processing terminal 10. Hereinafter, each process will be described.

(1) User Reaction Value Creation Processing Hereinafter, user reaction value creation processing by the server 30 will be described. As a premise of this process, it is assumed that the user A is using the information processing terminal 10. In this case, it is assumed that the user A who is also the user of the information presentation unit 14 of the information processing terminal 10 uses the information of the application C0 presented on the display unit 93. Further, voice data and skin conduction data of user A who is also a user of the information collecting unit 12 and the information collecting device 20 are collected by the information collecting unit 12 and the information collecting device 20 (22) while using the application C0. Shall be.

  In this case, audio data collected by the input unit 95 (for example, a microphone) of the information processing terminal 10 is once collected by the information collecting unit 12 of the information processing terminal 10. Further, the skin conduction data collected by the information collecting unit 22 of the information collecting device 20 is transmitted from the information collecting unit 22 to the information collecting unit 12 of the information processing terminal 10 and is collected once by the information collecting unit 12. The data once collected is transmitted to the information collection processing management unit 32 of the server 30 at an appropriate timing.

  5 is performed at a timing when the server 30 receives a certain amount or more of data from the information processing terminal 10 or the information collection device 20. However, the present invention is not limited to this, and the server 30 may periodically perform the process of FIG. 5 at predetermined time intervals.

  In the process of FIG. 5, first, in step S10, the information collection processing management unit 32 receives sensor input information (voice data and skin conduction data) from the information collection unit 12 of the information processing terminal 10, and the voice input data together with the time stamp information. Recording is performed in the recording DB 40 (FIG. 6A) and the skin conduction data recording DB 42 (FIG. 6B).

  Here, FIG. 6A shows the data structure of the voice input data recording DB 40, and FIG. 6B shows the data structure of the skin conduction data recording DB 42. As shown in FIG. 6A, the voice input data recording DB 40 includes “DB recording time”, “sensor recording start time”, “sensor recording end time”, “user name”, “information collecting unit ID”, “ Each field of the “audio data recording file URI” is included. In the “DB recording time” field, information (time stamp) of the date and time when the data was recorded in the voice input data recording DB 40 is stored, and in the “sensor recording start time” field, the recording start date and time of the voice data is stored. Information (time stamp) is stored, and information (time stamp) of recording end date and time of audio data is stored in the “sensor recording end time” field. In the “user name” field, user identification information (name and the like) is stored, and in the “information collection unit ID” field, identification information of the information collection device 20 is stored. In FIG. 6A, the code “12” assigned to the information collection unit of the information processing terminal 10 in FIG. 3, the application identification information “C0”, and the like are stored as the information collection unit ID. In the “voice data recording file URI” field, a URI (Uniform Resource Identifier) indicating the recording location of the voice data file is stored.

  On the other hand, as shown in FIG. 6B, the skin conduction data recording DB 42 includes “DB recording time”, “sensor recording time”, “user name”, “information collecting unit ID”, and “skin electrical activity value”. It has each field. Among these, the “sensor recording time” field stores a time stamp at the time of skin conduction data acquisition added in the information collecting device 20, and the “skin electrical activity value” field stores the specific skin conduction data. A numeric value is stored. For the other fields, data similar to the corresponding fields in the voice input data recording DB 40 is stored. In this embodiment, the “information collection unit ID” field stores the code “22” assigned to the information collection unit of the information collection device 20 in FIG.

  Next, in step S12, the registration data management unit 36 manages the sensor input information recorded in each DB for each information collection unit ID, and creates user reaction values in the information processing terminal 10 and the information collection device 20. The registered data management unit 36 records the created user response value in the user response value recording DB 44 shown in FIG. Here, the user reaction value recording DB 44 includes fields of “DB recording time”, “user reaction time”, “user name”, “device / app ID”, “user reaction type label”, and “user reaction value”. Have. In the “DB recording time” field, information (time stamp) of the time when the user reaction value was recorded is stored, and in the “user reaction time” field, the sensor recording end time of FIG. The sensor recording time 6 (b) is stored. In the field of “apparatus / app ID”, in addition to information on the apparatus that acquired the user response value, information on the information presentation unit and application that the user was viewing when the user response value was displayed is stored. The “user response type label” field stores a label indicating the type of user response value, and the “user response value” field stores the created user response value.

  Here, in step S12, the registration data management unit 36, specifically, calls an external user response quantification technique, and based on the sensor input information, the user response value (the magnitude of facial expression change, the interest / interest Positive / Neutral / Negative etc.). In this case, a user reaction value is created in association with the information processing terminal 10 (information collecting unit 12) and the information collecting device 20 (information collecting unit 22). Many methods for quantifying user responses have already been proposed. In the first embodiment, the presence / absence of stress is estimated based on skin conduction data, and the user's positive emotion or negative emotion is determined based on voice data. To estimate emotions. The former is described as an example in `` C. Setz et.al, Discriminating Stress From Cognitive Load Using a Wearable EDA Device, IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, VOL.14, NO.2, 2010. '' The latter is described as an example in “ME Hoque et. Al, Robust Recognition of Emotion from Speech, 6th International Conference on Intelligent Virtual Agents (IVA), 2006”.

  The registration data management unit 36 may calculate one user response value from one sensor data, or may calculate one user response value from a plurality of sensor data. Further, the user response value may be calculated only from newly acquired sensor data, or the user response value may be calculated including sensor data recorded in the past.

  In the present embodiment, for example, assuming that each of the three sensor data specifically recorded in each DB in FIGS. 6A and 6B is newly acquired data, the data in the bottom row ( The user response value at time tx is obtained using data from time tx-k to tx up to time tx-k that is back by a certain time (k) from the data recorded at the time tx). In other words, in the case of skin conductivity data, the sensor response time is the data that is within a certain time range from 2014/7/12 11: 00: 01.040, and the user response value of 2014/7/12 11: 00: 01.040 Ask. In this case, the first user response value from the top of FIG. 7A records the presence / absence of stress of user A on the information collection device 20 (information collection unit 22) of 2014/7/12 11: 00: 01.040. Is. That is, since the user response value is “1”, it is recorded that the user A is in a stressed situation. Similarly, the second user response value from the top in FIG. 7A is a record of User A's Positive / Negative for the information processing terminal 10 (information collecting unit 12), and the user response value is “N ", It is recorded that the situation was" Negative ".

  Next, in step S14, the registered data management unit 36 checks the correspondence list DB 46 (FIG. 7B), and lists information presenting units and applications that should create user responses, which are associated with the IDs of the information collecting devices. Up. The information presenting unit or application listed here means an information presenting unit or application that can calculate the user reaction value in accordance with the calculation of the user reaction value. In the correspondence list DB 46 of FIG. 7B, “information presentation unit / application ID” and “information collection unit ID” are associated with each other. For example, in the first list from the top in FIG. 7B, data that can be used to calculate a user response to the information presentation unit 14 is obtained from the information collection device 20 (information collection unit 22). It is shown that. The second list from the top indicates that data that can be used to calculate a user response to the information presentation unit 14 is obtained from the information processing terminal 10 (information collection unit 12). That is, in the calculation of the first and second user response values from the top of FIG. 7A, the user response values for the information collecting device 20 (information collecting unit 22) and the information processing terminal 10 (information collecting unit 12) are shown. Therefore, in step S14, the registration data management unit 36 lists the information presentation unit 14 and the application C0 as information presentation units / applications corresponding to the information collection units 22 and 12.

  Next, in step S <b> 16, the registration data management unit 36 creates user reaction values for the listed information presentation units and applications. That is, for example, in the third data from the top of FIG. 7A, the registration data management unit 36 is obtained from the information collection device (information collection unit 22) as a user reaction value for the information presentation unit 14. Reference is made to the first data from the top of FIG. At this time, for the “DB recording time”, the time at the time of reference / copying is recorded. Similarly, in the fourth data from the top in FIG. 7A, the first data from the top in FIG. 7A is referred to and copied. The same applies to the application C0, and the user response values of the information collection units 12 and 22 are referred to and copied. Therefore, the fifth data from the top in FIG. The second data from the top is copied to the sixth data from the top.

  Next, in step S <b> 18, the registration data management unit 36 associates the created user response value with the device / application ID and adds it to the user response value recording DB 44.

  In the first embodiment, for example, for an application, user response values of different user response types may be created using a plurality of types of data.

(2) Social Distance Score Calculation Processing by Server 30 Next, the social distance score calculation processing by the server 30 will be described in detail along the flowchart of FIG. Note that the processing in FIG. 8 is performed immediately before starting a certain application (denoted as application X). However, the present invention is not limited to this, and the process in FIG. 8 may be performed periodically at predetermined time intervals. FIG. 10 shows the social distance score recording DB 50 used in the process of FIG. In this social distance score recording DB 50, the social distance score for each application, which is expressed in vector by a plurality of indexes, is stored.

  In the process of FIG. 8, first, in step S30, the registration data management unit 36 checks the social distance calculation type list DB 48, and calculates the social distance score for any application X using any type of user reaction value. To decide. FIG. 9 shows an example of the social distance calculation type list DB 48. The social distance calculation type list DB 48 is a table in which the social distance calculation type of each application is registered as system data. For example, in the social distance calculation type list DB 48, the social distance calculation type of the application C0 is defined as {presence / absence of stress, Positive / Negative}. In other words, in this example, what stress level is shown for the application C0 and what feeling (Positive or Negative) is shown for the application C0 in a certain time is expressed as a social distance. For example, in the case of a human-human relationship, when thinking about the relationship between Mr. A and Mr. B in the morning and the relationship between Mr. A and Mr. B in the afternoon, Mr. A in the morning is Mr. B. Suppose you feel stressed when you talk with Mr. A, and you have a lot of negative reactions. In the afternoon, Mr. A doesn't feel much stress when you talk with Mr. B, and you get a lot of positive reactions. In this case, it can be inferred that the afternoon relationship is a better relationship than the morning relationship. In the present embodiment, a Positive / Negative user response calculated from speech data and a stress-existing user response calculated from skin conduction data are used.

  Next, in step S32, the registration data management unit 36 goes back in the social distance score recording DB 50 (FIG. 9) and records the social distance score recording time for the same application (application X) and the same user at the latest time. The target distance calculation section start point time.

  Next, in step S34, the registration data management unit 36 confirms the user response value record DB 44 (FIG. 7A) and takes out the user response value for the application X. In this case, the registration data management unit 36 extracts a plurality of types of user response values from the social distance calculation start time determined in step S32 to the current time.

  Next, in step S36, the registration data management unit 36 obtains an average value (or multiple value) of the time interval for each type of user response based on the user response value extracted in step S34.

  Hereinafter, a specific example of steps S32 to S36 will be described using the second data (DB recording time 2014/7/12 11: 03: 00.015) from the top in FIG. In this example, the registered data management unit 36 goes back to the social distance score record DB 50 and records the social distance score for the same application and the same user (tk-1 = 2014/7/12 10:59: 00.015) is set as the social distance calculation section start time (S32). Then, the registration data management unit 36 extracts a user response value for the application C0 from time tk-1 to the current time (S34). For example, as a user response to the application C0 from time tk-1 to the current time, the presence / absence of stress [1, 1, 1, 1, 0, 1] and Positive / Negative are [Negative, Negative, Negative, Positive, Negative] It is assumed that it is recorded in the user response value record DB 44. In this case, when the registered data management unit 36 obtains an average value of these user response values (S36), the presence / absence of stress is set to the average value “0.833”, and Positive / Negative is the majority value “Negative "

  Next, in step S38 of FIG. 8, the registration data management unit 36 adds the average value (or multiple value) of the time interval to the social distance score recording DB 50 as the social distance score in the current time stamp. For example, in the case of the above example, the two values obtained in step S36 are set as vector values {0.833, Negative}, and are recorded as social distance scores for the application C0 at time tk-1 to the current time. As a result, the social distance to the current application C0 can be quantified. In this case, as will be described later, the information presented by the application C0 can be dynamically changed. Also, if the social distance score is recorded in the same manner after the third data from the top of FIG. 10, the social distance between user A and application C0 was initially negative and highly negative. However, as time goes on, you will be able to observe how the tension changes to a positive one.

(3) Information presentation process by server 30 Next, the information presentation process by the server 30 (information presentation process management part 34) is demonstrated. The information presentation processing management unit 34 restricts information to be used and presents information within a usage range corresponding to the social distance score.

  In the process of (2) above, since the social distance score {stress presence / absence, Positive / Negative} between the user A and the application C0 at the time before the dialog generation at a certain time is clarified, the information presentation processing management unit 34 The range of information that can be used in dialog generation is controlled based on the social distance score.

  FIG. 11 shows an example of the information use restriction list DB 52 used by the information presentation process management unit 34 in this process. In the information use restriction list DB 52 of FIG. 11, for example, information use restrictions of information use levels 1 to 3 are provided for the application C0 using the social distance type {stress presence / absence, Positive / Negative}. To do. Note that there are various forms of associating information usage levels and information. For example, the user information type that can be used at each level is “profile information” for level 1 and “history” for level 2. “Information”, Level 3 can be defined as “Privacy information”.

  For example, if the current time is 2014/7/12 13: 02.13.044 and immediately after the fifth social distance score from the top of FIG. 10 is recorded, the social distance score {0.222, Positive} Referring to the information use restriction list DB 52, the information use level corresponds to 3, so that more information included in the privacy information can be used.

  As described above in detail, according to the first embodiment, the registration data management unit 36 specifies information (user reaction value) that specifies the user's emotion while using the application, and the application A social distance score for the application is determined based on a user response value while using. Thereby, the registration data management unit 36 can automatically determine what social distance the user feels to the application.

  In the first embodiment, the information presentation processing management unit 34 determines the information usage level based on the social distance score for the application, so that it matches the social distance that the user feels for the application. Information can be presented to the user. By presenting information that is not suitable for social distance, has no predecessor, is abrupt, and uses information without permission, the user knows that this service is a service that uses information up to what I have seen. It is possible to suppress the dislike of the application such as “No.”. By doing in this way, as a result, the favorable relationship between an application and a user is maintained, and it can raise the possibility that a user will use an application continuously.

  In the first embodiment, the registration data management unit 36 calculates a user reaction value and a social distance score using the user's biometric information collected by the information collection processing management unit 32. It is no longer necessary to create a questionnaire for investigating and to force the user to answer the questionnaire.

<< Second Embodiment >>
Hereinafter, the second embodiment will be described in detail with reference to FIGS. In the second embodiment, an example of calculating a relative social distance score using user response differences to a plurality of applications will be described.

  FIG. 12 schematically illustrates the configuration of the information providing system 200 according to the second embodiment, and FIG. 13 schematically illustrates a situation in which the user is using the information providing system 200. .

  In the second embodiment, an example in which a plurality of applications used by the user A exist at the same time will be described using personalization of a 3D presentation space. In this application, while walking through one building as shown in FIG. 13, the presented space has different specifications depending on the individual. There are information processing terminals 10a and 10b, an information collection device 20 ', an information presentation device 110, and the like in the building, and these pieces of information are integrated in the server 30. Here, as shown in FIG. 13, the information processing terminal 10a is a guide board type information terminal, and the information processing terminal 10b is a wearable terminal. The information processing terminals 10a and 10b are assumed to have an information collection unit 12 and an information presentation unit 14 as in the information processing terminal 10 of the first embodiment. The information collection device 20 'is a small video recorder, and the information collection device 20' has an information collection unit 22 as in the information collection device 20 of the first embodiment. The information presentation device 110 is an output device such as a projector or a speaker. Similarly to the first embodiment, the server 30 includes the information collection processing management unit 32, the information presentation processing management unit 34, the registration data management unit 36, and the display history management unit 38 shown in FIG. The information processing terminals 10a and 10b, the information collection device 20 ', the information presentation device 110, and the server 30 are connected to the network 80.

  In FIG. 13, a user A wears (carries) a wearable information processing terminal 10b, and uses the application C0 in the information processing terminal 10b. The application C0 is an application that presents a personalized 3D space to the user, and also presents and processes a dialog with a companion software agent that walks in the space. The application C0 presents information through the information presentation unit 14 of the information processing terminal 10b, and collects voice and image data through the information collection unit 12 that is a small video recording device. In the information presentation / information collection, communication between the information processing terminal 10b and the server 30 is also established, and when the user A starts using the service in the building, the information collecting unit 12 of the information processing terminal 10b. The information collected in step 1 is also sent to the server 30 and stored.

  In addition, the user A uses an application C1 that performs optimal presentation for a plurality of users to coexist in the same space by presenting and collecting information on the building side. The application C1 presents information through the information presentation device 110 through projection of information on the walls, floors, and hollows of the building, and collects voice and image data through the information collection device 20 '.

  Furthermore, the user A uses the guidance application C2 for the entire 3D space on the guidance board type information processing terminal 10a installed on the building side. The application C2 presents information through a screen (information presentation unit 14) attached to the information processing terminal 10a, and collects audio and image data through the information collection unit 12 which is a small video recording device attached to the front surface of the information processing terminal 10a. In this embodiment, for convenience of explanation, each application uses information of one device, but the present invention is not limited to this. For example, a number of applications may use data collected and stored on the server 30 such that the application C2 uses information collected by the information collection device 20 '.

  The server 30 calculates and records the user reaction value in the information collection device 20 ′, the user reaction value for the information presentation unit 14, and the user reaction value for each of the applications C 0 to C 2 by the same method as in the first embodiment. Note that the user reaction values in the second embodiment are that the application C0 is identified with the information presentation unit 14 and the information collection unit 12 of the information processing terminal 10b, and the application C1 is the information presentation device 110 and the information collection device 20 ′. The application C2 is identified with the information presenting unit 14 and the information collecting unit 12 of the information processing terminal 10a. This information is defined by a list similar to that shown in FIG.

  In the second embodiment, all user response values are calculated using images and audio included in the video image. As user response types to be used, “size of facial expression change during dialogue” and “Positive / Neutral / Negative of interest / interest” are obtained in common for all devices and applications. As in the first embodiment, since the existing technique is used for the user response quantification technique, details are omitted. For quantification of facial expression changes and interests / interests, “Emotient, Emotient API, http://www.emotient.com/products” and “iMotions, Attention Tool API, http://imotionsglobal.com” The technology described in "/ software / attention-tool-api /" can be employed.

  FIG. 14 shows a user reaction value record DB 44 ′ (corresponding to the user reaction value record DB 44 of FIG. 7A in the first embodiment). This user response value recording DB 44 ′ records user response values for applications, and includes “DB recording time”, “user response time”, “user name”, “application ID”, “user response type label”, Each field includes “user response value”. Details of each field are the same as those in the user response value record DB 44 in FIG. Note that, for example, the user response value is not recorded in the third data from the top in FIG. 14 (N / A (not available)), but this indicates that the collected video image corresponds to the application C1. This is because the dialogue did not exist in that time zone.

(Process of calculating relative social distance score by server 30)
FIG. 15 is a flowchart showing a relative social distance score calculation process executed in the server 30.

  The processing in FIG. 15 is assumed to be performed immediately before the user A starts a certain dialogue. However, the present invention is not limited to this, and the processing in FIG. 15 may be performed periodically at predetermined time intervals. In the following, a case will be described in which the application C0 is immediately before starting a conversation with the user A.

  In the process of FIG. 15, first, in step S50, the registered data management unit 36 of the server 30 confirms the relative social distance calculation type list DB 48 ′ (see FIG. 16A), and the application X (here, C0). ), It is determined which type of user response value is used for each comparison application. Here, the registered data management unit 36 refers to which type of user reaction value is used in each of the comparison applications (C1, C2) of the application C0 in the relative social distance calculation type list DB 48 '. In the case of FIG. 16 (a), {change in facial expression during dialogue, interest / interest} is the relative social distance calculation type.

  Next, in step S52, the registration data management unit 36 goes back to the relative social distance score recording DB 50 ′ (see FIG. 16B) and records the social distance score recording time for the same application C0 and the same user at the latest time. Is the social distance calculation section start time. Here, the relative social distance score record DB 50 ′ of FIG. 16B is substantially the same as the social distance score record DB 50 (FIG. 10) of the first embodiment, but the field of “comparison application ID” And a field of “relative social distance score” instead of “social distance score”. In this step S52, for example, recording at the latest time tk-1 is 2014/7/13 10: 50: 00.064 in comparison with the application C1, and 2014/7/13 10:50 in comparison with the application C2. 00.078 and the social distance calculation section start time for each application.

  Next, in step S54, the registered data management unit 36 confirms the user response value record DB 44 '(FIG. 14), and extracts the user response value for the application X (C0) from the social distance calculation section start time to the current time. For example, as a user response to C0 from time tk-1 to the current time, facial expression changes during conversation [Large, Large, Large, Small, Large, Small, Large], Interests [Positive, Negative, Neutral, Negative, Positive, Assume that [Positive, Positive] is extracted. Also, as the user response to application C1, the facial expression change during dialogue [N / A, Small, N / A] and the interest / interest [Positive, Negative, Neutral] are taken out, and the facial expression change during dialogue as the user response to application C2 It is assumed that [small, N / A, small, small] and interest [Positive, Neutral, Negative, Negative] are extracted.

  Next, in step S56, the registration data management unit 36 obtains a relative average value in the time interval for each type of user response based on the extracted user response value. Here, the relative average value may be calculated by averaging the data from time tk-1 to the current time for each application and then comparing between the applications. It is good also as averaging after comparing the first half of data and the second half. In addition, other methods such as adoption of a median value or multiple values may be used.

  For example, regarding application C0, if a large number of values are taken in the expression change during dialogue, the majority value from time tk-1 to the current time is [Large], and in interest / interest, Positive is 1, Neutral is 0.5, Negative If the average value is calculated with 0 being 0, the average value from time tk-1 to the current time is [Positive] (when 0.4 to 0.6 = Neutral). If the same method is used in application C1, [N / A] and interest / interest are [Neutral] for facial expression changes during dialogue, [Small] for facial expression changes during application C2, and [ Negative]. In this case, the result of the application C0 is [N / A] (no comparison target) as compared to the application C1, and the interest / interest is [possibly positive] (possibly positive). It becomes. Compared with application C2, the expression change during dialogue is [Larger] (the change is large), and the interest / interest is [Positive] (which was Positive).

  Next, in step S58, the registered data management unit 36 adds the average value of the time interval to the relative social distance score recording DB 50 ′ (FIG. 16B) as the relative social distance score in the current time stamp. To do. In this case, the registration data management unit 36 uses the result obtained in step S56 as a vector value and compares the application C0 at time tk-1 to the current time with the application C1 relative social distance score {N / A, Possibly positive} and the relative social distance score {Larger, Positive} when the application C0 is compared with the application C2 are recorded in the relative social distance score record DB 50 ′ (from the top of FIG. 16B). (Refer to the third and fourth data).

  By doing in this way, in this 2nd embodiment, relative social distance at the time of comparing with other applications to current application C0 can be quantified.

(Information presentation processing by the server 30)
Next, the information presentation process to the user based on the relative social distance score executed by the information presentation process management unit 34 will be described. FIG. 17 shows an unpleasant reaction DB 152 as a recording unit used in the second embodiment.

  The unpleasant reaction DB 152 is a database that stores whether or not the user feels uncomfortable when using the application in the past, together with the information usage level. As shown in FIG. 17, the unpleasant reaction DB 152 includes fields of “DB recording time”, “user name”, “application ID”, “information usage level”, and “unpleasant reaction”. For example, according to the first data from the top of FIG. 17, it can be seen that the user A showed an unpleasant reaction as a result of the information C2 being provided to the user A from the application C2. In addition, according to the third data from the top in FIG. 17, it is understood that as a result of the information C2 being provided to the user A from the application C2, the user A no longer exhibits an unpleasant reaction. .

  Here, when the user reaction is different from other people and it is difficult to obtain a clear response, when the social distance score described in the first embodiment is used, the score may be difficult to appear on the table. Therefore, in the second embodiment, appropriate information is presented to the user by using a sense of social distance (relative social distance score) compared to the user's reaction to other applications of the user. .

  For example, the information presentation processing management unit 34 refers to the relative social distance score recording DB 50 ′ in FIG. 16B immediately before the user A uses the application C 0. And the information presentation process management part 34 extracts the application which shows the expression change at the time of dialog, and interest / interest almost the same as application C0 from the latest relative social distance score. Note that “substantially the same” means that the same or difference is within a predetermined range. Here, as an example, it is assumed that the application C2 is extracted.

  In addition, the information presentation processing management unit 34 refers to the data of the user name = “UserA” and the application ID = “C2” in FIG. 17, and shows an unpleasant reaction when the user A uses the application C2 most recently. The information usage level (in the case of FIG. 17, information usage level = “2”) is determined. Then, the information presentation process management unit 34 sets the information usage level of the application C0 to the determined usage level (= 2) and presents information to the user A. In this way, it is possible to present appropriate information in the application C0.

  As can be seen from the above description, in the second embodiment, a user response value while using a plurality of applications and a specifying unit for specifying a user response value while using an application are used. An example of a determination unit that determines the relative social distance between a plurality of applications based on the registration data management unit 36 is given.

  As described above in detail, according to the second embodiment, the registration data management unit 36 specifies information (user response value) that specifies the user's emotion while using the application, A relative social distance score between a plurality of applications is determined based on a user reaction value while using the application. As a result, the registered data management unit 36 can automatically determine what social distance the user feels relative to the application.

  In the second embodiment, the information presentation processing management unit 34 determines the information usage level for a certain application (first application) based on the relative social distance score for a plurality of applications. Information suitable for the social distance felt for the application can be presented to the user. In this case, the information presentation processing management unit 34 refers to the relative social distance score recording DB 50 ′, and an application (second application) whose social distance score is equal to or different from a certain application (first application). Based on the information (whether or not it is uncomfortable) that identifies the user's emotions identified while the second application provides the user with information of a predetermined information usage level. The information usage level of information provided by one application is determined. For this reason, the appropriate information usage level of the first application can be determined based on the information specifying the user's feelings with respect to the second application.

  In the second embodiment, a case where one application is compared with one application on a one-to-one basis has been described. However, the present invention is not limited to this, and one application is a one-to-many relationship with another application. You may make it compare.

  Note that both the social distance score of the first embodiment and the relative social distance score of the second embodiment may be used as indices. In this case, the social distance score and the relative social distance score may be expressed by one vector.

(Modification 1)
In the above embodiment, information usage restrictions may be added using the social distance score or relative social distance score and the history of unpleasant reactions during information use. That is, in the first embodiment, the user and the application C0 at the time before the dialog generation at a certain time are calculated from the user reaction values calculated using the sensor input information (skin conduction data, audio data, video data, etc.) The social distance score (relative social distance score) was calculated, the information usage level was controlled as shown in FIG. 11, and the dialogue content premised on appropriate information usage was generated. In this case, However, it may be an unpleasant use of information for the user. Therefore, in the first modification, for example, when the user response to the dialogue indicates an unpleasant sensation, the information presentation processing management unit 34 calculates a social distance score (relative to the generation of the dialogue). (Social distance score) and information use level are set and recorded in the social distance score record DB as shown in FIG.

  Moreover, in this modification 1, the information presentation process management part 34 is every fixed time (for example, every other day), or whenever a fixed amount of data is collected (for example, every time an unpleasant reaction record collects as many as the number of registered users), Processing for setting an additional information usage restriction in the information usage restriction list DB 52 ′ shown in FIG. 19 is executed. In this process, the information presentation process management unit 34 sets the additional information use restriction in FIG. 19 when there is a significant pattern of unpleasant reaction in FIG.

  In this case, as a prominent pattern in the data accumulated in FIG. 18, for example, a certain number or more of users reacts with discomfort, or one user reacts with discomfort more than a certain number of times. Etc. For example, in FIG. 18, when the application C0 presents information of the information use level “2”, the users who showed an unpleasant reaction are user1 to user3. Moreover, when it summarizes by a social distance score, {0.412-0.578, Negative} shows two persons, and {0.500, Positive} shows one person unpleasant reaction. Therefore, for example, if the social distance score where two or more people showed an unpleasant reaction is inappropriate, the information presentation processing management unit 34, when the social distance score is {0.412 to 0.578, Negative} An information usage additional restriction is set in the information usage restriction list so as to avoid information usage level 2 information usage (see the second data from the top in FIG. 19).

  In this way, by adjusting the information usage restriction according to the user's reaction, it is possible to reduce the occurrence of the case that makes the user uncomfortable as compared with the case where the information usage level is set with a fixed value as shown in FIG. can do.

(Modification 2)
In the case of creating an information use restriction using the social distance score or the relative social distance score and the history of unpleasant reaction at the time of information use as in the first modification, the information use restriction is previously set as system data You do not have to create it. For example, when the server 30 increases the information usage level over time, after collecting unpleasant reaction records as recorded in the first modification and accumulating more than a certain amount, The use restriction list DB 52 ″ (see FIG. 20) may be created.

  In the second modification, the information presentation processing management unit 34 performs information every fixed time (for example, every other day) or every time a fixed amount of data is collected (for example, every time an unpleasant reaction record is collected to the same number as registered users). A usage restriction list DB 52 ″ is created.

  For example, when the information use restriction list DB 52 ″ is created based on the daily discomfort response record of 2014/7/10 in the social distance score record DB of FIG. 18, in FIG. Therefore, the information presentation processing management unit 34 may create the information use restriction list DB 52 ″ based on all these data, or data that has cleared certain conditions. The information use restriction list DB 52 ″ may be created using only the information. The information presentation processing management unit 34 may add conditions in such a manner that the information use restriction list on the previous day is overwritten. A new usage restriction list DB 52 ″ may be created every day. The example of FIG. 20 shows data when it is determined that the social distance score in which two or more people showed an unpleasant reaction is inappropriate and the information usage restriction list DB 52 ″ is newly created.

  By doing in this way, even if it is a case where the tendency of a user's reaction differs every day, it becomes possible to update appropriately information use restriction list DB52 "based on the latest unpleasant reaction record.

  The above processing functions can be realized by a computer. In that case, a program describing the processing contents of the functions that the processing apparatus should have is provided. By executing the program on a computer, the above processing functions are realized on the computer. The program describing the processing contents can be recorded on a computer-readable recording medium (except for a carrier wave).

  When the program is distributed, for example, it is sold in the form of a portable recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. It is also possible to store the program in a storage device of a server computer and transfer the program from the server computer to another computer via a network.

  The computer that executes the program stores, for example, the program recorded on the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes processing according to the program. The computer can also read the program directly from the portable recording medium and execute processing according to the program. Further, each time the program is transferred from the server computer, the computer can sequentially execute processing according to the received program.

  Each embodiment mentioned above is an example of suitable implementation of the present invention. However, the present invention is not limited to this, and various modifications can be made without departing from the scope of the present invention. For example, the sensor type, user response value type, social distance score, and the like that acquire the user information described in the first and second embodiments are examples, and thus are limited to the above embodiment. It is not a thing.

In addition, the following additional remarks are disclosed regarding description of the above 1st, 2nd embodiment and a modification.
(Additional remark 1) The specific part which specifies the information which specifies a user's emotion while using an application,
A social distance determination device comprising: a determination unit that determines a relative social distance between a plurality of applications based on information identifying the user's emotion while using the plurality of applications.
(Additional remark 2) The social distance judgment apparatus of Additional remark 1 further provided with the determination part which determines the information which a 1st application provides based on the relative social distance between the said some applications.
(Supplementary note 3)
With reference to the recording unit that records the determination result of the determination unit, a second application having a social distance equal to or different from the first application is extracted, and the second application is sent to the user. The level of information provided by the first application is determined based on information specifying the user's emotion specified while providing a predetermined level of information. Social distance judgment device.
(Additional remark 4) The said specific | specification part acquires the said user's biometric information, specifies the information which specifies the said user's emotion based on this biometric information, The additional description 1-3 characterized by the above-mentioned. Social distance judgment device.
(Appendix 5) Identify information that identifies the user's emotions while using the application,
A society characterized by causing a computer to execute a process of determining a relative social distance between a plurality of applications based on information specifying the user's emotions specified while using a plurality of applications. Distance judgment program.
(Additional remark 6) The social distance judgment program of Additional remark 5 which makes the said computer further perform the process which determines the information which a 1st application provides based on the relative social distance between the said some applications.
(Supplementary note 7) In the process of determining,
Referring to the recording unit in which the determination result of the determination process is recorded, the second application having the same social distance as the first application or a difference within a predetermined range is extracted, and the second application is the user The information level provided by the first application is determined based on information specifying the user's emotion specified while providing a predetermined level of information to the user. Social distance judgment program.
(Supplementary note 8) In any one of Supplementary notes 5 to 7, wherein in the specifying process, the user's biological information is acquired, and information specifying the user's emotion is specified based on the biological information. Social distance judgment program.
(Appendix 9) Identify information that identifies the user's emotions while using the application,
A society characterized in that a computer executes a process of determining a relative social distance between a plurality of applications based on information specifying the user's emotions specified while using a plurality of applications. How to determine the correct distance.
(Supplementary note 10) The social distance determination method according to supplementary note 9, wherein the computer further executes a process of determining information provided by the first application based on a relative social distance between the plurality of applications.
(Supplementary Note 11) In the determination process,
Referring to the recording unit in which the determination result of the determination process is recorded, the second application having the same social distance as the first application or a difference within a predetermined range is extracted, and the second application is the user The information level provided by the first application is determined based on information specifying the user's emotion specified while providing a predetermined level of information to the user. Social distance judgment method.
(Supplementary Note 12) In any one of Supplementary Notes 9 to 11, in the specifying process, the biological information of the user is acquired, and information specifying the emotion of the user is specified based on the biological information. Social distance judgment method.

30 servers (social distance judgment device)
36 Registered Data Management Department (Identification Department, Judgment Department)
34 Information presentation processing management unit (decision unit)
152 Unpleasant reaction DB (recording unit)

Claims (6)

A specific part that identifies information that identifies the user's emotions while using the application;
A social distance determination device comprising: a determination unit that determines a relative social distance between a plurality of applications based on information identifying the user's emotion while using the plurality of applications.   The social distance determination apparatus according to claim 1, further comprising a determination unit that determines information provided by the first application based on a relative social distance between the plurality of applications. The determination unit
With reference to the recording unit that records the determination result of the determination unit, a second application having a social distance equal to or different from the first application is extracted, and the second application is sent to the user. The level of information provided by the first application is determined based on information specifying the user's emotion specified while providing a predetermined level of information. Social distance judgment device.   The society according to any one of claims 1 to 3, wherein the specifying unit acquires the user's biological information and specifies information for specifying the user's emotion based on the biological information. Distance determination device. Identify information that identifies the user ’s emotions while using the application,
A society characterized by causing a computer to execute a process of determining a relative social distance between a plurality of applications based on information specifying the user's emotions specified while using a plurality of applications. Distance judgment program. Identify information that identifies the user ’s emotions while using the application,
A society characterized in that a computer executes a process of determining a relative social distance between a plurality of applications based on information specifying the user's emotions specified while using a plurality of applications. How to determine the correct distance.

Images