JP7257381B2 - Judgment system and judgment method - Google Patents

Description

The present invention relates to a determination system and determination method.

2. Description of the Related Art In recent years, biosensors are widely used to measure user's biometric information. Measured biological information is utilized not only in the medical field but also in various fields.

An example of technology related to utilization of such biometric information is disclosed in Patent Literature 1. In the technology disclosed in Patent Document 1, biometric information of a user is measured by a biosensor such as an electroencephalogram sensor. Then, based on the measured biological information, the state of the user's fatigue, stress, and the like is specified. In addition, information on products suitable for the identified state is displayed to the user as information on recommended products.

JP-A-2001-344352

By using the conventional technology such as the technology disclosed in the above-mentioned Patent Document 1, it is possible to newly propose to the user a product or service that is suitable for the user's state of fatigue and stress at that time.
However, conventional techniques such as the technique disclosed in Patent Document 1 only propose new products to users, and do not analyze users who have actually come into contact with products.

The present invention has been made in view of such circumstances. The object is to provide a determination system and a determination method for analyzing users who have actually come into contact with products or the like.

A determination system according to the present invention comprises a measurement unit that measures biological information of a customer who has been presented with at least one of the provided product or the provided service, and makes a determination based on the biological information measured by the measurement unit. and a determination unit that identifies the customer's responsive state that has received the presentation, and a notification unit that performs notification based on the customer's responsive state that has been identified by the determination unit.

A determination method according to the present invention is a determination method executed by a determination system, and includes a measurement step in which a measurement unit measures biological information of a customer who has been presented with at least one of the provided product or the provided service; a determination step in which a unit identifies the sensitive state of the customer who received the presentation by making a determination based on the biological information measured by the measurement unit; and a notification step of performing notification based on the responsive state.

According to the present invention, it is possible to analyze a user who has actually come into contact with a product or the like.

1 is a block diagram showing an example of the overall configuration of a determination system according to one embodiment of the present invention; FIG. 1 is a block diagram showing an example of the configuration of a determination device according to one embodiment of the present invention; FIG. It is a table which shows an example of the data structure of the information database for determination constructed|assembled by the determination apparatus which concerns on one Embodiment of this invention. It is a flow chart explaining a flow of sensitive state judging processing which an information gathering device concerning one embodiment of the present invention performs.

An example of an embodiment of the present invention will be described below with reference to the accompanying drawings.
[System configuration]
FIG. 1 is a block diagram showing the overall configuration of a determination system S according to this embodiment. As shown in FIG. 1, the determination system S includes a biological information measurement device 10, an environmental information measurement device 20, a determination device 30, and a display device 40. FIG. Also, FIG. 1 illustrates a customer 50 to be processed by the determination system S. As shown in FIG.

Each device included in these determination systems S is connected so as to be able to communicate with each other via a network. Communication between these devices may be performed in accordance with any communication method, and the communication method is not particularly limited. Also, the communication connection may be a wireless connection or a wired connection. Furthermore, communication between devices may be performed directly between devices without going through a network.

The determination system S is installed, for example, at a place where the provided product provided by the business operator or the provided service provided by the business operator is presented to the customer 50 . This presentation may be the presentation of the provided product and the provided service itself, or may be the presentation of information regarding the provided product and the provided service.

For example, the determination system S is installed in an exhibition hall where the offered products can actually be seen and touched, or in an experience facility where the offered offered services can be actually experienced. The offered products displayed in the exhibition hall are, for example, model houses, model rooms, cars, home electric appliances, works of art, jewelry, and the like. The services that can be actually experienced at the experience facility include, for example, hairdressing or beauty services, food and beverage services, entertainment services, and the like.
Below, it demonstrates assuming the case where the determination system S is installed in the model house. In this case, the customer 50 is a visitor who is interested in the model house and visits the model house.

The determination system S having such a configuration measures the biometric information of the customer 50 who has been presented with at least one of the provided product and the provided service. Further, the judgment system S identifies the sensitive state of the customer 50 who received the presentation by making a judgment based on the measured biological information. Further, the determination system S makes a notification based on the sensitive state of the specified customer 50 .
Therefore, according to the determination system S, it is possible to analyze users who have actually come into contact with products or the like. Such a judgment system S can serve as a sales promotion tool that provides, for example, information that allows the subjective state of sensitivity of the customer 50 to be examined from an objective point of view, making it possible to judge the value of a product. can be used.

Next, each device included in the determination system S will be described in detail.
The biological information measuring device 10 includes a function of measuring the biological information of the customer 50 (hereinafter referred to as "customer biological information"). For example, the biological information measuring device 10 measures the biological information of the customer 50 using any one of an electroencephalogram sensor, an electrocardiographic sensor, a Doppler sensor, or a combination thereof.

Here, the electroencephalogram sensor has a faster response speed than other sensors, and is therefore suitable for measuring instantaneous changes. On the other hand, other sensors require a data collection time of about 30 seconds to 1 minute.
In addition, the Doppler sensor is characterized by being able to measure information on heart rate, respiration rate, and body movement without contacting the customer's 50 body. For example, Doppler sensors can measure breathing rate, ratio of inhalation to exhalation time, depth of chest movement during respiration, and the like.
Other sensors, on the other hand, must be in contact with the customer's 50 body for measurements. However, for example, an electrocardiographic sensor has the feature that it can measure heart rate variability with higher accuracy than a Doppler sensor.

The biosensor used in the biometric information measuring apparatus 10 is determined according to the characteristics of each biosensor and the type of biometric information to be measured.
Below, the biometric information measuring device 10 assumes a case where customer biometric information is measured using two types of biosensors. For example, the biological information measuring device 10 measures variations in the electroencephalogram using a headphone-type electroencephalogram sensor that electrically contacts the body of the customer 50 at two points, the forehead and the earlobe. In addition, the biological information measurement apparatus 10 measures variations in the heart rate, which is one of the customer's biological information, using a two-point contact type electrocardiogram sensor in which one electrode is touched by the thumbs of both hands of the customer 50 .
The biometric information measuring device 10 generates customer biometric information by associating the electroencephalogram fluctuations and the heartbeat fluctuations measured by these biosensors with the measurement times in chronological order. The biological information measuring device 10 then transmits the generated customer biological information to the determination device 30 .

The environmental information measuring device 20 includes a function of measuring environmental information indicating characteristics of the environment in which the customer 50 is placed. For example, the environmental information measuring device 20 measures environmental information using one or a combination of a temperature sensor, humidity sensor, air quality sensor, particle counter, illuminance sensor, atmospheric pressure sensor, and acceleration sensor. In this case, the environmental information is, for example, physical quantities such as temperature, humidity, air quality (for example, the concentration of carbon dioxide in the air and the amount of fine particles), illuminance, atmospheric pressure, and acceleration. It should be noted that the acceleration may be measured, for example, when the environment in which the customer 50 is placed is inside a vehicle such as an automobile.

Moreover, the environmental information may include other information in addition to such physical quantities. For example, it may contain information indicating whether the environment in which the customer 50 is placed is a place where the spirit is generally likely to be elevated or a place where the mind is generally likely to be stable. In addition, in more detail, other information includes information indicating which place, such as a scenic spot, a famous historic site, a resort, or a so-called power spot, which is generally a place where the spirit is likely to be exalted. good too. Similarly, other information may be included that indicates which place, such as a home, an accommodation facility, or a coffee shop, which is generally a place where mental stability is likely to occur. Further, for example, the environment in the model house may include other information such as the operation mode and set temperature of the air conditioner.

Information other than these physical quantities is input to the environmental information measurement device 20 and the determination device 30 by, for example, an administrator of the determination system S. Alternatively, for example, information indicating where the location is by comparing position information obtained by positioning based on the GPS (Global Positioning System) or the like by the environment information measuring device 20 or the determination device 30 with map information. to get

The environment information measuring device 20 generates environment information by associating the physical quantity acquired by the measurement by each sensor and other information indicating the location with the measurement time. The environment information measuring device 20 then transmits the generated environment information to the determination device 30 .

The judgment device 30 makes a judgment based on the customer biological information acquired from the biological information measuring device 10 and the environment information acquired from the environmental information measuring device 20, thereby determining the sensitive state of the customer 50 who has received the offer product or the like. Contains the function to identify. The determination device 30 also includes a function of performing processing for notification based on the sensitive state of the identified customer 50 . Processing for notification is realized by transmitting notification information to the display device 40, for example.

The display device 40 is a display device such as a liquid crystal display connected to the determination device 30 or a display unit in a tablet terminal. The display device 40 displays the notification information received from the determination device 30 .

By referring to this notification information, the customer 50 can objectively examine the response state, which is subjective information of the customer 50 . Therefore, the customer 50 can judge the value of the offered product or the like based on the indicator of his/her own sensitive state. Further, the display device 40 may notify the business operator who sells the offered product or the like. In this case, the business operator can obtain the sensitive state of the customer 50 as an index of the customer's 50 reaction and response to the provided product or the like.
As a result, the determination system S functions as a useful sales promotion tool for businesses that sell offered products and the like.

Each device included in the determination system S has been described above. Although each device is illustrated one by one in the drawing, this is merely an example, and the determination system S may include any number of these devices. For example, a plurality of sets of the biological information measuring device 10 , the environmental information measuring device 20 , and the display device 40 may be provided corresponding to a plurality of customers 50 . Then, for example, one judging device 30 may collectively perform the judgment processing for these multiple sets.

[Configuration of determination device]
Next, the configuration of the determination device 30 will be described with reference to the block diagram of FIG. As shown in FIG. 2, the determination device 30 includes a CPU (Central Processing Unit) 31, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 33, a communication unit 34, a storage unit 35, an input A unit 36 and a display unit 37 are provided. These units are bus-connected by signal lines and exchange signals with each other.

The CPU 31 executes various processes according to programs recorded in the ROM 32 or programs loaded from the storage unit 35 to the RAM 33 .
The RAM 33 also stores data necessary for the CPU 31 to execute various processes.

The communication unit 34 performs communication control for the CPU 31 to communicate with other devices included in the determination system S. FIG.
The storage unit 35 is composed of a semiconductor memory such as a DRAM (Dynamic Random Access Memory), and stores various data.

The input unit 36 is composed of external input devices such as various buttons and a touch panel, or a mouse and keyboard, and inputs various information according to user's instruction operations.
The display unit 37 is composed of a liquid crystal display or the like, and displays an image corresponding to the image data output by the CPU 31 .

In the determination device 30, the "sensitive state determination process" is performed by the cooperation of these units. Here, the responsive state determination process is to specify the responsive state of the customer 50 who has been presented with the provided product or the like by the determining device 30 making a determination based on the customer biometric information, etc., and determine the specified responsive state. This is a series of processing for notification.

When the sensitive state determination process is executed, as shown in FIG. 315 and .
In one area of the storage unit 35, an information database 351 for determination is set.

The determination information database 351 is a database storing various types of information used by the determination device 30 to perform the sensitive state determination process. An example of a specific data structure of the determination information database 351 will be described with reference to FIG.

As shown in FIG. 3, in the determination information database 351, a plurality of pieces of biological information with identifiers are stored as one record in association with other information such as corresponding environmental information. For example, the biological information measured by the biological information measuring device 10 in one sensitive state determination process and other corresponding information are stored as one record. Each of these records is, for example, information obtained by measuring the customer 50 in the sensitive state determination process in the past.

However, it is preferable to obtain information such as biometric information from persons other than the customer 50 in order to enrich the records stored in the database and improve the accuracy of determination in the sensitive state determination process.
Specifically, in order to acquire various data, it is preferable to measure various people at various places and acquire biometric information. For example, biometric information may be acquired by taking measurements at a place where the mind is generally likely to be elevated and a place where the mind is generally likely to be stable. In addition, it is preferable to acquire information from a variety of people regardless of age and gender as to the persons to be measured.

In addition, biometric information may be obtained for the same person in various states. For example, while relaxing in the living room, sleeping, studying or working, watching sports and getting excited, admiring the scenery at a scenic spot, and intentionally conducting a stress test. A data set of biometric information may be created by acquiring biometric information in various states of the same person, such as a state where the person is in a dead state. Also, such data sets may be created for a larger number of people.

In this way, when various people other than the customer 50 are measured at various places, the measurement is performed by the biological information measuring device 10 and the environmental information measuring device 20 included in the determination system S. However, other measuring devices are also possible.

Each record has columns, for example, "information identifier", "measurement date and time", "first biological information", to "nth biological information (n is an arbitrary natural number)", "first "environmental information" to "m-th environmental information (m is an arbitrary natural number)" and "type classification". Specific contents of the information corresponding to each of these columns will be explained.

"Information identifier" is an identifier for identifying each record. The information identifier may be arbitrary information as long as it is unique information for each record. For example, a number indicating the order stored in the determination information database 351 or an ID (identifier) assigned based on a predetermined rule may be used as the information identifier.

The "measurement date and time" is information indicating the date and time when each biological information included in the record was measured. For example, the "measurement date and time" is time information from when the measurement of the biological information or the like is started until the measurement of the biological information or the like is finished.

"First biometric information" to "nth biometric information" are biometric information measured by the biometric information measuring device 10 or the like, and separate columns are provided for each type of biometric information. For example, the first biological information is "brain wave", the second biological information is "heart rate", the third biological information is "breathing rate", ..., the n-th biological information is "breathing depth". .

"First environment information" to "mth environment information" are the environment information measured by the environment information measuring device 20 or the like, and separate columns are provided for each type of environment information. For example, the first environmental information is "temperature", the second environmental information is "humidity", the third environmental information is "air quality", . . . and the m-th environmental information is "illuminance".

The “type classification” is information indicating the result of classifying the person whose biometric information is to be acquired according to a predetermined criterion. For example, classification can be performed based on attributes such as age, sex, and occupation of a person whose biometric information is to be acquired. There are individual differences in the degree of influence of biometric information on the sensitive state. Therefore, classification is performed based on information such as personal attributes that are considered to be correlated with individual differences. The sensitive state determination unit 313, which will be described later, can perform determination with higher accuracy by determining the biological information using this type classification. For example, the sensitive state determination unit 313 can perform determination with higher accuracy by comparing biometric information of the same type for determination.
Each of these pieces of information in the determination information database 351 is appropriately updated by the database updating unit 315, which will be described later.

The customer biometric information acquisition unit 311 acquires customer biometric information by receiving it from the biometric information measurement device 10 . Then, the customer biometric information acquisition unit 311 outputs the acquired customer biometric information to the sensitive state determination unit 313 and the database update unit 315, which will be described later.

The environment information acquisition unit 312 acquires environment information by receiving it from the environment information measuring device 20 . The environment information acquisition unit 312 then outputs the acquired environment information to the responsive state determination unit 313 and the database update unit 315, which will be described later.

The sensitive state determination unit 313 identifies the sensitive state of the customer 50 by performing determination based on at least one piece of customer biometric information input from the customer biometric information acquisition unit 311 .
As a premise for the description of the determination by the sensitive state determination unit 313, the procedure up to the determination will be described. In this embodiment, a customer 50 visiting the model house is fitted with a biosensor outside the model house. Also, the biological information measuring device 10 immediately starts measuring the customer 50 . The customer biometric information acquired by the measurement is acquired by the customer biometric information acquisition unit 311 and output to the sensitive state determination unit 313 as described above.

In this state, the business operator who sells residences using the model house gives a general explanation of the model house to the customer 50 before entering the model house. After the explanation, the customer 50 enters the model house and experiences the indoor environment of the model house.
Then, the sensitive state determination unit 313 makes a determination based on the customer biometric information of the customer 50 experiencing the indoor environment of the model house, and specifies the sensitive state of the customer 50 .

There are various types of responsive states, such as comfort, impression, emotions, burden on the body, and mood, but this embodiment focuses on comfort according to the environment. A state of high comfort is defined as a state in which a large number of alpha waves are present among electroencephalograms and parasympathetic nerves are dominant.

Alpha waves can be specified, for example, by separating frequency components in a medium frequency band when electroencephalograms obtained as customer biometric information are Fourier-transformed and frequency-decomposed.
In addition, for the parasympathetic nerve, for example, the frequency component of the high frequency band (for example, from 0.20 Hz to 0.35 Hz) when the power spectrum analysis of the frequency component of the periodic fluctuation of the heart rate is performed. If there are more of them, it can be determined that the parasympathetic nerves are dominant.

As examples of determination methods by the sensitive state determination unit 313 based on these pieces of information, three determination methods, a first determination method to a third determination method, will be described.
A first determination method is a determination method based on the magnitude of the intensity of α waves. Specifically, in the first determination method, a threshold for α waves is set. Then, when the absolute intensity of the alpha waves exceeds the threshold, it is determined that the comfort is high. Moreover, if a plurality of threshold values are provided, the comfort level is determined step by step.

Alternatively, the determination may be made based on the magnitude of the relative rate of change of the alpha wave intensity. In this case, the relative change rate of the α wave intensity before and after entering the model house is defined as "{A0×(α wave intensity after entering)}/(α wave intensity before entering)". Here, A0 is a predetermined constant. Then, by setting a threshold for the relative rate of change of the alpha wave intensity, comfort is determined for the relative rate of change in the same manner as the determination based on the absolute intensity.
In the first determination method, determination can be made from information close to raw data, so there is the advantage of high objectivity, and the possibility of causing misunderstandings when explaining to customers can be reduced.

The second determination method is a method that considers the degree of predominance of parasympathetic nerves in addition to the first determination method. In the second determination method, comfort is defined as “(comfort)=A1×(α wave intensity)+A2×(parasympathetic nerve dominance)”. where A1 and A2 are predetermined constants. Then, a threshold for this comfort is set. Then, when the comfort exceeds the threshold, it is determined that the comfort is high. Moreover, if a plurality of threshold values are provided, the comfort level is determined step by step. Moreover, if a plurality of threshold values are provided, the comfort level is determined step by step. For the definition of comfort, not only a linear expression as described above but also a secondary or higher expression may be used.

Furthermore, as in the case of the first determination method, the determination may be made based on the magnitude of the relative rate of change of the alpha wave intensity and the degree of parasympathetic nerve dominance. In this case, in the definition of "(comfort) = A1 × (α wave intensity) + A2 × (parasympathetic nerve dominance)", replace (α wave intensity) with (relative rate of change of α wave intensity) Together, (parasympathetic nerve dominance) is expressed as "(Relative change rate of parasympathetic nerve dominance) = {A3 x (parasympathetic nerve dominance after entry)}/(parasympathetic nerve dominance before entry)". replace with Then, by setting a threshold for the relative rate of change of the alpha wave intensity and the degree of parasympathetic nerve dominance, comfort is also determined for the relative rate of change in the same manner as the determination based on the absolute intensity.
In the second determination method, the degree of predominance of parasympathetic nerves is also considered in addition to α waves. Therefore, the comfort evaluation accuracy is improved as compared with the first determination method.

A third determination method is a method that further utilizes type classification in the first and second determination methods. In the third determination method, the values of constants A0, A1, A2, and A3 described above are varied for each type classification. As a result, it is possible to perform determination according to the tendency of each type, so that determination can be performed with higher accuracy.

The sensitive state determination unit 313 identifies the sensitive state of the customer 50 by making a determination using the determination method described above. Then, the sensitive state determination unit 313 outputs the identified sensitive state to the notification unit 314 . In this embodiment, the sensory state determination unit 313 outputs the comfort specified by the determination to the notification unit 314 .
The notification unit 314 generates notification information based on the responsive state input from the responsive state determination unit 313 . The notification information may be, for example, information indicating the responsive state itself specified by the responsive state determination unit 313 .

Also, information other than the responsive state may be included in the notification information. For example, by comparing the biometric information of the customer 50 with the biometric information of each record stored in the determination information database 351, it is possible to indicate that the biometric information is similar to the biometric information when the customer 50 is in another environment. It may be included. For example, a message such as "It's the same as when you're in a scenic spot." or "It's the same as when you're relaxing in the living room." .

The notification unit 314 transmits the generated notification information to the display device 40 in order to notify the customer 50 or the like of the generated notification information. As described above, the display device 40 that has received the notification information displays the received notification information. Note that the notification may be performed by a method other than displaying on the display device 40 . For example, the notification information may be audio data, and the notification may be performed by outputting audio from a speaker.

The database update unit 315 stores the customer biometric information input from the customer biometric information acquisition unit 311 and the environment information input from the environment information acquisition unit 312 in the corresponding fields of the determination information database 351 . In addition, the database updating unit 315 also updates the biological information obtained by measuring various people in various places to the information database 351 for determination, as described above when describing the information database 351 for determination. Store in field.

Furthermore, the database update unit 315 performs type classification on the newly stored biometric information and stores information indicating the result of the type classification in the “type classification” field of the determination information database 351 .
Type classification can be performed by comparing existing biometric information stored in the determination information database 351 such as new biometric information. For example, based on the comparison result, objects having similar biometric information can be classified as the same type.
In addition, for example, as described above, type classification can also be performed based on attributes such as age, sex, and occupation of the person whose biometric information is to be acquired.
Type classification can also be performed by using AI (Artificial Intelligence) to classify people who have shown similar reactions to changes in their status.

[Response state determination processing]
Next, the flow of the sensitive state determination process executed by the determination device 30 will be described with reference to the flowchart of FIG.

In step S<b>11 , the customer biometric information acquisition unit 311 acquires the customer biometric information by receiving it from the biometric information measurement device 10 . Then, the customer biometric information acquisition unit 311 outputs the acquired customer biometric information to the sensitive state determination unit 313 and the database update unit 315, which will be described later.

In step S<b>12 , the environment information acquisition unit 312 acquires the environment information by receiving it from the environment information measurement device 20 . The environment information acquisition unit 312 then outputs the acquired environment information to the responsive state determination unit 313 and the database update unit 315, which will be described later. For convenience of illustration, it is described that step S12 is performed after step S11 is performed. good.

In step S13, the sensitive state determination unit 313 determines whether or not the conditions for executing the determination are satisfied. A condition for executing the determination is, for example, that a predetermined time has passed since the measurement of the customer biometric information and the environmental information was started.
Further, in the case of the present embodiment, the condition for executing the determination may be that the customer 50 has entered the model house and experienced the indoor environment of the model house for a predetermined period of time. In this case, for example, a business operator who sells a house using a model house may input, through the input unit 36, that the condition for executing the determination has been satisfied. Alternatively, for example, a human sensor may be installed at the entrance of the model house, and it may be determined whether or not the conditions for executing the determination have been satisfied based on the detection of the customer 50 by the human sensor. Alternatively, for example, the determination may be made immediately after the measurement of the customer biometric information and the environmental information is started, without setting the conditions for executing the determination.

If the conditions for executing such a determination are not satisfied, a determination of No is made in step S13, and the process returns to step S11 again. On the other hand, if the condition for executing determination is satisfied, the process proceeds to step S14.

In step S14, the sensitive state determination unit 313 identifies the sensitive state of the customer 50 by determination based on the customer biometric information acquired in step S11. In addition, the sensitive state determination unit 313 outputs the identified customer biometric information to the notification unit 314 .

In step S15, the notification unit 314 generates notification information based on the sensitive state specified in step S14. Then, in order to notify the customer 50 or the like of the notification information, the notification information is transmitted to the display device 40 . The display device 40 performs notification by displaying notification information.

According to the sensitive state determination processing described above, it is possible to analyze the user who has actually come into contact with the product or the like.
For example, the customer 50 can examine the response state, which is subjective information of the customer 50, from an objective viewpoint by referring to the notification information in step S15. Therefore, the customer 50 can judge the value of the offered product or the like based on the indicator of his/her own sensitive state. Also, the business operator who sells the provided product or the like can obtain the response state of the customer 50 as an index of the customer's reaction to the provided product or the like by referring to the notification information in step S15.

The present invention is not limited to the above-described embodiments, but includes modifications, improvements, etc. within the scope of achieving the object of the present invention. Further, each device included in the above-described embodiments can be realized by general electronic devices having an information processing function.

Also, the series of processes described above can be executed by hardware or by software. Also, one functional block may be composed of hardware alone, software alone, or a combination thereof.
In other words, the functional configuration illustrated in FIG. 2 is merely an example and is not particularly limited. That is, it is sufficient if the determination system S has a function capable of executing the above-described series of processes as a whole, and what kind of functional blocks are used to realize this function is not particularly limited to the example in FIG.

For example, the functional configuration included in this embodiment can be realized by a processor that executes arithmetic processing, and processors that can be used in this embodiment include various processors such as single processors, multiprocessors, and multicore processors. In addition to those configured by a single processing device, those in which these various processing devices are combined with a processing circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array) are included.

When a series of processes is to be executed by software, a program that constitutes the software is installed in a computer or the like from a network or a recording medium.
The computer may be a computer built into dedicated hardware. The computer may also be a computer capable of executing various functions by installing various programs, such as a general-purpose personal computer.

A recording medium containing such a program may be provided to the user by being distributed separately from the device main body in order to provide the program to the user, or may be provided to the user in a state pre-installed in the device main body. good too. The storage medium distributed separately from the apparatus body is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, or a magneto-optical disk. Optical discs are composed of, for example, CD-ROMs (Compact Disc-Read Only Memory), DVDs (Digital Versatile Discs), Blu-ray (registered trademark) Discs (Blu-ray discs), and the like. The magneto-optical disc is composed of an MD (Mini Disc) or the like. Also, the recording medium provided to the user in a pre-installed state in the apparatus main body is, for example, the ROM 32 in FIG. 2 in which the program is recorded, or the hard disk included in the storage section 35 in FIG.

In this specification, the steps of writing a program recorded on a recording medium are not necessarily processed chronologically according to the order, but may be executed in parallel or individually. It also includes the processing to be performed.
Also, in this specification, the term "system" means an overall device composed of a plurality of devices, a plurality of means, and the like.

Although several embodiments of the present invention have been described above, these embodiments are merely examples and do not limit the technical scope of the present invention. The present invention can take various other embodiments, and various modifications such as omissions and substitutions can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the scope of the invention described in the claims and equivalents thereof.
For example, the embodiments of the present invention may be modified as in the following modified examples.

<First modification>
In the above-described method for determining the responsive state by the responsive state determination unit 313, determination using β waves of electroencephalograms may also be performed. β-waves are frequency components in a higher frequency band than α-waves, and a large amount of β-waves indicates active brain activity. β waves are often emitted when the stress is high or when the person is excited. When the comfort level specified by the determination according to the embodiment described above is low and the β waves are large, it can be understood that the user is in a stressful state. On the other hand, when the comfort level is high and the number of β waves is high in the determination according to the above-described embodiment, it can be understood that the level of concentration is high, the level of interest is high, and the like.
In this way, by adding the β wave and performing the determination, it is possible to specify not only that the sensitive state is a comfortable and relaxed state, but also that it is a state of high work efficiency.

<Second modification>
In the determination by the sensitive state determination unit 313 described above, in addition to the customer biometric information, environmental information may be used for determination. For example, the sensitive state determination unit 313 may identify the relationship between the environment and the sensitive state by comparing the customer biometric information and the environment information in chronological order.

Specifically, it is possible to specify the relationship that the environment outside the model house is in the first responsive state and the environment after entering the model house is in the second responsive state. As a result, the causal relationship that the sensory state has changed due to the entry into the model house can be notified as the notification information. Similarly, when the operating mode of an indoor device such as an air conditioner is controlled, the cause-and-effect relationship that the sensitive state has changed due to the change in the operating mode can be notified as notification information. As a result, for example, it is possible to distinguish between a driving mode in which the customer 50 can relax and a driving mode in which the customer can concentrate on studying.

<Third Modification>
In the method of determining the sensitive state by the sensitive state determination unit 313 described above, determination using other biological information may also be performed. For example, the determination may be made using any one or a combination of the number of basic body movements, the number of minute body movements, and the direction of eye movement of the customer 50, which is biometric information.

In this case, the biological information measuring device 10, for example, in addition to the above-described electroencephalogram sensor, Doppler sensor, and electrocardiographic sensor, further includes a line-of-sight sensor, an imaging device, an acceleration sensor, etc., or a combination thereof to Measure biometric information.
For example, the biological information measuring device 10 detects feature points located near the eyes, such as the inner corners, the outer corners of the eyes, and the pupils, using a line-of-sight sensor. Then, the biological information measuring apparatus 10 performs measurement based on changes in the line of sight of the customer 50 based on changes in the relative positional relationship of these detected feature points. For example, the variation in eye movement direction is measured.

In addition, for example, the biological information measurement device 10 captures still images and moving images of the customer 50 using an imaging device such as a camera. In addition, the biological information measuring device 10 detects the acceleration of the customer 50 using the acceleration sensor worn by the customer 50 .
Then, the biological information measuring device 10 analyzes the information measured by one of these imaging devices, acceleration sensors, etc., or a combination thereof, using a known method such as image analysis, thereby detecting fluctuations in the movement of the customer 50. Measure. For example, the number of basic body movements and intervals of body movements caused by the actions of the customer 50, etc., and the number of minute body movements and intervals of body movements caused by the shaking of the customer 50, etc., are measured.

As in the above-described embodiment, the biological information measuring device 10 obtains the customer biological information by linking the measured changes in the direction of eye movement, the number of body movements, etc., with the time of measurement in chronological order. Generate. The biological information measuring device 10 then transmits the generated customer biological information to the determination device 30 .
Also, the customer biometric information acquisition unit 311 of the determination device 30 acquires the customer biometric information by receiving it from the biometric information measurement device 10 . Then, the customer biometric information acquisition unit 311 outputs the acquired customer biometric information to the sensitive state determination unit 313 and the database update unit 315 .

When the sensitive state determination unit 313 identifies the sensitive state as described in the above-described embodiment, the customer biometric information acquired in this modified example can also be used to identify the sensitive state. For example, the sensitive state determination unit 313 identifies various body movements of the customer 50 based on customer biometric information such as changes in the direction of eye movement and changes in the number of body movements acquired in this modified example. For example, body movements of the customer 50, such as slight tremors, frequent hand movements, so-called poor shaking, eye rubbing, nodding, and line of sight movement in a specific direction, are identified.
Then, the responsive state determination unit 313 utilizes these identified body movements to identify the responsive state. For example, the specific movements that humans make when they lie are mostly accompanied by some kind of body movement, although it varies from person to person. Therefore, the responsive state determination unit 313 identifies the responsive state in consideration of the presence or absence of the identified body movement.

According to this modified example, more biometric information is measured and used, so that the sensitive state of the customer 50 can be specified with higher accuracy. In addition, according to this modification, by notifying the customer 50 of the identified body movements as one of the grounds for identifying the responsive state, the persuasiveness of the responsive state identification to the customer 50 is increased. becomes possible.

10 biological information measuring device 20 environmental information measuring device 30 determination device 31 CPU
31 ROMs
33 RAM
34 communication unit 35 storage unit 36 input unit 37 display unit 40 display device 50 customer 311 customer biological information acquisition unit 312 environmental information acquisition unit 313 sensitive state determination unit 314 notification unit 315 database update unit 351 determination information database S determination system

Claims (12)

a measurement unit that measures the biometric information of a customer who has been presented with at least one of the provided product or provided service;
a judgment unit that identifies the sensitive state of the customer who received the presentation by making a judgment based on the biological information measured by the measurement unit;
a notification unit that performs notification based on the sensitive state of the customer identified by the determination unit;
with
The determination unit refers to a database storing a plurality of biological information measured in a plurality of environments, and compares the plurality of biological information stored in the database with the customer's biological information to determine the customer's identify the sensitive state of
The database stores a classification based on the degree of influence of the biometric information on the sensitive state,
The classification is a classification based on at least one attribute of age, gender, and occupation of the person whose biometric information is to be acquired,
The determination unit identifies the sensitive state of the customer based on a plurality of pieces of biological information stored in the database, the classification, and the customer's biological information.
judgment system. The notification unit notifies the customer for the purpose of promoting sales of at least one of the provided product or the provided service,
The determination system according to claim 1. The measurement unit further measures environmental information indicating characteristics of the environment in which the customer receives the presentation,
The determination unit compares the customer's biological information measured by the measurement unit and the environment information indicating the characteristics of the environment measured by the measurement unit in chronological order, thereby determining the environment and the responsive state. identify the relationship between
The determination system according to claim 1 or 2. 4. The determination system according to claim 3, wherein the measurement unit measures the environmental information using one or a combination of a temperature sensor, a humidity sensor, an air quality sensor, an illuminance sensor, an atmospheric pressure sensor, and an acceleration sensor. The measurement unit measures the biometric information of the customer before the customer receives the presentation in addition to after the customer receives the presentation,
The determination unit determines a change in the customer's sensitive state based on both the customer's biometric information before receiving the presentation and the customer's biometric information after receiving the presentation.
The determination system according to any one of claims 1-4. The database stores, as the plurality of pieces of biological information, biological information measured at a location where the spirit of the person whose biological information is measured is likely to be elevated, and a location where the spirit of the person whose biological information is measured is likely to be stable. including biometric information measured by
The determination system according to any one of claims 1-5 . The measurement unit measures the biological information by using an electroencephalogram sensor, a Doppler sensor, an electrocardiogram sensor, or a combination thereof.
The determination system according to any one of claims 1-6 . The measurement unit measures the biometric information by any one of an electroencephalogram sensor, a Doppler sensor, an electrocardiographic sensor, a line-of-sight sensor, an imaging device, and an acceleration sensor, or a combination thereof.
The determination system according to any one of claims 1-6 . The measurement unit measures information about the movement of the customer's body with a Doppler sensor,
The determination unit acquires the change state of the heart rate of the customer, which is biological information, based on the information about the movement of the customer's body.
The determination system according to any one of claims 1-8 . The measurement unit measures information about the movement of the customer's body with a Doppler sensor,
The determination unit acquires one or a combination of the customer's breathing rate and breathing depth, which are biological information, based on the information about the movement of the customer's body.
The determination system according to any one of claims 1-8 . The measurement unit measures information about the movement of the customer's body,
The determination unit acquires one or a combination of the customer's basic body movement number, fine body movement number, and eye movement direction, which are biological information, based on information about the customer's body movement.
The determination system according to any one of claims 1-8 . A determination method executed by a determination system,
a measuring step in which the measuring unit measures the biometric information of the customer who has been presented with at least one of the provided product and the provided service;
a determination step in which a determination unit identifies the sensitive state of the customer who received the presentation by making a determination based on the biological information measured by the measurement unit;
a notification step in which the notification unit performs notification based on the sensitive state of the customer specified by the determination unit;
including
In the determination step, the determination unit refers to a database storing a plurality of pieces of biological information measured in a plurality of environments, and compares the pieces of biological information stored in the database with the customer's biological information. Identify the customer's sensitive state based on,
The database stores a classification based on the degree of influence of the biometric information on the sensitive state,
The classification is a classification based on at least one attribute of age, gender, and occupation of the person whose biometric information is to be acquired,
In the determination step, the determination unit identifies the sensitive state of the customer based on a plurality of pieces of biological information stored in the database, the classification, and the customer's biological information.
judgment method.

Images