WO2022014023A1

WO2022014023A1 - Device, method, and program

Info

Publication number: WO2022014023A1
Application number: PCT/JP2020/027735
Authority: WO
Inventors: 充裕後藤; 浩之戸田; 由美子松浦
Original assignee: 日本電信電話株式会社
Priority date: 2020-07-16
Filing date: 2020-07-16
Publication date: 2022-01-20

Abstract

A device according to one embodiment is attached to the head of a user at a location that does not interfere with the capturing of external sounds by the ear, said device characterized by comprising: an input unit for inputting a stimulation presentation instruction to the user; and a presentation unit for providing, to the ear or ear vicinity of the user, a warm or cold sensation of an intensity and type according to the stimulation presentation instruction.

Description

Equipment, methods and programs

The present invention relates to equipment, methods and programs.

The technology of notifying the user of some information by tactile stimulation has been known conventionally. For example, Non-Patent Document 1 discloses a technique for notifying information on the comfort and discomfort of a communication partner by the feel (slippery, bumpy, thorny) of a portable strap-type tool. Further, for example, Non-Patent Document 2 discloses a technique for notifying information on the direction and distance of an object by vibration of a neck-mounted device.

However, since the conventional technology notifies information by tactile stimulus, another person may notice the information notification when the stimulus is generated. In particular, for example, when the tactile stimulus is due to vibration, not only the vibration sound causes others to notice the information notification, but also the vibration sound may cause discomfort to others.

One embodiment of the present invention has been made in view of the above points, and an object thereof is to notify information without being noticed by others.

In order to achieve the above object, the device according to the embodiment is a device mounted at a position on the user's head that does not obstruct the capture of external sound in the ear, and is an input for inputting a stimulus presentation instruction to the user. It is characterized by having a unit and a presentation unit that presents a hot / cold sensation stimulus of a type and intensity corresponding to the stimulus presentation instruction to the user's selvage or the periphery of the selvage.

It is possible to notify information that is not noticed by others.

It is a figure which shows an example of the shape of the information notification device which concerns on one Embodiment. It is a figure which shows an example of the hardware composition of the information notification device which concerns on one Embodiment. It is a figure which shows an example of the functional structure of the information notification device which concerns on one Embodiment. It is a figure (the 1) which shows an example of a stimulus generation variable. It is a figure for demonstrating an example of stimulus generation and presentation. It is a flowchart which shows an example of the information notification processing which concerns on one Embodiment. It is a figure (the 1) which shows the other example of the information notification device which concerns on one Embodiment. It is a figure (the 2) which shows the other example of the information notification device which concerns on one Embodiment. It is a figure for demonstrating an example of an inner surface state. It is a figure which shows an example of the whole structure of the communication support system which concerns on one Embodiment. It is a figure which shows an example of the hardware composition of the stimulus control device which concerns on one Embodiment. It is a figure which shows an example of the functional structure of the communication support system which concerns on one Embodiment. It is a figure which shows an example of the inner surface state history. It is a figure (2) which shows an example of a stimulus generation variable. It is a figure for demonstrating an example of a hot / cold sensation stimulus. It is a flowchart which shows an example of the communication support processing which concerns on one Embodiment.

Hereinafter, each embodiment of the present invention will be described. However, each embodiment described below is only an example, and the embodiment to which the present invention is applied is not limited to each embodiment described below.

[First Embodiment]
In the first embodiment, an information notification device 10 capable of performing information notification without being noticed by others by presenting a warm / cold stimulus (warm / cold stimulus) to a user will be described. ..

<Shape of information notification device 10>
First, the shape of the information notification device 10 according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an example of the shape of the information notification device 10 according to the embodiment.

As shown in FIG. 1, the information notification device 10 has an earring-shaped shape and is attached to the user's pinna. Here, the information notification device 10 is attached to the auricle because the auricle and its surroundings (more generally, the head) are generally sensitive to thermal and cold sensation stimuli.

The information notification device 10 may be attached to any position of the auricle as long as it does not block the external ear canal, but in the case of an earring shape, it is attached, for example, near the earlobe or near the antitragus. Can be considered. Further, the information notification device 10 may be attached to only one ear or may be attached to both ears.

As described above, the information notification device 10 according to the present embodiment is attached to the user's ear (or its surroundings), and notifies the user of information by presenting a warm / cold sensation stimulus. This makes it possible to notify only the user of the information without being noticed by others. In addition, since the information notification device 10 is attached to the ear (or its surroundings), it interferes with the user's movements (for example, movements including gesture movements and eating movements during communication, and some other work). It is also possible to notify the information without any information.

<Hardware configuration of information notification device 10>
Next, the hardware configuration of the information notification device 10 according to the present embodiment will be described with reference to FIG. FIG. 2 is a diagram showing an example of the hardware configuration of the information notification device 10 according to the embodiment.

As shown in FIG. 2, the information notification device 10 has a processor 11, a memory device 12, an I / F 13, and a stimulus output device 14 as hardware.

The processor 11 is an arithmetic unit capable of performing various arithmetic operations. The memory device 12 is a storage device capable of storing various data. The I / F 13 is an interface device with other devices, terminals, devices, and the like. The stimulus output device 14 is a module that outputs a hot / cold sensation stimulus.

The information notification device 10 according to the present embodiment has the hardware configuration shown in FIG. 2, so that the information notification process described later can be realized. The hardware configuration shown in FIG. 2 is an example, and the information notification device 10 may have another hardware configuration. For example, the information notification device 10 may have an input device such as a hardware button.

<Functional configuration of information notification device 10>
Next, the functional configuration of the information notification device 10 according to the present embodiment will be described with reference to FIG. FIG. 3 is a diagram showing an example of the functional configuration of the information notification device 10 according to the embodiment.

As shown in FIG. 3, the information notification device 10 has an input unit 101, a stimulus generation unit 102, and a stimulus presentation unit 103 as functional units. Each of these functional units is realized, for example, by a process of causing the processor 11 to execute one or more programs stored in the memory device 12, a stimulus output device 14, and the like. However, instead of the processing executed by the processor 11, all or a part of each functional unit may be realized by the processing executed by a dedicated semiconductor chip or the like.

Further, the information notification device 10 has a stimulus generation variable storage unit 110 as a storage unit. The storage unit can be realized by, for example, the memory device 12.

The example shown in FIG. 3 shows a case where the information notification device 10 has an input unit 101, a stimulus generation unit 102, a stimulus presentation unit 103, and a stimulus generation variable storage unit 110, but the present invention is limited to this. However, for example, all or part of the functional unit and the storage unit other than the stimulus presentation unit 103 may be possessed by another device (for example, a smartphone or a wearable device connected to the information notification device 10).

The input unit 101 inputs a warm / cold stimulus presentation instruction (hereinafter referred to as “stimulus presentation instruction”) to the user, and from this stimulus presentation instruction, the stimulus type (warm stimulus or cold stimulus) and stimulus intensity (strong). , Medium, weak). The stimulus presentation instruction may be transmitted from various terminals (for example, a smartphone, a wearable device, etc.) that are communicably connected to the information notification device 10, or is a signal from a hardware button or the like included in the information notification device 10. You may.

Here, the stimulus presentation instruction includes at least information that can identify the stimulus type and the stimulus intensity. For example, when the stimulus presentation instruction is transmitted from a smartphone, a wearable device, or the like, it is conceivable to include a flag indicating the stimulus type and a numerical value indicating the stimulus intensity in the stimulus presentation instruction. Further, for example, when the stimulus presentation instruction is a signal from a hardware button or the like, the type of the button pressed by the user is used as information for specifying the stimulus type (specifically, for example, the button A is warm). The number of times the button is pressed is used as information for specifying the stimulus intensity (specifically, for example, when the number of times of pressing is 3 or more, it is "strong", 2 It is conceivable that the times are "medium" and the times are "weak"). The stimulus intensity is the intensity of the warm / cold sensation stimulus, and is, for example, the speed of temperature rise in the case of warm sensation stimulus, the speed of temperature decrease in the case of cold sensation stimulus, and the like.

The stimulus generation unit 102 reads out the stimulus generation variable corresponding to the stimulus type and the stimulus intensity specified by the input unit 101 among the stimulus generation variables stored in the stimulus generation variable storage unit 110, and the read out stimulus generation variable. Is used to generate a warm / cold sensation stimulus of the stimulus type and the stimulus intensity. The stimulus generation variable according to the present embodiment is information that includes a current value (hereinafter referred to as "required current value I") required to generate a hot / cold sensation stimulus having a predetermined stimulus type and a predetermined stimulus intensity. That is.

Here, FIG. 4 shows an example of the stimulus generation variable stored in the stimulus generation variable storage unit 110. In the example shown in FIG. 4, the required current value I = 500 [mA] is set as the stimulus generation variable of the stimulus type “warm stimulus” and the stimulus intensity “weak”, the stimulus type “warm stimulus” and the stimulus intensity “medium”. The required current value I = 1000 [mA] is included in the stimulus generation variable of, and the required current value I = 2000 [mA] is included in the stimulus generation variable of the stimulus type “warm stimulus” and the stimulus intensity “strong”. .. Similarly, the required current value I = 1000 [mA] for the stimulus generation variables of the stimulus type "cold stimulus" and the stimulus intensity "weak", and the stimulus generation variables of the stimulus type "cold stimulus" and the stimulus intensity "medium". The required current value I = 2000 [mA], and the required current value I = 2500 [mA] is included in the stimulus generation variables of the stimulus type “cold stimulus” and the stimulus intensity “strong”. As described above, the stimulus generation variable storage unit 110 stores the stimulus generation variable including the current value required for generating the warm / cold sensation stimulus of the stimulus type and the stimulus intensity for each stimulus type and the stimulus intensity. There is. In the present embodiment, as an example, the stimulus intensity is represented by three stages of "strong", "medium", and "weak", but the present invention is not limited to this, and any preset natural number can be used. It may be expressed as L in the L stage.

The stimulus presentation unit 103 presents the warm / cold sensation stimulus generated by the stimulus generation unit 102 to the user. As a result, the user is notified of the information corresponding to the hot / cold sensation stimulus. It should be noted that what kind of information the hot / cold sensation stimulus presented to the user represents is determined in advance according to, for example, the stimulus type and the stimulus intensity. More specifically, for example, a warm stimulus with a stimulus intensity of "weak" represents information A, a warm stimulus with a stimulus intensity of "medium" represents information B, and a warm stimulus with a stimulus intensity of "strong" represents information. It is determined in advance that it represents C and the like. Similarly, for example, a cold stimulus with a stimulus intensity of "weak" represents information D, a cold stimulus with a stimulus intensity of "moderate" represents information E, and a cold stimulus with a stimulus intensity of "strong" represents information F. Etc. are determined in advance. Further, for example, when the information notification device 10 is attached to both ears of the user, what kind of information may be represented may be determined according to the combination of the stimulus intensity and the stimulus type of the left and right thermal sensation stimuli. ..

Here, the stimulus generation unit 102 and the stimulus presentation unit 103 generate and present a warm / cold sensation stimulus by the stimulus output device 14. Therefore, the generation of the warm / cold sensation stimulus by the stimulus generation unit 102 and the stimulus presentation unit 103 and the presentation method thereof will be described with reference to FIG. FIG. 5 is a diagram for explaining an example of stimulus generation and presentation.

As shown in FIG. 5, the stimulus output device 14 has a circuit composed of the motor driver 14 ₁ and the resistor 14 ₂ and the Peltier element 14 _3, the motor driver 14 ₁ is connected to pressure supply There is. The stimulus generation unit 102 determines the current direction (warm stimulus direction or cold stimulus direction) and input voltage V of the circuit from the stimulus type and required current value I included in the stimulus generation variable read from the stimulus generation variable storage unit 110. in terms of the, to adjust the pressure supply to the input voltage V in PWM (pulse width modulation) control by the motor driver 14 ₁ to control the current direction. Thus, heat generation or heat absorption corresponding to the input voltage V by the Peltier element 14 ₃ (i.e., exothermic or endothermic depending on the required current value I) is carried out, the presentation of hot and cold sensation stimulus is achieved by the stimulation presenting unit 103 .. In this way, the stimulus type is controlled by the current direction, and the stimulus intensity is controlled by the input voltage. However, the Peltier element 14 _3, when a current flows in the warmth stimulation direction information notification device 10 is heated is the surface on the side in contact with the user, the surface absorbs heat when a current flows in the cold sensation stimuli direction It shall be.

When the stimulus type included in the stimulus generation variable is "warm stimulus", the current direction is determined to be "warm stimulus direction", and when the stimulus type is "cold stimulus", the current direction is "cold". The direction of stimulus is determined. Further, if the value of the resistance of resistor 14 ₂ and R, the input voltage V is calculated and determined by V = I / R.

In the example shown in FIG. 5, the case where the stimulus output device 14 generates heat or absorbs heat by the Pelche element to realize the presentation of the thermal sensation stimulus has been described, but this is an example, and the stimulus output device 14 generates heat and absorbs heat. Heat generation or control may be performed by any element or module capable of controlling endotherm.

<Information notification processing>
Next, the information notification process executed by the information notification device 10 according to the present embodiment will be described with reference to FIG. FIG. 6 is a flowchart showing an example of information notification processing according to an embodiment.

First, the input unit 101 inputs a stimulus presentation instruction (step S101). As described above, the stimulus presentation instruction includes at least information that can specify the stimulus type and the stimulus intensity.

Next, the input unit 101 specifies the stimulus type and the stimulus intensity from the stimulus presentation instruction in the above step S101 (step S102).

Next, the stimulus generation unit 102 reads out the stimulus generation variables corresponding to the stimulus type and the stimulus intensity specified in step S102 above among the stimulus generation variables stored in the stimulus generation variable storage unit 110 (step S103). ). The stimulus generation unit 102 may read, for example, a stimulus generation variable including the stimulus type and the stimulus intensity specified in step S102 from the stimulus generation variable storage unit 110.

Next, the stimulus generation unit 102 uses the stimulus generation variable read in step S103 above to provide a warm / cold stimulus of the stimulus type and stimulus intensity included in the stimulus generation variable (that is, a warm stimulus of the stimulus intensity). Alternatively, a cold sensation stimulus) is generated (step S104). As described above, the stimulus generation unit 102 controls the current direction and the input voltage with respect to the Pelche element by using the stimulus type and the required current value I included in the stimulus generation variable to control the stimulus intensity and the stimulus. Can generate different types of warm and cold stimuli.

Then, the stimulus presentation unit 103 presents the warm / cold sensation stimulus generated in step S105 to the user (step S105). As a result, the user is notified of the information according to the stimulus type and the stimulus intensity of the hot / cold sensation stimulus.

As described above, the information notification device 10 according to the present embodiment presents a warm / cold sensation stimulus having a predetermined stimulus intensity to the user in response to the stimulus presentation instruction. As a result, the user is notified of the information according to the stimulus intensity and the stimulus type (warm stimulus or cold stimulus) without being noticed by others other than the user wearing the information notification device 10. be able to. In the information notification device 10 according to the present embodiment, the information notification itself is not noticed by anyone other than the user wearing the information notification device 10, so that the information notification itself is different from the information notification by vibration to the user. Information notification does not cause discomfort to others.

<Other examples of the shape of the information notification device 10>
As an example, the information notification device 10 according to the present embodiment has an earring-shaped shape as shown in FIG. 1, but it goes without saying that the information notification device 10 is not limited to this. The information notification device 10 according to the present embodiment adopts any shape as long as it can present a thermal sensation stimulus to or around the auricle and can be worn at a position where the external ear canal is not blocked. Can be done. Therefore, some other examples of the shape of the information notification device 10 are shown. However, if it is possible to capture external sound, the shape may be such that it can be attached to a position that closes the external ear canal.

FIG. 7 is an example in which the information notification device 10 has a spectacle-shaped shape. In the information notification device 10 shown in FIG. 7, for example, a warm / cold sensation stimulus is presented from the tip portion 15 of the temple (vine) (the tip portion 15 is also referred to as a modern or tip cell). The warm / cold sensation stimulus may be presented from both the left and right tip portions 15, or the warm / cold sensation stimulus may be presented from only one of them.

FIG. 8 is an example in which the information notification device 10 has an earphone cable shape. In the information notification device 10 shown in FIG. 8, for example, the warm / cold sensation stimulus is presented from the cable portion 16 near the upper part of the auricle of the user (in other words, the cable portion 16 near the helix). The information notification device 10 may be attached to the left and right ears of the user, or may be attached to only one of them.

In addition to the above-mentioned shape, as the shape of the information notification device 10, for example, an ear cuff type shape, a hair band type shape, or the like can be considered.

[Second embodiment]
In the second embodiment, the user is presented with a warm / cold stimulus (warm / cold stimulus) to notify the user of information that is not noticed by others, and this information notification causes the transition of the internal state of the user. The communication support system 1 that can promote communication and support communication will be described. In this embodiment, as an example, the user is assumed to be a speaker in one-to-many communication (for example, a person who gives a presentation), and a case where the transition of the internal state of the user is promoted will be described. However, this is only an example, and the communication support system 1 according to the present embodiment can be applied to various communications. For example, it can be applied to one-to-one communication, and the place where communication is performed is not limited to real space but also communication performed in virtual space (for example, cyber space, VR (Virtual Reality) space, etc.). Applicable. Further, in addition to communication by direct dialogue, it can be applied to communication by telepresence environment, Web conference, voice call and the like.

Here, the internal state of the user can be defined by various models, but in this embodiment, it is defined by a two-dimensional model centered on emotions and arousal. Specifically, as shown in FIG. 9, the inner state is classified into the first quadrant to the fourth quadrant with emotion as the horizontal axis and arousal as the vertical axis. Hereinafter, the inner states classified into the first quadrant (emotion "positive" and arousal degree "high") are classified into the "first inner state" and the second quadrant (emotion "negative" and arousal degree "high"). The inner state is classified into the "second inner state" and the third quadrant (emotion "negative" and arousal "low"). The inner state is classified into the "third inner state" and the fourth quadrant (emotion "positive" and arousal). The inner surface state classified as "low") is referred to as "fourth inner surface state".

Examples of the first internal state include states such as "fun" and "excitement". In addition, the characteristics of the communication method during communication (that is, nonverbal characteristics when communicating the content of speech) include, for example, "speaking with oneself", "speaking with enthusiasm", and "bright facial expression". Features such as.

Examples of the second inner surface state include states such as "fear" and "tension". In addition, as the characteristics of the communication method at the time of communication, for example, there are characteristics such as "speaking speed becomes faster", "speaking style becomes unnatural", and "facial expression becomes stiff".

As the third inner surface state, for example, a state such as "boring" can be mentioned. In addition, as the characteristics of the communication method at the time of communication, for example, there are characteristics such as "speaking lightly", "feeling uncomfortable", and "not confident in facial expression".

The fourth inner surface state includes, for example, a state such as "relaxation". Further, as a characteristic of the communication method at the time of communication, for example, there are characteristics such as "speak slowly and softly", "speak like speaking", and "speak gently".

Of the above-mentioned first inner state to fourth inner state, the second inner state and the third inner state, in which emotions are negative, often do not have an appropriate communication method during communication. For example, the content of a statement is correctly conveyed to the listener. It may not be possible or may cause discomfort to the listener. Therefore, in the present embodiment, it is assumed that the transition of the inner surface state is promoted by presenting the warm / cold sensation stimulus according to the inner surface state of the user. At this time, paying attention to the psychological effect (psychological temperature) given by the warm / cold stimulus, the cold stimulus is presented when the user's arousal level is to be increased, and the warm sensation stimulus is presented when the user's arousal level is to be lowered. If the user's emotions are to be positive, the stimulus intensity is moderate, and if the user's emotions are to be negative, the stimulus intensity is intense.

<Overall configuration of communication support system 1>
First, the overall configuration of the communication support system 1 according to the present embodiment will be described with reference to FIG. FIG. 10 is a diagram showing an example of the overall configuration of the communication support system 1 according to the embodiment.

As shown in FIG. 10, the communication support system 1 according to the present embodiment includes an information notification device 10 and a stimulus control device 20, which are connected by wire. In the example shown in FIG. 10, the information notification device 10 and the stimulus control device 20 are connected by wire, but the present invention is not limited to this, and the information notification device 10 and the stimulus control device 20 may be connected by wireless communication standard.

As described in the first embodiment, the information notification device 10 is attached to the user's ear or the periphery thereof, and presents a warm / cold sensation stimulus to notify information (in the present embodiment, the transition of the inner surface state). Notification) is realized.

The stimulus control device 20 controls the presentation of the warm / cold sensation stimulus in the information notification device 10. As the stimulus control device 20, for example, a smartphone, a wearable device, a PC (personal computer), or the like can be used.

The overall configuration of the communication support system 1 shown in FIG. 1 is an example, and may be another configuration. For example, the information notification device 10 and the stimulus control device 20 do not have to be separate bodies, and the stimulus control device 20 may be included in the information notification device 10.

<Hardware configuration of stimulus control device 20>
Next, the hardware configuration of the stimulus control device 20 according to the present embodiment will be described with reference to FIG. FIG. 11 is a diagram showing an example of the hardware configuration of the stimulus control device 20 according to the embodiment.

As shown in FIG. 11, the stimulus control device 20 has an input device 21, a display device 22, a processor 23, a memory device 24, and an I / F 25 as hardware.

The input device 21 is, for example, a touch panel, various buttons, or the like. The display device 22 is, for example, a display or the like. The processor 23 is an arithmetic unit capable of performing various operations. The memory device 24 is a storage device capable of storing various data. The I / F 25 is an interface device with other devices, terminals, devices, etc. including the information notification device 10.

By having the hardware configuration shown in FIG. 11, the stimulus control device 20 according to the present embodiment can realize various processes described later. The hardware configuration shown in FIG. 11 is an example, and the stimulus control device 20 may have another hardware configuration. For example, the stimulus control device 20 may have a module for acquiring the vital information of the user, a camera module for photographing the user, and the like.

<Functional configuration of communication support system 1>
Next, the functional configuration of the communication support system 1 according to the present embodiment will be described with reference to FIG. FIG. 12 is a diagram showing an example of the functional configuration of the communication support system 1 according to the embodiment.

As shown in FIG. 12, the information notification device 10 of the communication support system 1 according to the present embodiment has a stimulus presentation unit 204 as a functional unit. The functional unit is realized by, for example, a stimulus output device 14.

Further, the stimulus control device 20 of the communication support system 1 according to the present embodiment has an input unit 201, a state determination unit 202, and a stimulus generation unit 203 as functional units. Each of these functional units is realized, for example, by a process of causing the processor 23 to execute one or more programs stored in the memory device 24. However, instead of the process executed by the processor 23, all or a part of each functional unit may be realized by a process executed by a dedicated semiconductor chip or the like.

Further, the stimulus control device 20 of the communication support system 1 according to the present embodiment has an internal state history storage unit 210 and a stimulus generation variable storage unit 220 as storage units. Each of these storage units can be realized by, for example, a memory device 24.

The input unit 201 inputs information that can specify the user's inner surface state or inner surface state at the current time t for each sampling interval ΔT of the inner surface state. Here, the information that can specify the inner surface state is arbitrary information that can specify whether the inner surface state of the user is any of the first inner surface state to the fourth inner surface state, and is, for example, the emotion of the user. Examples include emotion labels that represent them. The emotion label indicates, for example, whether the user's emotion is "fun", "excitement", "fear", "tension", "boring", or "relaxation". The emotion label may represent, for example, any of the emotions defined in Russell's annulus emotion model.

Further, the information input by the input unit 201 that can identify the inner surface state or the inner surface state is estimated from, for example, an image of the user's face, the user's vital information (heartbeat, skin potential, etc.) and the like. You may. Further, such estimation may be performed by the stimulus control device 20, or may be performed by another device, terminal, device, or the like communicably connected to the stimulus control device 20. When information that can specify the inner surface state is input, the input unit 201 specifies the inner surface state from the information.

The inner surface state input or specified by the input unit 201 is stored in the inner surface state history storage unit 210 in association with the time t. Here, FIG. 13 shows an example of the inner surface state stored in the inner surface state history storage unit 210. As shown in FIG. 13, the inner surface state history storage unit 210 stores the inner surface state (that is, the history of the inner surface state) from the current time t to the time t− (N-1) × ΔT. Note that N is the number of inner surface states stored in the inner surface state history storage unit 210.

The state determination unit 202 reads out the inner surface state stored in the inner surface state history storage unit 210 from the latest time t to the time tm × ΔT (where m is a predetermined natural number). , The current inner surface state of the user is determined from these inner surface states.

The stimulus generation unit 203 reads out the stimulus generation variable corresponding to the current inner surface state determined by the state determination unit 202 among the stimulus generation variables stored in the stimulus generation variable storage unit 220, and the read-out stimulus generation variable. Is used to generate a warm / cold sensation stimulus of the corresponding stimulus type and the corresponding stimulus intensity.

Here, the stimulus generation variable according to the present embodiment is information including the stimulus type and stimulus intensity of the warm / cold sensation stimulus for promoting the transition from the inner surface state for each inner surface state. Further, in the present embodiment, the stimulus intensity is assumed to be in two stages of "intense" or "gentle". In this case, the stimulus generation variable stored in the stimulus generation variable storage unit 220 is shown in FIG. In the example shown in FIG. 14, the stimulus generation variable of the "first inner surface state" includes the stimulus type "warm stimulus" and the stimulus intensity "violently", and the stimulus generation variable of the "second inner surface state" includes the stimulus type. "Warm stimulus" and stimulus intensity "gentle" are included. Similarly, the stimulus generation variables of the "third inner surface state" include the stimulus type "cold stimulus" and the stimulus intensity "gentle", and the stimulus intensity of the "fourth inner surface state" includes the stimulus type "cold stimulus". And the stimulus intensity "violently" is included. As described above, the stimulus generation variable storage unit 220 stores the stimulus type and the stimulus intensity for transitioning the inner surface state for each inner surface state. In this embodiment, the current value and its direction (or voltage value) required to generate a hot / cold sensation stimulus of the stimulus type and the stimulus intensity are known for each stimulus type and stimulus intensity. However, such a current value and its direction (or voltage value) may be included in the stimulus generation variable.

The stimulus presentation unit 204 presents the warm / cold sensation stimulus generated by the stimulus generation unit 203 to the user. This promotes the transition to the inner surface state according to the stimulus type and stimulus intensity of the warm / cold sensation stimulus.

Here, the temperature of the warm _{sensation stimulus is T Hot} , the temperature of the cold stimulus is T _Cold _{, the time when the temperature reaches T Hot} or T _Cold when the stimulus intensity is "intense" is _Trapid , and the stimulus intensity is "gentle". If the time for the temperature to reach up to _{T Hot} or _{T Cold} and _{T grad} in the case of "relationship between the temperature and time of hot and cold sensation stimuli is represented as in FIG. 15. The stimulus generation unit 203 gives the stimulus output device 14 of the information notification device 10 a current value and its direction (or voltage value) for generating a hot / cold sensation stimulus having a stimulus intensity and a stimulus type. As a result, a warm / cold sensation stimulus having the stimulus intensity and the stimulus type is generated. As a result, the stimulus presentation unit 204 presents the user with the stimulus intensity and the warm / cold sensation stimulus of the stimulus type.

Since the user's stimulus sensitivity may differ depending on the part where the information notification device 10 is attached, the stimulus generation unit 203 and the stimulus presentation unit 204 depend on the stimulus sensitivity of the part where the warm / cold sensation stimulus is presented. The stimulation time may be changed. For example, the stimulation time is shortened for a site where the stimulation sensitivity is sensitive, while the stimulation time is lengthened for a site where the stimulation sensitivity is relatively insensitive.

<Communication support processing>
Next, the communication support process executed by the communication support system 1 according to the present embodiment will be described with reference to FIG. FIG. 16 is a flowchart showing an example of the communication support process according to the embodiment. Steps S201 to S210 of FIG. 16 are repeatedly executed (that is, step S201 is executed again after the execution of step S210 is completed). The time interval of this repetition may be the same as or different from the sampling interval ΔT.

Here and thereafter, it is assumed that the inner surface state from time t to time t- (N-1) × ΔT is stored in the inner surface state history storage unit 210. These inner surface states are input by the input unit 201 for each sampling interval ΔT, and are stored in the inner surface state history storage unit 210. When the repetition interval of steps S201 to S210 is the same as the sampling interval ΔT, for example, the input unit 201 may input and store the inner surface state immediately before step S201.

First, the state determination unit 202 reads the inner surface state from the latest time t to the time tm × ΔT from the inner surface state history storage unit 210 (step S201).

Next, the state determination unit 202 calculates the frequency of the first inner surface state to the fourth inner surface state from the m + 1 inner surface states read in the above step S201 (step S202). That is, the state determination unit 202 sets the frequency of filing an application for each of the first inner surface state to the fourth inner surface state among the m + 1 inner surface states.

Next, the state determination unit 202 determines whether or not the frequency of the second inner surface state or the frequency of the third inner surface state is the highest (step S203).

When it is determined in step S203 above that the frequency of the second inner surface state or the frequency of the third inner surface state is the highest, the state determination unit 202 has the same number of frequencies of the second inner surface state and the frequency of the third inner surface state. Whether or not it is determined (step S204).

When it is determined in step S204 that the frequency of the second inner surface state and the frequency of the third inner surface state are not the same, the state determination unit 202 sets the most frequent inner surface state as the current inner surface state of the user ( Step S205). On the other hand, when it is determined in step S204 that the frequency of the second inner surface state and the frequency of the third inner surface state are the same, the state determination unit 202 sets the third inner surface state as the current inner surface state of the user. (Step S206). This is because the third inner state has negative emotions and a low degree of arousal, and is considered to be the worst inner state at the time of communication, and it is necessary to preferentially transition.

Following step S205 or step S206, the stimulus generation unit 203 reads out the stimulus generation variables corresponding to the current inner surface state among the stimulus generation variables stored in the stimulus generation variable storage unit 220 (step S207). .. The stimulus generation unit 203 may read, for example, a stimulus generation variable including the current inner surface state from the stimulus generation variable storage unit 220.

Next, the stimulus generation unit 203 uses the stimulus generation variable read in step S207 above to provide a warm / cold stimulus of the stimulus type and stimulus intensity included in the stimulus generation variable (that is, a warm stimulus of the stimulus intensity). Alternatively, a cold sensation stimulus) is generated (step S208). As described above, the stimulus generation unit 203 gives the stimulus output device 14 a current value and a direction (or voltage value) corresponding to the stimulus type and the stimulus intensity included in the stimulus generation variable. Generates a strong and cold stimulus of the stimulus type.

Then, the stimulus presentation unit 204 presents the warm / cold sensation stimulus generated in step S208 to the user (step S209).

Following the above step S209, or when it is not determined in the above step S203 that the frequency of the second inner surface state or the frequency of the third inner surface state is the highest, the state determination unit 202 waits for a predetermined time. (Step S210). This is to prevent the user from continuously presenting the warm / cold stimulus.

As described above, the communication support system 1 according to the present embodiment presents a warm / cold sensation stimulus having a predetermined stimulus intensity according to the current inner surface state of the user. This makes it possible to notify the user wearing the information notification device 10 to urge the user to transition to the inner state where communication becomes smoother. Moreover, at this time, the notification can be performed without being noticed by anyone other than the user wearing the information notification device 10.

In the communication support process shown in FIG. 16, the warm / cold sensation stimulus is presented only when the current state of the user is the second inner surface state or the third inner surface state (that is, the inner surface state that hinders communication). However, although the notification prompting the transition of the inner surface state is given, for example, the warm / cold sensation stimulus may be presented even when the current state is the first inner surface state or the fourth inner surface state. This makes it possible to promote a transition to an inner state where communication becomes smoother, for example, when the person is more positive than necessary, is awakened as necessary, or is positive but has a low degree of arousal. Will be.

Further, in the present embodiment, a warm / cold sensation is generated from the stimulus type and the stimulus intensity included in the stimulus generation variable according to the current inner surface state (that is, the stimulus type and the stimulus intensity are selected according to the rule base and the warm / cold sensation is generated. (Stimulation is generated), but the present invention is not limited to this, and for example, a warm / cold sensation stimulus may be generated by selecting a stimulus type and a stimulus intensity by a machine learning model learned in advance. For example, _S the current inner surface state _b, and the inner surface state of the transition destination is predetermined in accordance with the _{S b} as _{S a,} machine learning model _{_{P ba = {P (h,}} r), P (h, g) , P _{(c, r)} , P _{(c, g)} } are created in advance by learning. _{Here, P (h, r)} is the probability of stimulating type "Warm stimulation" and stimulation intensity "vigorous" is selected when a transition to _{S a} from _{_{S b, P (h, g}} ) is S from _{S b} _The probability that the stimulus type "warm stimulus" and the stimulus intensity "gentle" are selected _{when transitioning to a, and P (c, r)} is the stimulus type "cold stimulus" when transitioning from S _b _{to S a.} probability of stimulation intensity "vigorous" is _selected, P _{(c, g)} is the probability of stimulating type "cold sensation stimulation" and stimulation intensity "moderate" is selected when transitioning from S _b to S _a, P _{(H, r)} + P _{(h, g)} + P _{(c, r)} + P _{(c, g)} = 1. Then, by inputting the current inner surface state S _b and the transition destination inner surface state S _a into the machine learning model, the stimulus type and the stimulus intensity are stochastically selected, and the selected stimulus type and the stimulus intensity are used. A warm / cold sensation stimulus may be generated. It should be noted that such a machine learning model is a known machine using, for example, a plurality of learning data represented by a set of _{an inner surface state S b} before the transition, an inner surface state S _{a at the transition destination, a stimulus type, and a stimulus intensity.} It can be created by a learning method.

The present invention is not limited to the above-described embodiment specifically disclosed, and various modifications and modifications, combinations with known techniques, and the like are possible without departing from the description of the claims. ..

1 Communication support system 10 Information notification device 11 Processor 12 Memory device 13 I / F
14 Stimulation output device 20 Stimulation control device 21 Input device 22 Display device 23 Processor 24 Memory device 25 I / F
101 Input unit 102 Stimulation generation unit 103 Stimulation presentation unit 110 Stimulation generation variable storage unit 201 Input unit 202 State determination unit 203 Stimulation generation unit 204 Stimulation presentation unit 210 Internal state history storage unit 220 Stimulation generation variable storage unit

Claims

A device that is mounted on the user's head at a position that does not interfere with the capture of external sound in the ears.
An input unit for inputting a stimulus presentation instruction to the user,
A presentation unit that presents a hot / cold sensation stimulus of the type and intensity corresponding to the stimulus presentation instruction to the user's selvage or around the selvage.
A device characterized by having.
The first aspect of the present invention, wherein the shape of the device is one of an earring type shape, an eyeglass type shape, an earphone cable type shape, an ear cuff type shape, and a hairband type shape. device.
A device that is mounted on the user's head in a position that does not interfere with the capture of external sound in the ears
An input procedure for inputting a stimulus presentation instruction to the user and
A presentation procedure for presenting a hot / cold stimulus of the type and intensity corresponding to the stimulus presentation instruction to the user's selvage or the periphery of the selvage, and a presentation procedure.
A method characterized by running.
A program that causes a computer to function as the device according to claim 1 or 2.