WO2022014023A1 - Dispositif, procédé et programme - Google Patents

Dispositif, procédé et programme Download PDF

Info

Publication number
WO2022014023A1
WO2022014023A1 PCT/JP2020/027735 JP2020027735W WO2022014023A1 WO 2022014023 A1 WO2022014023 A1 WO 2022014023A1 JP 2020027735 W JP2020027735 W JP 2020027735W WO 2022014023 A1 WO2022014023 A1 WO 2022014023A1
Authority
WO
WIPO (PCT)
Prior art keywords
stimulus
user
surface state
warm
information notification
Prior art date
Application number
PCT/JP2020/027735
Other languages
English (en)
Japanese (ja)
Inventor
充裕 後藤
浩之 戸田
由美子 松浦
Original Assignee
日本電信電話株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電信電話株式会社 filed Critical 日本電信電話株式会社
Priority to PCT/JP2020/027735 priority Critical patent/WO2022014023A1/fr
Publication of WO2022014023A1 publication Critical patent/WO2022014023A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present invention relates to equipment, methods and programs.
  • Non-Patent Document 1 discloses a technique for notifying information on the comfort and discomfort of a communication partner by the feel (slippery, bumpy, thorny) of a portable strap-type tool.
  • Non-Patent Document 2 discloses a technique for notifying information on the direction and distance of an object by vibration of a neck-mounted device.
  • the conventional technology notifies information by tactile stimulus, another person may notice the information notification when the stimulus is generated.
  • the tactile stimulus is due to vibration, not only the vibration sound causes others to notice the information notification, but also the vibration sound may cause discomfort to others.
  • One embodiment of the present invention has been made in view of the above points, and an object thereof is to notify information without being noticed by others.
  • the device is a device mounted at a position on the user's head that does not obstruct the capture of external sound in the ear, and is an input for inputting a stimulus presentation instruction to the user. It is characterized by having a unit and a presentation unit that presents a hot / cold sensation stimulus of a type and intensity corresponding to the stimulus presentation instruction to the user's selvage or the periphery of the selvage.
  • the 2 which shows the other example of the information notification device which concerns on one Embodiment. It is a figure for demonstrating an example of an inner surface state. It is a figure which shows an example of the whole structure of the communication support system which concerns on one Embodiment. It is a figure which shows an example of the hardware composition of the stimulus control device which concerns on one Embodiment. It is a figure which shows an example of the functional structure of the communication support system which concerns on one Embodiment. It is a figure which shows an example of the inner surface state history. It is a figure (2) which shows an example of a stimulus generation variable. It is a figure for demonstrating an example of a hot / cold sensation stimulus. It is a flowchart which shows an example of the communication support processing which concerns on one Embodiment.
  • an information notification device 10 capable of performing information notification without being noticed by others by presenting a warm / cold stimulus (warm / cold stimulus) to a user will be described. ..
  • FIG. 1 is a diagram showing an example of the shape of the information notification device 10 according to the embodiment.
  • the information notification device 10 has an earring-shaped shape and is attached to the user's pinna.
  • the information notification device 10 is attached to the auricle because the auricle and its surroundings (more generally, the head) are generally sensitive to thermal and cold sensation stimuli.
  • the information notification device 10 may be attached to any position of the auricle as long as it does not block the external ear canal, but in the case of an earring shape, it is attached, for example, near the earlobe or near the antitragus. Can be considered. Further, the information notification device 10 may be attached to only one ear or may be attached to both ears.
  • the information notification device 10 is attached to the user's ear (or its surroundings), and notifies the user of information by presenting a warm / cold sensation stimulus. This makes it possible to notify only the user of the information without being noticed by others.
  • the information notification device 10 since the information notification device 10 is attached to the ear (or its surroundings), it interferes with the user's movements (for example, movements including gesture movements and eating movements during communication, and some other work). It is also possible to notify the information without any information.
  • FIG. 2 is a diagram showing an example of the hardware configuration of the information notification device 10 according to the embodiment.
  • the information notification device 10 has a processor 11, a memory device 12, an I / F 13, and a stimulus output device 14 as hardware.
  • the processor 11 is an arithmetic unit capable of performing various arithmetic operations.
  • the memory device 12 is a storage device capable of storing various data.
  • the I / F 13 is an interface device with other devices, terminals, devices, and the like.
  • the stimulus output device 14 is a module that outputs a hot / cold sensation stimulus.
  • the information notification device 10 has the hardware configuration shown in FIG. 2, so that the information notification process described later can be realized.
  • the hardware configuration shown in FIG. 2 is an example, and the information notification device 10 may have another hardware configuration.
  • the information notification device 10 may have an input device such as a hardware button.
  • FIG. 3 is a diagram showing an example of the functional configuration of the information notification device 10 according to the embodiment.
  • the information notification device 10 has an input unit 101, a stimulus generation unit 102, and a stimulus presentation unit 103 as functional units.
  • Each of these functional units is realized, for example, by a process of causing the processor 11 to execute one or more programs stored in the memory device 12, a stimulus output device 14, and the like.
  • all or a part of each functional unit may be realized by the processing executed by a dedicated semiconductor chip or the like.
  • the information notification device 10 has a stimulus generation variable storage unit 110 as a storage unit.
  • the storage unit can be realized by, for example, the memory device 12.
  • FIG. 3 shows a case where the information notification device 10 has an input unit 101, a stimulus generation unit 102, a stimulus presentation unit 103, and a stimulus generation variable storage unit 110, but the present invention is limited to this. However, for example, all or part of the functional unit and the storage unit other than the stimulus presentation unit 103 may be possessed by another device (for example, a smartphone or a wearable device connected to the information notification device 10).
  • another device for example, a smartphone or a wearable device connected to the information notification device 10.
  • the input unit 101 inputs a warm / cold stimulus presentation instruction (hereinafter referred to as “stimulus presentation instruction”) to the user, and from this stimulus presentation instruction, the stimulus type (warm stimulus or cold stimulus) and stimulus intensity (strong). , Medium, weak).
  • the stimulus presentation instruction may be transmitted from various terminals (for example, a smartphone, a wearable device, etc.) that are communicably connected to the information notification device 10, or is a signal from a hardware button or the like included in the information notification device 10. You may.
  • the stimulus presentation instruction includes at least information that can identify the stimulus type and the stimulus intensity.
  • the stimulus presentation instruction when the stimulus presentation instruction is transmitted from a smartphone, a wearable device, or the like, it is conceivable to include a flag indicating the stimulus type and a numerical value indicating the stimulus intensity in the stimulus presentation instruction.
  • the stimulus presentation instruction is a signal from a hardware button or the like, the type of the button pressed by the user is used as information for specifying the stimulus type (specifically, for example, the button A is warm).
  • the number of times the button is pressed is used as information for specifying the stimulus intensity (specifically, for example, when the number of times of pressing is 3 or more, it is “strong", 2 It is conceivable that the times are “medium” and the times are “weak”).
  • the stimulus intensity is the intensity of the warm / cold sensation stimulus, and is, for example, the speed of temperature rise in the case of warm sensation stimulus, the speed of temperature decrease in the case of cold sensation stimulus, and the like.
  • the stimulus generation unit 102 reads out the stimulus generation variable corresponding to the stimulus type and the stimulus intensity specified by the input unit 101 among the stimulus generation variables stored in the stimulus generation variable storage unit 110, and the read out stimulus generation variable. Is used to generate a warm / cold sensation stimulus of the stimulus type and the stimulus intensity.
  • the stimulus generation variable according to the present embodiment is information that includes a current value (hereinafter referred to as "required current value I") required to generate a hot / cold sensation stimulus having a predetermined stimulus type and a predetermined stimulus intensity. That is.
  • FIG. 4 shows an example of the stimulus generation variable stored in the stimulus generation variable storage unit 110.
  • the required current value I 1000 [mA] for the stimulus generation variables of the stimulus type “cold stimulus” and the stimulus intensity "weak”, and the stimulus generation variables of the stimulus type “cold stimulus” and the stimulus intensity “medium”.
  • the required current value I 2000 [mA]
  • the stimulus generation variable storage unit 110 stores the stimulus generation variable including the current value required for generating the warm / cold sensation stimulus of the stimulus type and the stimulus intensity for each stimulus type and the stimulus intensity.
  • the stimulus intensity is represented by three stages of “strong", “medium”, and “weak”, but the present invention is not limited to this, and any preset natural number can be used. It may be expressed as L in the L stage.
  • the stimulus presentation unit 103 presents the warm / cold sensation stimulus generated by the stimulus generation unit 102 to the user. As a result, the user is notified of the information corresponding to the hot / cold sensation stimulus.
  • what kind of information the hot / cold sensation stimulus presented to the user represents is determined in advance according to, for example, the stimulus type and the stimulus intensity. More specifically, for example, a warm stimulus with a stimulus intensity of "weak" represents information A, a warm stimulus with a stimulus intensity of "medium” represents information B, and a warm stimulus with a stimulus intensity of "strong” represents information. It is determined in advance that it represents C and the like.
  • a cold stimulus with a stimulus intensity of "weak” represents information D
  • a cold stimulus with a stimulus intensity of "moderate” represents information E
  • a cold stimulus with a stimulus intensity of "strong” represents information F.
  • Etc. are determined in advance. Further, for example, when the information notification device 10 is attached to both ears of the user, what kind of information may be represented may be determined according to the combination of the stimulus intensity and the stimulus type of the left and right thermal sensation stimuli. ..
  • FIG. 5 is a diagram for explaining an example of stimulus generation and presentation.
  • the stimulus output device 14 has a circuit composed of the motor driver 14 1 and the resistor 14 2 and the Peltier element 14 3, the motor driver 14 1 is connected to pressure supply There is.
  • the stimulus generation unit 102 determines the current direction (warm stimulus direction or cold stimulus direction) and input voltage V of the circuit from the stimulus type and required current value I included in the stimulus generation variable read from the stimulus generation variable storage unit 110. in terms of the, to adjust the pressure supply to the input voltage V in PWM (pulse width modulation) control by the motor driver 14 1 to control the current direction.
  • PWM pulse width modulation
  • the Peltier element 14 3 when a current flows in the warmth stimulation direction information notification device 10 is heated is the surface on the side in contact with the user, the surface absorbs heat when a current flows in the cold sensation stimuli direction It shall be.
  • the stimulus output device 14 generates heat or absorbs heat by the Pelche element to realize the presentation of the thermal sensation stimulus has been described, but this is an example, and the stimulus output device 14 generates heat and absorbs heat.
  • Heat generation or control may be performed by any element or module capable of controlling endotherm.
  • FIG. 6 is a flowchart showing an example of information notification processing according to an embodiment.
  • the input unit 101 inputs a stimulus presentation instruction (step S101).
  • the stimulus presentation instruction includes at least information that can specify the stimulus type and the stimulus intensity.
  • the input unit 101 specifies the stimulus type and the stimulus intensity from the stimulus presentation instruction in the above step S101 (step S102).
  • the stimulus generation unit 102 reads out the stimulus generation variables corresponding to the stimulus type and the stimulus intensity specified in step S102 above among the stimulus generation variables stored in the stimulus generation variable storage unit 110 (step S103). ).
  • the stimulus generation unit 102 may read, for example, a stimulus generation variable including the stimulus type and the stimulus intensity specified in step S102 from the stimulus generation variable storage unit 110.
  • the stimulus generation unit 102 uses the stimulus generation variable read in step S103 above to provide a warm / cold stimulus of the stimulus type and stimulus intensity included in the stimulus generation variable (that is, a warm stimulus of the stimulus intensity).
  • a cold sensation stimulus is generated (step S104).
  • the stimulus generation unit 102 controls the current direction and the input voltage with respect to the Pelche element by using the stimulus type and the required current value I included in the stimulus generation variable to control the stimulus intensity and the stimulus. Can generate different types of warm and cold stimuli.
  • the stimulus presentation unit 103 presents the warm / cold sensation stimulus generated in step S105 to the user (step S105).
  • the user is notified of the information according to the stimulus type and the stimulus intensity of the hot / cold sensation stimulus.
  • the information notification device 10 presents a warm / cold sensation stimulus having a predetermined stimulus intensity to the user in response to the stimulus presentation instruction.
  • the user is notified of the information according to the stimulus intensity and the stimulus type (warm stimulus or cold stimulus) without being noticed by others other than the user wearing the information notification device 10. be able to.
  • the information notification itself is not noticed by anyone other than the user wearing the information notification device 10, so that the information notification itself is different from the information notification by vibration to the user. Information notification does not cause discomfort to others.
  • the information notification device 10 according to the present embodiment has an earring-shaped shape as shown in FIG. 1, but it goes without saying that the information notification device 10 is not limited to this.
  • the information notification device 10 according to the present embodiment adopts any shape as long as it can present a thermal sensation stimulus to or around the auricle and can be worn at a position where the external ear canal is not blocked. Can be done. Therefore, some other examples of the shape of the information notification device 10 are shown. However, if it is possible to capture external sound, the shape may be such that it can be attached to a position that closes the external ear canal.
  • FIG. 7 is an example in which the information notification device 10 has a spectacle-shaped shape.
  • a warm / cold sensation stimulus is presented from the tip portion 15 of the temple (vine) (the tip portion 15 is also referred to as a modern or tip cell).
  • the warm / cold sensation stimulus may be presented from both the left and right tip portions 15, or the warm / cold sensation stimulus may be presented from only one of them.
  • FIG. 8 is an example in which the information notification device 10 has an earphone cable shape.
  • the warm / cold sensation stimulus is presented from the cable portion 16 near the upper part of the auricle of the user (in other words, the cable portion 16 near the helix).
  • the information notification device 10 may be attached to the left and right ears of the user, or may be attached to only one of them.
  • an ear cuff type shape for example, an ear cuff type shape, a hair band type shape, or the like can be considered.
  • the user is presented with a warm / cold stimulus (warm / cold stimulus) to notify the user of information that is not noticed by others, and this information notification causes the transition of the internal state of the user.
  • the communication support system 1 that can promote communication and support communication will be described.
  • the user is assumed to be a speaker in one-to-many communication (for example, a person who gives a presentation), and a case where the transition of the internal state of the user is promoted will be described.
  • this is only an example, and the communication support system 1 according to the present embodiment can be applied to various communications.
  • the place where communication is performed is not limited to real space but also communication performed in virtual space (for example, cyber space, VR (Virtual Reality) space, etc.). Applicable.
  • communication by direct dialogue it can be applied to communication by telepresence environment, Web conference, voice call and the like.
  • the internal state of the user can be defined by various models, but in this embodiment, it is defined by a two-dimensional model centered on emotions and arousal.
  • the inner state is classified into the first quadrant to the fourth quadrant with emotion as the horizontal axis and arousal as the vertical axis.
  • the inner states classified into the first quadrant emotion "positive” and arousal degree "high”
  • the inner state is classified into the "second inner state” and the third quadrant (emotion "negative” and arousal "low”).
  • the inner state is classified into the "third inner state” and the fourth quadrant (emotion "positive” and arousal).
  • the inner surface state classified as "low) is referred to as "fourth inner surface state”.
  • Examples of the first internal state include states such as “fun” and “excitement”.
  • the characteristics of the communication method during communication include, for example, “speaking with oneself”, “speaking with enthusiasm”, and “bright facial expression”.
  • Examples of the second inner surface state include states such as “fear” and “tension”.
  • characteristics of the communication method at the time of communication for example, there are characteristics such as “speaking speed becomes faster”, “speaking style becomes unnatural", and “facial expression becomes stiff”.
  • the third inner surface state for example, a state such as "boring” can be mentioned.
  • characteristics of the communication method at the time of communication for example, there are characteristics such as “speaking lightly”, “feeling uncomfortable”, and “not confident in facial expression”.
  • the fourth inner surface state includes, for example, a state such as "relaxation”. Further, as a characteristic of the communication method at the time of communication, for example, there are characteristics such as “speak slowly and softly”, “speak like speaking", and “speak gently”.
  • the second inner state and the third inner state in which emotions are negative, often do not have an appropriate communication method during communication.
  • the content of a statement is correctly conveyed to the listener. It may not be possible or may cause discomfort to the listener. Therefore, in the present embodiment, it is assumed that the transition of the inner surface state is promoted by presenting the warm / cold sensation stimulus according to the inner surface state of the user.
  • the cold stimulus is presented when the user's arousal level is to be increased, and the warm sensation stimulus is presented when the user's arousal level is to be lowered. If the user's emotions are to be positive, the stimulus intensity is moderate, and if the user's emotions are to be negative, the stimulus intensity is intense.
  • FIG. 10 is a diagram showing an example of the overall configuration of the communication support system 1 according to the embodiment.
  • the communication support system 1 includes an information notification device 10 and a stimulus control device 20, which are connected by wire.
  • the information notification device 10 and the stimulus control device 20 are connected by wire, but the present invention is not limited to this, and the information notification device 10 and the stimulus control device 20 may be connected by wireless communication standard.
  • the information notification device 10 is attached to the user's ear or the periphery thereof, and presents a warm / cold sensation stimulus to notify information (in the present embodiment, the transition of the inner surface state). Notification) is realized.
  • the stimulus control device 20 controls the presentation of the warm / cold sensation stimulus in the information notification device 10.
  • the stimulus control device 20 for example, a smartphone, a wearable device, a PC (personal computer), or the like can be used.
  • the overall configuration of the communication support system 1 shown in FIG. 1 is an example, and may be another configuration.
  • the information notification device 10 and the stimulus control device 20 do not have to be separate bodies, and the stimulus control device 20 may be included in the information notification device 10.
  • FIG. 11 is a diagram showing an example of the hardware configuration of the stimulus control device 20 according to the embodiment.
  • the stimulus control device 20 has an input device 21, a display device 22, a processor 23, a memory device 24, and an I / F 25 as hardware.
  • the input device 21 is, for example, a touch panel, various buttons, or the like.
  • the display device 22 is, for example, a display or the like.
  • the processor 23 is an arithmetic unit capable of performing various operations.
  • the memory device 24 is a storage device capable of storing various data.
  • the I / F 25 is an interface device with other devices, terminals, devices, etc. including the information notification device 10.
  • the stimulus control device 20 can realize various processes described later.
  • the hardware configuration shown in FIG. 11 is an example, and the stimulus control device 20 may have another hardware configuration.
  • the stimulus control device 20 may have a module for acquiring the vital information of the user, a camera module for photographing the user, and the like.
  • FIG. 12 is a diagram showing an example of the functional configuration of the communication support system 1 according to the embodiment.
  • the information notification device 10 of the communication support system 1 has a stimulus presentation unit 204 as a functional unit.
  • the functional unit is realized by, for example, a stimulus output device 14.
  • the stimulus control device 20 of the communication support system 1 has an input unit 201, a state determination unit 202, and a stimulus generation unit 203 as functional units.
  • Each of these functional units is realized, for example, by a process of causing the processor 23 to execute one or more programs stored in the memory device 24.
  • all or a part of each functional unit may be realized by a process executed by a dedicated semiconductor chip or the like.
  • the stimulus control device 20 of the communication support system 1 has an internal state history storage unit 210 and a stimulus generation variable storage unit 220 as storage units.
  • Each of these storage units can be realized by, for example, a memory device 24.
  • the input unit 201 inputs information that can specify the user's inner surface state or inner surface state at the current time t for each sampling interval ⁇ T of the inner surface state.
  • the information that can specify the inner surface state is arbitrary information that can specify whether the inner surface state of the user is any of the first inner surface state to the fourth inner surface state, and is, for example, the emotion of the user. Examples include emotion labels that represent them.
  • the emotion label indicates, for example, whether the user's emotion is "fun", “excitement”, “fear”, “tension”, “boring", or “relaxation”.
  • the emotion label may represent, for example, any of the emotions defined in Russell's annulus emotion model.
  • the information input by the input unit 201 that can identify the inner surface state or the inner surface state is estimated from, for example, an image of the user's face, the user's vital information (heartbeat, skin potential, etc.) and the like. You may. Further, such estimation may be performed by the stimulus control device 20, or may be performed by another device, terminal, device, or the like communicably connected to the stimulus control device 20.
  • the input unit 201 specifies the inner surface state from the information.
  • the inner surface state input or specified by the input unit 201 is stored in the inner surface state history storage unit 210 in association with the time t.
  • FIG. 13 shows an example of the inner surface state stored in the inner surface state history storage unit 210.
  • the inner surface state history storage unit 210 stores the inner surface state (that is, the history of the inner surface state) from the current time t to the time t ⁇ (N-1) ⁇ ⁇ T. Note that N is the number of inner surface states stored in the inner surface state history storage unit 210.
  • the state determination unit 202 reads out the inner surface state stored in the inner surface state history storage unit 210 from the latest time t to the time tm ⁇ ⁇ T (where m is a predetermined natural number). , The current inner surface state of the user is determined from these inner surface states.
  • the stimulus generation unit 203 reads out the stimulus generation variable corresponding to the current inner surface state determined by the state determination unit 202 among the stimulus generation variables stored in the stimulus generation variable storage unit 220, and the read-out stimulus generation variable. Is used to generate a warm / cold sensation stimulus of the corresponding stimulus type and the corresponding stimulus intensity.
  • the stimulus generation variable according to the present embodiment is information including the stimulus type and stimulus intensity of the warm / cold sensation stimulus for promoting the transition from the inner surface state for each inner surface state.
  • the stimulus intensity is assumed to be in two stages of "intense” or “gentle".
  • the stimulus generation variable stored in the stimulus generation variable storage unit 220 is shown in FIG.
  • the stimulus generation variable of the "first inner surface state” includes the stimulus type "warm stimulus” and the stimulus intensity "violently”
  • the stimulus generation variable of the "second inner surface state” includes the stimulus type. "Warm stimulus” and stimulus intensity "gentle” are included.
  • the stimulus generation variables of the "third inner surface state” include the stimulus type “cold stimulus” and the stimulus intensity “gentle”, and the stimulus intensity of the "fourth inner surface state” includes the stimulus type “cold stimulus”. And the stimulus intensity "violently” is included.
  • the stimulus generation variable storage unit 220 stores the stimulus type and the stimulus intensity for transitioning the inner surface state for each inner surface state.
  • the current value and its direction (or voltage value) required to generate a hot / cold sensation stimulus of the stimulus type and the stimulus intensity are known for each stimulus type and stimulus intensity.
  • such a current value and its direction (or voltage value) may be included in the stimulus generation variable.
  • the stimulus presentation unit 204 presents the warm / cold sensation stimulus generated by the stimulus generation unit 203 to the user. This promotes the transition to the inner surface state according to the stimulus type and stimulus intensity of the warm / cold sensation stimulus.
  • the temperature of the warm sensation stimulus is T Hot
  • the temperature of the cold stimulus is T Cold
  • the time when the temperature reaches T Hot or T Cold when the stimulus intensity is "intense” is Trapid
  • the stimulus intensity is "gentle”.
  • the stimulus generation unit 203 gives the stimulus output device 14 of the information notification device 10 a current value and its direction (or voltage value) for generating a hot / cold sensation stimulus having a stimulus intensity and a stimulus type.
  • a warm / cold sensation stimulus having the stimulus intensity and the stimulus type is generated.
  • the stimulus presentation unit 204 presents the user with the stimulus intensity and the warm / cold sensation stimulus of the stimulus type.
  • the stimulus generation unit 203 and the stimulus presentation unit 204 depend on the stimulus sensitivity of the part where the warm / cold sensation stimulus is presented.
  • the stimulation time may be changed. For example, the stimulation time is shortened for a site where the stimulation sensitivity is sensitive, while the stimulation time is lengthened for a site where the stimulation sensitivity is relatively insensitive.
  • FIG. 16 is a flowchart showing an example of the communication support process according to the embodiment. Steps S201 to S210 of FIG. 16 are repeatedly executed (that is, step S201 is executed again after the execution of step S210 is completed). The time interval of this repetition may be the same as or different from the sampling interval ⁇ T.
  • the inner surface state from time t to time t- (N-1) ⁇ ⁇ T is stored in the inner surface state history storage unit 210.
  • These inner surface states are input by the input unit 201 for each sampling interval ⁇ T, and are stored in the inner surface state history storage unit 210.
  • the input unit 201 may input and store the inner surface state immediately before step S201.
  • the state determination unit 202 reads the inner surface state from the latest time t to the time tm ⁇ ⁇ T from the inner surface state history storage unit 210 (step S201).
  • the state determination unit 202 calculates the frequency of the first inner surface state to the fourth inner surface state from the m + 1 inner surface states read in the above step S201 (step S202). That is, the state determination unit 202 sets the frequency of filing an application for each of the first inner surface state to the fourth inner surface state among the m + 1 inner surface states.
  • the state determination unit 202 determines whether or not the frequency of the second inner surface state or the frequency of the third inner surface state is the highest (step S203).
  • step S203 When it is determined in step S203 above that the frequency of the second inner surface state or the frequency of the third inner surface state is the highest, the state determination unit 202 has the same number of frequencies of the second inner surface state and the frequency of the third inner surface state. Whether or not it is determined (step S204).
  • step S204 When it is determined in step S204 that the frequency of the second inner surface state and the frequency of the third inner surface state are not the same, the state determination unit 202 sets the most frequent inner surface state as the current inner surface state of the user ( Step S205). On the other hand, when it is determined in step S204 that the frequency of the second inner surface state and the frequency of the third inner surface state are the same, the state determination unit 202 sets the third inner surface state as the current inner surface state of the user. (Step S206). This is because the third inner state has negative emotions and a low degree of arousal, and is considered to be the worst inner state at the time of communication, and it is necessary to preferentially transition.
  • the stimulus generation unit 203 reads out the stimulus generation variables corresponding to the current inner surface state among the stimulus generation variables stored in the stimulus generation variable storage unit 220 (step S207). ..
  • the stimulus generation unit 203 may read, for example, a stimulus generation variable including the current inner surface state from the stimulus generation variable storage unit 220.
  • the stimulus generation unit 203 uses the stimulus generation variable read in step S207 above to provide a warm / cold stimulus of the stimulus type and stimulus intensity included in the stimulus generation variable (that is, a warm stimulus of the stimulus intensity).
  • a cold sensation stimulus is generated (step S208).
  • the stimulus generation unit 203 gives the stimulus output device 14 a current value and a direction (or voltage value) corresponding to the stimulus type and the stimulus intensity included in the stimulus generation variable. Generates a strong and cold stimulus of the stimulus type.
  • the stimulus presentation unit 204 presents the warm / cold sensation stimulus generated in step S208 to the user (step S209).
  • Step S210 This is to prevent the user from continuously presenting the warm / cold stimulus.
  • the communication support system 1 presents a warm / cold sensation stimulus having a predetermined stimulus intensity according to the current inner surface state of the user. This makes it possible to notify the user wearing the information notification device 10 to urge the user to transition to the inner state where communication becomes smoother. Moreover, at this time, the notification can be performed without being noticed by anyone other than the user wearing the information notification device 10.
  • the warm / cold sensation stimulus is presented only when the current state of the user is the second inner surface state or the third inner surface state (that is, the inner surface state that hinders communication).
  • the notification prompting the transition of the inner surface state is given, for example, the warm / cold sensation stimulus may be presented even when the current state is the first inner surface state or the fourth inner surface state. This makes it possible to promote a transition to an inner state where communication becomes smoother, for example, when the person is more positive than necessary, is awakened as necessary, or is positive but has a low degree of arousal. Will be.
  • a warm / cold sensation is generated from the stimulus type and the stimulus intensity included in the stimulus generation variable according to the current inner surface state (that is, the stimulus type and the stimulus intensity are selected according to the rule base and the warm / cold sensation is generated.
  • Stimulation is generated
  • a warm / cold sensation stimulus may be generated by selecting a stimulus type and a stimulus intensity by a machine learning model learned in advance.
  • S the current inner surface state b, and the inner surface state of the transition destination is predetermined in accordance with the S b as S a
  • machine learning model P ba ⁇ P (h, r), P (h, g) , P (c, r) , P (c, g) ⁇ are created in advance by learning.
  • P (h, r) is the probability of stimulating type "Warm stimulation” and stimulation intensity "vigorous” is selected when a transition to S a from S b
  • P (h, g ) is S from S b
  • P (c, r) is the stimulus type "cold stimulus” when transitioning from S b to S a.
  • P (c, g) is the probability of stimulating type "cold sensation stimulation” and stimulation intensity "moderate” is selected when transitioning from S b to S a
  • P (H, r) + P (h, g) + P (c, r) + P (c, g) 1.
  • the stimulus type and the stimulus intensity are stochastically selected, and the selected stimulus type and the stimulus intensity are used.
  • a warm / cold sensation stimulus may be generated.
  • Such a machine learning model is a known machine using, for example, a plurality of learning data represented by a set of an inner surface state S b before the transition, an inner surface state S a at the transition destination, a stimulus type, and a stimulus intensity. It can be created by a learning method.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Un dispositif selon un mode de réalisation est fixé à la tête d'un utilisateur à un emplacement qui n'interfère pas avec la capture de sons externes par l'oreille, ledit dispositif étant caractérisé en ce qu'il comprend : une unité d'entrée pour entrer une instruction de présentation de stimulation à l'utilisateur ; et une unité de présentation pour fournir, à l'oreille ou au voisinage de l'oreille de l'utilisateur, une sensation de chaleur ou de froid d'une intensité et d'un type correspondant à l'instruction de présentation de stimulation.
PCT/JP2020/027735 2020-07-16 2020-07-16 Dispositif, procédé et programme WO2022014023A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/027735 WO2022014023A1 (fr) 2020-07-16 2020-07-16 Dispositif, procédé et programme

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/027735 WO2022014023A1 (fr) 2020-07-16 2020-07-16 Dispositif, procédé et programme

Publications (1)

Publication Number Publication Date
WO2022014023A1 true WO2022014023A1 (fr) 2022-01-20

Family

ID=79554625

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/027735 WO2022014023A1 (fr) 2020-07-16 2020-07-16 Dispositif, procédé et programme

Country Status (1)

Country Link
WO (1) WO2022014023A1 (fr)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018021040A1 (fr) * 2016-07-27 2018-02-01 ソニー株式会社 Système de traitement d'informations, support d'enregistrement et procédé de traitement d'informations

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018021040A1 (fr) * 2016-07-27 2018-02-01 ソニー株式会社 Système de traitement d'informations, support d'enregistrement et procédé de traitement d'informations

Similar Documents

Publication Publication Date Title
US11277519B2 (en) Methods and apparatus to assist listeners in distinguishing between electronically generated binaural sound and physical environment sound
CN105825486B (zh) 美颜处理的方法及装置
US10366778B2 (en) Method and device for processing content based on bio-signals
US11765538B2 (en) Wearable electronic device (WED) displays emoji that plays binaural sound
JP2019145108A (ja) 顔に対応する３次元アバターを用いて顔の動きが反映された３ｄアバターを含むイメージを生成する電子装置
CN109120790B (zh) 通话控制方法、装置、存储介质及穿戴式设备
CN109637098B (zh) 可穿戴设备及其控制方法
US10496360B2 (en) Emoji to select how or where sound will localize to a listener
US10350761B2 (en) Communication device
US11711664B2 (en) Moving an emoji to move a location of binaural sound
JP2018001403A (ja) 音声と仮想動作を同期させる方法、システムとロボット本体
Crum Hearables: Here come the: Technology tucked inside your ears will augment your daily life
EP3996385A1 (fr) Système de récupération d'information tenant compte de l'état de rêve éveillé
WO2022014023A1 (fr) Dispositif, procédé et programme
WO2022014024A1 (fr) Dispositif de génération, procédé de génération et programme
Hussein Wearable computing: Challenges of implementation and its future
US20220122630A1 (en) Real-time augmented hearing platform
JP2023168812A (ja) コミュニケーション支援システム、コミュニケーション支援方法及びプログラム
CN117835111A (zh) 一种通过无线耳机设备进行按摩的方法、装置和设备
CN116782418A (zh) 适用于按摩椅的音频输出方法及装置、按摩椅、存储介质
CN115591076A (zh) 用户感官功能的辅助方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20945370

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20945370

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP