JP2012075089A - Electronic apparatus and communication system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus and a communication system which can convey feelings that a user wants to convey to other users.SOLUTION: The electronic apparatus comprises: a sensor part having at least one of an acceleration sensor, a pressure-sensitive sensor and a microphone for detecting a physical amount given from a user; a conversion part for converting a sensor signal outputted from the sensor part into feeling information which is the information representing user's feeling state; and a communication part for transmitting the feeling information outputted from the conversion part to other devices and receiving the feeling information transmitted from the other devices. The conversion part further includes an output part for converting the feeling information received by the communication part into an output signal and perform driving by the converted output signal.

Description

  The present invention relates to an electronic device and a communication system.

  Japanese Patent Application Laid-Open No. 2004-133826 discloses a communication system that aims to transmit not only voice, images, and characters but also a user's emotional state from a transmitting device to a receiving device in real time.

JP 2006-5945 A

  However, the communication system disclosed in Patent Literature 1 detects biological information such as the body temperature and pulse of the user of the transmission device regardless of the emotion that the user of the transmission device wants to convey. For this reason, there has been a problem that the user of the transmitting device cannot convey the emotion he / she wants to convey to the user of the receiving device.

  The present invention has been made in view of the above points, and an object of the present invention is to provide an electronic device and a communication system that can convey feelings that a user wants to convey to other users.

  The present invention has been made to solve the above-described problem, and has at least one of an acceleration sensor, a pressure sensor, and a microphone, and detects a physical quantity given by a user; and A conversion unit that converts the sensor signal output from the sensor unit into emotion information that is information representing a user's emotional state; transmission of the emotion information output from the conversion unit to another device; A communication unit that receives emotion information transmitted from the device, and the conversion unit converts the emotion information received by the communication unit into an output signal, and is driven by the converted output signal. The electronic apparatus further includes an output unit for performing the above.

  Further, the present invention provides a communication unit that receives emotion information that is information representing the emotional state of the user of the other device transmitted from the other device, and outputs the emotion information received by the communication unit as an output signal An electronic apparatus comprising: a conversion unit that converts to an output; and an output unit that is driven by the converted output signal.

  ADVANTAGE OF THE INVENTION According to this invention, the electronic device and communication system can convey the emotion which a user wants to convey to another user.

It is a structural example of the sensory sympathy system in 1st Embodiment of this invention. It is a block diagram which shows the structural example of the sensory sympathy apparatus in 1st Embodiment of this invention. It is a structural example of the sensory sympathy system in 2nd Embodiment of this invention.

[First Embodiment]
Embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a configuration example of a sensory sympathy system (communication system). The sensory sympathy system includes a plurality of sensory sympathy devices (electronic devices) 100. The sensory sympathy device 100 uses at least one sensor among an acceleration sensor, a pressure sensor, a temperature sensor, a humidity sensor, a microphone, and an image sensor as a physical quantity given to the device by the user according to the emotion that the user wants to convey. To detect. In addition, the sensory sympathy device 100 transmits a signal based on a sensor signal corresponding to the detected physical quantity to another sensory sympathy device 100 for each type of the detected physical quantity. It is assumed that another sensory sympathy device 100 as a transmission destination is determined in advance.

  FIG. 1A shows a configuration example when the sensory sympathy device 100-1 transmits a signal based on a sensor signal to the sensory sympathy device 100-2 as a configuration example of the sensory sympathy system. Further, in FIG. 1B, as another configuration example of the sensory sympathy system, a sensory sympathy device 100-1 is converted into a plurality of sensory sympathy devices 100-n (n is an integer of 2 or more) and sensor signals. A configuration example in the case of transmitting a base signal is shown. As shown in FIG. 1, the sensory sympathy device 100 transmits a signal based on the sensor signal to one or more other sensory sympathy devices 100.

Next, the configuration of the sensory sympathy device will be described.
FIG. 2 is a block diagram illustrating a configuration example of the sensory sympathy device. The sensory sympathy device 100 includes a sensor unit 110, a communication unit 120, a conversion unit 130, a storage unit 140, a power supply unit 150, and an output unit 160.

The power supply unit 150 supplies power to each unit.
The sensor unit 110 detects the physical quantity given to the device by the user using various sensors, and outputs a sensor signal for each type of the detected physical quantity. The sensor unit 110 includes an acceleration sensor 111, a pressure sensor 112, a temperature sensor 113, a humidity sensor 114, a microphone 115, an image sensor 116, and an image analysis unit 117.

  The acceleration sensor 111 detects acceleration due to impact or vibration given to the device by the user, and outputs a sensor signal corresponding to the detected acceleration to the conversion unit 130. The acceleration sensor 111 detects acceleration at intervals of 0.2 [G] (10 steps (level)) from 0.0 [G] to 2.0 [G], for example. Further, the acceleration sensor 111 may calculate the period of vibration given to the device by the user based on the detected acceleration. The acceleration sensor 111 calculates the vibration period (frequency) at intervals of 2 [Hz] (10 steps) from 0 [Hz] to 20 [Hz], for example. Further, the acceleration sensor 111 may calculate the length of time that the user continues to give vibration to the device based on the detected acceleration. The acceleration sensor 111 calculates, for example, the length of time that the user continues to give vibration to the device at intervals of 1 [seconds] (from 5 [seconds] to 5 [seconds]).

  The pressure-sensitive sensor 112 detects a pressure applied by the user to the device (for example, a pressure due to a force for gripping the housing), and outputs a sensor signal corresponding to the detected pressure to the conversion unit 130. The pressure-sensitive sensor 112 detects, for example, the pressure applied to the device by the user in 10 steps every 5 [Pa].

  The temperature sensor 113 detects the temperature (for example, the temperature of the palm that holds the casing) given to the device by the user, and outputs a sensor signal corresponding to the detected temperature to the conversion unit 130. For example, the temperature sensor 113 detects the temperature given to the device by the user in 10 steps every 35 [degrees] to 0.2 [degrees].

  The humidity sensor 114 detects the humidity (for example, the amount of water in the palm that holds the casing) given to the device by the user, and outputs a first sensor signal corresponding to the detected humidity to the conversion unit 130. For example, the humidity sensor 114 detects the humidity given to the device by the user from 0 [%] to 100 [%] at intervals of 10 [%] (10 steps).

  The microphone 115 detects the sound (for example, the frequency and volume of the user's voice) transmitted from the user to the device, and outputs a sensor signal corresponding to the detected sound to the conversion unit 130. For example, the microphone 115 outputs a sensor signal corresponding to the length of time that the sound has continued. Here, for example, the microphone 115 detects the length of time that the user's voice continues from 0 [seconds] to 5 [seconds] at intervals of 1 [second] (5 steps), and the detected voice continues. The sensor signal corresponding to the length of time is output.

The image sensor 116 captures the user's face and outputs an image obtained by capturing the user's face to the image analysis unit 117.
The image analysis unit 117 performs pattern matching on an image obtained by capturing the user's face. Further, the image analysis unit 117 associates the image subjected to pattern matching with any one or more of emotion auxiliary information “joy”, “anger”, “sorrow”, and “easy” that is auxiliary information representing the emotional state of the user. . For example, if the image analysis unit 117 determines that the user's face is smiling as a result of executing pattern matching, the image analysis unit 117 associates an image in which the user's smile is captured with emotional auxiliary information “joy” and “easy”. . The image analysis unit 117 outputs an image obtained by capturing the user's face to the conversion unit 130 in association with the emotional auxiliary information.

  The sensor unit 110 may include a touch panel (not shown). The touch panel displays an operation button that receives an operation input from the user. Here, on the touch panel, operation buttons respectively corresponding to emotion auxiliary information “joy”, “anger”, “sorrow”, and “easy” are displayed. For example, when the user presses the operation button corresponding to “joy”, the touch panel outputs to the conversion unit 130 a sensor signal indicating that the operation button corresponding to emotion assistance information “joy” has been pressed. Similarly, for the emotional auxiliary information “anger”, “sorrow”, and “easy”, the touch panel outputs a sensor signal indicating that the corresponding operation button has been pressed.

  The conversion unit 130 acquires sensor signals from the sensor unit 110 for each physical quantity. In addition, the conversion unit 130 acquires emotion auxiliary information from the sensor unit 110. Also, the conversion unit 130 multiplies the level of the acquired sensor signal by a coefficient for each type of detected physical quantity, thereby communicating a sensor signal multiplied by the coefficient (hereinafter referred to as “coefficient multiplication sensor signal”). To the unit 120. Here, it is assumed that the coefficient is predetermined for each type of physical quantity.

  For example, the conversion unit 130 multiplies the level of the sensor signal corresponding to the acceleration by a predetermined coefficient corresponding to the detected acceleration. Further, the conversion unit 130 multiplies the level of the sensor signal corresponding to the vibration cycle by a predetermined coefficient corresponding to the detected vibration cycle. The same applies to pressure, temperature, humidity, and volume.

  Based on the sensor signal acquired from the acceleration sensor 111 of the sensor unit 110, the conversion unit 130 detects the length of time that the user continued to give vibration to the device, and the detected length of time is transmitted to the communication unit 120. Output. Further, the conversion unit 130 detects the length of time that the sound detected by the sensor unit 110 continues based on the sensor signal acquired from the microphone 115 of the sensor unit 110, and the detected length of time is communicated to the communication unit 120. Output to. Here, the conversion unit 130 may output a predetermined fixed time length.

  Moreover, when the sensor part 110 is provided with a touch panel (not shown), the conversion part 130 acquires emotion auxiliary information from a touch panel (not shown). In addition, the conversion unit 130 acquires, from the image analysis unit 117, an image obtained by capturing the user's face and emotional auxiliary information corresponding to the image. Further, the conversion unit 130 transfers an image obtained by capturing the user's face to the output unit 160 and the communication unit 120.

  When the conversion unit 130 acquires emotion assistance information from at least one of the image analysis unit 117 and the touch panel, the conversion unit 130 outputs the acquired emotion assistance information to the communication unit 120 as emotion information that is information representing the emotional state of the user. On the other hand, when emotion auxiliary information is not acquired from either the image analysis unit 117 or the touch panel, the conversion unit 130 determines emotion information based on the frequency of the sound detected by the microphone 115 of the sensor unit 110, and the determination result Is output to the communication unit 120. Here, the conversion unit 130 determines whether the user's voice is laughter (joy, fun), throat (sadness), or jealousy (anger) based on the frequency of the voice.

  Specifically, when the user is a male, for example, the conversion unit 130 determines that the voice frequency is “Fog” if the voice frequency is less than 100 [Hz], and the voice frequency is 100 [Hz] or more and less than 350 [Hz]. If there is “慟 哭”, it is determined as “laughter” if the audio frequency is 350 [Hz] or higher. On the other hand, when the user is a woman, for example, the conversion unit 130 determines that the voice frequency is less than 250 [Hz], and the conversion unit 130 determines that the voice frequency is 250 [Hz] or more and less than 500 [Hz]. “慟 哭”, if the voice frequency is 500 [Hz] or higher, it is determined as “laughter”.

  In this way, the conversion unit 130 determines whether the user's voice is laughter (joy, pleasure), throat (sadness), or jealousy (anger), and emotion information (“joy”) corresponding to the determination result. ”“ Anger ”“ sorrow ”“ easy ”) to the communication unit 120.

  In addition, when the conversion unit 130 has not acquired emotion auxiliary information from any of the image analysis unit 117 and the touch panel and there is no determination result of emotion information based on the frequency of the user's voice, the conversion unit 130 The image analysis unit 117 acquires the emotion auxiliary information output based on the image, and outputs the acquired emotion auxiliary information to the storage unit 140 and the communication unit 120 as emotion information.

  Further, the conversion unit 130 acquires the coefficient multiplication sensor signal received by the communication unit 120, and stores information indicating a physical quantity of a type different from the type of the physical quantity represented by the acquired coefficient multiplication sensor signal in the acquired coefficient multiplication sensor signal. A coefficient multiplication sensor signal to which information indicating physical quantities of different types is added may be output to the storage unit 140 and the output unit 160.

  For example, it is assumed that the coefficient multiplication sensor signal acquired from the communication unit 120 represents the physical quantity “acceleration”. The conversion unit 130 adds information indicating the physical quantity “acceleration” and “temperature” by adding information indicating the physical quantity “temperature” of a type different from the physical quantity “acceleration” to the acquired coefficient multiplication sensor signal. The coefficient multiplication sensor signal is output to the storage unit 140 and the output unit 160. Here, which physical quantity is a different type of physical quantity may be appropriately determined based on a predetermined condition.

  Thereby, the sensory sympathy device 100 can effectively convey the emotion that the user wants to convey to other users by using a plurality of physical quantities.

  Similarly, with respect to the sensor signal output from the sensor unit 110 of the device itself, the conversion unit 130 uses information indicating a physical quantity of a type different from the type of the physical quantity represented by the sensor signal output from the sensor unit 110 as a coefficient multiplication sensor. It may be added to the signal and output to the communication unit 120.

  For example, it is assumed that the coefficient multiplication sensor signal acquired from the sensor unit 110 of the own apparatus represents the physical quantity “temperature”. The conversion unit 130 adds information indicating the physical quantity “pressure” of a type different from the physical quantity “temperature” to the acquired coefficient multiplication sensor signal, thereby adding information indicating the physical quantity “temperature” and “pressure”. The coefficient multiplication sensor signal is output to the communication unit 120.

  Also, the conversion unit 130 may add information indicating a physical quantity to the image signal output from the image analysis unit 117 and output the image signal to the communication unit 120.

A coefficient multiplication sensor signal is input from the conversion unit 130 to the communication unit 120 for each type of physical quantity. The communication unit 120 transmits the coefficient multiplication sensor signal input for each physical quantity type to another sensory sympathy device 100.
In addition, emotion information is input from the conversion unit 130 to the communication unit 120. The communication unit 120 transmits the input emotion information to another sensory sympathy device 100.

  The communication unit 120 also receives an image of the user's face, the length of time that the user has continued to vibrate the device, and the length of time that the voice has continued from the conversion unit 130. . The communication unit 120 transmits to the other sensory sympathy device 100 the image obtained by capturing the user's face, the length of time that the user has continued to vibrate the device, and the length of time that the voice has continued.

  Further, the communication unit 120 receives the coefficient multiplication sensor signal from the other sensory sympathy device 100 and outputs the received coefficient multiplication sensor signal to the conversion unit 130. Communication unit 120 receives emotion information from other sensory sympathy devices 100 and outputs the received emotion information to conversion unit 130. In addition, the communication unit 120 receives from the other sensory sympathy device 100 the image obtained by capturing the user's face, the length of time that the user has continued to vibrate the device, and the length of time that the voice has continued. These are output to the conversion unit 130.

  The storage unit 140 stores the coefficient multiplication sensor signal calculated by the conversion unit 130 for each type of physical quantity. In addition, the storage unit 140 stores emotion information received by the communication unit 120 and output from the conversion unit 130, a length of time that the user has continued to vibrate the device, and a length of time that the voice has continued. . In addition, the storage unit 140 stores in advance, for each emotion information, a sound signal determined in advance corresponding to the emotion information “joy”, “anger”, “sorrow”, and “easy”. In addition, the storage unit 140 stores in advance a color signal predetermined in correspondence with emotion information for each emotion information. In addition, the storage unit 140 stores in advance an image signal predetermined in correspondence with emotion information for each emotion information. Note that the storage unit 140 may store an image obtained by capturing the user's face.

  The output unit 160 includes a vibration unit 161, a pressurization unit 162, a cooling / heating unit 163, a humidification unit 164, a speaker unit 165, an illumination unit 166, and a display unit 167. The output unit 160 includes at least one of the vibration unit 161, the pressurization unit 162, the cooling / heating unit 163, the humidification unit 164, and the speaker unit 165, and a coefficient multiplication sensor signal received by the communication unit 120 from the other sensory sympathy device 100. Drive according to.

  The vibration unit 161 vibrates according to at least one of the acceleration and period indicated by the coefficient multiplication sensor signal and the vibration time. For example, when the value of the coefficient multiplication sensor signal based on the acceleration level (stage) is “3.6”, the vibration unit 161 has (vibration rated input 0.1) + (maximum input 0.05) × (coefficient It vibrates at the value of the multiplication sensor signal 3.6) = 0.28 [W]. The vibration part 161 is, for example, a rotary motor, a linear motor, a piezoelectric element, or an artificial muscle element.

  The pressurizing unit 162 generates force (pressurization) according to the pressure indicated by the coefficient multiplication sensor signal. The pressurizing unit 162 is, for example, a micro pump, a linear actuator driven by ultrasonic waves, a piezoelectric element, an artificial muscle, or a piezo element.

  The cooling unit 163 changes the temperature of the cooling unit 163 according to the temperature indicated by the coefficient multiplication sensor signal. For example, when the value of the coefficient multiplication sensor signal based on the temperature level is “2.0”, the cooling / heating unit 163 uses a predetermined temperature (for example, 35 degrees Celsius) as a reference, and from the reference, 0. The temperature of the cooling unit 163 is increased by 5 × (value of coefficient multiplication sensor signal 2.0) = 1.0 degrees Celsius. The cooling unit 163 is, for example, a Peltier element.

  The humidifying unit 164 changes the humidity of the surface of the humidifying unit 164 according to the humidity indicated by the coefficient multiplication sensor signal. For example, when the value of the coefficient multiplication sensor signal based on the humidity level is “3.0”, the humidifying unit 164 uses (100−environmental humidity / 10) x (the coefficient multiplication sensor signal value 3.0) [%] increases the humidity of the surface of the humidifying unit 164.

  For example, the humidifying unit 164 generates water vapor by an ultrasonic vibrator, and passes the generated water vapor through the osmotic membrane to give moisture to the surface of the device itself. Further, the humidifying unit 164, for example, feeds moisture into the surface of its own device by sending water into the membrane by a fine capillary or the two-layer membrane having a gap between the layers by the microvalve and the capillary effect. May be given. Further, the humidifying unit 164 may condense water vapor in the air with a Peltier element and use the condensed water vapor as water for providing moisture. In addition, water may be stored in a small tank (not shown).

  The speaker unit 165 acquires a sound signal corresponding to the emotion information received by the communication unit 120 and output from the conversion unit 130 from the storage unit 140, and outputs a sound corresponding to the acquired sound signal. Here, the speaker unit 165 outputs a sound according to the volume indicated by the value of the coefficient multiplication sensor signal. In addition, the speaker unit 165 may determine the length of time of the sound to be output according to the value of the coefficient multiplication sensor signal.

  The illumination unit 166 acquires a color signal corresponding to the emotion information received by the communication unit 120 and output from the conversion unit 130 from the storage unit 140, and emits light in the color indicated by the acquired color signal. For example, when the emotion information output from the conversion unit 130 is “anger”, the illumination unit 166 emits red light. The illumination unit 166 determines the amount of light according to the volume or acceleration indicated by the value of the coefficient multiplication sensor signal output from the conversion unit 130.

  The display unit 167 acquires emotion information received by the communication unit 120 and output by the conversion unit 130. The display unit 167 displays a predetermined image corresponding to the acquired emotion information. For example, when the emotion information output from the conversion unit 130 is “joy”, the display unit 167 displays a predetermined image that reminds the user of joy. The display unit 167 may display an image obtained by capturing the user's face.

  The output unit 160 includes at least one of a vibration unit 161, a pressurization unit 162, a cooling / heating unit 163, a humidification unit 164, a speaker unit 165, an illumination unit 166, and a display unit 167. It only has to be.

  As described above, the sensory sympathy device 100 detects the physical quantity given to the device by the user using at least one of the acceleration sensor 111, the pressure sensor 112, the temperature sensor 113, the humidity sensor 114, and the microphone 115, and A sensor unit 110 that outputs a first sensor signal corresponding to the detected physical quantity for each type of physical quantity, the first sensor signal output by the sensor part 110 is acquired, and the physical quantity is obtained at the level of the acquired first sensor signal. When the conversion unit 130 outputs the second sensor signal, the second sensor signal output to the other sensory sympathy device 100 is transmitted. When the second sensor signal is received from another sensory sympathy device 100, the communication unit 120 that outputs the received second sensor signal and the communication unit 120 output The received second sensor signal is acquired, and at least one of the vibration unit 161, the pressurizing unit 162, the cooling / heating unit 163, the humidifying unit 164, and the speaker unit 165 is selected according to the acquired second sensor signal. And an output unit 160 to be driven.

  Thereby, the sensory sympathy device 100 can convey the emotion that the user wants to convey to other users. Also, the user can recognize the emotions of other users.

  The sensory sympathy device 100 acquires the second sensor signal received by the communication unit 120, and acquires the information indicating the physical quantity of a type different from the type of physical quantity represented by the acquired second sensor signal. A conversion unit 130 that adds to the signal and outputs the added second sensor signal is provided. The output unit 160 obtains the added second sensor signal and corresponds to information indicating the physical quantity added by the conversion unit 130. To drive.

  As a result, the sensory sympathy device can drive the output unit of its own device according to a physical quantity of a type different from the type of physical quantity represented by the coefficient multiplication sensor signal received from another sensory sympathetic device. The feeling that the user of the sensory sympathy device wants to convey can be effectively transmitted to the user of the own device using a plurality of physical quantities. Moreover, the user can recognize the feelings of other users more.

  The conversion unit 130 adds information indicating a physical quantity of a type different from the type of physical quantity represented by the first sensor signal to the multiplied second sensor signal, and outputs the added second sensor signal. The output unit 160 acquires the added second sensor signal, and drives according to information indicating the physical quantity added by the conversion unit 130.

  As a result, the sensory sympathy device can drive the output unit of another sensory sympathy device according to a physical quantity of a type different from the type of physical quantity detected by the sensor of the own device. The desired emotion can be effectively transmitted to users of other sensory sympathy devices using a plurality of physical quantities. Moreover, the user can recognize the feelings of other users more.

  Moreover, the other sensory sympathy device 100 may be plural. As a result, the sensory sympathy device drives the output unit of another sensory sympathy device in accordance with the sensor signal output by the sensor unit of the own device, so that the emotion desired by the user of the own device can be transmitted to a plurality of other senses. This can be communicated to the user of the sympathetic device.

  The sensory sympathy device 100 includes a storage unit 140 that stores at least one of the information represented by the sensor signal and the coefficient multiplication sensor signal, and the output unit 160 includes information represented by the signal stored in the storage unit 140. Drive according to.

  Thereby, the sensory sympathy device 100 receives and stores information represented by the coefficient multiplication sensor signal from another sensory sympathy device, and drives the output unit of the own device according to the information represented by the stored coefficient multiplication sensor signal. Therefore, it is possible to convey the emotion that the user of the other sensory sympathy device wants to convey to the user of the own device even after a predetermined time has elapsed. In addition, the user can recall emotions that other users have felt in the past.

  In addition, the sensory sympathy device 100 includes an image analysis unit 117 that outputs an image signal according to an image captured by the image sensor 116, and a display unit 167 that displays an image. The display unit 167 includes an image analysis unit. An image corresponding to the image signal output by 117 is displayed. Thereby, the sensory sympathy device 100 can effectively convey the emotion that the user wants to convey to other users based on the image of the face of the user.

  Further, the conversion unit 130 adds information indicating a physical quantity to the image signal and outputs the image signal, and the output unit 160 drives according to the information indicating the physical quantity added to the image signal. Thereby, the sensory sympathy device 100 can effectively convey the emotion that the user wants to convey to other users based on an image obtained by capturing the user's face by a sense other than vision.

  Further, as described above, the sensory sympathy device 100 (receiving device) receives communication of emotion information that is information representing the emotional state of the user of the other sensory sympathy device 100 transmitted from the other sensory sympathy device 100. Unit 120, conversion unit 130 that converts emotion information received by communication unit 120 into an output signal, and output unit 160 that is driven by the converted output signal. Here, the sensory sympathy device 100 (receiving device) may further include a storage unit 140 that stores a correspondence relationship between emotion information and the converted output signal. Further, the output unit 160 may include a vibration unit 161, a pressurization unit 162, a cooling / heating unit 163, a humidification unit 164, a speaker unit 165, and a display unit 167.

<When determining the output value of the output unit based on the total value of the coefficient multiplication sensor signals>
The output unit 160 (see FIG. 2) may determine the output value of each unit included in the output unit 160 based on the total value of the coefficient multiplication sensor signal for each sensor. For example, the output unit 160 may determine the volume of the speaker unit 165 according to the total value of the coefficient multiplication sensor signal output from the conversion unit 130 for each sensor.

  A coefficient that multiplies the sensor signal level according to acceleration, a coefficient that multiplies the sensor signal level according to the period, a coefficient that multiplies the sensor signal level according to pressure, and a sensor signal level according to temperature. Assume that the sum of the coefficient multiplied by the coefficient multiplied by the sensor signal level according to humidity and the coefficient multiplied by the sensor signal level according to the volume is 7.1, for example. In this case, the total value of the coefficient multiplication sensor signal for each sensor is 10 steps × 7.1 = 71 at the maximum.

  Temporarily, the coefficient multiplication sensor signal value based on acceleration, the coefficient multiplication sensor signal value based on the period, the coefficient multiplication sensor signal value based on pressure, the coefficient multiplication sensor signal value based on temperature, and the humidity based coefficient Assume that the sum of the value of the multiplication sensor signal and the value of the coefficient multiplication sensor signal based on the volume is 21.2. In this case, since 21.2 / 71 = about 0.3, the output unit 160 determines the volume of the speaker unit 165 as the third level of the 10 levels.

  Further, the output unit 160 may drive each unit included in the output unit 160 with a pattern determined in advance according to emotion information.

<When driving the output unit of the own device based on the physical quantity given to the device by the user>
The sensory sympathy device 100 may drive the output unit of the own device instead of the output unit of the other sensory sympathy device 100 based on the physical quantity given to the user's own device by the user. In this case, the number of sensory sympathy devices 100 included in the sensory sympathy system may be one.

  The conversion unit 130 causes the storage unit 140 to store the coefficient multiplication sensor signal and emotion information based on the sensor signal output by the sensor unit 110 of the device itself. When an operation input from the user is received via a touch pad (not shown) of the sensor unit 110, the conversion unit 130 outputs the coefficient multiplication sensor signal and emotion information stored in the storage unit 140 as the output of the own device. Output to the unit 160. The output unit 160 drives each unit of the output unit 160 based on the stored coefficient multiplication sensor signal and emotion information.

  As described above, in the sensory sympathy device 100, at least one of the acceleration sensor 111, the pressure sensor 112, the temperature sensor 113, the humidity sensor 114, and the microphone 115 detects the physical quantity given to the device by the user, The sensor unit 110 that outputs a first sensor signal corresponding to the detected physical quantity for each type of the detected physical quantity, the first sensor signal output by the sensor unit 110 are acquired, and the first sensor signal of the acquired first sensor signal The second sensor signal obtained by multiplying the level by the coefficient for each type of the physical quantity is stored in the storage unit 140, and the storage unit 140 outputs the stored second sensor signal, and the storage output by the conversion unit 130 The acquired second sensor signal is acquired, and the vibration unit 161 that vibrates, the pressurization unit 162 that pressurizes, and the cooling unit 163 that changes the temperature according to the acquired second sensor signal. Issue a humidifier 164, and the sound of humidifying and an output unit 160 for driving at least one of the speaker unit 165, a.

  As a result, the sensory sympathy device receives and stores the sensor signal from the sensor unit of the device itself, and drives the output unit of the device according to the stored sensor signal. Even after a predetermined time has elapsed, a plurality of physical quantities can be used to inform the user of the device. In addition, the user can recall emotions that he / she felt in the past.

  The conversion unit 130 may be configured as follows. The conversion unit 130 adds information indicating a physical quantity of a type different from the type of the physical quantity represented by the sensor signal output from the sensor unit 110 of its own device to the coefficient multiplication sensor signal, and the coefficient multiplication sensor signal and the emotion information Are stored in the storage unit 140. Moreover, the conversion part 130 outputs the coefficient multiplication sensor signal and emotion information which were memorize | stored in the memory | storage part 140 to the output part 160 of an own apparatus.

  For example, it is assumed that the coefficient multiplication sensor signal acquired from the sensor unit 110 of the device itself corresponds to the physical quantity “acceleration”. The conversion unit 130 adds information indicating the physical quantity “temperature” of a type different from the physical quantity “acceleration” to the acquired coefficient multiplication sensor signal, and adds the information indicating the physical quantities “acceleration” and “temperature”. The multiplication sensor signal and emotion information are stored in the storage unit 140. The output unit 160 is driven according to the stored coefficient multiplication sensor signal and emotion information.

  As described above, the conversion unit 130 adds information indicating a physical quantity of a type different from the type of physical quantity represented by the first sensor signal to the multiplied second sensor signal, and adds the added second sensor signal. The output unit 160 acquires the stored added second sensor signal, and drives according to information indicating the physical quantity added by the conversion unit 130.

  As a result, the sensory sympathy device can drive the output unit of the own device according to a physical quantity of a type different from the type of the physical quantity detected by the sensor of the own device. Even after a predetermined time elapses, it can be effectively transmitted to the user of the device using a plurality of physical quantities. Moreover, the user can recall more emotions that he / she felt in the past.

[Second Embodiment]
A second embodiment of the present invention will be described in detail with reference to the drawings. The second embodiment is different from the first embodiment in that a plurality of sensory sympathy devices transmit coefficient multiplication sensor signals. Only the differences from the first embodiment will be described below.

  FIG. 3 shows a configuration example of the sensory sympathy system. FIG. 3A shows a configuration example when the sensory sympathy devices 100-1 to 100-3 transmit a coefficient multiplication sensor signal to the sensory sympathy device 100-4 as a configuration example of the sensory sympathy system. ing. In FIG. 3B, as another configuration example of the sensory sympathy system, sensory sympathy devices 100-1 to 100-3 transmit coefficient multiplication sensor signals to sensory sympathy devices 100-4 to 100-6. An example of the configuration is shown. As shown in FIG. 3, a plurality of sensory sympathy devices 100 transmit coefficient multiplication sensor signals to one or more other sensory sympathy devices 100.

  Here, the sensory sympathy device 100 that has received the coefficient multiplication sensor signal exponentially calculates the total value of the coefficient multiplication sensor signal for each sensory sympathy device 100 according to the number of sensory sympathy devices 100 that have transmitted the coefficient multiplication sensor signal. It may be changed to. Thereby, even when the total value of the transmitted coefficient multiplication sensor signal for each sensory sympathy device 100 is small, the sensory sympathy device 100 that has received the coefficient multiplication sensor signal greatly drives the output unit 160 (see FIG. 2). be able to.

  As described above, the plurality of sensory sympathy devices 100 transmit the coefficient multiplication sensor signal to one or more other sensory sympathy devices 100. Accordingly, the plurality of sensory sympathy devices drive the output unit of the other sensory sympathy device in accordance with the sensor signal output by the sensor unit of the own device, so that each user of the plurality of transmission devices is based on the emotion that the user wants to convey The feeling can be conveyed to the user of the receiving device. For example, a plurality of sensory sympathy devices may include other sensory sympathy devices located at a place away from the game venue, based on feelings that a plurality of spectators (users of the plurality of sensory sympathy devices) watching the game want to convey. Can be communicated to users.

<When adding the value of the coefficient multiplication sensor signal according to emotion information>
The conversion unit 130 (see FIG. 2) may add the value of the coefficient multiplication sensor signal according to the emotion information.

  The conversion unit 130 calculates the average value of the coefficient multiplication sensor signal transmitted by the sensory sympathy device 100 that has transmitted the emotion information “joy” or “easy” (hereinafter referred to as “average value of positive signals”) and the emotion information “anger”. Alternatively, an average value of coefficient multiplication sensor signals transmitted by the sensory sympathy device 100 that transmits “sorrow” (hereinafter referred to as “average value of negative signals”) is calculated.

  Further, the conversion unit 130 sets the average value of the positive signal as a positive value, the average value of the negative signal as a negative value, and adds the average value of the positive signal and the average value of the negative signal to the coefficient multiplication sensor signal. Set a new value.

  When the new value of the coefficient multiplication sensor signal is a positive value, the conversion unit 130 drives the output unit 160 according to the new value of the coefficient multiplication sensor signal according to a predetermined pattern corresponding to the positive value. Let On the other hand, when the new value of the coefficient multiplication sensor signal is a negative value, the conversion unit 130 outputs the output unit 160 according to the new value of the coefficient multiplication sensor signal according to a predetermined pattern corresponding to the negative value. Drive.

  For example, it is assumed that the average value of positive signals is a positive value “+1” and the average value of negative signals is a negative value “−2”. In this case, the new value of the coefficient multiplication sensor signal is a negative value “−1”. The conversion unit 130 uses a predetermined pattern corresponding to a negative value (for example, a pattern including that the illumination unit 166 emits blue light) with a light amount corresponding to the new value “−1” of the coefficient multiplication sensor signal. The illumination unit 166 emits light.

<When sending emotion information to the user before sending it to the other party>
The sensory sympathy device 100 may notify the user (sender) of the emotion information in advance before sending the emotion information to the other sensory sympathy device 100. The conversion unit 130 (see FIG. 2) outputs the emotion information to the output unit 160 before outputting the emotion information to the communication unit 120.

  The display unit 167 of the output unit 160 displays a predetermined image (for example, a character image “angry”) corresponding to the emotion information (for example, “angry”) input from the conversion unit 130. In addition, the illumination unit 166 of the output unit 160 emits light in a predetermined color (for example, red) corresponding to emotion information (for example, “anger”) input from the conversion unit 130. In addition, the speaker unit 165 of the output unit 160 outputs a voice (for example, “screams”) or a melody corresponding to emotion information (for example, “anger”) input from the conversion unit 130.

  In this way, the emotion information is notified in advance to the user (sender) immediately before being transmitted to the other sensory sympathy device 100. The user operates the instruction via the touch panel (not shown) of the sensor unit 110 or the display unit 167 in order to instruct whether or not to permit the sent emotion information to be transmitted to the other sensory sympathy device 100. input.

  When permitting transmission to another sensory sympathy device 100, the user (sender) presses an “OK” button displayed on the touch panel. On the other hand, when transmission to another sensory sympathy device 100 is not permitted, the user (sender) presses the “NG” button displayed on the touch panel. Sensor signals corresponding to these operation inputs are input to the conversion unit 130.

  In addition, the user (sender) moves, tilts, or vibrates his / her sensory sympathy device 100 in order to instruct whether or not to allow the sent emotion information to be transmitted to another sensory sympathy device 100. A specific operation input operation may be performed. Sensor signals corresponding to these operation inputs are input to the conversion unit 130.

  The conversion unit 130 outputs emotion information to the communication unit 120 only when the sensor signal corresponding to the operation input indicates that transmission to the other sensory sympathy device 100 is permitted. Thereby, the conversion part 130 can prevent sending the emotion information different from the emotion which the user (transmission side) intended to transmit to the other sensory sympathy apparatus 100 (other party).

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention.

  For example, the communication performed by the sensory sympathy device may be either wireless communication or wired communication. For example, the display unit 167 may display the value of the coefficient multiplication sensor signal. For example, when a plurality of different emotion information is received, the conversion unit 130 may select one emotion information from the plurality of different emotion information based on a predetermined condition.

  A program for realizing the sensory sympathy device and the sensory sympathy system described above may be recorded on a computer-readable recording medium, and the program may be read into a computer system and executed. Here, the “computer system” includes an OS and hardware such as peripheral devices. The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Further, the “computer-readable recording medium” refers to a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. In addition, those holding programs for a certain period of time are also included. The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

DESCRIPTION OF SYMBOLS 100 ... Sensory sympathy apparatus, 110 ... Sensor part, 111 ... Acceleration sensor, 112 ... Pressure sensor, 113 ... Temperature sensor, 114 ... Humidity sensor, 115 ... Microphone, 116 ... Image sensor, 117 ... Image analysis part, 120 ... Communication , 130 ... Conversion unit, 140 ... Storage unit, 160 ... Output unit, 161 ... Vibrating unit, 162 ... Pressure unit, 163 ... Cooling unit, 164 ... Humidifying unit, 165 ... Speaker unit, 166 ... Illuminating unit, 167 ... Display section

Claims (19)

A sensor unit that has at least one of an acceleration sensor, a pressure sensor, and a microphone, and detects a physical quantity given by a user;
A conversion unit that converts the sensor signal output from the sensor unit into emotion information that is information representing the emotional state of the user;
A communication unit that performs transmission of the emotion information output from the conversion unit to another device and reception of emotion information transmitted from the other device;
The conversion unit converts the emotion information received by the communication unit into an output signal,
The electronic apparatus further comprising an output unit that is driven by the converted output signal.   The electronic device according to claim 1, further comprising a storage unit that stores a correspondence relationship between the sensor signal and the emotion information and a correspondence relationship between the emotion information and the output signal.   The electronic device according to claim 1, wherein the sensor unit includes an acceleration sensor, a pressure sensor, a temperature sensor, a humidity sensor, and a microphone.   The electronic device according to claim 1, wherein the output unit includes a vibrating unit, a pressurizing unit, a cooling / heating unit, a humidifying unit, a speaker unit, and a display unit. Having an image sensor,
The electronic device according to claim 1, wherein the conversion unit generates the emotion information from an image captured by the image sensor. A physical quantity given to the device by the user is detected by at least one of an acceleration sensor, a pressure sensor, a temperature sensor, a humidity sensor, and a microphone, and a first sensor signal corresponding to the detected physical quantity is detected for each type of physical quantity. A sensor unit that outputs to
A first conversion unit that acquires the first sensor signal output by the sensor unit and outputs a second sensor signal obtained by converting the acquired first sensor signal;
A communication unit that transmits the second sensor signal output from the first conversion unit to another device and receives the second sensor signal from the other device;
The second sensor signal received by the communication unit is acquired, and at least one of a vibrating unit, a pressurizing unit, a cooling / heating unit, a humidifying unit, and a speaker unit is driven according to the acquired second sensor signal. An output section;
An electronic device comprising:   The electronic device according to claim 6, wherein the first conversion unit outputs a second sensor signal obtained by multiplying the level of the acquired first sensor signal by a coefficient for each type of the physical quantity. The second sensor signal received by the communication unit is acquired from the communication unit, and information indicating a physical quantity of a type different from the type of physical quantity represented by the acquired second sensor signal is added to the acquired second sensor signal. And a second converter for outputting the added second sensor signal,
The electronic device according to claim 6, wherein the output unit acquires the added second sensor signal and is driven according to information indicating the physical quantity added by the second conversion unit. . The first conversion unit adds information indicating a physical quantity of a type different from the type of physical quantity represented by the first sensor signal to the multiplied second sensor signal, and outputs the added second sensor signal.
The electronic apparatus according to claim 6, wherein the output unit acquires the added second sensor signal and is driven according to information indicating the physical quantity added by the first conversion unit. .   The electronic apparatus according to claim 6, wherein the other apparatus is a plurality. A storage unit that stores at least one of the information represented by the first sensor signal and the second sensor signal;
The electronic device according to claim 6, wherein the output unit is driven according to information represented by the signal stored in the storage unit. An image analysis unit that outputs an image signal according to an image captured by the image sensor;
A display for displaying an image;
With
The electronic device according to claim 6, wherein the display unit displays an image corresponding to the image signal output from the image analysis unit. The first conversion unit adds information indicating a physical quantity to the image signal and outputs it,
The electronic apparatus according to claim 12, wherein the output unit is driven according to information indicating a physical quantity added to the image signal. A first electronic device and a second electronic device according to any one of claims 6 to 13, comprising:
The first electronic device transmits the second sensor signal to the second electronic device,
The second electronic device receives the second sensor signal and is driven according to the received second sensor signal. A physical quantity given to the device by the user is detected by at least one of an acceleration sensor, a pressure sensor, a temperature sensor, a humidity sensor, and a microphone, and a first sensor signal corresponding to the detected physical quantity is detected for each type of physical quantity. A sensor unit that outputs to
A conversion unit that acquires the first sensor signal output from the sensor unit, stores a second sensor signal obtained by converting the acquired first sensor signal in a storage unit, and outputs the stored second sensor signal. When,
The stored second sensor signal output from the conversion unit is acquired, and at least one of a vibration unit, a pressurization unit, a cooling / heating unit, a humidification unit, and a speaker unit is acquired according to the acquired second sensor signal. An output unit for driving
An electronic device comprising:   The electronic device according to claim 15, wherein the first conversion unit outputs a second sensor signal obtained by multiplying the level of the acquired first sensor signal by a coefficient for each type of the physical quantity. A communication unit that receives emotion information that is information representing the emotional state of the user of the other device transmitted from the other device;
A conversion unit that converts the emotion information received by the communication unit into an output signal;
An electronic device comprising: an output unit that is driven by the converted output signal.   The electronic apparatus according to claim 17, further comprising a storage unit that stores a correspondence relationship between the emotion information and the output signal.   The electronic device according to claim 17 or 18, wherein the output unit includes a vibrating unit, a pressurizing unit, a cooling / heating unit, a humidifying unit, a speaker unit, and a display unit.

Images