KR101218042B1 - Terminal device for emotion recognition - Google Patents

Abstract

Disclosed is a terminal apparatus for finding an emotional element included in a human body or voice and deriving it into a user-friendly environment. To this end, the present invention comprises an emotion information setting unit for determining the size by analyzing the first emotion information measured from any emotion sensor; A voltage adjuster configured to read the selected emotional state information according to the size of the first emotional information to adjust a voltage level; And adjusting the brightness of the R, G, and B pixels in response to the adjusted voltage level of the voltage adjusting unit to display the emotion state information on the LED.

Description

Terminal device for emotion recognition {TERMINAL DEVICE FOR EMOTION RECOGNITION}

The present invention relates to a terminal device for emotion recognition, and more particularly, to a terminal device for finding an emotional element contained in a human body or a voice and providing it in a user-friendly environment.

Recently, human-machine interface technology has been developed to recognize human emotion as a mechanical device. This human-machine interface technology has the purpose of quantifying the emotional elements contained in the human body or voice to utilize in life.

However, it is not easy to quantify the emotions contained in the human body or voice and implement them as a mechanical device. In other words, since human sensitivity is subtle and changes are difficult, it is not easy to derive accurate measurements.

Despite these reasons, it is often used in recognition of human emotion. An example is a polygraph. A polygraph is a type of polygraph that refers to a system that senses a person's state of excitement, tension or conflict by a predefined criterion.

However, most lie detectors are not only directly measurable from the human voice, but also do not recognize the emotions contained in the body. Moreover, unlike polygraphs for the purpose of criminal investigations, there have been no useful applications in life.

The present invention has been made to solve the above problems, extract the quantified information from the human body or voice of the human, and to display the emotions such as anger, joy, sadness, boredom and calm level in the form of LED It is an object of the present invention to provide a terminal device usefully applied.

In order to accomplish the objects of the present invention as described above and to carry out the characteristic functions of the present invention described below, features of the present invention are as follows.

According to an aspect of the present invention, an emotional information setting unit for averaging the emotional value measured from any emotional sensor within a limited time and determining the averaged emotional value as the size of the first emotional information; An emotional state reading unit which reads any one emotional state information selected by a matching result when one of anger, joy, sadness, boredom, and calm level is set according to the size of the first emotional information; A voltage controller configured to adjust a voltage level according to the read emotional state information; And a pixel controller which adjusts the brightness of the R, G, and B pixels in response to the adjusted voltage level of the voltage controller to display the emotional state information on the LED.

Here, the arbitrary emotion sensor may be any one of a PPG sensor, an FSR sensor, a GSR sensor, a temperature sensor, and a voice sensor.

delete

delete

delete

delete

delete

delete

According to the present invention, by displaying in the form of LED quantified the emotions contained in the human body or voice of the human, it is possible to purify their own emotions, there is an effect that provides a very beneficial to life.

In addition, by sharing the emotions contained in the human body with the other party as well as the self, it is effective to understand each other's emotions, and to control the self to lead a smooth communication.

In addition, by grasping the emotions contained in the voice of the other party, it is possible to understand the emotions of the other party and to have a time to look back on themselves to maintain a good interpersonal relationship.

1 is a diagram illustrating a terminal device 100 for emotion recognition according to a first embodiment of the present invention.
4 is a diagram illustrating a relationship between one LED 150 and a voltage according to each embodiment of the present invention.
5 is a diagram illustrating a relationship between a plurality of LEDs 150 and voltages according to embodiments of the present invention.
6 is a diagram illustrating an example of a terminal device 100 having one LED 150 according to each embodiment of the present invention.
7 is a diagram illustrating a terminal device 100 having a plurality of LEDs (R, G, B, Y, P) according to each embodiment of the present invention by way of example.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the present invention. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

First Embodiment

1 is a diagram illustrating a terminal device 100 for emotion recognition according to a first embodiment of the present invention.

Referring to FIG. 1, the emotion recognition terminal device 100 according to the first embodiment of the present disclosure may include an emotion information setting unit 111, an emotion state reading unit 114, a voltage adjusting unit 112, and pixel control. The unit 113 is included.

First, the emotion information setting unit 111 of the present invention is provided with an emotional value measured from an arbitrary emotion sensor 120. The arbitrary emotional sensor 120 may include a PPG sensor, an FSR sensor, a GSR sensor, a temperature sensor, a voice sensor, and the like.

The PPG sensor (Photoplethysmography Sensor) measures the degree of relaxation and contraction of blood vessels through the intensity of light passing through the skin through a light source through the human body skin to generate a numerical value of the sensitivity due to relaxation and contraction.

FSR sensor (Respiratory Sensor) increases the force on the surface of the sensor to contact the human body to measure the body pressure by the resistance according to the strength of contact to generate a sensitivity value of the body pressure.

Since the GSR sensor has a certain amount of electricity flowing through the human body, the electric resistance generated by the skin is measured to generate a numerical value of the electrical resistance, and the temperature sensor measures the temperature generated by the human body to measure the sensitivity of the temperature. Numerical values are generated, and the speech sensor measures human speech and generates the amplitude magnitude of the speech as an emotional numerical value.

As described above, since the emotional value generated by the various emotional sensors is provided inside and outside the terminal device 100 for emotion recognition, it is measured by touching the skin while holding the terminal device 100 or by placing it near the mouth. It means information that becomes.

However, it is not limited to the above-described emotional sensor, but may be applied to the emotional value measured in the other emotional sensor.

Accordingly, the emotion information setting unit 111 of the present invention receives each emotion value measured from the various kinds of emotion sensors 120 described above within a limited time period, averages the emotion value, and averages the emotion. The numerical value is determined as the size of the first emotion information.
For example, since the emotional value values of the relaxation and contraction of blood vessels measured from the PPG sensor have various emotional value values according to a limited time (preset time), the averaged emotional value values are averaged and then averaged. It is determined by the size of.

Next, the emotional state reading unit 114 of the present invention is matched to any one of the level of anger, joy, sadness, boredom, and tranquility preset according to the size of the first emotional information determined by the emotional information setting unit 111. It checks whether there is a function.

Subsequently, the emotional state reading unit 114 of the present invention is matched with the determination result, and when it is confirmed, the emotional state reading unit 114 reads any emotional state information selected by the matching result. In this case, the emotional state information may include, for example, five levels of emotion (emotional) state, for example, anger, joy, sadness, boredom and calm level. However, the present invention is not limited to the above level of emotional state but may be further added.

Next, the voltage adjusting unit 112 of the present invention has the read emotional state information and performs a function of adjusting the voltage magnitude according to the emotional state information. For example, the voltage level is adjusted to 80% in response to the emotional state information of the upset level, and the voltage level is adjusted to 20% in response to the emotional state information of the joy level. The reason for adjusting the voltage level is to adjust the brightness of the R, G, and B pixels, which can be checked later.

Next, the pixel controller 113 of the present invention adjusts the brightness of the R, G, and B pixels in response to the adjusted voltage level of the voltage controller 112 to display the above-mentioned emotional state information as one LED 150. Will be displayed on the screen. This is referred to FIGS. 4 and 5.

As shown in FIG. 4, when the R, G, and B pixels are related to one LED 150, the pixel controller 113 applies an amplitude level at a 100% rate to the R pixel to set an angry level as the LED 150. ) Will be displayed. In this case, the LED 150 is a device disposed on the screen surface of the terminal device 100 of the present invention. This is shown as in FIG.

Returning to FIG. 1 again, the pixel control unit 113 of the present invention can display the joy level on one LED 150 when the magnitude of the voltage is applied to the B pixel at a 100% ratio, and R, G, and B When the voltage level is applied to each pixel at a 33.3% rate, the level of tranquility can be displayed on one LED 150. When the voltage level is applied to the R and G pixels at a 50% rate, the boredom level is indicated by the LED ( 150).

Alternatively, R, G, B, Y, pixels may be associated with a plurality of LEDs 150, which can be represented as shown in FIG. Referring to FIG. 5, when five LEDs 150, R, G, B, Y, and P are implemented in response to anger, joy, sadness, boredom, and calm level, the five LEDs 150, R, G, In order to select any one of B, Y, and P), a voltage is applied to the corresponding LED. Of course, the application of the LED voltage is generated by the voltage regulator 112. This is illustrated in FIG. 7.

As a result, the emotions variously displayed by the LED 150 may be seen in the terminal device 100 of the user, but when the user talks with the mobile terminal of the other party, the emotion may be sent together with the voice signal.

The functions of each module as described above may be stored in the computer readable medium 110. The computer readable medium 110 may be any device or medium capable of storing code and / or data performed by one or more hardware processors, and may include cache, main memory, and secondary memory. It may include a memory hierarchy, including but not limited to. The memory hierarchy can be any of RAM (e.g., SRAM, DRAM, DDRAM), ROM, FLASH, magnetic and / or optical storage devices (disk drives, magnetic tapes, compact disks, CDs, and digital video discs). It can be implemented using a combination. In addition, the computer readable recording medium may also include a transmission medium carrying an information-bearing signal representing computer instructions or data. For example, the transmission medium may be the Internet (also known as the World Wide Web), intranet (s), local area network (LAN), wide local area network (WLAN), storage area network (SAN), MAN ( And a communication network, including but not limited to Metropolitan Area Network).

Meanwhile, in the present embodiment, the controller 130 may further include a controller 130, an I / O interface 140, and the like in terms of hardware.

The controller 130 of the present invention performs a function of controlling the data flow between the computer readable recording medium 110 and the I / O interface 140, and the emotion information setting unit stored in the computer readable recording medium 110 ( 111), a function of controlling a data flow between the emotional state reader 114, the voltage controller 112, and the pixel controller 113 is further performed. Such control enables the emotion information setting unit 111, the emotion state reading unit 114, the voltage adjusting unit 112, and the pixel adjusting unit 113 to perform unique functions.

The I / O interface 140 of the present invention performs an input / output interface function of converting input / output data into an appropriate data format so as to facilitate data flow transmitted between each internal device or internal and external. For example, an input / output interface function for performing data input / output interface function between the computer readable medium 110 and the controller 130 or converting data transmitted / received through a wireless communication network into a suitable data format may be included. . For this purpose, although not shown, the audio device, the video device, the processor, the input / output port and the RF circuit may be associated with the same.

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the exemplary embodiments or constructions. You can understand that you can do it. The embodiments described above are therefore to be considered in all respects as illustrative and not restrictive.

100 terminal device 110 computer readable medium
111: emotion information setting unit 112: voltage control unit
113: pixel control unit 114: emotional state reading unit
120: emotional sensor 130: controller
140: I / O interface 150: LED

Claims (23)

An emotional information setting unit which averages the emotional numerical values measured from any emotional sensor within a limited time and determines the averaged emotional numerical value as the size of the first emotional information;
An emotional state reading unit which reads any one emotional state information selected by a matching result when one of anger, joy, sadness, boredom, and calm level is set according to the size of the first emotional information;
A voltage controller configured to adjust a voltage level according to the read emotional state information; And
Pixel control unit for displaying the emotional state information on the LED by adjusting the brightness of the R, G, B pixels corresponding to the voltage level of the voltage control unit
Emotion recognition terminal device comprising a. The method of claim 1,
The arbitrary emotional sensor is any one of a PPG sensor, an FSR sensor, a GSR sensor, a temperature sensor, and a voice sensor. delete The method of claim 1,
The pixel control unit,
And an anger level is displayed on the LED when the magnitude of the voltage is applied to the R pixel at a rate of 100%. The method of claim 1,
The pixel control unit,
And the joy level is displayed on the LED when the magnitude of the voltage is applied to the B pixel at a ratio of 100%. The method of claim 1,
The pixel control unit,
And a calm level is displayed on the LED when the voltage magnitude is applied to each of the R, G, and B pixels at a rate of 33.3%. The method of claim 1,
The pixel control unit,
And a boring level is displayed on the LED when the magnitude of the voltage is applied to each of the R and G pixels at a 50% ratio. The method according to any one of claims 1, 2 and 4 to 7,
The information displayed by the LED,
The emotion recognition terminal device characterized in that the sent to share the emotion sent to the voice signal when talking with the mobile terminal of the other party. delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images