KR101446916B1 - Method for biometric data transmission with UHF based mobile RFID communication and emotion reasoning device using the same - Google Patents

Abstract

There is provided a biometric information transmission method using a second proximity communication and a emotion inferencing apparatus using the same. The emotion inferencing apparatus according to an embodiment of the present invention senses the user's biometric signal to infer the emotional state information of the user and transmits the inferred emotional state information to the external device through the second proximity communication. As a result, it is possible to lessen the influence of the adjacent interference in the communication in the limited area, and to strengthen the biometric information and the sensitive information security, which are a kind of user private information.

Description

TECHNICAL FIELD [0001] The present invention relates to a biometric information transmission method using a UHF-based mobile RFID communication,

The present invention relates to a method and apparatus for sensing a bio-signal induced by an activity of an autonomic nervous system, inferring an emotion status from sensed biometric data, and transmitting the emotion status to another system / apparatus.

BACKGROUND ART Detection or measurement of human vital signs has been mainly studied and utilized in the medical field in the early stage. That is, detected or measured vital signs were used to check the patient's health condition or to treat the patient by measuring blood pressure, pulse, and the like.

In recent years, biological signals have been used not only in the medical field but also in the field of man-machine interface for grasping human emotional state.

In particular, in order to provide more convenient and friendly communication means for human-machine interface, it is becoming essential to recognize human emotions using bio-signals. In response to this, various devices for detecting or measuring a bio-signal (or a physiological signal) and using it have been developed.

In this manner, the emotion state information recognized using the bio-signal may be provided to an external device. Thus, the external device provides a service corresponding to the emotional state of the user. At this time, the emotional state information of the user is transmitted to an external device using wired communication or wireless PAN (Personal Area Networks) communication technology such as Bluetooth or ZigBee.

However, Bluetooth or ZigBee using frequencies of 2.4GHz ISM (Industrial, Scientific, Medical) band together with WiFi are typically exposed to problems such as mutual radio interference. To avoid this, modulation is performed using frequency hopping spread spectrum (FHSS) or direct sequence spread spectrum (DSSS) techniques, but it is difficult to avoid complete crosstalk.

Also, in order to secure a transmission distance of 10 m or more, high transmission power is required and a relatively complicated MAC algorithm such as TDMA or CSMA / CA should be applied in order to avoid collision.

Accordingly, it is required to search for a method for the emotion inference apparatus to more efficiently transmit the emotion state information of the user.

SUMMARY OF THE INVENTION The present invention has been conceived to solve the problems as described above, and it is an object of the present invention to provide a method and system for estimating emotion state information of a user by using RFID communication capable of delivering inferred emotion state information, And a method for transmitting the result to an external device using the method.

According to an aspect of the present invention, there is provided an emotion inferencing apparatus including: a bio-signal sensing unit for sensing a bio-signal of a user; A processor for inferring emotional state information of a user using the sensed bio-signal; And a communication module for transmitting the emotion state information deduced by the processor to an external device through a second proximity communication.

The communication module may be a passive tag that uses an electromotive force induced by an information request signal received from the external device as a power source.

Also, the communication module can communicate with the external device by RFID (Radio Frequency Identification) communication or NFC (Near Field Communication) method.

The emotion inferencing apparatus according to an embodiment of the present invention further includes an external environment sensing unit for sensing an external environment, wherein the processor is configured to generate the external environment information by the external environmental information generated by the external environment sensing unit, Information can be encrypted.

In addition, the processor can encode the emotion state information by separately recording the external environment information in the emotion state information.

The external environment sensing unit may be disposed at an upper end of the emotion inferencing apparatus, and the bio-signal sensing unit may be disposed at a lower end capable of contacting a user.

According to still another aspect of the present invention, there is provided a device for inferring a sensation, comprising: a pre-processing unit for pre-processing sensed data generated by the bio-signal sensing unit and the external environment sensing unit; And the bio-signal sensing unit, and the processor may be located between the preprocessing unit and the communication module.

According to another aspect of the present invention, there is provided a method for transmitting emotion information, comprising: sensing a user's biological signal; Inferring the emotion state information of the user using the sensed bio-signal; And transmitting the deduced emotion state information to an external device through a second proximity communication.

As described above, according to various embodiments of the present invention, the emotion-triggered bio-signal is extracted from the sensed bio-signal, the emotion state information of the user is inferred by using the extracted sensed- It can be transmitted to an external device using RFID communication or NFC, which is a short distance communication. The UHF RFID uses the 900MHz / 13.56MHz band and has the advantage of being less influenced by adjacent interference due to limited area of communication.

Since the RFID communication and the NFC use the electromotive force induced through the wireless signal received from the reader as a power source, power consumption required for communication can be reduced because the battery power is not consumed for transmitting emotional information, There is a vertex that is available. In this regard, there is a difference from 2.4 GHz RF transmission, such as Bluetooth and Zigbee, which have high power consumption.

In addition, since RFID communication and NFC communicate directly with devices and devices in close proximity, it is possible to enhance biometric information and emotional information security, which is a type of user's personal information.

1 is a schematic view of a sensibility service system to which the present invention is applicable,
FIG. 2 illustrates a structure of a sentence inferencing apparatus according to an embodiment of the present invention; FIG.
3 is a detailed block diagram of the emotion speculation apparatus shown in Fig. 2,
FIG. 4 is a flowchart showing a method of transmitting emotion information according to another embodiment of the present invention;
5 is a view illustrating a safety device for a vehicle using the emotion inferencing device according to another embodiment of the present invention,
6A and 6B illustrate an MP3 player using emotion state information of a user received from the emotion speculation device according to another embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the drawings.

FIG. 1 is a view schematically showing an emotional service system to which the present invention is applicable. The emotional service system to which the present invention can be applied is constructed by connecting the emotion inferencing apparatus 100 and the emotional service apparatuses 210, 220, and 230 so that they can communicate with each other.

The emotion inference apparatus 100 is a device for inferring a user's emotional state and transmitting the inferred emotional state information to the emotional service devices 210, 220, and 230. The emotion inference apparatus 100 transmits emotion state information to the emotion service apparatuses 210, 220 and 230 through UHF RFID (Ultra High Frequency Radio Frequency Identification) communication or NFC (Near Field Communication).

The emotional service devices 210, 220, and 230 receive the emotion state information from the emotion inference device 100 and provide various services using the received emotion state information. As shown in FIG. 1, the emotional service device may be an MP3 player 210, a mobile phone 220, a car 230, or the like.

Since the emotional state information transmission from the emotion inference apparatus 100 to the emotional service apparatuses 210, 220 and 230 is performed by UHF RFID communication or NFC, the emotion inferencing apparatus 100 and the emotional service apparatuses 210, 220, 230 are very close to (very close to) the emotion speculation device 100, information transfer is performed.

The structure of the emotion speculation device 100 will be described in detail with reference to Fig. 2 is a diagram illustrating a structure of a emotion inferencing apparatus according to an embodiment of the present invention.

2, the emotion inference apparatus 100 is implemented as a wristwatch mounted on a wrist, and includes an external environment sensing unit 110, a sensing data preprocessing unit 120, a bio-signal sensing unit 130, A display 140, a processor 150 and an RFID / NFC module 160.

3, the external environment sensing unit 110 is disposed at the upper outer edge of the emotion inferencing apparatus 100 to sense the external environment of the user, and the bio- As shown in Fig.

In addition, the display 140 is located at the uppermost position so that the user can confirm the screen. The sensing data preprocessing unit 120 includes an external environment sensing unit 110 and a biological signal sensing unit 130 for pre-processing the sensing data generated by the external environment sensing unit 110 and the living body signal sensing unit 130, Respectively.

The processor 150 receives the sensing data preprocessed from the sensing data preprocessing unit 120 to deduce an emotional state and displays the sensed state on the display 140. The sensory data is transmitted to the emotional service apparatuses 150 through the RFID / The display 140 and the RFID / NFC module 160 because the sensor data must be transmitted to the RFID reader / writer 210, 220, 230.

In FIG. 3, the emotion inferencing apparatus 100 is implemented as a wristwatch mounted on a wrist, which is an example for convenience of explanation. It goes without saying that any structure can be implemented as long as it is in contact with or adjacent to the user's body.

Hereinafter, the operation of the emotion inferencing apparatus 100 will be described in detail with reference to FIG. 4 is a detailed block diagram of the emotion inferencing apparatus shown in FIG.

The external environment sensing unit 110 is a set of sensors that measure temperature, humidity, roughness, dust concentration, and the like and generate corresponding data.

The sensing data preprocessing unit 120 amplifies, removes and A / D converts the sensing data generated by the external environment sensing unit 110 and applies the amplified sensing data to the processor 150.

The biological signal sensing unit 120 senses a user's biological signal. Specifically, the bio-signal sensing unit 130 includes a contact portion contacting or approaching a part of a user's body, and detects a user's bio-signal through a portion contacting the user's body. Herein, the bio-signals represent various signals generated in the user's body and represent signals such as brain waves, blood pressure, pulse waves, skin temperature, skin resistance, skin conductivity, respiration, and the like.

In order to detect these, the biological signal sensing unit 130 includes a blood pressure sensor for measuring blood pressure, a skin temperature sensor for measuring skin temperature, a skin resistance sensor for measuring skin resistance, and a breathing sensor for measuring respiration rate. Here, the blood pressure sensor may be a pressure sensor such as a piezo sensor or a strain gauge, or a PPG (Photo-electric pulse PlethysmoGraph) sensor. The skin temperature sensor can be realized by a sensor for measuring the skin temperature using an electrode and a thermocouple. In addition, the skin resistance sensor can be realized by a sensor that directly or indirectly contacts the skin, and a sensor that measures skin resistance using a comparator connected to the electrode. However, the bio-signal sensing unit 130 may sense various bio-signals, and may include various sensors for detecting bio-signals.

The biological signal sensing unit 130 may further include a motion sensing unit for sensing motion information of the user. The motion information can be used additionally to deduce the emotional state of the user together with the external environment sensed by the external environment sensing unit 110.

The biometric data generated by the biosignal sensing unit 130 is also amplified, noise canceled, and A / D converted by the sensing data preprocessing unit 120 and applied to the processor 150.

The processor 150 extracts an emotion-induced biological signal from the biological signal sensed by the biological signal sensing unit 130 and deduces the emotion state information of the user using the extracted sensed biological signal. Here, the sensibility-induced biomedical signal represents a biomedical signal that induces the emotional state of the user, and represents biomedical signals used to infer the emotional state of the user.

Representative sensory-triggered bio-signals include pulse-wave signal (PPG), galvanic skin reflex (GSR), and skin temperature (SKT). In addition, in addition to the biometric signal (LF: Low Frequency) indicating the value obtained by integrating the power spectrum belonging to the low frequency range from the result of the fast Fourier transform of the biometric signal detected with respect to the blood pressure, (HF) representing a value obtained by integrating a power spectrum belonging to a high frequency range from a result of performing a fast Fourier transform on a biological signal, and a biometrics parameter (LF / HF) representing a value obtained by dividing LF by HF You may. In addition, the sensibility-induced bio-signal may include RR, HR, SKT, SCL, N-SCR, SCRM, RSA, RESP and FPV.

The processor 150 extracts the emotion-induced bio-signal from the bio-signal, and uses the extracted bio-signal to infer the emotional state of the user. Specifically, the processor 150 performs an average value analysis of the emotion-induced bio-signals (for example, GSR, SKT), a comparison between the reference emotion data before the emotion stimulation and the current emotion data after the emotion stimulation And an emotional signal variation (ESV) analysis is performed, and the emotional state corresponding to the current emotion induced bio signal is inferred through such an algorithm. In addition, the emotion inference algorithm of the processor 150 may include a function of mapping emotional responses, which are different from each other according to age, personal characteristics, etc., in a database and inferring them during inference.

In this manner, the processor 150 extracts the emotion-induced bio-signal from the bio-signal and uses the extracted bio-signal to infer the emotion state of the user to generate emotion state information of the user. Here, the emotion state information is information indicating the emotion state of the user, and may include information on various emotion states such as an angry state, a happy state, a sad state, and a depressed state.

The RFID / NFC module 160 transmits emotion state information deduced by the processor 150 to the emotional service devices 210, 220, and 230. The RFID / NFC module 160 uses the electromotive force induced by the emotion information request signal transmitted from the RFID / NFC reader (not shown) provided in the emotional service devices 210, 220 and 230 as a power source, (Passive Tag).

The processor 150 may receive a control signal for controlling the emotion inferencing apparatus 100 from the emotional service apparatuses 210, 220, and 230 through the RFID / NFC module 160. Then, the processor 150 controls the operation of the emotion inferencing apparatus 100 according to the received control signal. Accordingly, the user can control the emotion inferencing apparatus 100 using the emotional service apparatuses 210, 220, and 230.

The display 140 displays biometric information measured using a bio-signal or emotion status information of a user. For example, the display 140 may display biometric information such as the user's blood pressure, pulse rate, etc. on the screen. In addition, the display 140 may display whether the emotional state of the user is an angry state, depressed state, joy state, or sad state. Accordingly, the user can check his / her biometric information and emotion state information through the screen of the display 140. [

Hereinafter, the emotional information sensing / transmission process will be described in detail with reference to FIG. 4 is a flowchart provided in the description of the emotion information transmission method according to another embodiment of the present invention.

First, the bio-signal sensing unit 130 of the emotion inference apparatus 100 senses a bio-signal from a user (S410). In addition, the external environment sensing unit 110 senses the external environment (S420). The sensed data in steps S410 and S420 are pre-processed in the sensing data preprocessing unit 120. [

Then, the emotion inference apparatus 100 deduces the emotional state of the user using the sensing result of steps S410 and S420 (S430).

Specifically, the processor 150 analyzes the sensed bio-signal information, extracts the emotion-induced bio-signal (S431), and inferens the emotion state of the user based on the sensation-induced bio-signal (S433). Here, the processor 150 analyzes the emotion-induced bio-signal and analyzes the change amount of the bio-signal according to the physiological response.

Then, the processor 150 retrieves a rule base for each physiological response from the rule base table (S435), and determines the emotional state of the user using the retrieved rule base (S437).

The processor 150 packetizes the emotion information deduced by the step S430 and stores it (S440). In the packetization process in step S440, the processor 150 may encrypt the emotion information using the external environment information. For example, it is possible to encrypt the emotion state information by separately recording external environment information in the emotion state information. As a concrete example, 128 Bytes of external environment information is inserted every 256 bytes of emotion state information, and the remaining external environment information is inserted into the last part of the emotion state information.

The method of dividing external environmental information into emotional state information is implemented in advance in the emotional service devices 210, 220, and 230 so that the emotional state information, which is a type of personal information, can be encrypted.

When the RFID / NFC module 160 receives the data request from the RFID / NFC reader provided in the emotional service devices 210, 220 and 230 (S450), the RFID / NFC module 160 transmits the emotional information packet stored in step S440 to the RFID / (S460).

On the other hand, only when the emotional information request is received from the RFID / NFC reader, the processor 150 inferences the emotional information of the user and packetizes the sensed information, and the RFID / NFC module 160 transmits the sensed information to the RFID / NFC reader It is also possible.

The emotional service devices 210, 220, and 230 receiving the emotional state information provide various services using the emotional state information of the user. Hereinafter, a case in which the external device 200 is a safety device for a vehicle and an MP3 player will be described with reference to Figs. 5 to 6B.

5 is a diagram illustrating a safety device 500 for a vehicle using the emotion inferencing apparatus 100 according to an embodiment of the present invention. 5, the on-vehicle safeguard apparatus 500 can receive the emotional state information of the user from the emotion inferencing apparatus 100. [

Particularly, in the automobile, the user always holds the handle 510 in his / her hand while driving. That is, the handle 510 is always in close proximity to the user. Accordingly, the vehicle safety device 500 acquires emotion information from the emotion inferencing apparatus 100 through the RFID / NFC reader 520 provided on the handle 510. [

Accordingly, the vehicle safety device 500 determines whether the user is in a sleeping state or in a drinking state by using emotion state information. When the user is in a sleeping state or in a drinking state, the safety device 500 for a vehicle may alert the user to a sleeping warning or a drinking warning, and may control the driving of the vehicle.

In this way, the vehicle safety apparatus 500 performs a function of notifying the emotional state of the driver by using the emotion state information sensed by the emotion inference apparatus 100.

6A and 6B illustrate an MP3 player 210 using emotion state information of a user received from the emotion inferencing apparatus 100 according to an embodiment of the present invention. As shown in FIGS. 6A and 6B, the emotion speculation device 100 and the MP3 player 210 carried by the user can be closely related to each other.

When the MP3 player 210 and the emotional reasoning device 100 are closely contacted to such an extent that RFID communication or NFC is possible, the emotion information of the user is transmitted through the RFID / NFC reader 215 of the MP3 player 210 to the emotional reasoning device 100 To the MP3 player 210.

6A shows a case where the user is in a state of joy. Therefore, it can be confirmed that the emotional state of the user is displayed as 'joy' on the display screen of the emotion inferencing apparatus 100.

Then, the MP3 player 210 recognizes that the emotional state of the user is 'joyful', displays a list of pleasant music on the screen, or automatically reproduces music classified as pleasant music.

FIG. 6B shows a case where the user is depressed. Accordingly, it can be confirmed that the emotional state of the user is displayed as 'depressed' on the display screen of the emotion inferencing apparatus 100.

Then, the MP3 player 210 recognizes that the emotional state of the user is 'depressed', displays a list of comfortable music on the screen, or automatically reproduces music classified as comfortable music.

As described above, the MP3 player 210 receives the emotion state information of the user from the emotion inference apparatus 100, and can provide a function corresponding to the emotional state of the user.

5 to 6B illustrate that the external device 200 is a safety device for a vehicle and an MP3 player. However, the present invention is not limited thereto. That is, the external device 200 can be applied to any device capable of receiving the emotion state information of the user from the emotion inference device 100 through the second proximity communication and using the same to provide a function corresponding to the emotional state of the user Of course it is.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

100: emotion inference device 110: external environment sensing unit
120: sensing data preprocessing unit 130: biological signal sensing unit
140: Display 150: Processor
160: RFID / NFC module

Claims (8)

A biological signal sensing unit for sensing a user's biological signal;
An external environment sensing unit for sensing an external environment;
Inserting a second unit length of the external environment information generated by the external environment sensing unit for each first unit length of the emotion state information, A processor for inserting all of the environment information into the last part of the emotion state information and encrypting the emotion state information; And
And a communication module for transmitting the emotion state information encrypted by the processor to an external device via RFID (Radio Frequency Identification) communication or NFC (Near Field Communication).
The method according to claim 1,
The communication module includes:
Wherein the tag is a passive tag that uses an electromotive force induced by an information request signal received from the external device as a power source.
delete delete delete The method according to claim 1,
Wherein the external environment sensing unit is disposed at an upper outer side of the emotion inferencing apparatus,
Wherein the bio-signal sensing unit is disposed at a lower end capable of contacting the user.
The method according to claim 6,
And a preprocessing unit for preprocessing the sensing data generated by the bio-signal sensing unit and the external environment sensing unit,
Wherein the preprocessing unit is located between the external environment sensing unit and the bio-signal sensing unit,
Wherein the processor is located between the preprocessing unit and the communication module.
The method of claim 1, wherein the emotional reasoning device comprises: sensing a user's biometric signal; estimating emotional state information of the user using the sensed biometric signal;
Sensing the external environment by the emotion inferencing device;
Wherein the emotion inference apparatus inserts the second unit length of the external environment information for each first unit length of the emotion state information and inserts the remaining external environment information into the last portion of the emotion state information, Encrypting; And
Wherein the emotional reasoning device transmits the encrypted emotional state information to an external device by RFID (Radio Frequency Identification) communication or NFC (Near Field Communication).

Images