KR101169717B1 - The apparatus and method of change a emotion information with the five contents impormation - Google Patents

Abstract

The present invention is a conventional haptic technology is mainly used only for the task of connecting to a function or service of a computer or a terminal, there is no device for converting the hardware input value by the push or shake input to the software emotional value, various emotion applications The haptic input unit, the haptic API (Application Interface), the five sense extracting unit, and the emotional application display unit are configured to improve the problem that the emotional information is lost. It can be extracted and inferred with 1: 1 matched emotional information, and can be used as a device that can input / output new forms of communication using an emotional environment through tactile or tactile senses, emotional based virtual reality service, Various emotions such as virtual game, robotic, medical, art and design, literature An object of the present invention is to provide an apparatus and method for converting five sense contents obtained from haptics capable of activating an application service into emotional information.

Description

TECHNICAL APPARATUS AND METHOD OF CHANGE A EMOTION INFORMATION WITH THE FIVE CONTENTS IMPORMATION

The present invention converts the five senses contents obtained from haptics to emotional information by converting the information obtained through the touch screen provided on the smart phone, IPTV, computer monitor into emotional information and converting the hardware input value into software emotional value. To an apparatus and a method for causing the

In general, tactile feedback when the skin touches the surface of the object and kinesthetic force when the movement of joints and muscles is disturbed are called haptics.

That is, tactile feedback + kinesthetic force = haptic. Therefore, in many cases, the touch function is already included in the haptic, and the reality of using touch and haptic in the industrial field.

The prior art focuses primarily on providing a more human-friendly interface between a human and a computer or terminal, depending on the sense of touch.

As a result, there is no device for converting the hardware input value input by push or shaking into the software emotional value, so that various emotional applications cannot be activated, thereby causing emotional information to be lost.

Domestic Patent Publication No. 10-0714535 (announced May 7, 2007)

In order to solve the above problems, the present invention can extract and infer touch information about a user's sense of touch and touch as 1: 1 matched emotion information, and use a new environment by using an emotional environment through touch or touch. From haptics that can be used as a device for inputting / outputting communication, and can activate various emotional application services such as emotion-based virtual reality services, virtual games, robotic, medical, art and design, literature, etc. An object of the present invention is to provide an apparatus and method for converting five senses contents into emotional information.

The apparatus for converting the five senses content obtained from the haptic according to the present invention to the emotional information to achieve the above object

Sends the touch information data about the tactile sense and the touch pressed on the touch screen 1 provided on the smart phone, IPTV, computer monitor to the emotion-based web server 2 to convert the customized emotion information data, and the converted customized emotion Emotional information conversion module 10 for activating the information data as an emotional application on the touch screen screen provided on the smartphone, IPTV, computer monitor is achieved by being configured.

As described above, in the present invention, the touch information input by the user and the touch information can be extracted and inferred as 1: 1 matched emotion information, and a new type of emotion is used by using the touch environment. By presenting a communication environment for input and output, there is a good effect to activate a variety of emotional application services such as emotion-based virtual reality services, virtual games, robotic, medical, art and design, literature.

1 is a block diagram showing the components of the apparatus for converting the five senses content obtained from the haptic according to the present invention into emotional information;
2 is a block diagram showing the components of the emotional information conversion module 10 according to the present invention;
3 is a block diagram showing the components of the emotion extraction and transmission unit 400 according to the present invention;
4 is a block diagram showing the components of the emotional application display unit 500 according to the present invention,
5 is a block diagram showing the components of the emotional extraction unit 420 according to the present invention;
6 is a block diagram showing the components of the emotion-based platform according to the present invention,
7 is a flowchart illustrating a method of converting five senses contents obtained from a haptic to emotional information according to the present invention.

Tactile as described herein is a type of sensation that responds to external stimuli. Recognizing the stimulus caused by the contact with the external container, and senses the stimulus touched by the user through the tactile sensor configured on the touch screen.

In addition, the touch described in the present invention is a touch of the user's finger touching the touch screen, and senses the strength of the pressure pressed on the touch screen through the tactile sensor.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a block diagram showing the components of the device for converting the five senses content obtained from the haptic to emotional information according to the present invention, which is pressed on the touch screen (1) provided on a smartphone, IPTV, computer monitor Sends touch information data about true sense and touch to the emotion-based web server 2 and converts it into customized emotion information data, and converts the converted customized emotion information data into a smartphone, IPTV, and computer monitor on the touch screen screen. Emotional information conversion module 10 to be activated in the emotional application is configured to include.

The emotion information conversion module 10 is composed of a haptic input unit 100, haptic API unit 200, emotion collection unit 300, emotion extraction and transmission unit 400, emotion application expression unit 500.

First, the haptic input unit 100 according to the present invention will be described.

The haptic input unit 100 serves to receive touch information data about a tactile sense and a tactile sense pressed by a user through a touch screen provided on a smartphone, an IPTV, and a computer monitor.

It is composed of a first input device to input through the left and right shaking up and down through the gyro sensor, a second input device to input through the vibration element, and a third input device to input through the tactile, tactile touch of the touch screen.

The touch information data may be input when the user's emotion is happy, first touch information data regarding touch, touch input when the user's emotion is sad, second touch information data regarding touch, and input when the user's emotion is angry And third touch information data relating to the tactile sense and tactile sense.

In the present invention, a capacitive tactile sensor based on a polymer is used for a touch screen.

Here, the tactile sensor is basically a tactile sensor module that can be expanded using PDMS Elastomer as a main material, and one sensor module is configured in a 16 * 16 array form. It has a resolution of 1 mm, which is the same as the human epidermis, and the initial capacitance of each cell is about 180 fF.

One cell has a structure in which copper electrodes overlap between five PDMS layers. Four modules can be used to create a 32 * 32 extended tactile sensor array using ACP.

The touch screen used in the present invention is largely driven in four ways.

Capacitive sensing, Piezoresistive, Thermal, Magnetic

In the present invention, a capacitive sensing method is used. Here, the capacitive sensing method is used to detect a change in capacitance between the movable part and the fixed part when the movable part is displaced by acceleration, and has a relatively good optical characteristic, a multi-touch user interface, and strong durability. Has characteristics.

Next, a haptic API (Application Programming Interface) 200 according to the present invention will be described.

The haptic API (200) provides a service API (Application Programming Interface) that can use a system library to upload the touch information data received from the haptic input unit to the emotion-based web server in real time to the emotion-based platform in real time Play a role.

It provides a library of services among Peers, Groups, and Communities within the WMC network, and provides a search service library for searching among Peers, Groups, and Communities. Create a message to use for communication, provide a pipe communication service library to use during pipe communication, and create a pipe for the WIPI Mobile Community (WMC) input and a pipe for the WIPI Mobile Community (WMC) output to create a WIPI Mobile Community (WMC). WIPI-P2P service library is provided to provide sending and receiving library through message.

As shown in FIG. 6, the emotion-based platform includes a Windows & Dot Net Platform, a haptic API, a Clinical Skills Trainer, a Virtual Veins, and a Virtual Room Bar Puncher. (Virtual Lumbar Puncture), Virtual Anaesthetic Blocks, Virtual Renal Biospy, Virtual Epidurals, Virtual Cervical Smear Simulator, Virtual It consists of Virtual Deep Muscle Injections and Virtual Suturing.

Next, the emotion collection unit 300 according to the present invention will be described.

The emotion collection unit 300 serves to model the emotion state by quantifying the tactile sense and the touch of the touch information data received from the haptic input unit through the emotion-based platform.

It is composed of the emotional measurement DB 310 and the emotional state modeling forming unit 320.

The emotion measurement DB 310 serves to store touch information data regarding the tactile sense and the touch input when the user's emotion is happy, sad, or angry.

The emotional state modeling forming unit 320 serves to model the emotional state by graphicly processing the tactile sensation and the sensation that changes according to the user's emotion through the touch information data stored in the emotional measurement DB.

That is, the first touch information data regarding the tactile sense and the touch input when the user's emotions are happy, the second touch information data regarding the tactile sense and the touch input when the user's emotions are sad, and the input when the user's emotion is angry The third touch information data related to the tactile sense and the touch are repeatedly measured, the intensity of the pressure pressed on the touch screen is numerically stored, and stored in the emotion measurement DB.

Next, the emotion extraction and transmission unit 400 according to the present invention will be described.

The emotion extraction and transmission unit 400 maps the touch information data modeled in the emotional state to the emotion conversion DB to the emotion conversion DB, extracts the customized emotion information data, and then extracts the extracted customized emotion information data from the smart phone, It plays a role of transmitting to the emotion expression application part of IPTV, computer monitor.

It is composed of the emotion conversion DB 410, the emotion extraction unit 420, the emotion information data transmission unit 430.

The emotion conversion DB 410 is a database in which the user's emotions are happy and sad, when he is angry, the tactile and tactile inputs are set as reference data values and stored in advance.

The emotion extracting unit 420 compares the touch information data input through the actual touch screen with reference data values related to tactile and sensation according to the user's emotion, and extracts the user's customized emotion information data. Play a role.

It is composed of a band pass filter 421, an absolute value conversion unit 422, a comparison unit 423, an area center detection unit 424, an area interval detection unit 425.

The band pass filter 421 extracts only frequency components necessary for detecting the sense of touch and the sense of the signal SG1 input from the emotion collector. In this example, only frequency components in the range of 800 Hz to 1200 Hz appear as the signal SG2 at the output of the band pass filter. Here, it can be seen that the pattern of intensity changes due to tactile and tactile feelings in the word appears in the signal SG2.

The absolute value converting unit 422 converts the amplitude of the input signal into its absolute value. Here, the signal SG3 appears when the absolute value converter converts the amplitude to an absolute value.

The comparison unit 423 outputs only the component larger than the threshold as the signal SG4 compared with the threshold of the signal SG3. In other words, the comparator outputs only a component having a large value among the power spectrum of the signal SG3. In addition, the threshold value which applies a voltage to a comparison part is adaptively determined using the method called the discrimination analysis method. Here, two regions A1 and A2 corresponding to the tactile and tactile patterns in the word of speech are clearly shown in the signal SG4.

The area center detection unit 424 detects times t1 and t2 at which positions corresponding to the centers of the two areas A1 and A2 are shown.

The area interval detection unit 425 detects the time difference between two times t1 and t2 detected by the area center detection unit as the area interval Ty. The value of this area interval Ty corresponds to the tactile and tactile pattern in the touch information about the tactile and tactile pressed by the touch screen. In fact, the result of averaging the value of the area | region spacing Ty is used as a value of a touch and a touch. When three or more regions appear, the area interval Ty is calculated for each of two adjacent areas, and the result of averaging the requested plurality of area intervals Ty is used as the value of tactile and tactile.

The emotion information data transmission unit 430 serves to transmit the extracted customized emotion information data to the emotion expression application unit of the smart phone, IPTV, computer monitor.

The communication method used at this time is composed of a WiFi network.

Next, the emotional application display unit 500 according to the present invention will be described.

The emotion application display unit 500 serves to activate the customized emotion information data transmitted to the emotion extraction and transmission unit as an application window on a smartphone, IPTV, computer monitor screen, which is a web server interface unit 510, emotion The application activator 520 is configured.

The web server interface unit 510 serves to interface with a remote emotion-based web server.

The emotional application activator 520 serves to activate the emotional application window in a square or circular form on a smartphone, IPTV, computer monitor screen through an emotional application program provided on a Java virtual machine.

Hereinafter, a detailed operation process of the method for converting the five senses contents obtained from the haptic according to the present invention into emotional information will be described.

First, the haptic input unit receives touch information data regarding tactile sense and tactile sense pressed by a user through a touch screen provided on a smartphone, an IPTV, and a computer monitor (S100).

Subsequently, the touch information data received from the haptic input unit in the haptic API (Interface Interface) is interfaced to the emotion-based web server of the remote place in real time to upload to the emotion-based platform (S200).

Subsequently, the emotion collection unit scales the tactile sense and the touch among the touch information data received from the haptic input unit to model the emotional state (S300).

Subsequently, the emotion extraction and transmission unit maps the touch information data modeled in the emotion state through the emotion collection unit to the emotion conversion DB to extract customized emotion information data, and then extracts the extracted customized emotion information data from the smart phone, IPTV, Send to the emotion expression application unit of the computer monitor (S400).

Finally, the personalized emotion information data transmitted from the emotion application display unit to the emotion extraction-transmission unit is activated as an application window on the smartphone, IPTV, computer monitor screen (S500).

10: emotional information conversion module 100: haptic input unit
200: haptic API unit 300: emotion collection unit
400: emotion extraction and transmission unit 410: emotion conversion DB
420: emotion extraction unit 430: emotion information data transmission unit
500: emotional application display unit

Claims (5)

Sends the touch information data about the tactile sense and the touch pressed on the touch screen 1 provided on the smart phone, IPTV, computer monitor to the emotion-based web server 2 to convert the customized emotion information data, and the converted customized emotion Tactile pressed by the user through the touch screen provided on the smartphone, IPTV, computer monitor, so that the information data is configured to be activated by the emotional application on the touch screen screen provided on the smartphone, IPTV, computer monitor. , A haptic API (Interface) to interface with the haptic input unit 100 to receive touch information data on the tactile and the touch information data received from the haptic input unit to the emotion-based web server in real time to upload to the emotion-based platform in real time. Interface) 200, and the tactile sense of the touch information data received from the haptic input unit through the emotion-based platform, The emotion collection unit 300 that scales the emotion to model the emotion state, and maps the touch information data modeled in the emotion state to the emotion conversion DB to the emotion conversion DB to extract customized emotion information data, and then extract the customized emotion information. Emotion extraction and transmission unit consisting of emotional conversion DB 410, emotional extraction unit 420, emotional information data transmission unit 430 to transmit the emotional information data to the emotion expression application unit of the smart phone, IPTV, computer monitor ), And the emotion application data sent from the haptic to the emotion information to the emotion information application unit 500 for activating the customized emotion information data transmitted to the emotion extraction and transmission unit on the screen of the smartphone, IPTV, computer monitor In the apparatus,
The emotion extracting unit 420 is a band pass filter 421 for extracting only the frequency components necessary for the detection of tactile and tactile from the signal SG1 input from the emotional collecting unit;
An absolute value converting unit 422 for converting an amplitude of an input signal into an absolute value thereof;
A comparator 423 which outputs only a component larger than the threshold as a signal SG4 compared with the threshold of the signal SG3,
An area center detection unit 424 for detecting times t1 and t2 at which positions corresponding to the centers of the two areas A1 and A2 appear,
An apparatus for converting the five senses contents obtained from a haptic into emotional information, comprising an area interval detection unit (425) for detecting a time difference between two times t1 and t2 detected by the area center detection unit as an area interval Ty.
delete delete delete delete

Images