KR101839244B1 - Sigh language assisting system expressing feelings - Google Patents

Abstract

The present invention relates to a sign language assistance system expressing emotions which allows a person who has a speech disorder to intuitively express and recognize emotions through an accessory worn by a hand when the person uses a sign language, thereby supporting smooth language communication by translating the sign language. The sign language assistance system comprises: a worn part; a first translation part; and a first interface part.

Description

{SIGH LANGUAGE ASSISTING SYSTEM EXPRESSING FEELINGS}

The present invention relates to a hydration assist system, and more particularly, to an intuitive expression and recognition of an emotional state through an accessory worn by a hand in the hand of a deaf person, and expresses feelings capable of supporting smooth language communication by sign language translation To a hydration assistance system.

Sign language is a visual language that expresses using hand movements. It is a means of communication used by deaf people. In recent years, sign language education for the general public has been actively carried out for smooth communication between deaf and non - disabled people.

In recent years, systematic guidance has been made using sign language sentences or sign language videos in accordance with the levels of beginner, intermediate, advanced, and Korean sign language 1,2,3,4 in consideration of the level of the learner, In order to train a professional sign language interpreter, special sign language such as medical, law, education, job, broadcasting is also provided so that the sign language can be translated and interpreted according to the field of specialization with the sign language. However, It is not easy to use and understand.

Recently, with the proliferation of terminals such as portable computers and smart phones, many deaf people have tried to communicate with others by using such terminals.

Conventionally, a deaf-mute person has mainly used a method of transmitting and receiving a character by using a terminal and communicating with another person, converting the input character into voice, and converting the voice of the other person into a character. Recently, A method of converting the voice or voice into a character or voice and outputting the voice or converting the voice of the other person into a sign language video (animation), and the like.

However, there is still a lack of research on the expression of emotions and devices of deaf people. Non-disabled people express their emotions more accurately through speech or intonation, but deaf people express their emotions in communication based on IT technology. There was a very difficult problem.

Korean Patent Publication No. 10-2010-0104899 (Sep. 29, 2010)

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a sign language interpretation system that intuitively expresses and recognizes an emotional state of a deaf person through light emission of a hand- And to provide a sign language assisting system that expresses feelings capable of supporting smooth language communication.

According to another aspect of the present invention, there is provided a hydration assistance system for expressing emotions of a listener, comprising: a power source; a sensor unit configured to detect movement of three axes and including an acceleration sensor and a gyro sensor; And a judging unit for generating emotion information in comparison with the receiving unit, An extracting unit for analyzing the image and extracting a motion with respect to the hand, and analyzing a motion of the extracted hand to extract first conversation information expressed by a character or voice A first translation unit having a first analysis unit for generating a first translation unit; A first interface for outputting the emotion information together with the first dialog information; .

A second analyzing unit for analyzing a voice or a character input to the input unit to generate second dialog information, and a second analyzing unit for generating a sign language animation according to the second dialog information, A second translation unit having a second translation unit; A second interface for outputting the sign language animation; As shown in FIG.

The wearer may further include a light emitting unit having light emitting elements of a plurality of colors and outputting hues corresponding to the emotion information.

The wearer may further include an initialization unit for initializing the operation of the light emitting unit according to an operation input of the receiver.

In the present invention, efficient communication can be achieved by outputting emotions in color through a wearable form that can be worn on the hands of a handset along with hydration transmission. Especially, communication with a non-handicapped person can be performed by translating signatures and expressing emotions in an intuitive manner As a result, the barriers of communication between disabled people and non-disabled people can be solved.

1 is a conceptual diagram of the present invention,
2 is a perspective view showing a state of a wearer according to an embodiment of the present invention,
3 is a block diagram illustrating a configuration and a connection relationship according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a configuration of a hydration auxiliary system for expressing an emotion of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a conceptual view of the present invention, FIG. 2 is a perspective view showing a state of a wearer according to an embodiment of the present invention, FIG. 3 is a block diagram showing a configuration and a connection relation according to an embodiment of the present invention, A first translator 120, a second interface 150, and a second translator 130 and a first translator 130. The first translator 120 and the second translator 130 are provided in a non- And an interface unit 140.

In the present invention, such a configuration is distinguished and described according to the operational characteristics of the configuration, and the system can be configured as a separate terminal type configuration having the configuration according to the present invention as shown in FIG. In addition, well-known structures such as a communication unit and a power supply unit for data transmission / reception in the system configuration can be implemented without specific description by those skilled in the art, so that a detailed description thereof will be omitted in order to prevent blurring of the gist of the present invention .

The wearer 110 is configured as an accessory to be worn in the hand of a person who is hovering. The wearer 110 is configured in such a manner that the other person can easily see with the naked eye as the hydration is performed, such as a ring, a bracelet, A power supply unit 111, a sensor unit 112, a determination unit 115, a light emitting unit 116, and an initialization unit 117.

The power supply unit 111 is a small battery built in the wearing unit 110 and is used for the operation of the sensor unit 112, the determination unit 115, the light emitting unit 116 and the initialization unit 117 Supply power.

The acceleration sensor 113 and the gyro sensor 114 are coupled to the sensor unit 112. The acceleration sensor 113 and the gyro sensor 114 detect movement of three axes of the acceleration sensor 113 and the gyro sensor 114, Combined IMU (Inertia Measurement Unit) sensors can be used.

The acceleration sensor 113 constituting the acceleration sensor 113 measures the acceleration of how fast or slow the object is accelerating. It is possible to measure the degree of inclination of the acceleration sensor with respect to the surface of the earth through the action of gravity, , it is possible to measure three axes in the z-axis.

The gyro sensor 114 measures rotation speeds of the three axes x, y, and z. When the movement of a hand in which hydration is to be performed is accurately measured as in the present invention, only the acceleration sensor 113 moves And can measure the direction and the degree of movement more precisely. Unlike the acceleration sensor 113, the gyro sensor 114 is not affected by gravity. Therefore, the gyro sensor 114 is combined with an acceleration sensor to measure precise movement. Similarly, the x, y, Perform measurements on three axes.

The sensor unit 112 may include at least one or more sensors on each hand of the receiver so that it can recognize a hydration operation. Since the sensor unit 112 is embedded in the wearer's finger 110 on the finger or palm rather than the palm or the wrist, accurate motion detection can be performed.

The determination unit 115 compares the sensed value of the sensor unit 112 with a predetermined movement pattern to generate emotion information. In other words, in the normal sign language expression corresponding to the shape of the wearing part 110, 'happy', 'angry', 'sad', ' And the like, and stores them together with the operational characteristics of the hands that can be sensed through the sensor unit 112. When the receiver operates the sensor, the sensor unit 112 senses the emotion, Words are recognized.

The emotion thus recognized can be transmitted to the conversation partner in various ways, and in the present invention, the color is basically used so that the opponent can perceive it. This matches the promised colors and emotions. For example, you can use colors that can be generally felt by people in general, such as red, blue, gray, and joy, so that communication efficiency can be improved. have.

The wearer 110 has a plurality of light emitting devices of a plurality of colors and emits light corresponding to the emotion information in a manner such that the opponent who views the sign language can confirm the emotion state in real time together with the sign language Thereby forming a portion 116. Since the complexity of the structure and the inconvenience that the state can not easily be recognized, it is preferable to divide emotion into four or five small LED elements So that intuitive emotional expression can be performed.

The wearing unit 110 may further include an initialization unit 117 for initializing the operation of the light emitting unit 116 according to an operation input of the listener so as to display a quick emotion change according to a false sense of emotion or a pseudo process desirable. For this, a method of recognizing a set hand gesture other than a sign language operation may be used. Preferably, the recognizing means may recognize a touch of a sign language person so that the light emitting portion 116 can be turned off .

The first translating unit 120 translates the sign language of the signee so that the non-handicapped person can easily grasp the contents of the sign language. The photographing unit 121, the extracting unit 122, and the first analyzing unit 123 .

The photographing unit 121 may include a camera or a CCD to acquire an image including a hand of a listener, and may use a webcam or a camera with a built-in terminal as a camera capable of clearly recognizing sign language even if the resolution is not high.

The extracting unit 122 analyzes the image obtained through the photographing unit 121, and extracts the motion of the hand. It is preferable that the wearer 110 is formed of a glove or a band of color which is easy to recognize the image for smooth hand recognition in the image. The photographing unit 121 is constituted by an infrared camera, The recognition rate can be increased by applying a material capable of reflecting infrared rays to the display unit 110.

The first analyzing unit 123 analyzes the motion of the hand extracted through the extracting unit 122 to generate first dialog information expressed by a character or a voice, and translates the signatures extracted from the image . For this, the first analyzing unit 123 may store the sign language corresponding to the hand pattern of the extracted image as a DB, or may perform translation through interlocking with an external DB. As described above, the wearer 110 It is possible to verify whether or not the translation is correct by comparing the extracted image with the detection result transmitted from the sensor unit 112 as the hydration operation is recognized through the sensor unit 112 provided in the sensor unit 112.

The first interface unit 140 is configured to output the first dialog information generated by the first translator 120 and the emotion information generated by the determination unit 115 so that the non-disabled person can identify the first emotion information. Monitors, and liquid crystal panels of portable terminals. As the emotion information is represented by a color, the first interface unit 140 outputs the word or background of the translated sign language in a color corresponding to the emotion, so that the emotion state can be easily grasped.

The second translator 130 is configured to generate a sign language animation through a voice or a character of a non-disabled person who is not aware of sign language so that the sign language person can easily confirm the sign language. The input unit 131, the second analysis unit 132, And a generation unit 133.

The input unit 131 is basically configured to receive a voice or a character from a user who is a non-disabled person in a configuration capable of inputting a character, if necessary, including a microphone.

Unlike the first analyzing unit 123 for translating the sign language, the second analyzing unit 132 is configured to translate a voice or a character input to the input unit 131 into a sign language, And analyzes the characters to generate second dialog information for extraction and sign language translation of the morpheme representing the main meaning.

The image generating unit 133 includes a sign language animation DB and a conversion algorithm according to the morpheme to generate a sign language animation according to the second dialog information generated by the second analysis unit. The converted sign language animation includes a sign language And is output through the second interface unit 150 provided on the side of the receiver so that the receiver can easily recognize the receiver.

It is to be understood that the invention is not limited to the disclosed embodiment, but is capable of many modifications and variations within the scope of the appended claims. It is self-evident.

110: Wear section 111: Power supply section
112: sensor unit 113: acceleration sensor
114: Gyro sensor 115:
116: light emitting unit 117:
120: first translation unit 121: photographing unit
122: extracting unit 123: first analyzing unit
130: second translation unit 131: input unit
132: second analyzing unit 133: image generating unit
140: first interface unit 150: second interface unit

Claims (4)

A sign language auxiliary system for expressing emotion of a listener,
A sensor unit 112 composed of a power supply unit 111, an acceleration sensor 113 and a gyro sensor 114 to detect movement of three axes, and a sensor unit 112 for comparing sensed values of the sensor unit 112 with a set movement pattern, A light emitting unit 116 having four or five light emitting devices for distinguishing emotions from each other and outputting hues corresponding to the emotion information, And an initialization unit (117) for initializing the operation of the light emitting unit (116) in accordance with a touch box including recognizable recognition means, wherein the initialization unit (117) is worn on the hand of the handset and coated with a material capable of reflecting infrared rays (110);
An extracting unit 122 for analyzing the image and extracting a motion with respect to the hand, and analyzing the motion of the extracted hand, A first translation unit (120) having a first analysis unit (123) for generating first conversation information expressed by a character or voice;
A first interface unit 140 for outputting the emotion information by outputting a background corresponding to the emotion with the first dialog information; Wherein the sign language is an English alphabet.
The method according to claim 1,
A second analyzing unit 132 for analyzing a voice or a character input to the input unit 131 to generate second conversation information, A second translation unit 130 having an image generation unit 133 for generating a sign language animation corresponding to the sign language animation;
A second interface unit 150 for outputting the sign language animation; Further comprising: an input unit for inputting an input signal;
delete delete

Images