KR20030006570A - Transmission apparatus and method for the finger language - Google Patents

Abstract

PURPOSE: An apparatus and a method for transmitting a finger language are provided to process the finger language of an acoustically handicapped person as an image and transmit the finger language as a text. CONSTITUTION: A camera(140) extracts an image of a user. A finger language signal processing unit(130) extracts a finger language signal from the image of the camera(140), processes the finger language signal, and outputs the finger language as a text. A transmitting unit(70) converts the text outputted from the finger language signal processing unit(130) into an RF(Radio Frequency) with a designated standard, and transmits the RF. If a finger language mode is selected by a user, a control unit(50) activates the finger language signal processing unit(130) and controls the finger language signal process and transmission.

Description

Sign language transmission apparatus and method {TRANSMISSION APPARATUS AND METHOD FOR THE FINGER LANGUAGE}

The present invention relates to a sign language transmission method for imaging and transmitting a sign language of a hearing impaired person.

With the advent of the digital era, technology for digitalizing and processing voice and image information has been developed. In the case of real voice, a voice synthesis technology for converting text to voice or an MMI technology in which a machine operates by recognizing a speaker's voice is used. It is a trend that is applied to many parts of life.

In recent years, with the commercialization of CDMA technology and the widespread use of personal mobile phones, the functions of the mobile phones have expanded from simply sending and receiving voices to multimedia functions, and the IMT2000 service uses a camera equipped terminal. It also delivers image information in addition to information.

Since the IMT2000 service is limited to calls between persons capable of normal speech or normal listening, the deaf or speech impaired person may use only the SMS function to perform communication with the terminal.

That is, the hearing impaired or speech impaired persons can make a call by delivering an image communicating with a sign language at a high speed using an IMT2000 terminal. Communication can be performed by using a text message, which requires a text input with a terminal key, thereby limiting time and information amount.

In order to solve the inconvenience of the key input, it is possible to perform key input using a touch screen, but this also has a problem in that it does not overcome some limitations.

The present invention has been made to solve the above problems, and an object of the present invention is to provide a sign language transmission apparatus and method for transmitting a sign language, which is a communication means of the hearing impaired by the image processing.

1 is a block diagram showing the configuration of the sign language transmission apparatus of the present invention.

2 is an operation flowchart of the sign language transmission method of the present invention.

** Explanation of symbols for main parts of drawings **

10: antenna 20: transmission and reception signal synthesis unit

30: receiving unit 40: receiving signal processing unit

50: control unit 60: transmission signal processing unit

70: transmitter 80: memory

90: screen display unit 100: microphone

110: speaker 120: key input unit

130: sign language signal processing unit 131: detection unit

132: converter 133: storage unit

The present invention for achieving the above object, the first step of capturing the image information of the user to extract the position information of the hand; A second step of recognizing the shape of the hand with the extracted position information of the hand; In the second step, the shape of the hand recognized in the second step is mapped to the shape of the pre-stored hand, converted into text, and then transmitted.

The present invention for achieving the above object, the extraction means for extracting an image of the user; Sign language signal processing means for extracting a sign language signal from an image of the extraction means, and then outputting the sign signal as text; Transmitting means for making and outputting a text output from the sign language signal processing means at a high frequency of a predetermined standard; When the sign language mode is selected by the user, the sign signal processing means is activated to control sign signal processing and transmission.

The sign language signal processing means includes: sensing means for detecting a shape of a hand by detecting a position of a wrist from an image of the extraction means; And a converting means for comparing the shape of the hand of the sensing means with the shape of the pre-stored hand and converting the negative information into text.

Hereinafter, operations and effects of the sign language transmission apparatus and method according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing a configuration of a sign language transmission apparatus according to the present invention, and an antenna 10 for radiating or receiving a radio signal as shown in the drawing; Transmitting and receiving signal synthesizing unit 20 for combining the transmitting unit 70 and the receiving unit 30 in one path to perform communication with one antenna 10; A receiver 30 which processes a high frequency radio signal received through the antenna 10 to a predetermined signal; A reception signal processing unit 40 which separates a signal output from the reception unit 30 into an audio signal, a video signal, and various data; A speaker 110 for outputting an audio signal output from the reception signal processor 40 to the outside; A camera 140 for capturing the entire image of the user; A sign language signal processing unit 130 for extracting a sign language signal from an image captured by the camera 140 and processing the predetermined signal and outputting the signal as text; A transmission signal processing unit 60 for processing a voice signal input from the microphone 100 and a video signal input through the camera 140 or the sign language signal processing unit 130; A transmitter 70 for converting a signal output from the transmission signal processor 60 into a high frequency of a predetermined standard so as to be transmitted through the antenna 10; A key input unit 120 for inputting various kinds of information so that a user can use a telephone; A screen display unit 90 for displaying various materials; The controller 50 is configured to collectively control each unit.

The sign language signal processor 130 includes: a detector 131 for detecting a shape of a hand by detecting a position of a wrist from an image of the camera 140; A converting unit 132 for comparing the shape of the hand of the sensing unit 131 with the shape of the pre-stored hand and converting the negative information into text; It consists of a storage unit 133 that defines the sound for each hand shape and stores it as a database.

FIG. 2 is an operation flowchart of the sign language transmission method of the present invention, as shown in FIG. 1, by capturing image information of a user and extracting position information of a hand; A second step of recognizing the shape of the hand with the extracted position information of the hand; The third step of converting the shape of the hand recognized in the second step with the shape of the pre-stored hand, converting the text into text, and transmitting the same, will be described.

First, in the transmission mode, the transmission signal processor 60 processes the audio signal input through the microphone 100 and the video signal input through the camera 140 to a predetermined signal, and applies the signal to the transmitter 70. ) Is a high frequency signal processing of the signal output from the transmission signal processing unit 60 and outputs through the transmission and reception signal synthesis unit 20 and the antenna 10.

The transmitter 70 amplifies the signal output from the transmission signal processor 60 at a high frequency and amplifies it to a predetermined level, and then passes only the desired transmission signal through the band pass filter.

In the reception mode, the reception unit 30 processes a high frequency radio signal input through the antenna 10, and the reception signal processing unit 40 outputs a signal output from the reception unit 30 to an audio signal, a video signal, and various kinds of signals. The data is separated into data, and under the control of the controller, the audio signal is output to the outside through the speaker 110, and the image signal and various data are displayed on the screen display unit 90.

Here, when the user selects the sign language signal transmission mode through the key input unit 120 for the sign signal processing, the controller 50 activates the sign signal processor 130, that is, the sign signal processor 130 is normally used. Is deactivated and activated only when necessary to prevent power consumption.

In this case, the controller 50 controls the image signal captured by the camera 140 to be applied to the sign language signal processor 130.

Then, the sign language signal processor 130 extracts a sign language signal from the image captured by the camera 140, processes the signal into a predetermined signal, converts the signal into text, and outputs the signal through the transmitter 70 and the antenna 10.

That is, the sensing unit 131 detects the shape of the hand by detecting the position of the wrist from the image of the camera 140, and the converting unit 132 stores the shape of the hand of the sensing unit 131 in the storage unit 133. Compared to the shape of the hand previously stored in the) and the resulting negative information is converted into text and output.

The storage unit 133 defines a sound for each shape of the hand and stores it in a database. The shape of the hand includes the number of fingers, the number of thumb, the index finger, the direction of the finger, the contact situation, etc. To be recognized.

In other words, the present invention captures the user's image information to extract the position information of the hand, and then recognizes the shape of the hand with the extracted position information of the hand, and maps the shape of the recognized hand with the shape of the pre-stored hand Convert it to text and send it.

As described in detail above, the present invention can broaden a call range limited to some ordinary people or deaf people by converting a sign language image of a deaf person into text using an IMT 2000 terminal equipped with a camera. There is an effector.

Claims (8)

Capturing image information of the user and extracting position information of the hand; A second step of recognizing the shape of the hand with the extracted position information of the hand; The sign language transmission method of claim 2, wherein the shape of the hand recognized in the second step is mapped to the shape of the pre-stored hand, and converted into text. The sign language transmission method according to claim 1, wherein the shape of the hand is recognized by the number of fingers, the number of thumb, the index finger, and the like, the direction of the finger, the contact state of each other, and the like. The sign language transmission method according to claim 1, comprising the step of defining a sound for each hand shape and storing it in a database. Extraction means for extracting an image of a user; Sign language signal processing means for extracting a sign language signal from an image of the extraction means, and then outputting the sign signal as text; Transmitting means for making and outputting a text output from the sign language signal processing means at a high frequency of a predetermined standard; And a control means for activating the sign language signal processing means to control sign language signal processing and transmission when a sign language mode is selected by a user. The sign language transmission apparatus according to claim 4, further comprising key input means for selecting a sign language mode by a user. 5. The apparatus of claim 4, wherein the sign language signal processing means comprises: sensing means for sensing the position of the wrist from the image of the extraction means and sensing the shape of the hand; And a conversion means for comparing the shape of the hand of the sensing means with the shape of the pre-stored hand and converting the negative information into text. The sign language transmission apparatus according to claim 6, further comprising storage means for defining a sound for each hand shape and storing it in a database. 8. The sign language transmission apparatus according to claim 6 or 7, wherein the shape of the hand is recognized by the number of fingers, the thumb, the index finger, and the like, the direction of the fingers, and the contact status of each other.