KR20200090580A - System and method for interpreting and translating using smart clothes - Google Patents

Abstract

The present invention discloses a smart clothes interpretation and translation system including smart clothes, which comprises an input unit collecting voices spoken between chatters and converting the voices into voice signals; and an output unit using the voice signal and outputting contents translated for recognized voice contents in at least one formed of text and a synthesized voice. According to the present invention, an interpretation and translation result can be output through audio and video using smart clothes.

Description

Interpretation and translation system and method using smart clothing{SYSTEM AND METHOD FOR INTERPRETING AND TRANSLATING USING SMART CLOTHES}

The present invention relates to a system and method for translating and translating using smart clothing, and more specifically, translating and translating using smart clothing to output translated and interpreted contents through smart clothing by recognizing voices between dialogs or between speakers and audiences. System and method.

A wearable device refers to all electronic devices that can perform a computing action by attaching to a body, and includes an application that can perform some computing functions.

In addition, the wearable device refers to a next-generation electronic device that is small and lightly developed to be worn on a body or clothes so that the user can freely use it while moving or in activity, and can communicate with the user at the nearest body.

Wearable devices are also largely classified into accessory type, integrated clothing type, and body attachment type. Among them, a clothing-integrated wearable device is called smart clothing.

The interpretation and translation system using smart clothing according to an embodiment of the present invention uses smart clothing that has been limitedly used for biometric recognition or context-based color/pattern changes with an interpretation and translation algorithm, and inputs through smart clothing between dialogs or between speakers and audiences. It relates to an interpretation and translation system that performs audio and video interpretation and translation using an output function, and is intended to solve the above problems as a technique different from the prior art described above.

The present invention was created to solve the above problems, and an object of the present invention is to provide an interpretation and interpretation system using smart clothing that can output interpretation and interpretation results through audio and video using smart clothing.

In addition, it is an object of the present invention to provide a translating and translating system using smart clothing capable of outputting a translating and translating result through a remote translating and translating server using a communication function of a wired or wireless connected user terminal.

In addition, it is an object of the present invention to provide an interpretation and translation system using smart clothing in which the size of voice and text that is output is automatically adjusted according to a distance between a talker or a speaker and an audience.

In addition, an object of the present invention is to provide an interpretation and translation system using smart clothing capable of recognizing external noise and actively removing it.

An interpretation and translation system using smart clothing according to an embodiment of the present invention includes: an input unit for collecting voice for conversion from spoken voice to voice signal; And a smart clothing including an output unit for outputting at least one form of text and synthesized speech, the translated content of the speech content recognized using the speech signal.

Here, it characterized in that it further comprises a translator for translating and interpreting through the speech recognition process using the voice signal.

Here, the translator and translation unit is characterized in that it is implemented in the form of a user terminal connected to the smart clothing by wire or wirelessly to perform translation and interpretation for the spoken voice.

Here, the smart clothing includes: a distance sensor for a user to recognize a distance away from a talker or audience; And it characterized in that it further comprises a control unit for controlling the volume of the voice and the size of the text output through the output unit using the sensing information of the distance sensor.

Here, the smart clothing includes a plurality of microphones of the input unit across the front and rear surfaces, and further includes an audio processing unit for recognizing and filtering a voice signal using a volume difference of voice according to the location of the microphone. Is done.

Here, the smart clothing analyzes the waveform of the noise signal included in the voice signal, generates an interference wave that cancels the analyzed waveform, and receives the noise signal and the synthesized wave of the interference wave so that the synthesized wave is canceled. It characterized in that it further comprises a noise processor for correcting the interference wave.

Here, the smart clothing, the power supply unit for supplying power to the input and output units; And it characterized in that it further comprises a charging unit for charging the user terminal using the power supply.

Here, the output unit includes a display device, the display device is located on at least one of the back of the front and back of the chest and belly portion of the smart clothing, so that other users can see, so that the user can see, It is characterized by being located on the arm portion of the smart clothing.

According to another embodiment of the present invention, a translation and interpretation method using smart clothing includes: collecting spoken voices through an input unit of the smart clothing and converting them into voice signals; Performing translation and interpretation through a voice recognition process using the voice signal; And outputting the translation and interpretation results in at least one form among text and synthesized speech using smart clothing.

Here, the step of performing the translation and interpretation is characterized in that it is performed by a user terminal communicating with the smart clothing by wire or wirelessly.

Here, the translation and interpretation method using the smart clothing includes: recognizing a voice signal using a volume difference of voice according to the location of the microphone, and filtering the voice signal; And analyzing the waveform of the noise signal included in the voice signal, generating an interference wave that cancels the analyzed waveform, and receiving the noise signal and the synthesized wave of the interference wave to correct the interference wave so that the synthesized wave is canceled. It characterized in that it further comprises at least one of the steps.

According to the present invention, the interpretation result can be output through audio and video using smart clothing.

In addition, using a communication function of a wired or wirelessly connected user terminal, the interpretation and translation results can be output through a service of a remote interpretation and translation server.

In addition, the translation result can be output by using smart clothing to automatically adjust the size of the voice and text output according to the distance between the talkers or between the speaker and the audience.

In addition, it is possible to actively remove external noise through smart clothing.

1 is an exemplary diagram of a network environment of an interpretation and translation system using smart clothing according to an embodiment of the present invention.
2 is a block diagram of an interpretation and translation server according to an embodiment of the present invention.
3 is a block diagram of a smart clothing according to an embodiment of the present invention.
4 is an exemplary view of smart clothing according to an embodiment of the present invention.
5 is an exemplary view of a translation and interpretation method using smart clothing according to an embodiment of the present invention.
6 is an exemplary diagram of an audio signal pre-processing step according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the translation and interpretation method and the translation and interpretation system using smart clothing will be described in detail with reference to the accompanying drawings. The same reference numerals in each drawing denote the same members. Also, specific structural or functional descriptions of the embodiments of the present invention are exemplified for the purpose of describing the embodiments according to the present invention, and unless defined otherwise, all terms used herein, including technical or scientific terms. These have the same meaning as those generally understood by those of ordinary skill in the art. Terms such as those defined in a commonly used dictionary should be interpreted as having meanings consistent with meanings in the context of related technologies, and should not be interpreted as ideal or excessively formal meanings unless explicitly defined herein. It is desirable not to.

Hereinafter, a network environment of an interpretation and translation system using smart clothing according to an embodiment of the present invention will be described.

1 is an exemplary diagram of a network environment of an interpretation and translation system using smart clothing according to an embodiment of the present invention.

Referring to FIG. 1, an interpreter and translation system 1 using smart clothing according to an embodiment of the present invention is illustrated. The translation/translation system 1 using smart clothing basically includes smart clothing 100, and may further include a user terminal 200 and an interpretation/translation server 300.

The smart clothing 100 receives and inputs foreign language voices between dialogs or between the audience and the audience, recognizes them, performs translation and interpretation using the recognized contents, and outputs and outputs the results of the results in speech synthesis or text Perform a function. Here, depending on which device performs the voice recognition, translation, interpretation, and speech synthesis functions, the translation/translation system 1 using smart clothing includes only the smart clothing 100 or the user terminal 200 and the translation/translation server 300. It can contain.

The user terminal 200 may receive a voice signal input through the smart clothing 100 and use it to perform at least one of voice recognition, translation, interpretation, and voice synthesis functions. For example, the user terminal 200 directly performs all of the voice recognition, translation, interpretation and speech synthesis functions, or performs the voice recognition, translation, and interpretation functions that require a large database through the interpretation and translation server 300 and performs speech synthesis functions. Can be performed alone.

The user terminal 200 includes a communication unit 210, a display unit 220, a speech synthesis unit 230, a storage unit 240, an input unit 250, an output unit 260, a playback unit 270, and a power unit 280. ) And a control unit 290.

Various embodiments of the user terminal 200 include a cellular phone, a smart phone having a wireless communication function, a personal digital assistant (PDA) having a wireless communication function, a wireless modem, a portable computer having a wireless communication function, and a digital having a wireless communication function Portable devices incorporating photographic devices such as cameras, gaming devices with wireless communication functions, music storage and playback appliances with wireless communication functions, Internet home appliances with wireless Internet access and browsing, as well as combinations of such functions. It may include a unit or terminals, but is not limited thereto.

The translation and translation server 300 may selectively perform voice recognition, translation, interpretation, and voice synthesis functions through sharing with the user terminal 200.

2 is a block diagram of an interpretation and translation server according to an embodiment of the present invention.

Referring to FIG. 2, the interpretation and translation server 300 includes a speech recognition module 310, a speech DB 315, a translation module 320, and a translation DB 325 speech synthesis module 330.

The voice recognition module 310 records the voice of the speaker, and performs voice recognition using the recorded data. The voice recognition module 310 performs a process of automatically recognizing a voice signal from the speaker's mouth and converting it into a character string. Other names of the speech recognition unit are automatic speech recognition (ASR), voice recognition, or speech-to-text (STT).

The voice recognition module 310 may be based on a probability statistics method. That is, the speech recognition module 310 uses a model based on probability statistics as an acoustic model (AM) language model (LM) used in the speech recognition process. And the core algorithm HMM (hidden markov model) can also be based on probability statistics. The above models are examples and are not intended to limit the present invention.

GMM (Gaussian Mixture Model) may be used as the acoustic model, and N-gram may be used as the language model. Furthermore, instead of GMM, it is also desirable to use Deep Neural Network (DNN), one of the deep learning architectures. And, in order to improve the performance of speech recognition, high-quality speech models and language models are set, and the set models can be learned by a deep learning algorithm. It is preferable that the learning DB necessary for learning includes colloquial and conversational voice and language DB.

When the speech of the speaker uttered in the source language recognized by the speech recognition module 310 is output as text, the translation module 320 translates the output text into characters of the target language. Interpretation server 300 according to an embodiment of the present invention is characterized in that it includes a voice recognition module 310 and the translation module 320 itself.

The translation method performed by the translation module 320 includes at least one of a rule-based method, a corpus-based method, and a neural machine translation (NMT). The rule-based method is divided into a direct translation method, an indirect transformation method, and an intermediate language method according to the analysis depth. Examples of corpus-based methods include example-based methods and statistical-based methods.

Stochastic Machine Translation (SMT) technology is a technology that translates sentences by learning model parameters from a bilingual corpus through statistical analysis. When developing grammar or semantic representation, create a model for translation from the corpus of the language pairs that you want to translate, without manual intervention. So, if you can only secure the corpus, you can expand the language relatively easily.

The disadvantages of the statistics-based automatic translation technology are that a large-scale bilingual corpus is required and there is no common semantic representation connecting multiple languages.

Neural Machine Translation (NMT) is a technique to compensate for these shortcomings.

SMT is a method of translating a sentence into words or phrases of several words and then translating them based on a statistical model. Modeling statistical translation rules based on vast learning data is key.

In contrast, NMT translates the whole sentence by artificial intelligence (AI). The reason why sentence unit translation is possible is that the artificial neural network converts sentence information into a vector (coordinate value) representing a specific point in virtual space.

For example, the word'person' means'[a, b, c,… , x, z]'. Since vector contains all information such as words, phrases, and word order, sentence-by-sentence translation is possible. Artificial neural networks place sentences with similar meanings in close space to each other.

In NMT technology, high-dimensional vectors are utilized. The artificial neural network is trained by using learning data composed of sentences of the starting language and sentences of the arriving language, and the learned artificial neural network recognizes sentence information as a vector.

The speech synthesis module 330 outputs a synthesized voice corresponding to the speaker's voice according to the translation of the translation module 310. When the smart clothing 100 performs a voice synthesis function, TTS data is received from the translation and translation server 300 through the user terminal 200. The smart clothing 100 synthesizes speech using a speech synthesis module based on TTS data. The smart clothing 100 reproduces the TTS data transmitted from the user terminal 200, and the result is output to the speaker.

When the translation/translation server 300 includes the speech synthesis module 330, the translation/translation server 300 itself generates TTS data.

Speech synthesis is called TTS (Text-to-speech) or Voice Synthesis. As a method of speech synthesis, a combination of syllables can be used. The melody combination method extracts the melody according to the sentence analysis and analysis results from the melody database and attaches them. Synthetic sounds of several candidates are generated, and the most suitable one is adopted in consideration of rhyme and smoothness. Moreover, the tone of the talker is determined by using the sound spectrum of the talker's voice, and post-processing is performed to match the tone of the speaker, so that the synthesized sound close to the tone of the original speaker can be output. In addition, the speaker's emotions are recognized, and the perceived emotions may be carried on the synthesized sound.

The voice recognition DB 315 and the translation DB 325 correspond to the database determined by reducing the recognition range in the order of the lowest frequency of appearance depending on the type of language, and the voice recognition module 310 and the translation module 320 are miniaturized. It includes an engine that uses a speech recognition DB or a translation DB.

The voice recognition DB 315 is a DB constructed by learning voices caused by various utterances using a deep learning algorithm and reducing or expanding a recognition range according to the frequency of utterances. In other words, the amount of DB is relatively increased to recognize utterance contents with high frequency, and the amount of DB is significantly reduced to recognize utterance contents with low frequency.

In order to obtain a high completion rate of speech recognition, the larger the amount of speech recognition DB 315 is, the more advantageous it is, but there is a problem of time delay and overload. Do.

In addition, for the translation DB 325, similar to the above method, a deep learning algorithm can be used to learn various translation examples, to enlarge the colloquial expression according to the frequency of the translation example, and to reduce the written language expression to construct a DB. have.

Therefore, the speech recognition module 310 and the translation module 320 according to the present invention can use a low-capacity speech recognition DB 315 or a translation DB 325 compared to a DB built without considering frequency.

The network 400 is a wired and wireless network, such as a local area network (LAN), a wide area network (WAN), the Internet, an intranet and an extranet, and a mobile network, for example It can be any suitable communication network, including cellular, 3G, LTE, WiFi networks, ad hoc networks, and combinations thereof.

Network 400 may include connections of network elements such as hubs, bridges, routers, switches, and gateways. The network 400 may include one or more connected networks, such as a public network such as the Internet and a private network such as a secure corporate private network, such as a multiple network environment. Access to network 400 may be provided through one or more wired or wireless access networks.

3 is a block diagram of a smart clothing according to an embodiment of the present invention.

Referring to FIG. 3, the smart clothing 100 according to an embodiment of the present invention includes an input unit 110, an output unit 120, a PCB 130, a distance sensor 140, and a charging unit 150. .

The input unit 110 has a function of receiving a conversation between a talker and a voice between a speaker and an audience, and receiving text and numbers from a user. The input unit 110 includes a microphone 111 and a keyboard 112.

The output unit 120 outputs the translated content as text and outputs the interpreted content as voice. The output unit 120 includes a display device 121 and a speaker 122.

The input unit 110 and the output unit 120 are characterized in that they are located outside the smart clothing 100.

4 is an exemplary view of smart clothing according to an embodiment of the present invention.

Referring to FIG. 4, a microphone 111 and a speaker 122 for inputting or outputting sound may be located at the chest of smart clothing. However, each position indicated in each drawing is only one of several exemplary embodiments, and thus is not limited thereto.

The keyboard 112 is preferably positioned in the left arm in the case of a right-handed person, considering the position of the hand used by the user. The keyboard may be implemented by a touch method using a touch sensor.

The display device 121 is located on at least one of the front of the chest and the belly of the smart clothing and the back of the back, so that other than the user can see them. In addition, the display device 121 is located in the arm portion of the smart clothing for the user to see.

The PCB 130 is a mechanical component and may include various electronic components therein. The PCB 130 may be implemented in a film form using a flexible flat cable (FFC). The PCB 130 may be located in the smart clothing 100 without particular attention, and may be located in a part of the arm or arm.

The distance sensor 140 serves to measure the distance from the talker or the audience through infrared rays. The distance sensor 140 is preferably located in front of the smart clothing 100 due to its characteristics.

The charging unit 150 serves to charge the user terminal 200 by wire or wireless by using the power unit of the smart clothing 100. The user terminal 200 may be charged by wire through the USB terminal, or may be wirelessly charged by receiving power from a transmitter that transmits wireless power while in the pocket of the smart clothing 100.

And the PCB 130 corresponding to the mechanical configuration includes a control unit 1310, a power supply unit 132, an interpretation and translation unit 1300, an audio processing unit 134, and a noise processing unit 135.

The control unit 131 serves to control each component of the smart clothing 100. For example, the volume of the voice and the size of the text output through the output unit 120 are controlled using the sensing information of the distance sensor 140.

The power supply unit 132 serves to supply power required for the input, output, and communication functions of the input unit 110 and the output unit 120 and other smart clothing 100. As a component of the power supply unit 132, a secondary battery such as Lithium ion, a circuit for charging and discharging, and a protection circuit are included.

The interpretation/translation unit 133 records the input voice signal, and performs voice recognition, translation, interpretation, and speech synthesis functions using the recorded voice data. The entire function of the translation and interpretation by the translation and interpretation unit 133 is similar to the function performed by the translation and translation server 300.

The audio processing unit 134 serves to pre-process the audio signal when the translation and interpretation unit 133 performs translation and interpretation using the audio signal. A plurality of microphones 111 may be included in the smart clothing 100. The voice input according to the location of the microphone 111 shows a volume difference. For example, in the case of a conversation with a talker in front of the user, a larger voice is input through the microphone 111 located in front of the back rather than the back. And when there is noise included in the voice, the size of the noise may be input in a constant size regardless of the front or back of the smart clothing. In this case, the audio processing unit 134 may recognize an input showing a change in size as a voice signal and filter it.

The noise processing unit 135 analyzes the noise waveform included in the voice signal and serves to generate an interference wave that cancels the analyzed waveform. The audio signal separated by the audio processing unit 134 may include a noise signal. In this case, after analyzing the waveform of the noise, generating an interference wave opposite to the analyzed waveform, the noise can be actively removed. Even in this case, after receiving the feedback signal of the noise signal and the interference wave through the microphone 111, the noise processing unit 135 may perform noise processing by correcting the interference wave so that the synthesized wave including the remaining noise is canceled again. have.

The communication unit 136 communicates with the user terminal 200 and the translation and translation server 300. The communication unit 136 includes a communication module corresponding to various communication networks of the network 400, for example, a Bluetooth module, a WiFi module, an Ethernet, a USB module, and a cellular wireless communication module. In particular, a USB module as a wired communication, a Bluetooth module, a Zigbee module, an NFC module, and a WiFi module as short-range communication may be included in the communication unit 136.

In addition, the PCB 130 includes a storage device that stores a voice recognition DB, a translation DB, and voice. In the storage device, a client program and the like for linking the user terminal 200 and the translation and translation server 300 are stored. Here, the storage device includes volatile RAM, non-volatile ROM, and flash memory, and stores various digital files according to its function. In particular, the storage device stores the TTS engine, so that the voice synthesis function of the translation and translation server 300 can be directly performed in the smart clothing 100.

There is no guarantee that the talk will end between the talkers and that the other person has a talk. Therefore, in utterances that may occur simultaneously, it is necessary to distinguish heterogeneous voices that are input at the same time. To solve this, the controller 131 determines the characteristics of the tone using the sound spectrum of the speaker's voice, and filters the voices of the heterogeneous languages simultaneously uttered using the determined features of the tone using a filter. Accordingly, the speakers of the heterogeneous speech can be distinguished, and the speech of the heterogeneous languages can be separated from each other by filtering.

Further, the control unit 131 is characterized in that for the speech of the heterogeneous languages that are spoken at the same time, the scores according to the translation result of the sample speech are used to distinguish the languages of the heterogeneous languages.

Specifically, when the voices of the English and Korean languages are mixed and input, the voice signal of the English speaker and the voice signal of the English speaker and the voice signal of the Korean language and the other voice signal for the filtered voice signal according to the characteristics of the voice of the Korean speaker It attempts to translate into Korean and English, converts it into scores, and adopts the translation with the highest score to determine which language the language is in.

According to an embodiment of the present invention, a language setting to be in charge of the smart clothing 100 or the user terminal 200 may be automatically performed using a client program. That is, the controller 131 may automatically set the starting language in Korean by referring to the setting language of the user terminal 200.

Additionally, when the other user terminal 200 set in a different language is within a certain distance, the starting language and the target language may be automatically set by referring to the language setting of the other user terminal 200.

In addition, the control unit 131 uses the sample of the voice uttered through the interpreter 133 to score the completeness of the translation and automatically sets the language with the highest score as the destination language. For example, if the other party's spoken voice corresponds to a foreign language other than Korean, after the spoken voice is translated into English, Japanese, and Chinese, the translated result is scored to score the highest score for the user terminal (200) ) Is set as the destination language for Korean, the starting language.

Hereinafter, an interpretation and translation method (S100) using smart clothing according to an embodiment of the present invention will be described.

5 is an exemplary view of a translation and interpretation method using smart clothing according to an embodiment of the present invention.

Referring to FIG. 5, the translation and interpretation method (S100) using smart clothing according to an embodiment of the present invention includes steps S110 to S140.

First, the uttered voice is collected through the input unit 110 of the smart clothing 100 and converted into a voice signal. The input voice is converted into a voice signal through the microphone 111 of the input unit 110.

Next, the audio signal is pre-processed using at least one of the audio processing unit 134 and the noise processing unit 135 (S120).

The pre-processing of the audio signal includes at least one of the following steps.

The voice signal is recognized and filtered using the difference in volume of the voice according to the location of the microphone (S121).

Analyze the waveform of the noise signal included in the voice signal, generate an interfering wave that cancels the analyzed waveform, and feed back the synthesized wave of the noise signal and the interfering wave to correct the interfering wave so that the synthesized wave is canceled ( S122).

6 is an exemplary diagram of an audio signal pre-processing step according to an embodiment of the present invention.

Referring to FIG. 6, a voice including noise input to the microphone 111 is converted into a voice signal and a noise signal while passing through the microphone 111. The audio processing unit 134 recognizes a voice signal other than noise by comparing the output of the front microphone and the output of the rear microphone, for example, by comparing the output of a plurality of microphones at different positions included in the smart clothing 100. And filter it.

The filtered voice signal still contains noise. The noise processing unit 135 generates a primary interference wave capable of first-order interference canceling the noise signal included in the speech signal. Then, the primary interference wave is corrected by separating the noise still included in the output speech signal and adding a secondary interference wave for secondary offset interference to the separated noise to the primary interference wave.

Next, translation and interpretation are performed using a voice signal through a voice recognition process (S130).

Here, the translation and interpretation may be performed through the smart clothing 100 alone or through the user terminal 100 and the translation and translation server 300 communicating through wired or wireless.

Next, the translation and interpretation results are output in at least one form among text and synthesized speech using smart clothing (S140). Here, the smart clothing 100 may control the volume and text size of the voice output through the output unit 120 using the sensing information of the distance sensor.

The translation and interpretation method S100 using smart clothing according to an embodiment described through the drawings may be implemented in the form of a recording medium including a set of instructions executable by a computer, such as a program module executed by a computer. Can. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism, and includes any information delivery media.

As described above, according to an embodiment of the present invention, a translation result may be output through audio and video using smart clothing.

In addition, using a communication function of a wired or wirelessly connected user terminal, the interpretation and translation results can be output through a service of a remote interpretation and translation server.

In addition, the translation result can be output by using smart clothing to automatically adjust the size of the voice and text output according to the distance between the talkers or between the speaker and the audience.

In addition, it is possible to actively remove external noise through smart clothing.

The above description of the present invention is for illustration only, and those skilled in the art to which the present invention pertains can understand that it can be easily modified to other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and it should be interpreted that all changes or modified forms derived from the meaning and scope of the claims and equivalent concepts thereof are included in the scope of the present invention. do.

100: smart clothing 110: input unit
111: microphone 112: keyboard
200: output unit 121: display device
122: speaker 130: PCB
131: control unit 132: power supply unit
133: interpretation and translation unit 134: audio processing unit
135: noise processing unit 140: distance sensor
150: charging unit 200: user terminal
300: interpretation server 400: network
500: computing device

Claims (11)

An input unit that collects voice for conversion from spoken voice to voice signal;
Interpretation and translation system using smart clothing, including smart clothing including an output unit for outputting at least one form of text and synthesized speech, the translated contents of the speech contents recognized using the voice signal. The method according to claim 1,
Interpretation and translation system using smart clothing, characterized in that it further comprises a translator and translator to perform translation and interpretation through a speech recognition process using the voice signal. The method according to claim 2,
The interpretation and translation unit,
Interpretation and translation system using smart clothing, characterized in that it is implemented in the form of a user terminal that performs translation and interpretation for the spoken voice connected to the smart clothing by wire or wirelessly. The method according to claim 1,
The smart clothing,
A distance sensor for a user to recognize a distance away from the talker or the audience; And
Interpretation and translation system using smart clothing, characterized in that it further comprises a control unit for controlling the volume of the voice and the volume of text output through the output unit using the sensing information of the distance sensor. The method according to claim 1,
The smart clothing,
It includes a plurality of microphones of the input unit across the front and rear surfaces,
Interpretation and translation system using smart clothing, characterized in that it further comprises an audio processing unit for recognizing and filtering the voice signal using the volume difference of the voice according to the location of the microphone. The method according to claim 1,
The smart clothing,
Noise that analyzes the waveform of the noise signal included in the voice signal, generates an interfering wave that cancels the analyzed waveform, and corrects the interfering wave so that the synthesized wave is canceled by feedback of the synthesized wave of the noise signal and the interfering wave Interpretation and translation system using smart clothing, characterized in that it further comprises a processing unit. The method according to claim 1,
The smart clothing,
A power supply unit supplying power to the input unit and the output unit; And
Interpretation and translation system using smart clothing, characterized in that it further comprises a charging unit for charging the user terminal using the power supply. The method according to claim 1,
The output unit includes a display device,
The display device,
Located on at least one of the front of the chest and the back of the smart clothing and the back of the back, so that other than the user can see them,
Interpretation and translation system using smart clothing, characterized in that located on the arm portion of the smart clothing for the user to see. Collecting the spoken voice through the input part of the smart clothing and converting it into a voice signal;
Performing translation and interpretation through a voice recognition process using the voice signal; And
And outputting the translation and interpretation results in at least one form among text and synthesized voices using smart clothing. The method according to claim 9,
The step of performing the translation and interpretation,
Interpretation and translation method using smart clothing, characterized in that is performed by a user terminal to communicate with the smart clothing is connected to the wired or wireless. The method according to claim 9,
Recognizing a voice signal using the volume difference of the voice according to the location of the microphone, and filtering it; And
Analyzing the waveform of the noise signal included in the voice signal, generating an interference wave that cancels the analyzed waveform, and receiving the noise signal and the synthesized wave of the interference wave and correcting the interference wave so that the synthesized wave is canceled Interpretation and translation using smart clothing, characterized in that it further comprises at least one step.

Images