KR101906549B1 - A wearable device for hearing impairment person - Google Patents

Abstract

TECHNICAL FIELD The present invention relates to a wearable device for a hearing impaired person, and a technical problem to be solved is to make it easy for anyone with a hearing impairment to easily and comfortably use in everyday life, and to transmit auditory information more clearly to a hearing impaired person.
For example, an eyeglass structure constituting a structure of glasses; And a display unit mounted on the eyeglass structure unit for receiving a voice signal from outside, converting the inputted voice signal into text data, displaying the converted text data through a lens of the eyeglass structural unit, A wearable device for a hearing impaired person comprising a guide part.

Description

TECHNICAL FIELD [0001] The present invention relates to a wearable device for a hearing impaired person,

An embodiment of the invention relates to a wearable device for the hearing impaired.

Hearing impairment refers to a disorder in which the ability to hear sounds is significantly poor or inaudible. People who are suffering from these disorders are called hearing impaired people.

Along with the development of advanced information and communication equipment, ancillary equipment for the hearing impaired is also being studied continuously. Many devices for people with hearing impairments are also being studied. Recently, automatic hydration transmission systems for the hearing impaired, real time text interpretation programs, and hearing aids have been developed.

In the automatic hydration transmission system, when the handwriting, the finger, and the facial motion description are not precisely handled when a handover moving picture is transmitted and received by a general transmission algorithm using a low bandwidth, conversation conversation is difficult. Even if a problem of such a video compression technique is solved, There is a problem that requires considerable power for calculating video compression.

In addition, the real-time text interpreting program takes the form of transmitting the contents announced at various venues such as conferences, performances and lectures to the mobile phone of the hearing-impaired person while receiving the text interpreter while accessing the platform. This approach has the disadvantage that it is impossible to provide services for individuals with deafness in daily life because of the need for manpower.

In addition, the hearing aid has disadvantages in that it can cause discomfort due to the wearing structure of the hearing aid, limits on the sound control of various environments, and low sound discrimination ability although it sounds.

Open Patent Publication No. 10-2014-0066258 (May 2015.05) "Modification of video display based on sensor input for perspective near sight display" Registered Patent Publication No. 10-0782103 (November 28, 2007) [Patent Document 1] Published Japanese Patent Application No. 10-2015-0055262 (May 2015.05.1) 'Visualization of sound using a mobile device' Patent Document No. 10-2014-0116517 (Apr. 20, 2014) 'Wearable device with input and output structures'

An embodiment of the present invention provides a wearable device for a hearing-impaired person who can easily and comfortably use hearing-impaired persons in daily life, and can more clearly convey auditory information to a hearing-impaired person.

A wearable device for a hearing impaired person according to an exemplary embodiment of the present invention includes: And a display unit mounted on the eyeglass structure unit for receiving a voice signal from outside, converting the inputted voice signal into text data, displaying the converted text data through a lens of the eyeglass structural unit, And a guide portion.

The auditory information guide unit may include: a first microphone unit for receiving a voice signal from outside; A voice-to-text conversion unit for converting the voice data input through the first microphone unit into text data; And a projector unit for projecting the beam so that the text data converted by the voice-to-text conversion unit is displayed through the lens of the eyeglass structure unit.

The voice-to-text conversion unit may include a translation setting unit for setting a language for the voice and a language for the text, respectively; And a translation execution unit for executing translation according to the language setting of the translation setting unit.

In addition, the first microphone unit may include a directional microphone.

The apparatus may further include a wearable terminal that is wearable to the body, receives a voice signal from the outside, and transmits the voice signal to the auditory information guide unit.

The wearable terminal may further include: a second microphone for receiving a voice signal from outside; And a voice data transmitting unit for transmitting the voice data input through the second microphone unit to the auditory information guide unit in real time, wherein the audible information guide unit comprises a voice data receiving unit for receiving voice data from the wearable terminal in real time .

The voice data transmitting unit may include a wireless communication unit for transmitting voice data using short-range wireless communication.

The voice data transmission unit may include a data port for transmitting voice data through a data cable.

Also, the wearable terminal may be in the form of at least one of a ring, a bracelet, and a watch.

According to the embodiment of the present invention, it is possible to provide a wearable apparatus for a hearing-impaired person who can easily and comfortably use hearing-impaired persons in daily life, and can more clearly transmit auditory information to hearing-impaired persons.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram showing the overall configuration of a wearable device for a hearing impaired person according to an embodiment of the present invention; FIG.
2 is a diagram illustrating a configuration in which a wearable terminal for voice collection is added to a wearable device according to an embodiment of the present invention.
3 is a block diagram showing the overall configuration of a wearable apparatus according to an embodiment of the present invention.
4 is a perspective view of a first wearable terminal according to an embodiment of the present invention.
5 is an exploded perspective view of a first wearable terminal according to an embodiment of the present invention.
6 and 7 are perspective views of a second wearable terminal according to the present invention.

The terms used in this specification will be briefly described and the present invention will be described in detail.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

When an element is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements as well, without departing from the spirit or scope of the present invention. Also, the terms "part," " module, "and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

FIG. 1 is a diagram illustrating the overall configuration of a wearable device for a hearing impaired person according to an embodiment of the present invention. FIG. 2 is a diagram illustrating a configuration in which a wearable terminal for voice acquisition is added to a wearable device according to an embodiment of the present invention. FIG. 4 is a perspective view of a first wearable terminal according to an embodiment of the present invention, and FIG. 5 is a perspective view of a wearable device according to an embodiment of the present invention FIGS. 6 and 7 are perspective views of a second wearable terminal according to a first embodiment of the present invention. FIG.

1 to 7, a wearable device 1000 for a hearing impaired person according to an embodiment of the present invention may include a first wearable terminal 1100 and a second wearable terminal 1200, The second wearable terminal 1200 may be omitted according to circumstances. However, in the present embodiment, the configuration for the wearable device 1000 for the hearing impaired will be described in the form including the second wearable terminal 1200. [

The first wearable terminal 1100 includes an eyeglass structural part 1110 and an auditory information guidance part 1120.

The eyeglass structure 1110 may have a general eyeglass structure including a rim 1110a, a lens 1110b, a bridge 1110c, a nose pad 1110d, a temple 1110e, and a tip 1110f, The first microphone portion 1121 is exposed to the end piece of the rim 1110a.

The audiovisual information guide unit 1120 is mounted on the eyeglass structure unit 1110 and receives a voice signal from the outside, converts the inputted voice signal into text data, and transmits the converted text data through the lens of the eyeglass structural unit And can provide a text guide service.

To this end, the auditory information guide unit 1120 is installed in the eyeglass structure unit 1110 and includes the first microphone unit 1121, the voice-to-text conversion unit 1122, the projector unit 1123, and the voice data receiving unit 1124 ). The voice data receiving unit 1124 may be omitted when the second wearable terminal 1200 is omitted in the second configuration of the second wearable terminal 1200. However, since the present embodiment is described as including the second wearable terminal 1200, the voice data receiver 1124 is also described as being included in the first wearable terminal 1100 do.

The first microphone portion 1121 may be formed on the protrusion portion of the eyeglass structure portion 1110 and may be installed on the end piece portion of the rim 1110a, for example.

The first microphone unit 1121 may include a directional microphone as a means for directly receiving a voice signal from the outside and converting it into an electrical signal, that is, voice data. Accordingly, the first microphone unit 1121 can selectively record sound of a narrow angle heard in a specific direction, thereby minimizing the input of only a desired voice from the wearer and inputting noises such as various voices have.

The voice-to-text conversion unit 1122 may convert the voice data generated through the first microphone unit 1121 into corresponding text data. Various known methods can be used as a method of determining the text corresponding to the predetermined voice data.

For example, a model of thousands of sub-words taking into account the transformation processing context can be used. That is, after extracting necessary feature vectors from predetermined speech data, it is possible to extract text corresponding to speech data by comparing the feature vectors with data of previously stored databases. Here, the speech feature vector contains phonetic information, which may correspond to statistical data that is not sensitive to background noise, speaker differences, or pronunciation attitude.

In order to extract speech feature vectors, various methods can be applied. For example, LPC (Linear Predictive Coding) extraction method in which speech data is analyzed with weighting equally in all frequency bands, MFCC (Mel Frequency Cepstral Coefficients) extraction method which reflects the characteristic of following Mel Scale similar to log scale, high frequency emphasis extraction method which emphasizes high frequency component to distinguish voice and noise clearly, disconnection which occurs when voice is divided into short sections And a window function extraction method that minimizes the distortion caused by the window function.

The speech-to-text conversion unit 1122 compares the extracted speech feature vector with phonetic information of a previously constructed speech database to obtain recognition results. The speech-text conversion unit 1122 extracts text by word-based search or sentence-based search can do.

The voice-to-text conversion unit 1122 may extract text corresponding to the voice data in various manners.

The voice-to-text conversion unit 1122 may further include a function module including a translation setting unit 1122a and a translation execution unit 1122b for providing a language translation service, as well as voice-to-text conversion .

The translation setting unit 1122a can set a language for voice and a language for text, respectively. That is, the translation setting unit 1122a is a means for setting a translation mode between the language of the speech and the language of the text. The translation setting unit 1122a sets the language of the speech to be inputted through the first microphone unit 1121 (for example, (For example, Korean, English, Japanese, Chinese, German, French, etc.) to be finally outputted through the projector unit 1123 can be set. Accordingly, the translation setting unit 1122a sets the language of the voice to be recognized through the voice-to-text conversion unit 1122 so that the voice-to-text conversion unit 1122 converts the voice- To perform the function.

The translation executing section 1122b can perform machine translation according to the language translation mode setting of the translation setting section 1122b. Accordingly, the translation executing unit 1122b can perform the function of translating the language of the text converted through the voice-to-text converting unit 1122 into a predetermined language. For example, when the language of the voice is set to English through the translation setting unit 1122a and the language of the text is set to Korean, the voice-to-text conversion unit 1122 converts After performing the recognition, conversion, and conversion processes, text information in Korean can be provided to the wearer through the projector unit 1123. [

The projector unit 1123 can project the beam so that the text data converted through the voice-to-text conversion unit 1122 is displayed through the lens 1110b of the eyeglass structure unit 1110. [ As described above, various known methods can be used as the project technique for projecting the light so that predetermined information is displayed on the lens 1110b of the eyeglasses. Here, the lens 1110b may perform a display function for displaying text.

The voice data receiving unit 1124 can receive voice data from the second wearable terminal 1200. At this time, the voice data receiving unit 1124 receives the voice data through the voice-to-text conversion unit 1122, converts and converts the voice data, and transmits the voice data to the wearer through the projector unit 1123, Lt; / RTI > The voice data receiver 1124 receives voice data from the second wearable terminal 1200 using short-range wireless communication such as Wi-Fi, Bluetooth, Zigbee, or Beacon It can receive or communicate in real time.

When the voice data receiving unit 1124 is activated, it is preferable to avoid the situation where the first microphone unit 1121 is inactivated so that the voice data is multiplexed and converted. Accordingly, it is preferable that the first microphone unit 1121 and the voice data receiving unit 1124 are provided with separate selection control means for selectively activating the first microphone unit 1121 and the voice data receiving unit 1124, Do.

The voice-to-text conversion unit 1122, the projector unit 1123, and the voice data reception unit 1124 may be manufactured as a small module formed on one substrate and mounted in the eyeglass structure unit 1110.

The second wearable terminal 1200 can be made wearable to the body. For example, the second wearable terminal 1200 may be formed in the form of a ring, a bracelet, and a watch. Hereinafter, the second wearable terminal 1200 will be described as an example in the form of a ring.

The second wearable terminal 1200 may be connected to the auditory information guide unit 1120 and may directly receive a voice signal from the outside and transmit the voice signal to the first wearable terminal 1100.

The second wearable terminal 1200 may include a second microphone unit 1210, a voice data transmission unit 1220, and a power switch unit 1230.

The second microphone unit 1210 may include a directional microphone as a means for directly receiving a voice signal from outside and converting it into an electrical signal, that is, voice data. Accordingly, the second microphone unit 1210 can selectively record only the sound of a narrow angle heard in a specific direction, thereby minimizing the input of a desired voice from the wearer and inputting noises such as various voices have.

The voice data transmission unit 1220 may transmit the voice data input through the second microphone unit 1210 to the first wearable terminal 1100. More specifically, the voice data transmitting unit 1220 transmits the voice data input through the second microphone unit 1210 to the voice data receiving unit 1124 of the first wearable terminal 1100, To the guide unit 1120. At this time, the auditory information guide unit 1120 converts the voice data received from the second wearable terminal 1200 into the corresponding text data through the voice-to-text conversion unit 1122, 1123 to display the corresponding information.

The voice data transmitting unit 1220 may connect the first wearable terminal 1100 with the voice data in a wired or wireless manner.

For this, the voice data transmission unit 1220 may include a wireless communication unit 1220a and a data port 1220b.

The wireless communication unit 1220a may transmit voice data or other data to the first wearable terminal 1100 using short-range wireless communication such as Wi-Fi, Bluetooth, Zigbee or Beacon, And may receive predetermined data or information from the first wearable terminal 1100 as needed.

 The data port 1220b may be connected to the first wearable terminal 1100 through a data cable (not shown) to transmit voice data or other electrical signals. If necessary, the first wearable terminal 1100 And may receive predetermined data or information.

The power switch unit 1230 may turn on / off the power of the second wearable terminal 1200. For example, when the second wearable terminal 1200 is turned on via the power switch unit 1230, the first microphone unit 1121 of the first wearable terminal 1100 is inactivated, The voice data input through the second microphone unit 1210 of the wearable terminal 1200 can be transmitted to the first wearable terminal 1100 through the voice data transfer unit 1220. [

In addition, when the second wearable terminal 1200 is turned off through the power switch unit 1230, the voice recognition process described above can be performed through the first wearable terminal 1100. [

According to the embodiment of the present invention, the wearable device is basically constructed of a wearable device having a glasses structure. By converting the words of another person into text in real time and displaying them immediately in front of the user's eyes, the hearing-impaired person can easily and comfortably use it in daily life.

In addition, when the wearable device of the eyeglass structure is not easy to input the sound source, it is possible to easily input the sound source by using another wearable device in the form of a ring, a watch or a bracelet, Can be minimized.

In addition, the voice information can be translated and displayed in real time in the language desired by the user, so that it can be utilized variously for the simultaneous interpretation of not only the hearing-impaired person but also the general person lacking the foreign language ability.

As described above, the present invention is not limited to the above-described embodiment, but can be applied to a case where the present invention It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

1000: Wearable device 1100: First wearable terminal
1110: eyeglass structure section 1120: auditory information guide section
1121: first microphone unit 1122: voice-text conversion unit
1122a: translation setting unit 1122b: translation execution unit
1123: Projector unit 1124: Audio data receiver
1200: second wearable terminal 1210: second microphone unit
1220: voice data transmission unit 1220a: wireless communication unit
1220b: Data port 1230: Power switch unit

Claims (1)

An eyeglass structure constituting the structure of glasses; And
An eyeglass structure unit for receiving a voice signal from outside, converting the input voice signal into text data, displaying the converted text data through a lens of the eyeglass structure unit, A wearable device for the hearing impaired,
The hearing information guide unit,
A first microphone unit installed to be exposed to the rim and piece of the eyeglass structure unit and configured to receive a voice signal from the outside, the microphone unit being a directional microphone;
(LPC) extraction method, Mel Frequency Cepstral Coefficients (MFCC) extraction method, high-frequency emphasis extraction method, and the like. And extracting a text corresponding to the voice data by a word unit search or a sentence unit search by comparing with the data of a previously stored database after using any one of the window function extraction method and the window function extraction method) And
And a projector unit for projecting the beam so that the text data converted by the voice-to-text conversion unit is displayed through the lens of the eyeglass structure unit,
The speech-to-text conversion unit
A translation setting unit for setting a country for a language to be input through the first microphone unit and a language for a text to be finally output through the projector unit in order to set a translation mode between a language for speech and a language for text, ; And
Further comprising a translation execution unit for executing translation according to the language setting of the country of the translation setting unit,
The wearable device for the hearing impaired person
Further comprising a wearable terminal which is adapted to be worn on the hand and receives a voice signal from the outside and transmits the voice signal to the auditory information guide unit,
In the wearable terminal,
A second microphone unit having a directional microphone for receiving a voice signal from outside and selectively receiving only a sound heard in a specific direction;
A voice data transmitting unit for transmitting the voice data input through the second microphone unit to the auditory information guide unit in real time; And
And a power switch unit for turning on / off the power of the wearable terminal,
The hearing information guide unit further includes a voice data receiving unit for receiving voice data from the wearable terminal in real time,
Wherein when the wearable terminal is turned on through the power switch unit, the first microphone unit is deactivated and the voice data receiving unit and the second microphone unit are activated, and when the wearable terminal is turned off through the power switch unit, The first microphone unit is activated and the voice data receiving unit and the second microphone unit are deactivated so that voice data is multiplexed and input through the first microphone unit and the second microphone unit, The microphone unit is not activated at the same time, but is selectively activated,
Wherein the eyeglass structure comprises a rim, a lens, a bridge, a nose pad, a temple and a tip,
The projector unit projects a beam toward the lens so that the text data, which is positioned between the bridge and the nose pad and converted through the voice-to-text conversion unit, is displayed on the lens,
The wearable terminal is implemented in a ring form,
Wherein the voice data transmitting unit includes a wireless communication unit for transmitting voice data using short-range wireless communication,
Wherein the voice data transmission unit includes a data port for transmitting voice data through a data cable,
When the voice data receiving unit is activated, the first microphone unit is deactivated so that voice data is input in multiple and not converted,
Wherein the voice-to-text conversion unit, the projector unit, and the audio data receiving unit are manufactured as a small module formed on one substrate and mounted in the eyeglass structure unit.

Images