KR20220139125A - Hearing loop device with various functions - Google Patents

Abstract

The present invention relates to a hearing loop device having various functions. The hearing loop device according to one embodiment of the present invention comprises: an audio terminal for which a sound signal is inputted from another device; a signal conversion part that converts the sound signal into a hearing loop so that a magnetic field signal for the inputted sound signal is outputted from a loop coil; a text conversion part that converts sound information according to the inputted sound signal into the text information; and a display part that displays a text according to the converted text information. Therefore, the present invention is capable of having an advantage of improving an understanding and concentration of a user.

Description

Hearing loop device with various functions {HEARING LOOP DEVICE WITH VARIOUS FUNCTIONS}

The present invention relates to a hearing loop device, and more particularly, to a hearing aid having various functions, such as converting acoustic signals provided from various sources into magnetic fields and providing them to hearing aids, as well as providing captions for acoustic signals to a user at the same time. It relates to the loop device.

Hearing aids (eg, hearing aids, cochlear implants, etc.) used for people with hearing loss collect external sound collected through a microphone and deliver it through a speaker. However, in public places with large background noise, such as lecture halls, movie theaters, terminals, and churches, the hearing-impaired can hear the desired sound even when wearing hearing aids due to ambient noise and noise (hereinafter referred to as “background noise”). may not be able to hear properly.

Accordingly, in recent years, a hearing loop system has been installed in various public places. In this case, the hearing loop system refers to a system that allows a user of a hearing aid to hear a desired sound without disturbing background noise by using a telecoil included in the hearing aid.

For example, the hearing loop system converts the speaker's sound into a magnetic field signal and radiates it through a loop coil installed around the floor or ceiling of a specific space. As a result, the hearing aid may induce the corresponding magnetic field signal to the embedded telecoil, convert it into sound, and give it to the listener. At this time, the hearing aid may be in a state switched to a telecoil mode (also referred to as a “T mode”).

On the other hand, the hearing loop system has been mainly used as a fixed type installed in a specific place, and recently, hearing aid wearers (hereinafter referred to as “users”) have been developed for dog use. However, since the conventional hearing loop system only has a general function of converting an acoustic signal into a magnetic field signal and providing it as a hearing aid, there is a problem in that a user's understanding and concentration using the same is lowered.

US 10-0714233 B

In order to solve the problems of the prior art as described above, the present invention provides various functions such as converting acoustic signals provided from various sources into magnetic signals and providing them to hearing aids as well as providing captions for the corresponding acoustic signals to the user at the same time. An object of the present invention is to provide a hearing loop device having a

However, the problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. There will be.

A hearing loop device according to an embodiment of the present invention for solving the above problems, an audio terminal to which a sound signal is input from another device; a signal converter for converting the sound signal into a hearing loop so that a magnetic field signal for the input sound signal is output from the loop coil; a text conversion unit for converting sound information according to the input sound signal into text information; and a display unit for displaying text according to the converted text information.

The other device may be an audio processing device, a video processing device, or a multimedia processing device.

The hearing loop device according to an embodiment of the present invention may further include a microphone for converting ambient sound into an acoustic signal.

The signal conversion unit may perform the hearing loop conversion also on the sound signal of the microphone, and the text conversion unit may convert the sound signal of the microphone into the test information.

The signal conversion unit may perform the hearing loop conversion when the sound signal of the microphone is equal to or higher than a certain level, and the text conversion unit may perform the conversion into the test information when the sound signal of the microphone is equal to or higher than a certain level.

The display unit may display the text for the sound signal of the audio terminal and the text for the sound signal of the microphone separately.

The hearing loop device according to an embodiment of the present invention analyzes the sound signal of the microphone to recognize a voice command and perform an operation according to the recognized voice command, but an artificial intelligence (AI) that generates a sound signal related to the performance of the operation. artificial intelligence (AI) modules may be further included.

The signal conversion unit may perform the hearing loop conversion also on the sound signal of the AI module, and the text conversion unit may convert the sound signal of the AI module into the test information.

The operation may include an operation of processing stored content in the Al module related to the recognized voice command, or an operation of downloading and processing the content by accessing an external server that provides content related to the recognized voice command.

The processing may include outputting a sound signal of audio content, video content, or multimedia content, or a sound signal obtained by converting corresponding text information into sound information for text content.

When receiving event information from an IoT (Internet of Things) sensor or IoT device installed in the surrounding environment of the hearing loop device, the AI module may generate an acoustic signal informing of the received event information.

The hearing loop device according to an embodiment of the present invention may further include a speaker for outputting a sound in response to the sound signal.

The present invention configured as described above converts acoustic information provided from various sources into a magnetic field signal and provides it as a hearing aid, as well as providing a user with a caption for the corresponding acoustic information at the same time, thereby providing cultural contents experience, There is an advantage that can improve the understanding and concentration of the user during learning and education.

In addition, the present invention is based on the sound signal of the audio terminal to the user of the hearing aid who is being provided with a hearing loop function for services such as cultural content experience, learning and education, the sound signal input into the microphone while the service is provided. Also, a hearing loop function and a subtitle function can be provided together.

As a result, the present invention has the advantage that the user of the hearing aid who is provided with services such as cultural content experience, learning and education can recognize the situation such as the voice of the person next to him, cautions and warnings that may occur in the surroundings even while using the service. have.

In addition, the present invention can additionally provide various functions such as an AI speaker function, a surrounding environment control function, or a surrounding environment monitoring function in addition to the subtitle function, so that users of hearing aids can smoothly access rapidly changing information without discrimination. It has the advantage of being able to provide opportunities.

However, the effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be able

1 shows a schematic block diagram of a hearing loop device 100 according to an embodiment of the present invention.
2 shows an example of the appearance of the hearing loop device 100 according to an embodiment of the present invention.
3 shows an example of the arrangement of each component in the main body 101 in FIG. 2 .
FIG. 4 shows an operation process when a sound signal is input to the audio terminal 110 in FIG. 3 .
FIG. 5 shows an operation process when a general sound, not a voice command, is inputted to the microphone 120 in FIG. 3 .
FIG. 6 shows an operation process when a voice command related to text content is input to the microphone 120 in FIG. 3 .
FIG. 7 shows an operation process when a voice command related to music content is input to the microphone 120 in FIG. 3 .
FIG. 8 shows an operation process when a control command is input to the microphone 120 in FIG. 3 .
9 shows an operation process when event information is received from the AI module 170 in FIG. 3 .

The above object and means of the present invention and its effects will become more apparent through the following detailed description in relation to the accompanying drawings, and accordingly, those of ordinary skill in the art to which the present invention pertains can easily understand the technical idea of the present invention. will be able to carry out In addition, in describing the present invention, if it is determined that a detailed description of a known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

The terminology used herein is for the purpose of describing the embodiments, and is not intended to limit the present invention. In this specification, the singular form also includes the plural form as the case may be, unless otherwise specified in the text. In this specification, terms such as “include”, “provide”, “provide” or “have” do not exclude the presence or addition of one or more other components other than the mentioned components.

In this specification, terms such as “or” and “at least one” may indicate one of the words listed together, or a combination of two or more. For example, “A or B” and “at least one of A and B” may include only one of A or B, or both A and B.

In this specification, descriptions according to “for example”, etc. may not exactly match the information presented, such as recited properties, variables, or values, tolerances, measurement errors, limits of measurement accuracy, and other commonly known factors. The embodiments of the invention according to various embodiments of the present invention should not be limited to effects such as modifications, including

In this specification, when a component is described as being 'connected' or 'connected' to another component, it may be directly connected or connected to the other component, but other components may exist in between. It should be understood that there is On the other hand, when it is mentioned that a certain element is 'directly connected' or 'directly connected' to another element, it should be understood that there is no other element in the middle.

In this specification, when a component is described as being 'on' or 'adjacent' to another component, it may be directly in contact with or connected to the other component, but another component may exist in the middle. It should be understood that On the other hand, when it is described that a certain element is 'directly above' or 'directly' of another element, it may be understood that another element does not exist in the middle. Other expressions describing the relationship between the elements, for example, 'between' and 'directly between', etc. can also be interpreted similarly.

In this specification, terms such as 'first' and 'second' may be used to describe various components, but the components should not be limited by the above terms. In addition, the above terms should not be construed as limiting the order of each component, and may be used for the purpose of distinguishing one component from another. For example, a 'first component' may be referred to as a 'second component', and similarly, a 'second component' may also be referred to as a 'first component'.

Unless otherwise defined, all terms used herein may be used with meanings commonly understood by those of ordinary skill in the art to which the present invention pertains. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless clearly specifically defined.

Hereinafter, a preferred embodiment according to the present invention will be described in detail with reference to the accompanying drawings.

1 shows a schematic block diagram of a hearing loop device 100 according to an embodiment of the present invention.

The hearing loop device 100 according to an embodiment of the present invention may be a personal terminal that provides various functions to a user by providing not only a basic hearing loop function but also other additional functions.

That is, in the case of general hearing aids (eg, hearing aids, cochlear implants, etc.), all sounds heard in the vicinity of the user (eg, people with hearing loss, hearing impaired, etc.) are greatly amplified and transmitted. Accordingly, it is difficult for the user to concentrate on the desired sound, and furthermore, since the sound is transmitted through the speaker rather than the voice, the clarity of the sound is deteriorated. To solve this problem, a hearing loop function is provided.

That is, the hearing loop function refers to a function that allows the user of the hearing aid to hear a desired sound without interference from background noise by using a telecoil included in the hearing aid.

Specifically, the hearing loop function is a function of converting sound signals provided from various sound source units into magnetic field signals and radiating them through the loop coil 160 . As a result, the hearing aid may introduce the radiated magnetic field signal to the embedded telecoil and convert it into sound, so that the listener of the hearing aid can hear the converted sound. At this time, the hearing aid may be in a state switched to a telecoil mode (also referred to as a “T mode”).

In this case, the acoustic signal refers to an electrical signal for sound. That is, the acoustic signal is a sound converted into an electrical signal. Accordingly, when a speaker or the like is used, the sound signal is converted back into sound and output, so that the human ear can hear it.

Meanwhile, the additional function may include a caption function, an artificial intelligence (AI) speaker function, a surrounding environment control function, or a surrounding environment monitoring function. However, detailed descriptions of these additional functions will be provided later.

Referring to FIG. 1 , a hearing loop device 100 according to an embodiment of the present invention includes an audio terminal 110 , a microphone 120 , a signal conversion unit 130 , a loop coil 140 , and a text conversion unit 150 . ), a display unit 160 , an AI module 170 , and a speaker 180 . At this time, at least one of the audio terminal 110 and the microphone 120 , the signal conversion unit 130 and the loop coil 140 may correspond to essential components. In addition, the text conversion unit 150 , the display unit 160 , and the AI module 170 may correspond to configurations necessary for additional functions.

2 shows an example of the appearance of the hearing loop device 100 according to an embodiment of the present invention, and FIG. 3 shows an example of the arrangement of each component in the body 101 in FIG. 2 .

Referring to FIG. 2 , the hearing loop device 100 according to an embodiment of the present invention may be configured in the form of a desk to enable a more convenient cultural content experience, learning, and education for the user. That is, the desk shape includes a plate-shaped body 101 having a user space 102 on the upper part for writing or placing books/learning devices, etc. to the user, and a support part 103 for supporting the main body 101 from the lower part. include each.

In particular, referring to FIG. 3 , an audio terminal 110 , a microphone 120 , a signal conversion unit 130 , a loop coil 140 , a text conversion unit 150 , a display unit 160 , and an AI module 170 ) The silver may be variously disposed in the body 101 .

The audio terminal 110 is one of the sound source units, and is an audio input terminal to which a sound signal is input from another device. For example, the other device may be an audio processing device, a video processing device, or a multimedia processing device, but is not limited thereto. The sound signal input to the audio terminal 110 is transmitted to the signal conversion unit 130 , and may also be transmitted to the text conversion unit 150 and the speaker 180 , respectively. For example, the audio terminal 110 may be a phone plug terminal, an RCA terminal, or the like, but is not limited thereto.

The microphone 120 is one of the sound source units, and converts ambient sound into an acoustic signal. That is, the microphone 120 includes a device that converts mechanical vibration of sound into an electrical signal (ie, an acoustic signal). The sound signal converted by the microphone 120 is transmitted to the signal processing unit 130 and the AI module 170, respectively, and may also be transmitted to the text conversion unit 150 and the speaker 180, respectively. For example, the microphone 120 may be a dynamic microphone or a condenser microphone, but is not limited thereto.

The signal conversion unit 130 converts (hereinafter, ""the referred to as “hearing loop transformation”). That is, the signal conversion unit 130 may perform signal processing such as signal amplification and frequency conversion for converting an acoustic signal into a magnetic field signal, and provide the converted signal to the loop coil 140 .

The loop coil 140 radiates the signal converted by the signal conversion unit 130 into a magnetic field signal. That is, the loop coil 140 may act as a transmitting antenna of the magnetic field signal. As described above, the magnetic field signal radiated from the loop coil 140 is converted into sound while being induced in the telecoil included in the hearing aid, and accordingly, the listener of the hearing aid can hear the original sound of the corresponding magnetic field signal. For example, the loop coil 140 may be wired in a loop shape along the circumferential direction within the body 101 including a copper wire, but is not limited thereto.

The text conversion unit 150 converts sound information according to the input sound signal into text information. That is, the text conversion unit 130 may output a signal obtained by converting the sound information of the sound signal into text information by using various algorithms or machine learning models that perform speech-to-text (STT) from the sound signal. . The converted text information signal may be provided to the display unit 160 .

The display unit 160 performs a caption function by displaying text (subtitles) according to the converted text information signal provided from the text conversion unit 150 on the screen. That is, the caption function is a function of providing a caption (text) for the sound signal to the user through the display unit 150 . In this case, the display unit 160 displays data of various image signals, such as text information signals, on a screen, and may be configured as a non-emission type panel or a light emission type panel. For example, the display unit 160 may include a liquid crystal display (LCD) panel, a light emitting diode (LED) display panel, an organic light emitting diode (OLED) display panel, a microelectromechanical system ( It may include a micro electro mechanical systems (MEMS) display panel, an electronic paper display panel, or the like, but is not limited thereto.

AI (artificial intelligence) module 170 analyzes the sound signal transmitted from the microphone 120 to recognize a voice command and interact with the user to perform an operation according to the recognized voice command, thereby performing an AI speaker function to be. For example, an artificial intelligence (AI) module may be implemented as a product provided as a control module of an AI speaker, but is not limited thereto.

In particular, the AI module 170, as one of the sound source units, generates a sound signal related to performing an operation according to a recognized voice command. In this case, the generated sound signal is transmitted to the signal conversion unit 130 , and may also be transmitted to the text conversion unit 150 and the speaker 180 , respectively.

The operation performed by the AI module 170 may be an operation of processing content related to a recognized voice command among various contents stored in the Al module 170 . However, when the content related to the recognized voice command is not stored in the AI module 170 , the AI module 170 may access an external server that provides the related content. In this case, the AI module 170 may download the relevant content from an external server and process the relevant content.

For example, content pre-stored in the AI module 170 or downloaded from an external server includes text content (news information content, information search result content, etc.), audio content (music content, voice content, etc.), video content, or It may be multimedia content, and the like, but is not limited thereto.

For example, when the content related to the recognized voice command is text content, the AI module 170 replaces text information with sound information for the text content pre-stored in itself or downloaded from an external server (Text-to-Speech) ; TTS) may perform an operation of generating a sound signal and transmitting it to the signal converting unit 130 , the text converting unit 150 and the speaker 180 . In this case, the generated TTS sound signal corresponds to the sound signal related to the operation.

In addition, when the content related to the recognized voice command is audio content, video content, or multimedia content, the AI module 170 plays the corresponding audio content, video content or multimedia content pre-stored in itself or downloaded from an external server action can be performed. Of course, the AI module 170 performs an operation of outputting a sound signal generated during reproduction of the corresponding content to the signal conversion unit 130 in addition to performing the operation of playing the corresponding audio content, video content or multimedia content. can In this case, the sound signal generated according to the reproduction of the corresponding content corresponds to the sound signal related to the operation.

Meanwhile, the AI module 170 may transmit a control command to an Internet of Things (IoT) sensor or IoT device installed in the surrounding environment of the hearing loop device 100 , or may receive event information from the IoT sensor or IoT device.

In this case, the IoT sensor is a sensor that transmits a sensor value through IoT communication. For example, the IoT sensor may be a temperature sensor, a humidity sensor, a light sensor, a pressure sensor, a vibration sensor, a noise sensor, a gas sensor, a chemical sensor, a current sensor, or a magnetic sensor, but is not limited thereto. In addition, the IoT device may be various home appliances whose operation is controlled through IoT communication or that transmits internal/external state information.

That is, the control command is a command issued by the IoT sensor or IoT device to perform a given specific operation. In addition, the event information may include a sensor value of an IoT sensor or IoT device, state information (eg, current state information, changed state information, etc.), or notification information about reaching a preset threshold or more.

That is, the AI module 170 recognizes a control command from the sound signal of the microphone 120 , and transmits an operation command according to the recognized control command to the corresponding IoT sensor or IoT device, and then performs the corresponding operation from the IoT sensor or IoT device By receiving the result, it performs a surrounding environment control function. In this case, the AI module 170 generates an acoustic signal related to the execution of the control command. The generated sound signal is transmitted to the signal conversion unit 130 , and in addition, it may be transmitted to the text conversion unit 150 and the speaker 180 , respectively.

Meanwhile, the AI module 170 may receive event information from an IoT sensor or IoT device, and in this case, by generating an acoustic signal informing of the received event information, it performs a surrounding environment monitoring function. The sound signal of the event information notification is transmitted to the signal conversion unit 130 , and may also be transmitted to the text conversion unit 150 and the speaker 180 , respectively.

As the AI module 170 generates an acoustic signal (that is, an acoustic signal related to performing an operation related to a recognized voice command, an acoustic signal related to performing an operation related to a recognized control command, or an acoustic signal of an event information notification), the signal The conversion unit 130, the text conversion unit 150, and the speaker 180 perform each unique function for the sound signal generated by the AI module 170 in addition to the sound signal of the audio terminal 110 or the microphone 120. can do.

At this time, the unique function of the signal conversion unit 130 is the function described above in relation to the signal conversion unit 130 , and means performing a hearing loop conversion on the transmitted sound signal. In addition, the intrinsic function of the text conversion unit 150 is the function described above in relation to the text conversion unit 150 , and refers to conversion of a transmitted sound signal into a test information signal, and the like. In addition, the intrinsic function of the speaker 180 means a function to be described later in relation to the speaker 180 .

That is, the signal conversion unit 130 not only performs the hearing loop conversion on the sound signal of the audio terminal 110 or the microphone 120 , but also performs the hearing loop conversion on the sound signal generated by the AI module 170 . can do. In addition, the text conversion unit 150 converts the audio signal of the audio terminal 110 or the microphone 120 into test information, as well as converts the audio signal generated by the AI module 170 into test information. conversion can be performed. In addition, the speaker 180 may output a sound with respect to the sound signal of the audio terminal 110 or the microphone 120 as well as the sound signal generated by the AI module 170 .

On the other hand, the signal conversion unit 130, the text conversion unit 150, and the AI module 170 each have a different configuration and a port for transmitting and receiving signals, a memory storing necessary information, and for controlling each unique function. It may include a control unit.

The memory stores various types of information necessary for the operation of its own control unit. For example, the memory may include a flash memory type, a read only memory type, a random access memory type, etc. depending on the type, depending on its purpose/location. It may be a cache, a buffer, a main memory, or an auxiliary memory, depending on the circumstances, but is not limited thereto.

Also, the controller may perform a control operation for a unique function based on information stored in its own memory. For example, the control unit may include, but is not limited to, a processor that is hardware or a process that is software that is executed in a corresponding processor.

In particular, since the AI module 170 needs to communicate with an external server, an IoT sensor, or an IoT device, it may further include a communication unit for performing the communication. In this case, the operation of the communication unit may be controlled by the control unit of the AI module 170 . For example, the communication unit 5G (5th generation communication), LTE-A (long term evolution-advanced), LTE (long term evolution), Bluetooth (bluetooth), BLE (bluetooth low energe), NFC (near field communication), Wireless communication such as Wi-Fi communication and IoT communication may be performed, or wired communication such as cable communication may be performed, but is not limited thereto.

The speaker 180 outputs a sound corresponding to the sound signal transmitted from the sound source unit. That is, the speaker 180 may include a vibration element that converts an electrical signal of an acoustic signal into mechanical vibration. However, the speaker 180 may be implemented to be turned on/off according to a user selection through a switch.

At least one of the audio terminal 110 , the microphone 120 , and the AI module 170 operates as a sound source unit that provides a sound signal to the signal conversion unit 130 , the text conversion unit 150 , and the speaker 180 . In particular, the AI module 170 performs an AI speaker function, a surrounding environment control function, or a surrounding environment monitoring function as described above while performing an acoustic signal (ie, an acoustic signal related to performing an operation related to a recognized voice command, recognized control). An acoustic signal related to performing an operation related to a command or an acoustic signal of an event information notification) may be generated.

At this time, the signal conversion unit 130 and the loop coil 140 perform a hearing loop function based on the sound signal provided from the sound source unit as described above, and the text conversion unit 150 and the display unit 160 are described above. As described above, a caption function is performed for the sound signal provided from the sound source unit.

Hereinafter, an operation process of the hearing loop device 100 according to the sound signal of each sound source unit will be described.

FIG. 4 shows an operation process when a sound signal is input to the audio terminal 110 in FIG. 3 .

Referring to FIG. 4 , a sound signal of “hello” is input to the audio terminal 110 . Accordingly, the sound signal of “hello” is transmitted to the signal conversion unit 130 , the text conversion unit 150 , and the speaker 180 , respectively.

At this time, the signal conversion unit 130 processes the sound signal so that the sound signal of “hello” is converted into a magnetic field signal and radiated through the loop coil 140 . In addition, the text conversion unit 150 provides a signal obtained by converting the sound information of the sound signal of “Hello” into text information to the display unit 160, so that the text of “Hello” is displayed on the display unit 160 . . In addition, the speaker 180 outputs a sound signal of “hello” as a sound when the speaker 180 is in an on state according to a user's selection.

FIG. 5 shows an operation process when a general sound, not a voice command, is inputted to the microphone 120 in FIG. 3 .

Referring to FIG. 5 , a sound of “Goodbye” is input to the microphone 120 . Accordingly, the sound of “Goodbye” is converted into a sound signal by the microphone 120, and the converted sound signal of “Goodbye” is a signal conversion unit 130, a text conversion unit 150, and an AI module 170. and to the speaker 180 , respectively.

At this time, the signal conversion unit 130 processes the sound signal so that the sound signal of “Goodbye” is converted into a magnetic field signal and radiated through the loop coil 140 . In addition, the text conversion unit 150 provides a signal obtained by replacing the sound information of the sound signal of “Goodbye” with text information to the display unit 160, so that the text of “Goodbye” is displayed on the display unit 160 . make it possible In addition, when the speaker 180 is in an on state according to a user's selection, the speaker 180 outputs a sound signal of “Goodbye” as a sound. Meanwhile, in the AI module 170 , it is determined that the sound signal of “Goodbye” is not a voice command, and accordingly, other special functions are not performed.

FIG. 6 shows an operation process when a voice command related to text content is input to the microphone 120 in FIG. 3 .

Referring to FIG. 6 , a voice command of “Tell me about the news” is input to the microphone 120 . Accordingly, the voice command of “Tell me about the news” is converted into a sound signal by the microphone 120 , and the converted sound signal of “Tell me about the news” is a signal conversion unit 130 , a text conversion unit 150 , and an AI module 170 . ) and the speaker 180, respectively.

At this time, the signal conversion unit 130 processes the sound signal so that the sound signal of “Tell me about the news” is converted into a magnetic field signal and radiated through the loop coil 140 . In addition, the text conversion unit 150 provides a signal in which the sound information of the sound signal of “Tell me about the news” is converted into text information to the display unit 160, so that the text of “Tell me about the news” is displayed on the display unit 160 . make it possible In addition, when the speaker 180 is in an on state according to a user's selection, the speaker 180 outputs a sound signal of “Tell me about the news” as a sound.

On the other hand, the AI module 170 recognizes that the sound signal of “Tell me the news” is a voice command, and performs a special function (AI speaker function, surrounding environment control function, or surrounding environment monitoring function) accordingly. However, since the voice command of “Tell me the news” is related to the Al speaker function, the Al module 170 contains content related to the voice command of “Tell me the news” recognized by downloading it from among various contents pre-stored in itself or by accessing an external server. to process the operation. That is, the Al module 170 generates a TTS sound signal in which text information is converted into sound information for news content (text content) pre-stored in itself or downloaded from an external server, and the signal conversion unit 130, the text conversion unit 150 and the speaker 180 .

As a result, the signal conversion unit 130 processes the corresponding sound signal so that the TTS sound signal of the corresponding news content is converted into a magnetic field signal and radiated through the loop coil 140 . In addition, the text conversion unit 150 provides the display unit 160 with a signal obtained by replacing the sound information of the TTS sound signal of the corresponding news content with text information, so that the text of the corresponding news content is displayed on the display unit 160 . do. In addition, the speaker 180 outputs a TTS sound signal of the corresponding news content as a sound when the speaker 180 is in an on state according to a user's selection.

FIG. 7 shows an operation process when a voice command related to music content is input to the microphone 120 in FIG. 3 .

Referring to FIG. 7 , a voice command of “play a song A” is input to the microphone 120 . Accordingly, the voice command of “play a song A” is converted into a sound signal in the microphone 120, and the converted sound signal of “play a song A” is a signal conversion unit 130, a text conversion unit 150, It is transmitted to the AI module 170 and the speaker 180, respectively.

At this time, the signal conversion unit 130 processes the sound signal so that the sound signal of “play a song A” is converted into a magnetic field signal and radiated through the loop coil 140 . In addition, the text conversion unit 150 provides a signal in which the sound information of the sound signal of “play a song A” is converted into text information to the display unit 160, so that the display unit 160 “plays a song A” to display the text of In addition, the speaker 180 outputs a sound signal of “play a song A” as a sound when the speaker 180 is in an on state according to the user's selection.

On the other hand, the AI module 170 recognizes that the sound signal of “play a song A” is a voice command, and performs a special function (AI speaker function, surrounding environment control function, or surrounding environment monitoring function) accordingly. However, since the voice command of “Play Song A” is related to the Al speaker function, the Al module 170 recognizes the voice of “Play Song A” recognized by downloading it from among various contents pre-stored in itself or by accessing an external server. It performs an operation to process the content related to the command. That is, the Al module 170 reproduces the music content (audio content) of “Song A” pre-stored in itself or downloaded from an external server. In addition, the AI module 170 generates a sound signal of the corresponding music content generated according to the reproduction and transmits it to the signal conversion unit 130 , the text conversion unit 150 , and the speaker 180 .

As a result, the signal conversion unit 130 processes the sound signal so that the sound signal of the corresponding music content is converted into a magnetic field signal and radiated through the loop coil 140 . In addition, the text conversion unit 150 provides a signal obtained by changing the sound information of the sound signal of the corresponding music content into text information to the display unit 160 , so that the text of the corresponding music content is displayed on the display unit 160 . . In addition, when the speaker 180 is in an on state according to a user's selection, the speaker 180 outputs a sound signal of the corresponding music content as a sound.

FIG. 8 shows an operation process when a control command is input to the microphone 120 in FIG. 3 .

Referring to FIG. 8 , a control command of “turn on the air conditioner” is input to the microphone 120 . Accordingly, the voice command of “Turn on the air conditioner” is converted into a sound signal in the microphone 120, and the converted sound signal of “Turn on the air conditioner” is the signal conversion unit 130, the text conversion unit 150, and the AI module. 170 and the speaker 180, respectively.

At this time, the signal conversion unit 130 processes the sound signal so that the sound signal of “turn on the air conditioner” is converted into a magnetic field signal and radiated through the loop coil 140 . In addition, the text conversion unit 150 provides the display unit 160 with a signal obtained by changing the sound information for the sound signal of “Turn on the air conditioner” into text information, so that the text of “Turn on the air conditioner” on the display unit 160 is provided. to be displayed. In addition, the speaker 180 outputs a sound signal of “turn on the air conditioner” as a sound when the speaker 180 is in an on state according to the user's selection.

Meanwhile, the AI module 170 recognizes that the sound signal of “turn on the air conditioner” is a control command, and performs a special function (AI speaker function, surrounding environment control function, or surrounding environment monitoring function) accordingly. However, since the control command of “turn on the air conditioner” is related to the surrounding environment control function, the Al module 170 can connect to the IoT sensor or IoT device and transmit the corresponding control command so that the IoT sensor or IoT device performs a specific operation. have. Thereafter, the Al module 170 receives the operation result according to the corresponding control command from the IoT sensor or IoT device, and generates an acoustic signal of the received operation result to the signal conversion unit 130 , the text conversion unit 150 and the speaker. forward to (180).

As a result, the signal conversion unit 130 processes the sound signal so that the sound signal of the operation result is converted into a magnetic field signal and radiated through the loop coil 140 . In addition, the text conversion unit 150 provides a signal obtained by changing the sound information of the sound signal of the corresponding operation result into text information to the display unit 160 , so that the text of the corresponding operation result is displayed on the display unit 160 . . In addition, when the speaker 180 is in an on state according to a user's selection, the speaker 180 outputs a sound signal of a corresponding operation result as a sound.

FIG. 9 shows an operation process when event information is received from the AI module 170 in FIG. 3 .

Referring to FIG. 9 , event information of a doorbell ringing from a doorbell IoT device is input to the AI module 170 . At this time, since the corresponding event information is related to the surrounding environment monitoring function, the Al module 170 generates an acoustic signal notifying the event information of the doorbell ringing, and the signal conversion unit 130 , the text conversion unit 150 and the speaker 180 . ) to pass

As a result, the signal converting unit 130 processes the corresponding acoustic signal so that the acoustic signal of the corresponding event information is converted into a magnetic field signal and radiated through the loop coil 140 . In addition, the text conversion unit 150 provides a signal obtained by changing the sound information of the sound signal of the corresponding event information into text information to the display unit 160 , so that the text of the corresponding event information is displayed on the display unit 160 . . In addition, when the speaker 180 is in an on state according to a user's selection, a sound signal of the corresponding event information is output as a sound.

On the other hand, when the hearing loop function is provided to the user of the hearing aid, the user cannot recognize the situation such as the voice of the person next to him that is not input into the system (device) for providing the hearing loop function, and it is impossible to recognize situations such as cautions and warnings that may occur in the surroundings. , there is a problem that may be insensitive to coping with situations and dangers.

Accordingly, the hearing loop apparatus 100 according to an embodiment of the present invention not only provides a hearing loop function for sound signals provided from various sources, but also provides subtitles for the corresponding sound signals to the user at the same time, thereby corresponding to these problems. There are advantages to solving

That is, the signal conversion unit 130 performs a hearing loop conversion on the sound signal of the audio terminal 110 , but hears the sound signal of the corresponding microphone 120 when the sound signal of the microphone 120 is above a certain level. Perform a loop transformation. In addition, the text conversion unit 150 converts the sound signal of the audio terminal 110 into test information, but when the sound signal of the microphone 120 is above a certain level, the sound signal of the microphone 120 is It also performs conversion into test information.

However, for user convenience and ease of understanding, the text conversion unit 150 displays the text for the sound signal of the audio terminal 110 and the text for the sound signal of the microphone 120 separately on the display unit 160 . Transformation of each text information can be performed so that

Accordingly, the present invention provides a hearing loop function for a service such as cultural content experience, learning and education based on the sound signal of the audio terminal 110 to a user of a hearing aid device that is provided with a microphone 120 while providing the service. It is possible to provide a hearing loop function and a subtitle function together for an acoustic signal of a sound input through the . As a result, the present invention has the advantage that the user of the hearing aid who is provided with services such as cultural content experience, learning and education can recognize the situation such as the voice of the person next to him, cautions and warnings that may occur in the surroundings even while using the service. have.

In addition, the signal conversion unit 130 is at least one of the sound signals of the sound source unit (that is, the sound signal of the audio terminal 110, the sound signal of the microphone 120, and the sound signal of the AI module 170). While the hearing loop function is provided based on the signal, the hearing loop transformation may also be performed on other acoustic signals among the acoustic signals. In addition, while the text conversion unit 150 converts at least one of the sound signals of the sound source unit into test information, it also converts the other sound signals among the sound signals into test information. can do.

However, for user convenience and ease of understanding, the text conversion unit 150 may convert each text information so that the text for the sound signal of each sound source unit can be displayed separately on the display unit 160 . .

Accordingly, the present invention provides a hearing loop function and a caption function for acoustic signals from various sources at the same time, thereby improving understanding and concentration when providing services such as cultural content experience, learning and education to users of hearing aids. There are advantages that can be

In addition, the present invention can additionally provide various functions such as an AI speaker function, a surrounding environment control function, or a surrounding environment monitoring function in addition to the subtitle function, so that users of hearing aids can smoothly access rapidly changing information without discrimination. It has the advantage of being able to provide opportunities.

In the detailed description of the present invention, although specific embodiments have been described, various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention is not limited to the described embodiments, and should be defined by the following claims and their equivalents.

100: hearing loop device 101: body
102: user space 103: support
110: audio terminal 120: microphone
130: signal conversion unit 140: loop coil
150: text conversion unit 160: display unit
170; AI module 180: speaker

Claims (10)

an audio terminal to which a sound signal is input from another device;
a signal converter for converting the sound signal into a hearing loop so that a magnetic field signal for the input sound signal is output from the loop coil;
a text conversion unit for converting sound information according to the input sound signal into text information; and
a display unit for displaying text according to the converted text information;
Hearing loop device comprising a.
According to claim 1,
The other device is a hearing loop device that is an audio processing device, a video processing device, or a multimedia processing device.
According to claim 1,
and a microphone that converts ambient sound into an acoustic signal,
The signal conversion unit performs the hearing loop conversion also on the sound signal of the microphone,
The text conversion unit is a hearing loop device that also converts the sound signal of the microphone into the test information.
4. The method of claim 3,
The signal conversion unit performs the hearing loop conversion when the sound signal of the microphone is above a certain level,
The text conversion unit is a hearing loop device that converts the test information into the test information when the sound signal of the microphone is above a certain level.
4. The method of claim 3,
The display unit is a hearing loop device for distinguishing between the text for the sound signal of the audio terminal and the text for the sound signal from the microphone.
4. The method of claim 3,
An artificial intelligence (AI) module for recognizing a voice command by analyzing the acoustic signal of the microphone and performing an operation according to the recognized voice command, and generating an acoustic signal related to the performance of the operation,
The signal conversion unit performs the hearing loop conversion also on the sound signal of the AI module,
A hearing loop device for converting the text conversion unit into the test information even for the sound signal of the AI module.
7. The method of claim 6,
The operation is an operation of processing stored contents in the Al module related to the recognized voice command, or an operation of accessing an external server providing contents related to the recognized voice command, and downloading and processing the contents.
8. The method of claim 7,
The processing operation includes outputting an audio signal of audio content, video content or multimedia content, or an audio signal obtained by converting the text information into sound information with respect to the text content.
7. The method of claim 6,
When the AI module receives event information from an IoT (Internet of Things) sensor or IoT device installed in the surrounding environment of the hearing loop device, the hearing loop device generates an acoustic signal notifying the received event information.
10. The method according to any one of claims 1 to 9,
Hearing loop device further comprising a speaker for outputting a sound in response to the sound signal.

Images