KR102350787B1 - Translation system using sound vibration sensor - Google Patents

Abstract

The present invention relates to an interpretation system using a voice vibration microphone capable of fundamentally blocking noise by detecting vibrations generated from a user's voice using a piezo element.
An interpretation system using a voice vibration microphone according to the present invention includes a first ear set equipped with a voice vibration sensor and a speaker, a first wearable sound device having a microphone and a speaker and performing wireless communication with the first ear set, and a first wearable sound device and a first electronic communication device that performs wireless communication with the interpreter server and communicates with an interpretation server, wherein the first wearable acoustic device and the first electronic communication device are in a communicable state.

Description

Interpretation system using a voice vibration microphone {TRANSLATION SYSTEM USING SOUND VIBRATION SENSOR}

The present invention relates to an interpretation system, and more particularly, to an interpretation system using a voice vibration microphone capable of fundamentally blocking noise by detecting vibrations generated from a user's voice using a piezo element.

Recently, the number of foreign visitors to Korea and Koreans visiting overseas has been steadily increasing year by year. In particular, as transactions with China are made in the overall industry, the number of Chinese visits to Korea is increasing rapidly. In addition, it is easy to predict that a large number of visitors from all over the world, including Japan, will visit. Also, the number of people visiting Korea for business purposes is increasing. Therefore, communication between numerous visitors from all over the world and communication between Koreans is becoming very important.

These foreign visitors and overseas travelers usually use hotels with thorough service. Generally, in hotels, when visitors want to communicate using their own language, or they use a language other than their own, If you want to communicate with someone you want to communicate with, you can communicate through an interpreter resident in the hotel, or you can use e-mail or facsimile using the Internet. In addition, it is practically difficult to have all interpreters who can speak different languages in a hotel, and it is unreasonable that an interpreter must be accompanied at all times, and one or two interpreters cannot provide satisfactory service to a large number of visitors. , and there is a problem that interpretation services are not provided at the desired time.

Accordingly, in the field of technology, there is a demand for technology development for simultaneous interpretation in real time when talking with foreigners using their own communication terminals during tourism.

An object of the present invention is to provide an interpretation system using a voice vibration microphone capable of fundamentally blocking noise by detecting vibrations generated from a user's voice using a piezo element.

An interpretation system using a voice vibration microphone according to the present invention includes a first ear set equipped with a voice vibration sensor and a speaker, a first wearable sound device having a microphone and a speaker and performing wireless communication with the first ear set, and a first wearable sound device and a first electronic communication device that performs wireless communication with an interpretation server and communicates with an interpretation server, wherein the first wearable acoustic device and the first electronic communication device are in a communicable state, and the first wearable acoustic device is connected from the first earphone transmits a first voice signal of to the electronic communication device, the electronic communication device transmits the first voice signal to the interpretation server, receives the first interpretation signal corresponding to the first voice signal from the interpretation server, the first interpretation signal transmits to the first wearable sound device, the first wearable sound device emits sound through the provided speaker, and the first wearable sound device transmits the second voice signal from the provided microphone to the electronic communication device and the electronic communication device sends the second voice signal to the interpretation server, receives a second interpretation signal corresponding to the second voice signal from the interpretation server, and sends the second interpretation signal to the first wearable sound device, The first wearable sound device transmits the second interpretation signal to the first earphone, and the first earphone emits sound of the second interpretation signal through the provided speaker.

In addition, the interpretation system using the voice vibration microphone of the present invention is composed of a first ear set equipped with a voice vibration sensor and a speaker, and a first wearable sound device having a microphone and a speaker and performing wireless communication with the first ear set, 1 The wearable sound device transmits the first voice signal from the first earphone set to the interpretation server, receives the first interpretation signal corresponding to the first audio signal from the interpretation server, and receives the first interpretation signal through the speaker provided with the first interpretation signal 1 emits a sound of an interpretation signal, the first wearable sound device transmits a second audio signal from the provided microphone to the interpretation server, receives a second interpretation signal corresponding to the second audio signal from the interpretation server, and Transmits the interpretation signal to the first ear set, the first ear set emits a sound of the second interpretation signal through the provided speaker.

In addition, the interpretation system using the voice vibration microphone of the present invention includes a first ear set equipped with a voice vibration sensor and a speaker, a first wearable sound device having a microphone and a speaker and performing wireless communication with the first ear set, a microphone and a speaker and a first electronic communication device that performs wireless communication with a first wearable acoustic device and communicates with an interpretation server, wherein the first wearable acoustic device and the first electronic communication device are in a communicationable state; The wearable acoustic device transmits a first voice signal from the first earset to the electronic communication device, the electronic communication device transmits the first voice signal to the interpretation server, and a first interpretation signal corresponding to the first voice signal from the interpretation server receiving, and emitting a sound of the first interpretation signal through a speaker provided with the first interpretation signal,

The electronic communication device transmits the second voice signal from the provided microphone to the interpretation server, receives the second interpretation signal corresponding to the second voice signal from the interpretation server, and transmits the second interpretation signal to the first wearable sound device And, the first wearable sound device transmits the second interpretation signal to the first ear set, and the first ear set emits the sound of the second interpretation signal through the provided speaker.

In addition, the voice vibration sensor includes a housing forming an exterior, a piezoelectric element having a cantilever structure installed in the housing, a support structure supporting a fixed end of the piezoelectric element, a weight attached to a free end of the piezoelectric element, and a piezoelectric element includes a current-carrying part that transmits the output of , the fixing part of the piezoelectric element fixed by the support structure is 40% or less of the total volume, the thickness of the piezoelectric element is 0.3mm or more, the weight is 5mg or more, and the weight is It is preferable that it is made of metals with a density of 5 or more.

An object of the present invention is to provide an interpretation system using a voice vibration microphone capable of fundamentally blocking noise by detecting vibrations generated from a user's voice using a piezo element.

The piezo voice vibration microphone of the present invention provided with a cantilever structure has an advantage that it can fundamentally block external noise because it uses a piezo element to sense vibrations generated from a speaker's voice.

In addition, the piezo voice vibration microphone of the cantilever structure provided by the present invention has an advantage in that the piezo element has a cantilever structure and thus has excellent vibration sensing ability.

1 is a control configuration diagram of an interpretation system using a voice vibration microphone according to the present invention.
2 is an exploded view of a voice vibration microphone using a piezoelectric element having a cantilever structure according to a first embodiment of the present invention.
3 is a cross-sectional view of a voice vibration microphone using a piezoelectric element having a cantilever structure according to a first embodiment of the present invention.
4 is a cross-sectional view of a voice vibration microphone using a piezoelectric element having a cantilever structure according to a second embodiment of the present invention.
5 is a view showing parts except for the housing of the voice vibration microphone using the piezoelectric element of the cantilever structure according to the third embodiment of the present invention.
6 is a cross-sectional view of a voice vibration microphone using a piezoelectric element having a cantilever structure according to a fourth embodiment of the present invention.
7 is a cross-sectional view of a voice vibration microphone using a piezoelectric element having a cantilever structure according to a fifth embodiment of the present invention.
8 is a cross-sectional view of a voice vibration microphone using a piezoelectric element having a cantilever structure according to a sixth embodiment of the present invention.
9 is a cross-sectional view of a voice vibration microphone using a piezoelectric element having a cantilever structure according to a seventh embodiment of the present invention.
10 is a cross-sectional view of a voice vibration microphone using a piezoelectric element having a cantilever structure according to an eighth embodiment of the present invention.

Hereinafter, the present invention will be described in detail through examples and drawings. However, this is not intended to limit the present invention to specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives of the embodiments of the present invention are included. In connection with the description of the drawings, like reference numerals may be used for like components.

In this document, expressions such as "have", "may have", "includes", or "may include" indicate the presence of a corresponding characteristic (eg, a numerical value, function, operation, or component such as a part). and does not exclude the presence of additional features.

In this document, expressions such as “A or B”, “at least one of A or/and B”, or “one or more of A or/and B” may include all possible combinations of the items listed together. . For example, "A or B", "at least one of A and B", or "at least one of A or B" means (1) includes at least one A, (2) includes at least one B; Or (3) it may refer to all cases including both at least one A and at least one B.

Expressions such as "first", "second", "first", or "second" used in this document may modify various elements, regardless of order and/or importance, and may modify one element to another. It is used only to distinguish it from the components, and does not limit the components. For example, the first user equipment and the second user equipment may represent different user equipment regardless of order or importance. For example, without departing from the scope of the rights described in this document, a first component may be referred to as a second component, and similarly, the second component may also be renamed as a first component.

A component (eg, a first component) is "coupled with/to (operatively or communicatively)" to another component (eg, a second component); When referring to "connected to", it will be understood that the certain element may be directly connected to the other element or may be connected through another element (eg, a third element). On the other hand, when it is said that a component (eg, a first component) is "directly connected" or "directly connected" to another component (eg, a second component), the component and the It may be understood that other components (eg, a third component) do not exist between other components.

The expression "configured to (or configured to)" as used in this document, depending on the context, for example, "suitable for", "having the capacity to" It can be used interchangeably with "," "designed to", "adapted to", "made to", or "capable of". The term "configured (or set up to)" may not necessarily mean only "specifically designed to" in hardware. Instead, in some circumstances, the expression “a device configured to” may mean that the device is “capable of” with other devices or parts. For example, the phrase "a processor configured (or configured to perform) A, B, and C" executes a dedicated processor (eg, an embedded processor), or one or more software programs stored in a memory device, to perform the corresponding operations. By doing so, it may refer to a generic-purpose processor (eg, a CPU or an application processor) capable of performing corresponding operations.

Terms used in this document are only used to describe specific embodiments, and may not be intended to limit the scope of other embodiments. The singular expression may include the plural expression unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meanings as commonly understood by one of ordinary skill in the art described in this document. Among the terms used in this document, terms defined in a general dictionary may be interpreted with the same or similar meaning as the meaning in the context of the related art, and unless explicitly defined in this document, have an ideal or excessively formal meaning. not interpreted In some cases, even terms defined in this document cannot be construed to exclude embodiments of this document.

1 is a control configuration diagram of an interpretation system using a voice vibration microphone according to the present invention.

The interpretation system includes first and second wireless earphones 10 and 20, and first and/or second wireless earphones 10 and 20 for communicating with the wearable acoustic device 30, respectively, and electronic communication A wearable acoustic device 30 that independently communicates with each of the device 40 and the interpretation server 50, and an electronic communication device 40 that communicates with each of the wearable acoustic device 30 and the interpretation server 50 and communicates independently with each of the electronic communication device 40 and/or the wearable sound device 30 and/or the electronic communication device 140 through the network 60, and receives the interpretation target information to receive the included voice The interpretation server 50 that translates the voice included in the signal into text and provides interpretation information including the voice signal converted from the text, and the third wireless earphone 110 that communicates with the wearable sound device 30, respectively ), and the third wireless earphone 110 and the electronic communication device 140 and the wearable acoustic device 130 that independently communicates with each other, and the wearable acoustic device 130 and the interpretation server 50, respectively. It is configured to include an electronic communication device 140 and the like.

The network 60 corresponds to a system for performing wired communication and/or wireless communication, and corresponds to a technology naturally recognized by those skilled in the art to which the present invention pertains, and thus detailed description thereof will be omitted.

The first wireless earphone 10 obtains the user's voice and applies a voice signal to the data processor 19 with a voice vibration microphone 11, and a speaker 13 that receives an electrical signal from the data processor 19 and emits sound ) (or a receiver), a communication module 15 that performs wireless communication with the wearable acoustic device 30 (eg, a wireless communication module such as a Bluetooth module, etc.), and a wearable acoustic device ( 30) and transmits a voice signal from the voice vibration microphone 11 to the wearable acoustic device 30 through the communication unit 15 when an interpretation function is performed, and electricity from the wearable acoustic device 30 It is configured to include a data processor 19 that receives an audio signal, which is a signal, through the communication unit 15 and applies it to the speaker 13 . However, the configuration or function of the power supply unit (not shown) for supplying power, the microphone 11, the speaker 13, and the communication unit 15 corresponds to the technology naturally recognized by those skilled in the art to which the present invention belongs. The description is omitted. 2 to 10 below, it will be described in detail with respect to the mechanical structure of the first ear set (10). In addition, as is well known, the data processor 19 performs a phone call function and a sound reproduction function, and a process of performing an interpretation function according to the present invention will be described below.

The second wireless earphone 20 is the same as the configuration of the first wireless earphone 10 described above, and is configured to include a voice vibration microphone 21 , a speaker 23 , a communication unit 25 and a data processor 29 . .

Each of the first and second wireless earphones 20 may communicate with each other as a master device and a slave device.

The wearable sound device 30 is, for example, a device that includes a wireless communication function, such as a neckband-type sound conversion device, and performs a phone call function, a sound reproduction function, and the like. The wearable sound device 30 includes a microphone 31 for acquiring an external sound, a speaker 33 for emitting sound by receiving an electrical signal, and first and/or second earphones 10, 20, and electronic A communication unit 35 for performing wireless communication (eg, Bluetooth communication, etc.) and/or wired communication with each of the communication device 40 and the interpretation server 50, a microphone 31, a speaker 33, and a communication unit ( 35)) to control the data processor 39 to selectively perform a phone call function, a sound reproduction function, and an interpretation function. However, the configuration or function of the power supply unit (not shown) for supplying power, the microphone 31, the speaker 33, and the communication unit 35 corresponds to the technology naturally recognized by those skilled in the art to which the present invention belongs. The description is omitted.

The data processor 39 performs a phone call function and a sound reproduction function, as known to those skilled in the art to which the present invention pertains, and a processor (eg, an interpretation function according to the present invention) CPU, MCU, MICROPROCESSOR, etc.) and a storage space (eg, memory, etc.) for storing audio signals and the like. As is well known, the data processor 39 performs a phone call function and a sound reproduction function, and the process of performing the interpretation function according to the present invention will be described below.

The electronic communication device 40 corresponds to, for example, an information communication device such as a smartphone or tablet having a communication function, and input from a user (eg, selection of start or end of an application for an interpretation function, interpretation The input unit 41 for acquiring and applying the function start or end selection, the selection input of the interpretation target language and/or the interpretation target language, etc.) to the data processor 49 and the user interface for the interpretation function are visually or audibly displayed. The display unit 43 for displaying or expressing, and the communication unit 45 for performing wireless communication (eg, Bluetooth communication, etc.) with the wearable sound device 30 and communicating with the translation server 50 through the network 60 ), a microphone 46 for acquiring voice or sound, a data processor 49 for performing a phone call function and a sound reproduction function, and performing an interpretation function according to the present invention. However, the configuration or function of the power supply unit (not shown) for supplying power, the input unit 41, the display unit 43, the microphone 46, and the communication unit 45 is naturally recognized by those skilled in the art to which the present invention belongs. It corresponds to the technology to be used and the description thereof is omitted.

The data processor 49 includes a processor (eg, CPU, MCU, MICROPROCESSOR, etc.) that performs a phone call function, a sound reproduction function, and an interpretation function, an application and a user interface for the interpretation function, and a storage for storing interpretation information, etc. It is configured to include a space (eg, memory, etc.) and the like. The data processor 49 performs an application for an interpretation function, which will be described in detail below through various embodiments.

The translation server 50 has a Speech to Text (STT) function (a function of extracting voice information included in the interpretation target information and recognizing it and converting it into text) and/or a function of generating translated text by translating the text and/or As a server including a Text to Speech (TTS) function (a function for synthesizing text into speech), the translation server 50 corresponds to a technology naturally recognized by those skilled in the art to which the present invention pertains, and the detailed description thereof Description is omitted.

The third wireless earphone 110 has the configuration of the above-described first and second wireless earphone 10, 20, and performs communication with the wearable acoustic device (130).

The wearable acoustic device 130 has the same configuration as the above-described wearable acoustic device 30 , and performs communication with each of the third wireless earphone 110 and the electronic communication device 140 .

The electronic communication device 140 has the same configuration as the above-described electronic communication device 40 , and communicates with the wearable acoustic device 30 and communicates with the interpretation server 50 through the network 60 .

The electronic communication device 40 and the electronic communication device 140 may perform data communication with each other without passing through the network 60 such as short-distance communication.

In the present specification, the target language for interpretation corresponds to a language that is to be translated or interpreted into the language spoken by the user, and the target language for interpretation corresponds to a language to be finally delivered to the conversation partner by translating or interpreting the language spoken by the user. For example, when a Korean-speaking user wants to interpret in English, the target language for interpretation becomes English, and the target language for interpretation becomes Korean.

In the following, examples of the interpretation function in the interpretation system according to the present invention are described.

As a first embodiment, a control process in the interpretation system of Fig. 1 is described. The data processor 49 operates the application for the interpretation function, the first setting process of setting the interpretation target language and the interpretation target language, and the wearable sound device 30 and the first wireless earphone 10 into the interpretation function mode A second interpretation process that operates is performed.

First, in the first setting process, the data processor 49 operates an application for an interpretation function, displays a user interface for setting an interpretation target language and an interpretation target language on a display unit (not shown), and an input unit (not shown) ), the target language for interpretation and the target language for interpretation are inputted by the user's selection and set.

Next, in the second interpretation process, the data processor 49 detects the user's voice as a voice signal (first voice signal) from the voice vibration microphone 11 of the first wireless earphone 10 that the user inserts or wears in the ear. ), and the voice of the user's conversation partner is acquired as a voice signal (second voice signal) from the microphone 30 of the wearable acoustic device 30 worn by the user on the neck or shoulder, etc., the wearable acoustic device ( 30), through the communication unit 45, a start command of the interpretation function mode is applied. Accordingly, the data processor 39 starts the interpretation function mode according to the start command of the interpretation function mode, and transmits a start command of the interpretation function mode to the first wireless earphone 10 through the communication unit 35 . In addition, the data processor 19 receives a start command of the interpretation function mode through the communication unit 15 to start the interpretation function mode.

In the first embodiment, in the user's voice interpretation path, the data processor 19 obtains the first voice signal from the voice vibration microphone 11 of the first wireless earphone 10, and transmits the first voice signal to the communication unit 15 transmits to the wearable sound device 30 through the data processor 39 receives the first voice signal through the communication unit 35 49 receives the first voice signal through the communication unit 45, and controls the communication unit 45 to include information on the interpretation target (the first audio signal, the target language for interpretation, the target language for interpretation, etc.) through the network 60 ) to the interpretation server 50, including a voice signal transmission path. In addition, in the user's voice interpretation route, the interpretation server 50 transmits the first interpretation signal, which is the audio signal obtained by interpreting the first audio signal from the interpretation target information into the interpretation target language, to the electronic communication device 40 through the network 60 and the data processor 49 receives the first interpretation signal through the communication unit 45 , and transmits the first interpretation signal to the wearable sound device 30 through the communication unit 45 , and the data processor 39 receives the first interpretation signal through the communication unit 45 . and an interpretation signal transmission path that receives the first interpretation signal through the communication unit 35 and applies it to the speaker 33 so that the conversation partner can hear the interpretation voice according to the first interpretation signal.

In addition, in the voice interpretation path of the conversation partner, the data processor 39 transmits the second voice signal obtained from the microphone 31 to the electronic communication device 40 through the communication unit 35 , and the data processor 49 transmits the communication unit Receives the second voice signal through (45), controls the communication unit (45) to transmit the information to be interpreted (including the second voice signal, the target language for interpretation, the target language for interpretation, etc.) through the network 60 to the interpretation server ( 50) includes a voice signal transmission path to transmit to. The interpretation target language of the second audio signal is the same as the interpretation target language of the first audio signal, and the interpretation target language of the second audio signal is the same as the interpretation target language of the first audio signal. In addition, in the voice interpretation path of the conversation partner, the interpretation server 50 transmits the second interpretation signal, which is a voice signal obtained by interpreting the second voice signal from the interpretation target information into the interpretation target language, through the network 60 to the electronic communication device 40 and the data processor 49 receives the second interpretation signal through the communication unit 45, transmits the second interpretation signal to the wearable sound device 30 through the communication unit 45, and the data processor 39 receives the second interpretation signal through the communication unit 35 , and transmits it to the first wireless earphone 10 through the communication unit 35 , and the data processor 19 receives the second interpretation signal through the communication unit 15 . and an interpretation signal transmission path that is applied to the speaker 13 so that the user can hear the interpretation voice according to the second interpretation signal.

Next, in the second embodiment, the wearable sound device 30 may directly communicate with the interpretation server 50 through the network 60 without control by the electronic communication device 40 to perform an interpretation function. .

The data processor 39 obtains an interpretation function start input from the input unit (not shown), operates an application for the interpretation function, and sets the interpretation target language and the interpretation target language, a first setting process, and a first wireless earphone set The second interpretation process of operating (10) in the interpretation function mode is performed.

First, in the first setting process, the data processor 39 operates an application for an interpretation function, and receives and sets an interpretation target language and an interpretation target language from an input unit (not shown).

Next, in the second interpretation process, the data processor 39 receives the user's voice from the voice vibration microphone 11 of the first wireless earphone 10 inserted or worn in the user's ear (the first voice signal) In order to acquire as a voice signal (second voice signal) from the microphone 30 of the wearable acoustic device 30 that the user wears on the neck or shoulder, the voice of the user's conversation partner is acquired with a first wireless earphone ( 10), a start command of the interpretation function mode is transmitted through the communication unit 35 . In addition, the data processor 19 receives a start command of the interpretation function mode through the communication unit 15 to start the interpretation function mode.

In the second embodiment, in the user's voice interpretation path, the data processor 19 obtains the first voice signal from the voice vibration microphone 11 of the first wireless earphone 10, and transmits the first voice signal to the communication unit 15 transmits to the wearable sound device 30 through 1 includes a voice signal transmission path for transmitting a voice signal, an interpretation target language, an interpretation target language, etc.) to the interpretation server 50 . In addition, in the user's voice interpretation path, the interpretation server 50 transmits the first interpretation signal, which is a voice signal obtained by interpreting the first voice signal from the interpretation target information into the interpretation target language, to the wearable sound device 30 through the network 60 . and the data processor 39 receives the first interpretation signal through the communication unit 35 and applies it to the speaker 33 so that the conversation partner can hear the interpretation voice according to the first interpretation signal. includes

In addition, as for the voice interpretation path of the conversation partner, the data processor 39 controls the communication unit 35 to control the second voice signal obtained from the microphone 31, and through the network 60, information on the interpretation target (second voice signal, interpretation) and a voice signal transmission path for transmitting a target language and an interpretation target language) to the interpretation server 50 . The interpretation target language of the second audio signal is the same as the interpretation target language of the first audio signal, and the interpretation target language of the second audio signal is the same as the interpretation target language of the first audio signal. In addition, in the voice interpretation path of the conversation partner, the interpretation server 50 transmits the second interpretation signal, which is a voice signal obtained by interpreting the second voice signal from the interpretation target information into the interpretation target language, through the network 60 to the wearable sound device 30 To transmit, the data processor 39 receives the second interpretation signal through the communication unit 35, and transmits to the first wireless earphone 10 through the communication unit 35, the data processor 19 is the communication unit 15 ) through which the second interpretation signal is received and applied to the speaker 13 so that the user can hear the interpretation voice according to the second interpretation signal.

Next, in the third embodiment, unlike the first embodiment, the electronic communication terminal 40 acquires the voice of the conversation partner through the built-in microphone 41, and transmits an interpretation signal for the user's voice through the built-in speaker (43) through the sound emission. For the third embodiment, the electronic communication device 40 is preferably located adjacent to the conversation partner.

The data processor 49 operates the application for the interpretation function, the first setting process of setting the interpretation target language and the interpretation target language, and the wearable sound device 30 and the first wireless earphone 10 into the interpretation function mode A second interpretation process that operates is performed.

First, in the first setting process, the data processor 49 operates an application for an interpretation function, displays a user interface for setting an interpretation target language and an interpretation target language on a display unit (not shown), and an input unit (not shown) ), the target language for interpretation and the target language for interpretation are inputted by the user's selection and set.

Next, in the second interpretation process, the data processor 49 detects the user's voice as a voice signal (first voice signal) from the voice vibration microphone 11 of the first wireless earphone 10 that the user inserts or wears in the ear. ), and the voice of the user's conversation partner is acquired as a voice signal (second voice signal) from the built-in microphone 41, in the interpretation function mode through the communication unit 45 with the wearable sound device 30 Approve the start command. Accordingly, the data processor 39 starts the interpretation function mode according to the start command of the interpretation function mode, and transmits a start command of the interpretation function mode to the first wireless earphone 10 through the communication unit 35 . In addition, the data processor 19 receives a start command of the interpretation function mode through the communication unit 15 to start the interpretation function mode.

In the third embodiment, in the user's voice interpretation path, the data processor 19 obtains the first voice signal from the voice vibration microphone 11 of the first wireless earphone 10, and transmits the first voice signal to the communication unit 15 transmits to the wearable sound device 30 through the data processor 39 receives the first voice signal through the communication unit 35 49 receives the first voice signal through the communication unit 45, and controls the communication unit 45 to include information on the interpretation target (the first audio signal, the target language for interpretation, the target language for interpretation, etc.) through the network 60 ) to the interpretation server 50, including a voice signal transmission path. In addition, in the user's voice interpretation route, the interpretation server 50 transmits the first interpretation signal, which is the audio signal obtained by interpreting the first audio signal from the interpretation target information into the interpretation target language, to the electronic communication device 40 through the network 60 and the data processor 49 receives the first interpretation signal through the communication unit 45 and applies it to the speaker 43 so that the conversation partner can hear the interpretation voice according to the first interpretation signal. includes

In addition, as for the voice interpretation path of the conversation partner, the data processor 49 controls the communication unit 45 to control the second voice signal obtained from the microphone 41, and thus the interpretation target information (second voice signal, interpretation) through the network 60 . and a voice signal transmission path for transmitting a target language, an interpretation target language, etc.) to the interpretation server 50 . The interpretation target language of the second audio signal is the same as the interpretation target language of the first audio signal, and the interpretation target language of the second audio signal is the same as the interpretation target language of the first audio signal. In addition, in the voice interpretation path of the conversation partner, the interpretation server 50 transmits the second interpretation signal, which is a voice signal obtained by interpreting the second voice signal from the interpretation target information into the interpretation target language, through the network 60 to the electronic communication device 40 and the data processor 49 receives the second interpretation signal through the communication unit 45, transmits the second interpretation signal to the wearable sound device 30 through the communication unit 45, and the data processor 39 receives the second interpretation signal through the communication unit 35 , and transmits it to the first wireless earphone 10 through the communication unit 35 , and the data processor 19 receives the second interpretation signal through the communication unit 15 . and an interpretation signal transmission path that is applied to the speaker 13 so that the user can hear the interpretation voice according to the second interpretation signal.

Next, as a fourth embodiment, the first and second wireless earphones 10, 20 and wireless communication are connected to the wearable acoustic device 30, and the first wireless earphone 10 is worn on the user's ear and first 2 The wireless earphone 20 is worn on the ear of the conversation partner.

The data processor 49 operates the application for the interpretation function, the first setting process of setting the interpretation target language and the interpretation target language, the wearable sound device 30 and the first and second wireless earphones 10, ( 20) is operated in the interpretation function mode to perform the second interpretation process.

First, in the first setting process, the data processor 49 operates an application for an interpretation function, displays a user interface for setting an interpretation target language and an interpretation target language on a display unit (not shown), and an input unit (not shown) ), the target language for interpretation and the target language for interpretation are inputted by the user's selection and set.

Next, in the second interpretation process, the data processor 49 detects the user's voice as a voice signal (first voice signal) from the voice vibration microphone 11 of the first wireless earphone 10 that the user inserts or wears in the ear. ), and the voice of the conversation partner of the user is acquired as a voice signal (second voice signal) from the voice vibration microphone 21 of the second wireless earphone 20 that the conversation partner inserts or wears in the ear, wearable A start command of the interpretation function mode is applied to the sound device 30 through the communication unit 45 . Accordingly, the data processor 39 starts the interpretation function mode according to the start command of the interpretation function mode, and the start command of the interpretation function mode through the communication unit 35 to the first and second wireless earphones 10 and 20 to send In addition, each of the data processors 19 and 29 receives a start command of the interpretation function mode through the communication units 15 and 25, respectively, and starts the interpretation function mode.

In the fourth embodiment, in the user's voice interpretation path, the data processor 19 obtains the first voice signal from the voice vibration microphone 11 of the first wireless earphone 10, and transmits the first voice signal to the communication unit 15 transmits to the wearable sound device 30 through the data processor 39 receives the first voice signal through the communication unit 35 49 receives the first voice signal through the communication unit 45, and controls the communication unit 45 to include information on the interpretation target (the first audio signal, the target language for interpretation, the target language for interpretation, etc.) through the network 60 ) to the interpretation server 50, including a voice signal transmission path. In addition, in the user's voice interpretation route, the interpretation server 50 transmits the first interpretation signal, which is the audio signal obtained by interpreting the first audio signal from the interpretation target information into the interpretation target language, to the electronic communication device 40 through the network 60 and the data processor 49 receives the first interpretation signal through the communication unit 45 , and transmits the first interpretation signal to the wearable sound device 30 through the communication unit 45 , and the data processor 39 receives the first interpretation signal through the communication unit 45 . Receives the first interpretation signal through the communication unit 35, transmits the first interpretation signal to the second wireless earphone 20, the data processor 29 applies the first interpretation signal to the speaker 23 to the conversation partner and an interpretation signal transmission path through which an interpretation voice according to the first interpretation signal can be heard.

In addition, in the voice interpretation path of the conversation partner, the data processor 29 acquires the second voice signal from the voice vibration microphone 21 of the first wireless earphone 20 , and transmits the second voice signal to the wearable through the communication unit 25 . transmit to the acoustic device 30 , the data processor 39 receives the second voice signal through the communication unit 35 , transmits it to the electronic communication device 40 through the communication unit 35 , and the data processor 49 Receives the second audio signal through the temporary communication unit 45, and controls the communication unit 45 to interpret the interpretation target information (including the second audio signal, the interpretation target language, the interpretation target language, etc.) through the network 60 It includes a voice signal transmission path to be transmitted to the server (50). The interpretation target language of the second audio signal is the same as the interpretation target language of the first audio signal, and the interpretation target language of the second audio signal is the same as the interpretation target language of the first audio signal. In addition, in the voice interpretation path of the conversation partner, the interpretation server 50 transmits the second interpretation signal, which is a voice signal obtained by interpreting the second voice signal from the interpretation target information into the interpretation target language, through the network 60 to the electronic communication device 40 and the data processor 49 receives the second interpretation signal through the communication unit 45, transmits the second interpretation signal to the wearable sound device 30 through the communication unit 45, and the data processor 39 receives the second interpretation signal through the communication unit 35 , and transmits it to the first wireless earphone 10 through the communication unit 35 , and the data processor 19 receives the second interpretation signal through the communication unit 15 . and an interpretation signal transmission path that is applied to the speaker 13 so that the user can hear the interpretation voice according to the second interpretation signal.

Next, as a fifth embodiment, the user interpretation apparatus is configured to include a first wireless earphone 10, a wearable sound device 30 and an electronic communication device 40, the conversation partner interpretation apparatus is a third wireless earphone set 110 , and a wearable acoustic device 130 and an electronic communication device 140 .

While the electronic communication terminal 40 and the electronic communication terminal 140 perform an application for an interpretation function, a communication connection state is maintained.

In the user interpretation apparatus, the data processor 49 transmits a first voice signal that is the user's voice to the interpretation server 50 through the network 60, and the interpretation server 50 sends a first voice signal corresponding to the first voice signal. It transmits the interpretation signal to the electronic communication device 40 via the network 60 . The data processor 49 transmits the first interpretation signal to the conversation partner interpretation apparatus through the communication unit 45 . so that the data processor 149 of the electronic communication device 140 receives the first interpretation signal and emits sound through the speakers 133 and 113 of the wearable sound device 130 and/or the third wireless earphone 110 do.

Conversely, in the conversation partner interpreting apparatus, the data processor 149 transmits the second voice signal, which is the voice of the conversation partner, to the interpretation server 50 through the network 60, and the interpretation server 50 responds to the second voice signal. It transmits a corresponding second interpretation signal to the electronic communication device 140 via the network 60 . The data processor 149 transmits the second interpretation signal to the user interpretation apparatus through the communication unit 145 . That is, the data processor 49 of the electronic communication device 40 receives the second interpretation signal, the wearable sound device 30 and / or the speaker 33 of the first wireless earphone 10, the sound through the 13 let it be released

Next, as a sixth embodiment, the wearable acoustic device 30 additionally includes a voice vibration microphone. When the user wears the wearable acoustic device 30 on the body, the additionally provided voice vibration microphone is applied to the user's skin. Direct or indirect contact. The wearable acoustic device 30 may perform an interpretation function by using a voice signal from any one or more of the microphone 31 and the voice vibration microphone.

Next, as a seventh embodiment, the first or second wireless earphone set (10), (20) is additionally provided with a general microphone in addition to the voice vibration microphone, any one of the microphone and the voice vibration microphone (11), (21) An interpretation function can be performed using the voice signal from the above.

The voice vibration microphones 11 , 21 , and 111 in FIG. 1 are the same as the voice vibration sensors in FIGS. 2 to 10 .

2 is an exploded view of a voice vibration sensor using a piezoelectric element having a cantilever structure according to a first embodiment of the present invention, and FIG. 3 is a cross-sectional view of a voice vibration sensor using a piezoelectric element having a cantilever structure according to the first embodiment of the present invention. .

In a voice vibration sensor (hereinafter, referred to as a voice vibration sensor) using a piezoelectric element having a cantilever structure according to the first embodiment of the present invention, a housing comprising a lower housing 110 and an upper housing 120 forms an exterior, and the vibration inside the housing Components for sensing are installed.

The lower housing 110 is provided with a lower surface and sidewalls and has a box shape with an open upper surface, and the upper housing 120 is coupled to the lower housing 110 to close the open upper surface. A piezoelectric element 220 in the form of a strip having a length longer than the thickness or width is installed in the lower housing 110 . At this time, one end of the piezoelectric element 220 is fixed, and the other end is fixed in a cantilever structure that is a free end. The piezoelectric element 220 is preferably made of a PZT ceramic material.

A support structure 210 for supporting the fixed end of the piezoelectric element 220 is provided in the lower housing 110 . The fixing portion of the piezoelectric element 220 fixed by the support structure 210 is preferably 40% or less of the total volume. This is because, when the volume of the fixed portion of the piezoelectric element 220 is increased, the vibration width of the free end is reduced, so that the detection range of the voice vibration is limited.

Meanwhile, a weight 230 is attached to the free end of the piezoelectric element 220 . The weight 230 amplifies the vibration of the piezoelectric element 220 and has an advantage in that the detection range of the voice vibration of the voice vibration sensor is expanded. At this time, it is preferable that the weight 230 has a weight of 5 mg or more. If the weight is smaller than that, since the vibration amplification effect of the weight 230 is reduced, it is preferably 5 mg or more to increase the sensing efficiency of the piezoelectric element 220 and minimize noise. On the other hand, the weight 230 is preferably made of a metal having a density of 5 or higher that can increase the weight while reducing the volume. At this time, the shape of the weight 230 does not limit the vibration of the piezoelectric element 220 and may be any shape as long as it can be attached to the piezoelectric element 220 . For example, the weight 230 may have any shape, such as a cylindrical shape, a cap shape surrounding the free end of the piezoelectric element 220 , a cuboid, or a cube. When the weight 230 is attached to the piezoelectric element 220, it is attached by an adhesive member such as a bond or a tape.

Meanwhile, the current conducting unit 300 capable of transmitting the output of the piezoelectric element 220 is connected to the fixed end side of the piezoelectric element 220 . One end 302 of the conducting unit 300 is connected to the piezoelectric element 220 in the housings 110 and 120, and the other end 304 of the conducting unit 300 is drawn out of the housings 110 and 120, Form a contact with the outside.

The voice vibration sensor detects vibrations caused by the speaker's voice transmitted through the housings 110 and 120 using the piezoelectric properties of the piezoelectric element 220 . Since the piezoelectric element 220 is installed in a cantilever structure, the vibrations of the housings 110 and 120 are amplified at the free end, there is an advantage in that the voice vibration can be sensitively detected. In addition, the sensor cannot detect external noise because it is attached to the speaker's body and detects vibrations generated during voice utterance.

4 is a cross-sectional view of a voice vibration sensor using a piezoelectric element having a cantilever structure according to a second embodiment of the present invention.

The voice vibration sensor according to the second embodiment of the present invention also includes a housing, a piezoelectric element 220 , a weight 230 , and a energizing unit 300 . However, a support structure for supporting the fixed end of the piezoelectric element 220 is not separately attached to the lower housing 110a. Instead, a portion of the lower housing 110a is bent inward to form a support structure 112a capable of supporting the piezoelectric element 220 .

5 is a view showing parts except for the housing of the voice vibration sensor using the piezoelectric element of the cantilever structure according to the third embodiment of the present invention.

The voice vibration sensor according to the third embodiment of the present invention is different from the previous embodiments in that it includes two piezoelectric elements 222a and 224a. In the third embodiment of the present invention, two piezoelectric elements 222a and 224a are provided, but three or more may be provided. When a plurality of piezoelectric elements 222a and 224a are provided, there is an advantage in that a detection range capable of detecting voice vibration is widened. In this case, by varying the thickness of the piezoelectric elements 222a and 224a from each other, it is possible to increase the accuracy of sound vibration detection. By varying the thickness of the piezoelectric elements 222a and 224a, not only the amplitude of the free end of each of the piezoelectric elements 222a and 224a changes, but also the piezoelectric characteristics are different, so the signals generated from each of the piezoelectric elements 222a and 224a are combined By doing so, the voice sensing accuracy can be improved.

Here, when the thicknesses of the piezoelectric elements 222a and 224a are different from each other, the top surfaces of the piezoelectric elements 222a and 224a are the same by varying the height of the portion supporting each of the piezoelectric elements 222a and 224a in the support structure 300a. It is desirable to be at a height, ie, on the same plane. By arranging the upper surfaces of the piezoelectric elements 222a and 224a on the same plane, there is an advantage in that it is easy to attach the conducting part 300 .

6 is a cross-sectional view of a voice vibration sensor using a piezoelectric element having a cantilever structure according to a fourth embodiment of the present invention. 7 is a cross-sectional view of a voice vibration sensor using a piezoelectric element having a cantilever structure according to a fifth embodiment of the present invention. The sound vibration sensor according to the fourth embodiment and the voice vibration sensor according to the fifth embodiment of the present invention are provided with a damping structure for preventing damage to the piezoelectric element 220 . In the fourth embodiment of the present invention, the damping bond 400 is applied on the lower housing 110 in a position close to the weight 230 . In the fifth embodiment of the present invention, the porons 402 and 404 are attached to the housing 110 and the upper housing 120 . The porons 402 and 404 are appropriately disposed in the empty space within the housings 110 and 120, and prevent an impact from being applied to the piezoelectric element 220 by a fall or the like.

8 is a cross-sectional view of a voice vibration sensor using a piezoelectric element having a cantilever structure according to a sixth embodiment of the present invention. The voice vibration sensor according to the sixth embodiment of the present invention is characterized in that the reinforcing plate 500 is attached to the piezoelectric element 220 in order to prevent damage to the piezoelectric element 220 . The reinforcing plate 500 does not play a role of damping, but may prevent the piezoelectric element 220 from being damaged.

9 is a cross-sectional view of a voice vibration sensor using a piezoelectric element having a cantilever structure according to a seventh embodiment of the present invention. In the voice vibration sensor according to the seventh embodiment of the present invention, as in the sixth embodiment, the reinforcing plate 500 is attached to the piezoelectric element 220 in order to prevent damage to the piezoelectric element 220 in the voice vibration sensor. . In addition to this, the elastic member 600 is provided between the free end of the piezoelectric element 220 and the housing. The elastic member 600 serves to damp the vibration of the free end. In the seventh embodiment of the present invention, the elastic member 600 is installed between the weight 230 attached to the lower portion of the free end of the piezoelectric element 220 and the lower housing 110 . However, the installation positions of the weight 230 and the elastic member 600 may be changed as needed.

10 is a cross-sectional view of a voice vibration sensor using a piezoelectric element having a cantilever structure according to an eighth embodiment of the present invention. The voice vibration sensor according to the eighth embodiment of the present invention includes housings 110 and 120 , a support structure 210 , a piezoelectric element 220 , a weight 230 , and an energizing unit 300 , as in the previous embodiments. be prepared In this case, the amplifier 310 for amplifying the signal of the piezoelectric element 220 may be provided on the conducting unit 300 .

As described above, the present invention is not limited to the specific preferred embodiments described above, and anyone with ordinary skill in the art to which the invention pertains can use various methods without departing from the gist of the present invention as claimed in the claims. It goes without saying that modifications are possible, and such modifications are intended to be within the scope of the claims.

10,, 20: first and second wireless earphone
30, 130: wearable sound device
40, 140: electronic communication device

Claims (6)

A first earphone equipped with a voice vibration sensor and a speaker;
A first wearable sound device having a microphone and a speaker and performing wireless communication with the first ear set;
and a first electronic communication device that performs wireless communication with a first wearable acoustic device and communicates with an interpretation server,
The first wearable acoustic device and the first electronic communication device are in a communicable state,
The first wearable sound device transmits a first voice signal from the first earphone set to the electronic communication device, the electronic communication device transmits the first voice signal to the interpretation server, and a first corresponding to the first voice signal from the interpretation server receiving the interpretation signal, transmitting the first interpretation signal to the first wearable sound device, the first wearable sound device emitting sound through the provided speaker;
The first wearable sound device transmits a second voice signal from the provided microphone to the electronic communication device, the electronic communication device transmits the second voice signal to the interpretation server, and a second voice signal corresponding to the second voice signal from the interpretation server Receives the interpretation signal, transmits the second interpretation signal to the first wearable sound device, the first wearable sound device transmits the second interpretation signal to the first earphone, and the first earset interprets the second through the provided speaker emit a signal,
The voice vibration sensor includes a housing forming an exterior, a piezoelectric element having a cantilever structure installed in the housing, a support structure supporting a fixed end of the piezoelectric element, a weight attached to the free end of the piezoelectric element, and the output of the piezoelectric element. Including an energizing unit to transmit,
The piezoelectric element is provided with two or more piezoelectric elements having different thicknesses, and the vibration of the body generated when the speaker's voice is uttered in contact with the speaker's body is transmitted through the housing and amplified by the free end of the piezoelectric element. An interpretation system using a voice vibration microphone, characterized in that it detects the voice vibration of a piezoelectric element using the piezoelectric characteristics. A first earphone equipped with a voice vibration sensor and a speaker;
It includes a first wearable sound device having a microphone and a speaker and performing wireless communication with a first earphone,
The first wearable sound device transmits the first voice signal from the first earphone set to the interpretation server, receives the first interpretation signal corresponding to the first voice signal from the interpretation server, and through the speaker provided with the first interpretation signal sound emission of the first interpretation signal,
The first wearable sound device transmits the second voice signal from the provided microphone to the interpretation server, receives the second interpretation signal corresponding to the second voice signal from the interpretation server, and transmits the second interpretation signal to the first earphone And, the first earphone emits a sound of the second interpretation signal through the provided speaker,
The voice vibration sensor includes a housing forming an exterior, a piezoelectric element having a cantilever structure installed in the housing, a support structure supporting a fixed end of the piezoelectric element, a weight attached to the free end of the piezoelectric element, and the output of the piezoelectric element. Including an energizing unit to transmit,
The piezoelectric element is provided with two or more piezoelectric elements having different thicknesses, and the vibration of the body generated when the speaker's voice is uttered in contact with the speaker's body is transmitted through the housing and amplified by the free end of the piezoelectric element. An interpretation system using a voice vibration microphone, characterized in that it detects the voice vibration of a piezoelectric element using the piezoelectric characteristics. A first earphone equipped with a voice vibration sensor and a speaker;
A first wearable sound device having a microphone and a speaker and performing wireless communication with the first ear set;
It includes a first electronic communication device having a microphone and a speaker, performing wireless communication with a first wearable sound device, and communicating with an interpretation server,
The first wearable acoustic device and the first electronic communication device are in a communicable state,
The first wearable sound device transmits a first voice signal from the first earphone set to the electronic communication device, the electronic communication device transmits the first voice signal to the interpretation server, and a first corresponding to the first voice signal from the interpretation server receiving the interpretation signal, and emitting the sound of the first interpretation signal through a speaker provided with the first interpretation signal;
The electronic communication device transmits the second voice signal from the provided microphone to the interpretation server, receives the second interpretation signal corresponding to the second voice signal from the interpretation server, and transmits the second interpretation signal to the first wearable sound device and, the first wearable sound device transmits the second interpretation signal to the first earphone, and the first earphone emits sound through the provided speaker,
The voice vibration sensor includes a housing forming an exterior, a piezoelectric element having a cantilever structure installed in the housing, a support structure supporting a fixed end of the piezoelectric element, a weight attached to the free end of the piezoelectric element, and the output of the piezoelectric element. Including an energizing unit to transmit,
The piezoelectric element is provided with two or more piezoelectric elements having different thicknesses, and the vibration of the body generated when the speaker's voice is uttered in contact with the speaker's body is transmitted through the housing and amplified by the free end of the piezoelectric element. An interpretation system using a voice vibration microphone, characterized in that it detects the voice vibration of a piezoelectric element using the piezoelectric characteristics. First and second earphones equipped with a voice vibration sensor and a speaker;
A first wearable acoustic device for performing wireless communication with the first and second earphones;
and a first electronic communication device that performs wireless communication with a first wearable acoustic device and communicates with an interpretation server,
The first wearable acoustic device and the first electronic communication device are in a communicable state,
The first wearable sound device transmits a first voice signal from the first earphone set to the electronic communication device, the electronic communication device transmits the first voice signal to the interpretation server, and a first corresponding to the first voice signal from the interpretation server Receives the interpretation signal, transmits the first interpretation signal to the first wearable sound device, the first wearable sound device transmits the first interpretation signal to the second earphone, and the second earphone transmits the first interpretation through the provided speaker emit a signal,
The first wearable acoustic device transmits a second voice signal from the second earset to the electronic communication device, the electronic communication device transmits the second voice signal to the interpretation server, and a second corresponding to the second voice signal from the interpretation server Receives the interpretation signal, transmits the second interpretation signal to the first wearable sound device, the first wearable sound device transmits the second interpretation signal to the first earphone, and the first earset interprets the second through the provided speaker emit a signal,
The voice vibration sensor includes a housing forming an exterior, a piezoelectric element having a cantilever structure installed in the housing, a support structure supporting a fixed end of the piezoelectric element, a weight attached to the free end of the piezoelectric element, and the output of the piezoelectric element. Including an energizing unit to transmit,
The piezoelectric element is provided with two or more piezoelectric elements having different thicknesses, and the vibration of the body generated when the speaker's voice is uttered in contact with the speaker's body is transmitted through the housing and amplified by the free end of the piezoelectric element. An interpretation system using a voice vibration microphone, characterized in that it detects the voice vibration of a piezoelectric element using the piezoelectric characteristics. A first ear set equipped with a voice vibration sensor and a speaker, a first wearable acoustic device having a microphone and a speaker and performing wireless communication with the first ear set, and wireless communication with the first wearable acoustic device and communicating with an interpretation server a user interpretation apparatus configured with a first electronic communication device that performs
A second earset equipped with a voice vibration sensor and a speaker, a second wearable acoustic device having a microphone and a speaker and performing wireless communication with the second earset, and a second wearable acoustic device performing wireless communication and communicating with an interpretation server a conversation partner interpreting apparatus configured with a second electronic communication device that performs
The first wearable sound device transmits a first voice signal from the first earset to the first electronic communication device, and the first electronic communication device transmits the first voice signal to the interpretation server, and from the interpretation server to the first voice signal receive a corresponding first interpretation signal, transmit the first interpretation signal to a second electronic communication device, the second electronic communication device transmit the first interpretation signal to a second wearable sound device, and the second wearable sound device includes: By transmitting the first interpretation signal to the second earphone, the sound emission of the first interpretation signal,
The second wearable sound device transmits a second voice signal from the second earset to the second electronic communication device, and the second electronic communication device transmits the second voice signal to the interpretation server, and from the interpretation server to the second voice signal. receive a corresponding second interpretation signal, send the second interpretation signal to the first electronic communication device, the first electronic communication device transmits the second interpretation signal to the first wearable sound device, the first wearable sound device includes: By transmitting the second interpretation signal to the first earphone, the sound emission of the second interpretation signal,
The voice vibration sensor includes a housing forming an exterior, a piezoelectric element having a cantilever structure installed in the housing, a support structure supporting a fixed end of the piezoelectric element, a weight attached to the free end of the piezoelectric element, and the output of the piezoelectric element. Including an energizing unit to transmit,
The piezoelectric element is provided with two or more piezoelectric elements having different thicknesses, and the vibration of the body generated when the speaker's voice is uttered in contact with the speaker's body is transmitted through the housing and amplified by the free end of the piezoelectric element. An interpretation system using a voice vibration microphone, characterized in that it detects the voice vibration of a piezoelectric element using the piezoelectric characteristics. 6. The method according to any one of claims 1 to 5,
An interpretation system using a voice vibration microphone, characterized in that upper surfaces of two or more piezoelectric elements are disposed on the same plane.

Images