KR20190136731A - The Assistive Speech and Listening Management System for Speech Discrimination, irrelevant of an Environmental and Somatopathic factors - Google Patents

Abstract

The present invention relates to an apparatus and a system, which recognize physical characteristics of articulators of a head and neck part of a speaker in accordance with a utterance intention of the speaker through a sensor of the head and neck part including an oral tongue sensor, and forms the same in a signal to efficiently transmit the same to a speaker or listener who has a limit for hearing sound due to environmental or physical obstacle factors. The system of the present invention comprises: a sensor unit (100) adjacent to one surface of a head and neck part of a speaker (10) and measuring physical characteristics of articulators; a data analysis unit (200) for recognizing one or more utterance features (220) of the speaker on the basis of a position (210) of the sensor unit and the measured physical characteristics of the articulators; a data conversion unit (300) for converting the position (210) of at least one sensor unit and the utterance features (220) into voice data (310); and a data expression unit (500) for expressing the voice data (310) to the outside in at least one form of a sound wave (510), a vibration wave (520), and a hearing-electrical stimulation (530). The data expression unit (500) includes an electric sound device (1000) for providing the voice data (310) for one or more of a speaker and a listener.

Description

The Assistive Speech and Listening Management System for Speech Discrimination, irrelevant of an Environmental and Somatopathic factors}

The present invention recognizes the physical characteristics of the articulatory organs of the head and neck, including the oral cavity through the sensor, grasps the intention of ignition through this, and signals the signal to speakers or listeners who are limited in hearing due to environmental or physical obstacles. An apparatus and system for efficiently delivering the present invention.

Voices produced by articulation organs are called speech or linguistic sounds for the communication of linguistic information, and speech in non-verbal cases. The major structures of the human body that are involved in the production of voice are the nervous system and respiratory system.

The nervous system is involved in the central nervous system and the peripheral nervous system. In the central nervous system, the cranial or cranial cell nuclei are located in the brain stem, and the cerebellum has the function of precisely controlling the muscle control for movement. Play a dominant role in function The cranial nerve involved in speech production includes the fifth cranial nerve involved in jaw movement, the seventh cranial nerve involved in lip movement, the tenth cranial nerve involved in pharynx and larynx, and the eleventh cranial nerve involved in pharyngeal movement. And the 12th nerve involved in the movement of the tongue. Among the peripheral nerves, especially the laryngeal nerves and the recurrent laryngeal nerves branched from the vagus nerve are directly involved in larynx movement.

Speech is also produced by the lower respiratory tract, the larynx, and the vocal tract. The vocal cords are the source of voice, and the flow of exhalation from the lungs causes the vocal cords to vibrate and exhalation control provides efficient sound energy.

When the vocal cords are properly tensioned and closed, the vocal cords vibrate by exhalation (breathing airflow) and the gates are opened and closed at regular intervals to control the respiratory air passage through the gates.

In order for a person to use a horse for communication, it must go through several physiological processes. The articulation process refers to a process of forming phonemes, which are units of speech sounds, after the sound is amplified and supplemented through the resonance process. The tongue is considered to be the most important articulator, but actually the phoneme involves not only the tongue but also various structures of the mouth and face. These articulators include movable structures such as the tongue, lips, soft palate, jaws, and immovable structures such as teeth or hard palates. These articulators block or restrict the flow of air to form consonants and vowels.

It is not easy to distinguish the tongue as the first articulator because its parts do not show distinct boundaries, but in terms of function, it is helpful to understand pathological articulation as well as normal articulation. The tongue can be divided from the front into the apex (tip), the blade (blade), the dorsum, the body of the tongue, and the root of the tongue (root). The tip of the tongue is the part that is used when we point out the tongue or articulate / d / (such as “La La La”), which is the first sound of the syllable, and the tongue is made from the front of the mouth, such as the alveolar sounds. It is mainly used to articulate phonemes, and the tongue is the part of the tongue that is commonly used to articulate back sounds such as velar sounds.

Secondly, as an articulator, the lips form the mouth of the mouth, which plays an important role in the expression of the head and neck. In particular, the vowels are distinguished by phonemes as well as the movement of the tongue. The bilabial sounds can be pronounced only when the lips are closed. The shape of the lips is modified by the surrounding muscles. For example, the circumference of the mouth around the lips (orbicularis oris muscle) plays an important role in pronounced lip vowels such as head lip consonants and / right / by closing or pinching the lips. Quadratus labii superior muscle and quadrates labii inferior muscle open the lips. In addition, the risorius muscle plays an important role in pulling the corners of the lips and smiling or contracting the lips to make sounds like /.

The third articulator is divided into the jaw and teeth, the jaw does not move (upper maxilla) and the lower jaw (mandible) that moves up and down and left and right. These jaws are the strongest and largest of the facial bones and are driven by four pairs of muscles. The movement of the lower jaw changes the size of the mouth, which is important not only for chewing but also for vowel production.

The fourth articulator is the gum and hard palate, the gum is the area where the / c / or / ㅅ / speech sounds are articulated, and the hard palate is the hard and rather flat area behind the gum, where the sound of the / // series is articulated. .

The last articulator is classified as an articulator that moves to the Yeongrin Palate, because the muscles of the Yeongrin Palate contract and form a closed lover's head and thus oral sounds.

Articulation

Some of the sounds are generated by the vocal cords through the vocal tract in the oral cavity, more accurately speaking, with some obstruction in the central part of the oral passage, or otherwise without any interruption. The former is usually called the consonant vowel.

1) consonant articulation

Consonants should be examined according to how and where they are spoken. Each column represents the articulation position and each line represents the articulation method. First, if the classification according to the articulation method, depending on what kind of disturbed respiratory airflow in the central part can be divided into the sound of clogging and mute sound.

Clogging sound is the sound that completely blocks and blows the airflow in the oral cavity. Clogging sound is the sound of narrowing a part of the saint and passing the airflow through the narrow passage.

The sound of clogging can again be divided into nasal resonances and non-acoustic sounds. At the same time, the nasal stops (nasal stops), which are accompanied by the nasal passages and the nasal passages, are included in the former, and the nasal stops are raised against the pharyngeal wall. The latter are the oral blockage sounds (oral stops) that block and prevent airflow from reaching the nasal passages. Depending on the length and method of occlusion, oral clog sounds are considered to be closed (stop) or ruptured (plosive), electric (trill), and snowballs (or flap / tap). can see. The mute sound is divided into a fricative (approach) and an approach sound (approximant). When a passage of air flow is formed on the side of the tongue, it is called lateral sound.

In addition, there is a wave sound (affricate) that uses a combination of multi-block and unblocked articulation methods. Finally, it is expressed as / r / or / l / in the alphabet, but it is expressed as / ㄹ / in Korean. (liquid) and not in Korean, but there is an electric tone that vibrates the articulation organs.

Categorized according to the articulation position, the bilabial refers to the sound associated with the articulation of two lips, and the Korean / ㅂ, ㅃ, ㅍ, ㅁ / etc. belong to this. The Yangpyeon in modern Korean (standard) is a sound that blocks both lips, but it can also narrow the gap between the two lips, rubbing the airflow between them (sheep friction), and dropping both lips (sheep rolling) . Labiodentals refer to sounds related to articulation of the lower lip and upper teeth, and do not exist in Korean. There is no pure sound in Korean, but [f, v] in English belongs to this pure sound. Dental is the sound that occurs when the airflow narrows or closes at the back of the upper teeth, and is sometimes called interdental because of friction between them. Alveolar is a sound produced by the constriction or closure of air currents near the upper gums, and it belongs to the Korean ㄷ, ㄸ, ㅌ, ,, ㅆ, //. In Korean, / ㅆ, ㅆ / is the sound of air constriction in the alveolar region, and the location of constriction of / s and z / in English is almost similar.

Palatoalveolar, also known as postalveolar, is the sound of the tip of the tongue or forearm touching the posterior neck, not in Korean, but in English or French. Alveolopalatal is also called prepalatal because it is articulated in front of the palatal or near the alveolar.

The three patters of the Korean language, / ㅈ, ㅊ and ㅉ /, belong to this. Retroflex differs from other tongues where the tip of the tongue or the upper surface of the tongue is articulated by touching or approaching the palate, and the lower surface of the tongue is articulated by touching or approaching the palate. A palatal sound refers to the sound that the body touches or approaches an oral palatal articulation. Velar is the sound that the body touches or approaches by the corpus. Korean closed sound / ㄱ, ㅋ, ㄲ / and nasal / ㅇ / belong to this. The palatal masturbation (uvular) refers to the sound articulated by the ear reaching or approaching the palate, the tip of the study palate. Pharyngeal refers to the sound that the articulation is made in the pharyngeal cavity. Lastly, the glottal refers to the sound that the vocal cords are used as an articulation organ, and there is only a voiceless vocal friction / ㅎ / as a phoneme in Korean.

2) Vowel Articulation: Vowel articulation is the three most important variables of the tongue height, front and back position, and the shape of the lips. In the first variable, the opening of the vowel, or the degree of opening of the vowel, is determined by the height of the tongue.The sound of opening the mouth less is called a close vowel, or a high vowel, and the sound of throwing away the mouth greatly. Is called open vowel, or low vowel. The sound between the high and low vowels is called the mid vowel, which is the close-mid vowel, or half-close vewel, with the mouth open again. It can be subdivided into larger open-mid vewels or half-open vewels. The second variable, the front and rear position of the tongue, is in fact determined based on which part of the tongue is the narrowest, that is, which part of the tongue is closest to the palate.

The narrow part of the tongue is called the front vowel, the back vowel is called the back vowel, and the middle vowel is called the central vowel. Finally, the most important variable in vowel articulation is the shape of the lips. When the articulation is rounded vowels are rounded vowels, rounded vowels are called rounded vowels.

Speech disorders mean that voice, intensity, sound quality, and fluidity are not appropriate for gender, age, size, social environment, or geographic location. This can be caused either innately or acquiredly and can be treated to some extent by increasing or decreasing the vocal cords that are part of the larynx through surgery. However, the treatment is not perfect, and the effect is not accurate.

The functions of the larynx include swallowing, coughing, obstruction, breathing, and vocalization. The methods for determining the function of the larynx include a history test, a speech pattern, an acoustic test, and an aerodynamic test.

 This method of grasping the larynx can be used to determine the degree of speech disorder.

Different types of speech disorders are classified into functional speech disorders and organic speech disorders. Most of these types have abnormalities in the vocal cords, which are part of the larynx, and these vocal cords are often disturbed due to swelling, tearing, and abnormal substances caused by external environmental factors.

In addition, in order to replace the function of the vocal cords, a vibration generator capable of artificially generating vibrations may be used.

One method of the vibration generator is a speaker method, which is composed of a magnet and a coil, and the magnetic force and repulsive force are alternately generated by causing the magnetic force and repulsive force to be reversed by changing the direction in which the current flows in the coil. .

Another method using the piezoelectric phenomenon is that the piezoelectric crystal unit receives a low frequency signal voltage and causes distortion, thereby causing the diaphragm to vibrate to generate sound. Therefore, the vibration generator using these principles can be performed to perform the function of the vocal cords.

However, in this case, the sound that appears outside is simply a function of vibrating the vocal cords, and it is not easy to identify the speaker's intention. In addition, the vibration generator should be located at the vocal cords and always have one hand. The above-mentioned utterance disorder and the above-described utterance abnormalities can be sought for therapeutic methods such as surgery on the larynx or vocal cords, but such surgical methods or treatments are sometimes impossible to provide a complete solution.

The Rion EPG, Flecher, which was widely commercialized under the name of Rion in 1973 by the University of Reading, Fujimura, Japan, and Tatsumi, used by companies such as WinEPG and Articulate Instruments Ltd. This application includes Kay Palatometer, developed by UCLA Phonetics Lab for research purposes, and Complete Speech (Logomertix), developed by Schmidt.

However, the conventional techniques have a limitation in igniting based on passive articulation organs, and using oral sulcus which is an active articulation organ itself, or realization of utterance according to actual articulation method by linkage between oral lingual articulation and other articulation organs. There was a definite limit.

Various sensors have been developed to detect changes in state or movement. Based on the sensors, it is possible to detect changes in pressure, temperature, distance, and friction.

In addition, the element of the body that controls hearing comprises the auditory system 3000 including the outer ear 3100, the middle ear 3200, and the inner ear 3300, when the auditory system 3000 is incomplete and does not function properly. , Head and neck outer side (4100), head and neck inner side (4200), head and neck side substitutes (4300), including a head replacement (4000) supplements and replaces it. Types of hearing-related disorders include disorders due to environmental factors and physical factors such as preneural hearing loss due to physical damage to the auditory system and sensorineural hearing loss due to biological damage. In detail, the obstacle caused by environmental factors is that when the sound of the surrounding environment is not properly reached from the outer ear (3100) to the middle ear (3200) or is disturbed by the noise of the surrounding environment. to be. In addition, there is a lack of air as a medium or an environmental obstacle that cannot properly listen to sounds and sounds even in the sea or the space such as the universe.

The present invention has been proposed to solve the above-mentioned problems, an object of the present invention is to grasp the articulation of the speaker according to the speaker's intention through the sensor of the head and neck including the oral cavity, and to signal the environmental and physical It is an object of the present invention to provide an apparatus and a system for efficiently delivering to a speaker or a listener who have limited hearing due to obstacles.

An object of the present invention is to implement a good quality appropriate speech in the case that it is unable to perform a normal function in the speech and can not be corrected or treated, so that the speaker or the listener can listen to the speech regardless of environmental or physical disorders. To help.

In accordance with the present invention provided to solve the problems of the prior art as described above, the head and neck neck physical characteristics-based complex system for improving hearing, the sensor unit for measuring the physical characteristics of the articulation engine adjacent to one side of the head and neck of the speaker; A data analysis unit for identifying one or more speech features of the speaker based on the position of the sensor unit and the measured physical characteristics of the articulation engine, and a data converter for converting the positions of the one or more sensor units and the one or more speech features into voice data And a data expression unit for expressing the voice data to the outside in the form of at least one of sound waves, vibration waves, and a stimulator of the speaker. do.

According to the complex system for improving the articulation and hearing of the present invention, when there is a serious limitation in selective hearing due to noise and speech of a plurality of speakers, the speaker's speech is controlled by the speaker himself or the listener's hearing system. To communicate effectively.

In addition, when the intention to speak according to the speaker's speech is expressed as a character, it is applied to Speech to Text, thereby enabling Silent Speech. Through this, when communicating with the hearing impaired, the speaker speaks and the hearing impaired as the listener recognizes this as visual material, thus eliminating communication difficulties.

In addition, it can be used for public transportation, public facilities, military facilities, operations, and underwater activities that are affected by noise in communication. Since the diagram is presented intuitively in the form of hearing, sight and touch, it is expected that the quality of communication and the convenience of living will be excellent.

1 is an exemplary view of a sensor unit configuration according to the present invention
Figure 2 is an exemplary view of the position of the sensor unit according to the present invention
3 is an exemplary view of the configuration of the sensor unit and the data analysis unit according to the present invention
Figure 4 is an illustration of the action of oral tongue for vowel ignition utilized in the present invention
5 is an illustration of an oral tongue sensor according to the present invention.
Figure 6 is another exemplary view of the oral tongue sensor according to the present invention
Figure 7 is another exemplary view of the oral tongue sensor according to the present invention
8 is another exemplary view of the oral tongue sensor according to the present invention.
9 is another exemplary view of the oral cavity sensor according to the present invention.
Figure 10 is an integrated example of the oral tongue sensor according to the present invention
11 is a cross-sectional view showing the attachment form of the oral tongue sensor according to the present invention.
12 is a perspective view showing the configuration of a mouthwash sensor according to the present invention
Figure 13 is a block diagram showing the configuration of the circuit portion of the oral cavity sensor according to the present invention
Figure 14 is an illustration of the utilization of the oral cavity sensor according to the various ignition according to the present invention
15 is a configuration example of the sensor unit, data analysis unit, database unit according to the present invention
16 is a principle diagram of grasping the physical characteristics of the articulation engine measured by the data analysis unit according to the present invention as a utterance characteristic.
17 is a more detailed principle diagram of grasping the physical characteristics of the articulation engine measured by the data analysis unit according to the present invention as a utterance characteristic.
18 is a standard speech feature matrix diagram of a vowel for the data interpreter according to the present invention to grasp the articulation physics characteristics as speech features.
19 is a standard speech feature matrix diagram of a consonant in which a data interpreter according to the present invention grasps the physical characteristics of articulator organs as speech features.
20 is a diagram illustrating an algorithm process performed by the data interpreter according to the present invention to grasp the physical characteristics of articulator organs as utterance features.
21 is a detailed illustration of an algorithm process performed by a data interpreter according to the present invention to grasp articulator physical characteristics as a speech feature.
22 is a detailed principle diagram of an algorithm process for identifying a speech feature progressed by a data interpreter according to the present invention.
Figure 23 is an illustration of the oral cavity sensor according to the present invention to grasp the specific vowels uttered by the speaker as a utterance feature
24 is an exemplary view showing that the oral cavity sensor according to the present invention measures a specific consonant uttered by the speaker and the data interpreter grasps it as an Alveolar Stop.
25 is an exemplary view showing that the oral cavity sensor and the facial sensor according to the present invention measure a specific consonant uttered by a speaker and the data interpreter grasps it as a bilabial stop.
FIG. 26 is actual experimental data of the oral cavity sensor and the facial sensor actually measuring a specific consonant uttered by a speaker, and interpreting the data as a voiced bilabial stop / bur / and a voiceless bilabial stop.
27 is an exemplary view showing that the oral tongue sensor, face sensor, voice acquisition sensor, vocal cord sensor, dental sensor measures a specific consonant uttered by the speaker and the data interpreter grasps it as a voiced labiodental fricative according to the present invention.
28 is an exemplary view showing that the oral tongue sensor, face sensor, voice acquisition sensor, vocal cord sensor, dental sensor measured a specific consonant uttered by the speaker according to the present invention and the data interpreter grasps it as Voiceless Labiodental Fricative.
29 is an exemplary view showing that the articulation engine physical characteristics are acquired by the sensor unit according to the present invention and the data analysis unit is linked with the database.
30 is a mouth oral sensor, facial sensor, voice acquisition sensor, vocal cord sensor, tooth sensor according to the present invention measures the specific consonants and vowels uttered by the speaker and the data interpreter is called / beef / to [bif] Illustrative diagram showing grasping
31 is an exemplary view showing a database unit used when grasping voice data acquired by a sensor unit according to the present invention.
32 is an exemplary view showing that the sensor unit is interlocked with the communication unit for connecting to the outside according to the present invention.
33 is an exemplary view of a database unit interworking with a data analysis unit according to the present invention.
34 is actually another exemplary diagram of a database unit interworking with a data analysis unit according to the present invention;
35 is a structural diagram showing that the sensor unit, data analysis unit, data expression unit, database unit in accordance with the present invention
36 is an exemplary view illustrating that the sensor unit, the data analysis unit, the data expression unit, and the database unit operate in accordance with the present invention.
37 is an exemplary view showing that a data expression unit expresses voice data according to the present invention.
FIG. 38 is an exemplary view illustrating that a data expression unit expresses voice data in visual form and voice form including text according to the present invention.
FIG. 39 is yet another exemplary diagram showing that the data expression unit expresses voice data in visual form and voice form including text according to the present invention. FIG.
40 is yet another exemplary diagram showing that the data expression unit expresses the voice data in the form of a visual material including a character and a voice according to the present invention.
FIG. 41 is yet another exemplary diagram showing that the data expression unit audibly expresses voice data to visual data including speech data and standard speech of voice data according to the present invention; FIG.
FIG. 42 is an exemplary view illustrating that a data expression unit visually expresses voice data in letters and audibly expresses standard speech of voice data in units of sentences according to the present invention.
FIG. 43 is yet another exemplary diagram illustrating that the data expression unit visually expresses voice data as a character in a word unit and a corresponding picture or picture in a word unit, and expresses the voice data in the form of a voice.
FIG. 44 is still another exemplary diagram illustrating that the data expression unit expresses and provides voice data in the form of text and voice as a continuous speech unit according to the present invention.
FIG. 45 is yet another exemplary diagram illustrating that the data expression unit expresses voice data in text, but provides visual and audio together with the high and low index of the corresponding sound.
46 is an exemplary view showing that the imaging sensor picks up the trauma of the head and neck articulation engine that changes according to the utterance of the speaker and grasps the data interpreter according to the present invention.
FIG. 47 is an exemplary view illustrating that a data interpreter combines mutual information through a standard speech feature matrix based on information captured by an imaging sensor and speech features grasped by the remaining sensors.
48 is a confusion matrix for recognizing and classifying a speaker's speech to correct the speaker's speech according to the present invention.
49 shows the Confusion Matrix as a percentage according to the present invention.
50 is an exemplary view showing an auditory system and a pseudo-alternative organ associated with the present invention.
FIG. 51 is an exemplary view illustrating that an electric sound device is located in the outer ear of the auditory system so that the data receiving unit receives voice data and the speaker unit transmits the voice data as sound waves to the middle ear.
FIG. 52 is an exemplary view illustrating that an electric sound device is located at the outer ear of an auditory system so that a data receiving unit receives voice data and the speaker unit transmits the voice data as sound waves, but amplifies and transmits the voice data to the middle ear.
FIG. 53 is an exemplary view illustrating that the data receiver of the sound recording apparatus is located in the outer ear of the auditory system to receive voice data, and the conduction vibration unit located inside the ear canal transmits the voice data as a vibration wave and transmits the voice data to the middle ear.
54 is a data receiver according to the present invention, the data receiver is located on one side of the head and neck of the similar substitute organs to receive voice data, and the conduction vibration unit adjacent to the voice data is transmitted as a vibration wave through the medial side bone of the head and neck; An illustration showing delivery to the inner ear
55 is according to the present invention, the data receiving unit of the transom device is located on one outer surface of the head and neck of the similar substitute organs to receive voice data, and the conduction vibration unit located on one side of the middle ear transmits the voice data as a vibration wave to deliver to the cleaning bone Figure showing that
FIG. 56 shows that the data receiving unit of the transom device is located on one outer side of the head and neck of the similar substitute organs to receive voice data, and the first conduction vibration unit adjacent thereto transmits the voice data in advance with a vibration wave. Exemplary diagram showing that the second conduction vibration unit located on one side forwards the voice data transmitted from the first conduction vibration unit to the cleaning bone
57 is a data receiver according to the present invention, the data receiver is located on one side outer surface of the head and neck of the similar substitute organ species to receive voice data, and one or more reference messaging electrode located outside the cochlea of the inner ear and one or more active located inside the cochlea Exemplary figure showing that the scorpion electrode portion consisting of scorpion electrode transmits the voice data to the stimulation of the electrostatic stimulus to replace the role of the cochlea and to transmit to the auditory nerve
58 is, according to the present invention, the data receiving unit of the transom device is located on the outer surface of the head and neck of the similar substitute organ species to receive voice data, one or more reference messaging electrodes located inside the cochlea of the inner ear and one or more active located inside the cochlea Exemplary figure showing that the scorpion electrode portion consisting of scorpion electrode transmits the voice data to the stimulation of the electrostatic stimulus to replace the role of the cochlea and to transmit to the auditory nerve
59 is a data receiving unit of the transom device located on one side of the head and neck of the similar substitute organs to receive voice data, and one or more reference messaging electrodes located inside the cochlea of the inner ear and a single active located inside the cochlea Exemplary figure showing that the scorpion electrode portion consisting of scorpion electrode transmits the voice data to the stimulation of the electrostatic stimulus to replace the role of the cochlea and to transmit to the auditory nerve
60 is according to the present invention, the data receiving unit of the transom device is located on one outer surface of the head and neck of the similar substitute organs to receive voice data, leading to one inner surface of the head and neck of the similar alternative organs and at least one reference messaging electrode adjacent to the cerebrum; An example showing that the scorpion electrode portion consisting of one or more active scorpion electrodes transmits the voice data to the stimulus of the stimulus to transmit to the cerebrum by replacing the role of the auditory nerve.
61 is a view illustrating the type of vibrator used in the conduction vibration unit and its operation principle according to the present invention.

Hereinafter, with reference to the accompanying drawings will be described in detail according to an embodiment of the present invention.

The following examples of the present invention are intended to embody the present invention, but not to limit or limit the scope of the present invention. What can be easily inferred by those skilled in the art from the detailed description and the embodiments of the present invention is interpreted as belonging to the scope of the present invention.

Details for carrying out the present invention will be described in detail with reference to FIGS. 1 to 60. 1 and 2, the sensor unit 100 of the present invention is located in the oral cavity sensor 110 located in the head and neck (11). The face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, the dental sensor 150, and the imaging sensor 160 are configured.

More specifically oral sensor 110 located in the head and neck. The facial sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the dental sensor 150 are utterance characteristics 220 according to the position of the sensor unit 210 where the respective sensors are located, and the utterance of the speaker 10. ), The speaker's voice 230, speech history information 240, and speech variation 250 are provided.

According to FIG. 3, the data analysis unit 200 acquires such data, and the data conversion unit 300 processes the data into voice data 310.

4 and 5, in the case of the oral tongue sensor 110, it is fixed to one side of the oral tongue 12, or wrapped around the surface, or inserted into it, low altitude, front and rear tongue, bending degree, extension, Identify the independent physical characteristics of one or more of the oral cavity itself: rotation, tension, contraction, relaxation, vibration.

6 and 7, in grasping the independent physical characteristics of the oral tongue itself, the oral tongue sensor 110 includes accelerations in the x-axis, y-axis, and z-axis directions, among the amount of change in the rotation angle per unit time. By grasping one or more, grasping the speech characteristics 220 by the physical characteristics of other articulation organs, including oral cavity (12).

In addition, according to FIG. 8, the oral tongue sensor 110 includes a piezoelectric element in which an electric signal is generated by polarization caused by a change in the crystal structure 111 according to the physical force generated by contraction or relaxation of the oral tongue due to ignition. By determining the degree of bending of the oral tongue through 112, it is possible to grasp the ignition feature 220 by the physical characteristics of the articulation organ including the oral tongue.

According to FIG. 9, the oral tongue sensor 110 has a triboelectric generator generated by the approach and contact caused by the oral tongue 12 interacting with other articulation organs inside and outside the head and neck 11. In order to determine the associated physical properties, the triboelectric element 113 is used to grasp the ignition characteristics 220 of the speaker 10.

10, 11, and 12, the operation principle of the oral cavity sensor 110 is composed of a composite thin film circuit can be implemented in a single film form.

At this time, the oral tongue sensor 110 is composed of a circuit portion 114, a capsule portion 115 surrounding the circuit portion 114, and an adhesive portion 116 to be fixed to one surface of the oral tongue 12.

6, 7, 8, and 9, the oral tongue sensor 110, according to the characteristics of each sensor, the degree of rupture, friction, resonance caused by the adjacent or in contact with other articulators inside and outside the head and neck 11 It is possible to grasp one or more physical characteristics of the degree of access.

According to FIG. 13, the circuit unit 114 of the oral cavity sensor 110 includes a communication chip, a sensing circuit, and an MCU.

According to FIG. 14, according to the present invention, according to the vowels of various consonants of the speaker 10, the utterance feature 220 according to the vowel vowels can be identified.

12 is an illustration showing the operation of the oral tongue sensor according to the Bilabial Sound (the labyrinth), the Alveolar Sound (the alveolar sound), and the Palatal Sound (the palate).

According to FIG. 15, a sensor near the head and neck articulation organ including the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, the tooth sensor 150, and the imaging sensor 160. The unit 100 includes a position 210 of the sensor unit in which the head and neck articulation organ is located, a speech feature 220 according to speech, a voice 230 of the speaker according to speech, a start of speech, stop speech, and end speech. Ignition history information 240 is determined.

In this case, the speech feature 220 refers to at least one basic physical speech feature among closed tear speech, friction speech, percussive speech, non-voice, speech, active speech, sibilant speech, voiceless speech, and voiced speech. . The speaker's voice 230 is also an auditory speech feature that accompanies the speech feature.

In addition, according to FIG. 15, the utterance history information 240 grasps the information by the EMG or tremor of the vocal cords through the vocal cord sensor 140.

The data analysis unit is located near the head and neck articulation organ consisting of oral tongue sensor 110, face sensor 120, voice acquisition sensor 130, vocal cord sensor 140, teeth sensor 150, imaging sensor 160 In the physical characteristics of the speaker's articulator organ measured by (100), the speech variation 250 generated according to the speaker's gender, race, age, and native language is identified.

At this time, the utterance variation 250 is assimilation, dissimilation, elimination, attachment, stress, and reduction caused by asthma and syllables. Negative (Syllabic cosonant), Flapping, Tensification, Labilalization, Velarization, Dentalizatiom, Palatalization, Nasalization, Stress Shift), Lengthening, or more than one secondary articulation.

According to FIG. 15, the present invention includes the head and neck articulation change information 161 according to the ignition from outside the head and neck in addition to the sensors adjacent to the head and neck articulation organs, and thus the head and neck facial expression change information 162, a non-verbal expression. And an imaging sensor 160 for grasping the information 163.

According to FIG. 15, the data analysis unit 200 may include a location 210 of the sensor unit measured by the head and neck articulator sensors 110, 120, 130, 140, and 150, a speech feature 220 according to speech, and speech. Recognizes the speaker's voice 230, speech history information 240, and speech variation 250 according to the speaker.

In addition, when the data converter 300 converts the data into the voice data 310 and processes the data, the data analyzer 300 is linked with the database 350.

The head and neck articulation change information 161, the head and neck facial expression change information 162, and the non-verbal expression information 163 measured by the imaging sensor 160 are recognized and processed as voice data 310.

In recognizing and processing the voice data 310 identified in association with the imaging sensor, the data analysis unit 200 is also linked with the database unit 350.

According to FIG. 31, the database unit 350 includes a phoneme unit 361, an index syllable unit index 362, a word unit index 363, a phrase unit index 364, and a sentence unit index 365. And a speech data index 360 including a continuous speech index 366 and a high and low index 367 of pronunciation.

Through the voice data index 360, the data analysis unit 200 may process various speech-related information acquired by the sensor unit 100 as voice data.

16, 17, 18, and 19, the data analysis unit 200 first acquires the physical characteristics of the articulation organ measured from the sensor unit 100 including the oral cavity sensor 110.

When the articulation organ physical characteristics are acquired due to the oral cavity sensor, the oral cavity sensor senses the articulation organ physical characteristics and creates a matrix value of the sensed physical characteristics.

Thereafter, the data analysis unit 200 grasps the utterance feature 220 of the vowel corresponding to the matrix value of the physical characteristic in the standard utterance feature matrix 205 of the vowel.

In this case, the standard speech feature matrix 205 of the consonants may exist as one or more of consonant utterance symbols, binary numbers and real numbers.

In addition, according to FIG. 16, the data analysis unit 200 is a consonant uttered by the speaker through the physical characteristics of the oral tongue measured by the sensor unit and other articulation organs inside and outside the head and neck, and thus the lexical unit stresses appearing accordingly. Identify one or more speech features 220 of stress, tonic stress.

According to FIG. 20. The data analyzing unit 200, in grasping the physical characteristics of the articulation engine measured by the sensor unit 100, acquiring articulation engine physical characteristics, and each consonant unit of the acquired articulation engine physical characteristics Determining the pattern of, extracting a unique feature from each consonant pattern, classifying the extracted features, and recombining the features of the classified pattern. Identify by specific speech characteristics.

According to FIGS. 21, 22, and 23, in the speech feature grasping algorithm performed by the data analyzing unit 200, the step of identifying the pattern of the unit of each consonant may include: If) is the oral hypothesis, the pattern of the consonant unit is identified based on the x, y, and z axes.

The algorithm is applied to one or more of K-nearset Neihbor (KNN), Artificial Neural Network (ANN), Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Restricted Boltzmann Machine (RBM), and Hidden Markov Model (HMM). Can be based.

22 and 23, when the oral tongue sensor 110 is driven by a sensor that detects a change amount or an angle change amount of the vector amount, the change in the vector amount and the angle change amount are determined by measuring the utterance of the speaker. It is recognized as a vowel [i] with Tongue Height and Tongue Frontness.

As another method, when the oral tongue sensor 110 is a sensor driven based on the principle of piezoelectric or triboelectric signals, the oral tongue sensor 110 may be generated by the change of the electrical signal due to piezoelectricity and the proximity or friction of the oral tongue sensor and the articulator inside and outside the mouth. The triboelectric signal is identified and recognized as a vowel [i] with dullness and legend.

In addition, in the case of [u] based on the same principle, it measures the height (Tongue Height: High) and backness (Backness) to determine the corresponding collection.

In the case of [ae], based on the same principle, it measures the Tongue Height (Low) r and the Tongue Frontness as a corresponding collection.

In addition, according to FIG. 23, the oral tongue sensor 110 measures vowels such as [i], [u], and [ae] generated by the speaker's speech as the speech characteristics 220.

The vowel speech feature 220 of the vowel corresponds to the phoneme unit index 361 of the consonant of the database unit 350.

According to FIG. 24, the oral cavity sensor 110 measures a specific consonant uttered by the speaker, and the data analyzer 200 measures this as the utterance feature 220.

The consonant utterance feature 220 of the consonant corresponds to the phoneme unit index 361 of the consonant of the database unit 350, and the data interpreter 200 is an Alveolar Stop on which the voice data 310 is based. Figure out.

According to FIG. 25, the oral tongue sensor 110 and the face sensor 120 measure a specific consonant uttered by the speaker, and the data analysis unit 200 recognizes this as the utterance feature 220.

The consonant utterance feature 220 of the consonant corresponds to the phoneme unit index 361 of the consonant of the database unit 350, and the data analysis unit 200 serves as a bilabial stop on which the voice data 310 is based. Figure out.

FIG. 26 is an actual test result according to the present invention. The oral tongue sensor 110 and the face sensor 120 measure a specific consonant uttered by a speaker, and the data analyzer recognizes the utterance feature 220.

The consonant utterance feature 220 of the consonant corresponds to the phoneme unit index 361 of the consonant of the database unit 350, and this is interpreted by the data interpreter 200 as the basis of the voice data 310 voiced bilabial stop. In / ver / and Voiceless Bilabial Stop, in / per /.

According to FIG. 27, the oral tongue sensor 110, the face sensor 120, and the voice acquisition sensor 130. The vocal cord sensor 140 and the dental sensor 150 measure the specific consonant uttered by the speaker with the utterance feature 220.

The consonant utterance feature 220 of the consonant corresponds to the phoneme unit index 361 of the consonant of the database unit 350, and the data interpreter 200 is a voiced labiodental fricative on which the voice data 310 is based. Figure out.

According to FIG. 28, the oral tongue sensor 110, the face sensor 120, and the voice acquisition sensor 130. The vocal cord sensor 140 and the dental sensor 150 measure the specific consonant uttered by the speaker with the utterance feature 220.

The consonant utterance feature 220 of the consonant corresponds to the phoneme unit index 361 of the consonant of the database unit 350, and the data analysis unit 200 is a voiceless labiodental fricative on which the voice data 310 is based. Figure out.

According to Figure 29, the imaging sensor 160, the speaker 10, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130. Articulation change information (161), head and neck facial expression change information (162), non-verbal expression information (163) of the head and neck generated when the vocal cord sensor (140), when using one or more of the dental sensor 160 is ignited The voice data 310 is recognized and processed.

In particular, the face sensor located on one surface of the head and neck has its own position with the potential difference between the anode sensor 122 and the cathode sensor 123 with respect to the reference sensor 121, which is provided by the imaging sensor 160 by imaging. The physical head and neck articulation organ change information 161, head and neck facial expression change information 162, and non-verbal expression information 163 are transmitted to the data converter 300 as voice data 310.

According to FIG. 30, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, the dental sensor 150, and the imaging sensor 160 according to the present invention are provided by the speaker. The specific consonants and vowels measured are measured, and the data analysis unit 200 recognizes the consonants and the vowels as the speech features 220.

The speech features 220 of the respective consonants 220, b, i, and f correspond to phoneme indexes 361 of the consonants of the database unit 350, respectively, and the data converter 300 ) Recognizes this as voice data 310 called / beef / to [bif].

According to FIG. 31, the voice data index 360 of the database unit 350 includes a phoneme unit index 361, a syllable unit index 362, a word unit index 363, and a phrase unit index 364. , Sentence unit index 365, continuous speech index 366, and high and low index 367 of pronunciation.

According to FIG. 32, the present invention includes a communication unit 400 capable of interworking communication when at least one of the data analysis unit and the data conversion unit is located outside and operated.

The communication unit may be implemented by wire or wireless. In the case of wireless, various methods such as Bluetooth, Wi-Fi, 3G, 4G, and NFC may be used.

33 and 34, according to the present invention, the database unit linked to the data analyzer according to the present invention uses the voice data index. The speech variation 250 is identified as the voice data 310.

FIG. 33 is actual data in which a sensor unit measures various consonant utterance features including the high front tense vowel and the high back tense vowel of FIG. 23, the alveolar sounds of FIG. 24, and the voiceless labiodental fricative of FIG. 28.

FIG. 34 is actual data in which the sensor measures various consonant utterance features including the high front lax vowel of FIG. 23, the alveolar sounds of FIG. 24, and the bilabial stop sounds of FIG. 25, and reflects the data analyzer.

According to FIG. 35, it can be seen that the sensor unit 100, the data analysis unit 200, the data conversion unit 300, the data expression unit 500, and the database unit 350 are organically interoperable systems. have.

In addition, according to Figure 36, the sensor unit is located in the actual articulation engine to measure the physical characteristics of the articulation engine according to the utterance of the speaker, and transmits it to the data analysis unit, the data analysis unit interprets it as voice data.

The interpreted voice data is transmitted to the data representation unit, and it can be seen that the database unit works in conjunction with the interpretation process and the representation process of the voice data.

37 to 41, the physical characteristics of the head and neck articulator of the speaker obtained by the sensor unit 100 are determined by the sensor 210 through the data analyzer 200, the position of the sensor 210, the speech feature 220, and the speaker 230. ), The utterance history information 240, and the utterance variation 250 is identified.

Thereafter, the information is converted into the voice data 310 by the data converter 300, and is externally represented by the data expression unit 500.

In this case, FIG. 37 illustrates that the data expression unit 500 audibly expresses the voice data 310.

FIG. 38 illustrates that the data expression unit 500 visually expresses the voice data 310, and indicates the physical characteristics of the speaker's articulation engine measured by the data analysis unit 200. The voice data index of the database unit 350 is shown in FIG. Compared with (360), the present invention provides a broad description of the actual standard phonetic sound and a numerical value and a voice that measure one or more of bullish noon, similar proximity, and intention to speak.

FIG. 39 illustrates that the data expression unit 500 expresses the voice data 310 visually and aurally, and indicates the physical characteristics of the speaker's articulation engine measured by the data analysis unit 200. Compared with the voice data index 360, the present invention provides a negative description of the actual standard phonetic sound along with a numerical value and a voice which measure one or more of bullish noon, similar proximity, and intention to speak.

40 illustrates that the data expressing unit 500 visually expresses the voice data 310, the physical characteristics of the speaker's articulation engine measured by the data analyzing unit 200 are indexed by the voice data of the database unit 350. Compared with (360), the numerical value measuring one or more of the accent noon, similar proximity, intention to speak with a narrow description of the actual standard pronunciation, and the corresponding speech data 310 is a word as a word In the case of corresponding to the unit index 363, it shows that the corresponding image and the corresponding voice are provided together.

FIG. 41 illustrates that the data expression unit 500 expresses the voice data 310 visually and aurally, indicating the physical characteristics of the speaker's articulation engine measured by the data analysis unit 200. Compared to the voice data index 360, the voice data 310 provided by the speaker is provided with a numerical value measuring one or more of the accent noon, similar proximity, and intention to speak, along with a narrow description of the actual standard pronunciation. ) To provide a correction image to utter the pronunciation so that the pronunciation can be enhanced.

FIG. 42 illustrates that the data expression unit 500 visualizes the voice data 310 in a text form and provides a signal for sound. The data expression unit 500 provides a database of physical characteristics of the speaker's articulation engine measured by the data analyzer 200. Speech data index 360 of one or more of consonant phoneme unit index 361, syllable unit index 362, word unit index 363, phrase unit index 364, sentence unit index 365 of section 350 Compare with The voice data 310 measures the one or more of stressed noon, pseudo-proximity, and speech intention together with a narrow description of actual standard pronunciation related to the speaker's voice data 310. It provides a voice and sound to help the speaker to correct and enhance the voice data 310.

FIG. 43 illustrates that the data expression unit 500 visualizes the voice data 310 as one or more of a voice, a picture, a picture, and an image.

At this time, the data analysis unit 200 measures the physical characteristics of the speaker's articulation organ by using the consonant phoneme index index 361, syllable unit index 362, word unit index 363, and the like of the database unit 350. One or more of the phrase unit index 364 and the sentence unit index 365 are compared with the voice data index 360.

In addition, when visualized as a letter, both a narrow description and a broad description of the actual standard pronunciation are provided. Through this, the voice data 310 is provided as a voice and a sound measured by measuring one or more of bullish noon, similar proximity, and intention to speak together with a narrow description and a broad description of the actual standard pronunciation. Helps the speaker to correct and enhance voice data 310.

FIG. 44 illustrates that the data expression unit 500 visualizes the voice data 310 as a text and provides the physical characteristics of the speaker's articulation engine measured by the data analysis unit 200. Speech data index of one or more of consonant phoneme unit index (361), syllable unit index (362), word unit index (363), phrase unit index (364), sentence unit index (365), continuous speech index (366) 360).

The voice data 310 is used as a voice and a sound of a continuous speech unit that measures one or more of stressed noon, similar proximity, and intention to speak, together with a narrow description and a broad description of the actual standard pronunciation. Provides help the speaker to correct and enhance the voice data 310.

FIG. 45 illustrates that the data expression unit 500 visualizes the voice data 310 in a text form and provides a signal by sound. The data expression unit 500 provides a database of physical characteristics of the speaker's articulation engine measured by the data analysis unit 200. Phoneme consonant index (361), syllable unit index (362), word unit index (363), phrase unit index (364), sentence unit index (365), continuous speech index (366) Compare to one or more voice data index 360 of the high and low index (367).

The voice data 310 is provided as a voice and a sound by measuring one or more of noon, similar proximity, and intention to speak together with a narrow description and a broad description of the actual standard pronunciation. Helps to calibrate and enhance voice data 310.

According to FIG. 46, the imaging sensor 160 captures a change in appearance of the head and neck articulation engine of the speaker according to the utterance, and the data analyzer 200 changes information 161 of the head and neck articulation engine of the speaker through the head and neck. The facial expression change information 162 is grasped.

At this time, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130 of the sensor unit 100. Vocal cord sensor 140. The data analysis unit 200 also considers the utterance feature 210 of the speaker identified through the dental sensor 150.

According to FIG. 47, the oral tongue sensor 110, the face sensor 120, and the voice acquisition sensor 130 of the sensor unit 100. Vocal cord sensor 140. The dental sensor 150 grasps the speaker's utterance feature 210, and the imaging sensor 160 grasps change information 161 and head and neck facial expression change information 162 of the head and neck articulation organ of the speaker.

The data analysis unit 200 combines the speech features corresponding to the change information 161 of the head and neck articulation organ and the head and neck facial expression change information 162 based on the standard speech feature matrix 205.

According to FIGS. 47 and 54, the data analyzer 200 uses a representative feature extraction algorithm using Variance of Time Domain, Cepstral Coefficient in the frequency domain, and Linear Predict Coding Coefficient in order to identify the utterance characteristics.

Variance, which represents the degree of dispersion of the data, is calculated according to Equation 1 below, where n is the network of the population, is the mean of the population of the collected articulator physical properties, and is the data of the collected articulator physical properties. .

[Equation 1]

Cepstral Coefficient is calculated by the following Equation 2 to formulate the strength of the frequency. Denotes an Inverse Fourrier Transform, which is an inverse Fourier series transform, and X (f) denotes a spectrum of frequencies for the signal. In this example, Cofficent of Cepstral utilizes the value when n = 0.

[Equation 2]

Linear Predict Coding Coefficient represents the linear characteristic of frequency and is calculated according to Equation 3 below. N is the number of samples, and is the linear predictive coding coefficient. As the coefficient of Cepstral, the value when n = 1 was used.

[Equation 3]

In addition, ANN was used to classify the data of the articulator organs according to similarity and generate prediction data to classify each data. Through this, the speaker can grasp the noon, proximity similarity, and intention of the utterance of his utterance in preparation for the standard utterance.

Based on this, the speaker gets feedback on the contents of the utterances and continuously executes the utterances for utterance correction. Through this repetitive articulation data input method, a large amount of articulation data of physical arts is gathered and accuracy of ANN is increased.

In this study, the input consonant physics was selected as 10 consonants, and five extraction positions were classified into Bilabial, Alveolar, Palatal, Velar, and Glottal. To this end, 10 consonants corresponding to the five articulation positions were pronounced 100 times in order, 1000 times in total, 50 times in total, and 500 times in total.

Accordingly, a confusion matrix for consonant classification is formed as shown in FIG. 47. On the basis of this, considering that the number of consonants spoken in each of the articulation positions is different, it is shown as a percentage as shown in FIG.

Through this, it can be seen that the speaker cannot utter consonants properly with respect to Palatal, which has low noon and close similarity as compared to the standard speech.

In addition, according to FIG. 52, 17% of cases attempt to utter consonants related to Palatal but erroneously utter consonants related to Alveolar. This means that the speaker does not clearly recognize the difference between the consonant associated with Palatal and the consonant associated with Alveolar.

According to FIG. 49, an element of the body that controls hearing includes an auditory system 3000 including an outer ear 3100, a middle ear 3200, and an inner ear 3300, and the auditory system 3000 is incomplete and functions. If not completely, the head and neck outer side (4100), head and neck inner side (4200), head and neck similar inner organs (4300), including the replacement body species (4000) is complemented and replaced.

The types of disability related to hearing are disorders due to environmental factors and physical factors such as preneural hearing loss due to physical damage to the auditory system and sensorineural hearing loss due to biological damage.

In detail, the obstacle caused by environmental factors is that when the sound of the surrounding environment is not properly reached from the outer ear (3100) to the middle ear (3200) or is disturbed by the noise of the surrounding environment. to be.

In addition, there is a lack of air as a medium or an environmental obstacle that cannot properly listen to sounds and sounds even in the sea or the space such as the universe.

As an example related to a physical disorder, the damage associated with the outer ear 3100 is amplification limited by damage to the ear canal and eardrum.

In order to solve this problem, in the case of all-negative hearing loss, the sound wave is linearly amplified and delivered to the eardrum.

Injury associated with the middle ear 3200 may be limited in amplification due to damage to the inner ear bones.

In this case, there is a method of directly stimulating the scavenging bone located in the middle ear of the auditory system, or using the bone conduction effect through the medial neck lateral bone 4300 in the pseudolarva tubular tube (4000) that is not the auditory system.

Injury associated with the inner ear 3300 is limited in the generation of waveforms through endoscopic fluid oscillation due to cochlear damage, and thus the voice cannot be converted into a hearing signal and thus cannot reach the auditory nerve.

In order to solve this problem, there is a method of distributing a conventional cochlear implant to the auditory nerve by placing an electrode in the cochlea. Alternatively, it may be solved by a method of directly transmitting a hearing signal to the cerebrum as in the conventional artificial brain stem.

According to FIG. 50, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located in the outer ear of the auditory system to receive voice data, and the speaker unit 1200 is also located on one surface of the outer ear to convert the voice data 310 into the sound wave 510. It is sent out and delivered to the middle ear, especially the tympanic membrane 3210.

According to FIG. 51, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side of the outer ear including the auricle 3110 of the auditory system to receive voice data, and the speaker unit 1200 is also located on one side of the outer ear and the voice data 310 is transmitted to the sound wave 510, but the high-frequency region or the entire region of the voice data 310 is amplified or reduced through the increase / decrease control unit 1210 to transmit to the middle ear, especially the eardrum 3210.

In this case, the increase / decrease control unit 1210 selectively adjusts or decreases the F value (Formant Frequency), which is a unique frequency of each consonant of the speaker's voice data 310, by classifying F1, F2, and F3. It becomes possible.

According to FIG. 52, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located in the outer ear of the auditory system to receive voice data, and the conduction vibration unit 1300 is located on one surface of the ear canal 3120 to vibrate the voice data 310. 520 to middle ear 3200, particularly tympanic membrane 3210.

According to FIG. 53, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side outer surface 4100 of the head and neck portion of the similar substitute organ model 4000 to receive the voice data 310 and the conduction vibration unit 1300 adjacent thereto is the head and neck portion. The voice data 310 is transmitted as the vibration wave 520 through the side end bone 4300 and transmitted to the inner ear 3300.

According to FIG. 54, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do. Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side outer surface 4100 of the head and neck of the similar substitute organs 4000 to receive the voice data 310, the conduction team located on one side of the middle ear (3200) The eastern portion 1300 transmits the voice data 310 to the vibration wave 520 and transmits the voice data 310 to the inner ear 3200, particularly, the cleaning bone 3220.

According to FIG. 55, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the dental sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310. The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000.

At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side outer surface 4100 of the head and neck of the similar substitute organ model 4000 to receive the voice data 310 and the first conduction vibration unit 1301 adjacent thereto. The voice data 310 is transmitted in advance by the vibration wave 520, and the second conduction vibration unit 1302 located in the middle ear 3200 follows the voice data 310 transmitted from the first conduction vibration unit 1301. Inner ear (3200), in particular delivered to the cleaning bone (3220).

According to FIG. 56, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310. The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000.

At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side outer surface 4100 of the head and neck of the similar substitute organs 4000 to receive the voice data 310, the cochlea 3310 of the inner ear (3300) The electrical messaging unit 1400 including one or more reference messaging electrodes 1410 located on one side of the outer surface and one or more active messaging electrodes 1420 located on one of the inner surfaces of the cochlear 3310 has a voice data 310 for the electrical stimulation 530. And send it to the inner ear 3200, especially the cleaning bone 3210. Accordingly, the auditory nerve 3320 receives the hearing stimulus 530.

According to FIG. 57, the data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the electric sound device 1000 is located on one side outer surface 4100 of the head and neck of the similar substitute organs 4000 to receive the voice data 310, the cochlea 3310 of the inner ear (3300) The electrical messaging unit 1400 including one or more reference messaging electrodes 1410 and one or more active messaging electrodes 1420 located on one outer surface of the inner ear 3200 transmits voice data 310 to the stimulator 530. In particular, to deliver to clean bone (3210). Accordingly, the auditory nerve 3320 receives the hearing stimulus 530.

Referring to FIG. 58, the data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side outer surface 4100 of the head and neck of the similar substitute organs 4000 to receive the voice data 310, the cochlea 3310 of the inner ear (3300) The electrical messaging unit 1400 including one or more reference messaging electrodes 1410 and a single active messaging electrode 1420 located on an outer surface of the inner ear 3200 transmits voice data 310 to the stimulator 530. In particular, to deliver to clean bone (3210). Accordingly, the auditory nerve 3320 receives the hearing stimulus 530.

According to FIG. 59, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do. Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the transom device 1000 is located on one side outer surface 4100 of the head and neck of the similar substitute organs 4000 to receive the voice data 310, and leads to one side inner surface 4200 of the head and neck The electrical messaging unit 1400 including one or more reference messaging electrodes 1410 and one or more active messaging electrodes 1420 adjacent to the 3330 transmits the voice data 310 to the hearing stimulus 530 to the cerebrum 3330. To pass on. Accordingly, the cerebral 3330 directly receives the hearing stimulus 530.

Referring to FIG. 60, the conduction vibration unit 1300 constituting the electric sound device 1000 of the data expression unit 500 reconverts the converted voice data 310 into the vibration wave 520 through the vibrator 1310. In this case, various types of vibrators and operating principles thereof may be provided.

First, there are two oscillator models, W-Type and C-Type, which are Lorentz forces. The two types of vibrators form magnetic fields using cylindrical magnets and donut magnets as shown in the speaker diagrams of Fig. 1) and Fig. 2) on the left, and then use a Lorentz force applied by current by placing a coil in the magnetic field. To work.

Alternatively, as shown in Figs. 3 and 4) on the right, the E-Type oscillator is an electromagnet-type oscillator with two R + V complexes and a single V oscillator, both speaker and oscillator functions. There is this. Both models operate using magnetic forces between a cylindrical electromagnet and a disc-shaped metal plate attached to a donut magnet.

In addition to the method described in the drawings, the sensor unit may include the following.

1. Pressure sensor: MEMS sensor, Piezoelectric method, Piezoresistive method, Capacitive method, Pressure sensitive rubber method, Force sensing resistor (FSR) method, Inner particle deformation method, Buckling measurement method.

2. Friction sensor: Micro hair array method, friction temperature measurement method.

3. Electrostatic sensor: electrostatic consumption, electrostatic generation.

4. Electric resistance sensor: DC resistance measurement method, AC resistance measurement method, MEMS, Lateral electrode array method, Layered electrode method, Field Effect Transistor (FET) method (Organic-FET, Metal-oxide-semiconductor-FET, Piezoelectric-oxide) -semiconductor -FET etc.).

5. Tunnel Effect Tactile Sensor: Quantum tunnel composites, Electron tunneling, Electroluminescent light.

6. Thermal resistance sensor: thermal conductivity measurement method, thermoelectric method.

7. Optical sensor: light intensity measurement, refractive index measurement.

8. Magnetism based sensor: Hall-effect measurement method, Magnetic flux measurement method.

9. Ultrasonic based sensor: Acoustic resonance frequency method, Surface noise method, Ultrasonic emission measurement method.

10. Soft material sensors: rubber, powder, porous materials, sponges, hydrogels, aerogels, carbon fibers, nanocarbon materials, carbon nanotubes, graphene, graphite, composites, nanocomposites, metal-polymer composites, ceramic-polymer composites Pressure, stress, or strain measurement method using materials such as conductive polymers, Stimuli responsive method.

11. Piezoelectric sensor: Ceramic materials such as quartz, lead zirconate titanate (PZT), polymer materials such as PVDF, PVDF copolymers, and PVDF-TrFE, and nanomaterials such as cellulose and ZnO nanowires.

10: speaker 11: head and neck 12: buccal theory 13: vocal cord
Reference Signs List 100 sensor portion 110 oral cavity sensor 111 crystal structure 112 piezoelectric element
120: face sensor 121: reference sensor 122: anode sensor 123: cathode sensor
130: voice acquisition sensor 140: vocal cord sensor
160: imaging sensor 161: change information of the articulator
162: facial expression change information of the head and neck 163: non-verbal expression
200: data analysis unit 205: standard speech feature matrix
210: position of sensor unit 220: speech feature 230: speaker's voice
240: ignition history information
250: ignition mutation
300: data conversion unit 310: voice data
350: database unit 360: voice data index
361: Phoneme unit index of consonants 362: Syllable unit index 363: Word unit index
364: verse index 365: sentence index 366: continuous speech index
367: High and low index of pronunciation
400: communication unit
500: data expression unit 510: sound wave 520: vibration wave 530: electrical stimulation
1000: electric sound device 1100: data receiver
1200: speaker portion 1210: increase and decrease control unit
1300: conduction vibration unit 1301: first conduction vibration unit 1302: second conduction vibration unit 1310: vibrator
1400: electrical messaging unit 1410: reference messaging electrode 1420: active messaging electrode
2000: display
3000: Auditory System
3100: outer ear 3110: auricle 3120: ear canal
3200: Middle ear 3210: Eardrum 3220: Cleaning bone
3300: inner ear 3310: cochlea 3320: auditory nerve 3330: brain
4000: Similar Substitution 4100: One side of head and neck
4200: one side of head and neck 4300: one side of head and neck

Claims (37)

Sensor unit 100 for measuring the physical characteristics of the articulation engine adjacent to one surface of the head and neck of the speaker 10,
A data analyzer 200 for identifying one or more speech characteristics 220 of the speaker based on the position 210 of the sensor unit and the measured physical characteristics of the articulator;
A data converter 300 for converting the position 210 and the one or more utterance features 220 of the one or more sensor units into voice data 310;
It includes a data expression unit 500 for expressing the voice data 310 to the outside in the form of at least one of the sound wave 510, vibration wave 520, the stimulator 530,
The data expression unit 500 is composed of a phonetic apparatus 1000 to provide the voice data 310 to one or more of the speaker, the listener.
Complex system for improving articulation and listening, characterized in that.
The method of claim 1,
The sensor unit 100 is fixed to one side of the oral tongue, or wrapped around the surface of the oral tongue, or inserted into the interior of the oral tongue at the time based on the x-axis, y-axis, z-axis direction of the oral tongue according to the ignition By determining the amount of change according to the amount of the vector according to the oral cavity, oral tongue sensor 110 to grasp the physical characteristics of one or more of the low altitude, front and rear tongue, flexion, extension, rotational, tension, contraction, relaxation, vibration Complex system for improving the articulation and listening, comprising.
The method of claim 1,
The sensor unit 100 is fixed to one side of the oral tongue, or wrapped around the surface of the oral tongue, or inserted into the inside of the oral tongue, unit time based on the x-axis, y-axis, z-axis direction of the oral tongue according to the ignition Oral sensor (110) to grasp the physical characteristics of one or more of the low altitude, front and rear tongue, flexion, extension, rotation, tension, contraction, relaxation, vibration degree of the oral tongue by grasping the amount of change of the rotation angle per rotation Complex system for improving articulation and listening, characterized in that it comprises a).
The method of claim 1,
The sensor unit 100 is fixed to one side of the oral tongue, or surrounds the surface of the oral tongue, the polarization is generated by the change in the crystal structure 111 according to the physical force generated by the contraction or relaxation of the oral tongue by the ignition Articulation and listening characterized in that it comprises a oral tongue sensor 110 for grasping the physical characteristics of the articulatory organ including the oral tongue by grasping the degree of bending of the oral tongue through the piezoelectric element 112 to generate an electrical signal. Complex system for improvement. The method of claim 1,
The sensor unit 100 has a rupture degree, friction degree, resonance degree according to the triboelectric generator generated by the approach and contact caused by the interaction of the oral cavity with other articulation organs inside and outside the head and neck. Combination system for improving articulation and hearing, characterized in that it comprises a buccal sensor (110) consisting of a triboelectric charging element (113) to grasp one or more physical characteristics of the approach.
The method of claim 1,
The data analysis unit may include one or more of a consonant uttered by the speaker through physical characteristics of the oral culprit and other articulators measured by the sensor unit, lexical stress, and tonic stress. Complex system for improving the articulation and listening to grasp the speech features (220).
The method of claim 6,
When the data analyzer detects the utterance feature 220 based on the physical characteristics of the articulation engine measured by the sensor unit, the speaker's pronunciation is based on a standard utterance feature matrix 205 composed of numerical values including binary or real number. A complex system for improving articulation and listening, characterized in that it measures the utterance characteristics 220 of one or more of noon, stress, proximity intent, and speech intent.
The method of claim 6,
In the data analysis unit to grasp the physical characteristics of the articulation engine measured by the sensor unit 100 as a utterance feature 220,
Recognizing the physical characteristics of the articulator as a pattern of each consonant unit,
Extracting a feature of the pattern of the consonant unit, and classifying the feature of the classified pattern according to similarity;
Recombining the features of the classified pattern,
Comprehensive system for improving the articulation and hearing, characterized in that to identify the speech characteristics according to the step of interpreting the physical characteristics of the articulation organ as speech characteristics.
The method of claim 7, wherein
The data analysis unit causes the assimilation, dissimilation, elimination, attachment, stress, and weakening of the consonants due to the physical characteristics measured by the sensor unit. Asperation, Syllabic cosonant, Flapping, Tensification, Labilization, Velarization, Dentalizatiom, Palatalization, A complex system for improving articulation and listening, characterized by measuring a speech variation (250), which is one or more secondary articulations of nasalization, stress shift, and longenging.
The method according to any one of claims 2 to 5,
The oral cavity sensor is a complex system for improving articulation and hearing, characterized in that consisting of a circuit portion for sensor operation, the capsule portion surrounding the circuit, the adhesive portion attached to one side of the oral tongue.
The method of claim 10,
The oral tongue sensor is a film having a thin film circuit complex system for improving articulation and listening, characterized in that it operates adjacent to the oral cavity.
The method of claim 1,
The sensor unit 100 may include one or more reference sensors 121 for generating a reference potential for measuring nerve signals of head and neck muscles adjacent to one or more facial muscles, and one or more bipolar sensors for measuring nerve signals of the head and neck muscles ( 122) and a face sensor 120, comprising a more than one cathode sensor 123, characterized in that the composite system for improving the articulation and hearing.
The method of claim 12,
The data analysis unit 200 acquires the position 210 of the sensor unit based on the face sensor 120, based on the reference sensor 121 of the anode sensor 122 and the cathode sensor 123. Comprehensive system for improving the articulation and hearing, characterized in that to grasp the potential difference to determine the position of the face sensor 120.
The method of claim 12,
The data analyzer 200 acquires the speaker's ignition feature 220 based on the face sensor 120, based on the reference sensor 121 and the anode sensor 122 and the cathode sensor 123. Comprehensive system for improving the articulation and listening, characterized in that to grasp the potential difference of the speech characteristics (220) by the physical characteristics of the articulation engine generated in the head and neck of the speaker.

The method of claim 1,
The sensor unit 100 to the data analysis unit 200 detect the electromyography or tremor of the vocal cords adjacent to the vocal cords of the head and neck of the speaker 10, and at least one of utterance start, ignition stop, and utterance end of the speaker 10. Complex system for improving the articulation and hearing, characterized in that it comprises a vocal cord sensor (140) to grasp the utterance history information (240).
The method of claim 1,
The data analysis unit 200 is the change information 161 of the head and neck articulation organ of the speaker according to the utterance, the head and neck facial expression change information 162 of the speaker, the head and neck, rib cage, upper limbs, lower extremity In order to grasp the non-verbal expression (163), it is linked with the imaging sensor 160 for imaging the head and neck of the speaker 10, characterized in that a complex system for improving articulation and hearing.
The method of claim 1,
The sensor unit may further include a dental sensor 150 adjacent to one surface of the tooth to determine a signal generation position according to a change in electrical capacity generated due to contact between the oral tongue and the lower lip. Complex system for improvement.
The method of claim 1,
The data analysis unit 200 is a complex system for improving the articulation and listening, characterized in that to obtain the voice of the speaker 230 according to the utterance through the voice acquisition sensor 130 adjacent to one side of the head and neck.
The method of claim 18,
The data conversion unit 300 is the position of the sensor unit 210 to the speaker obtained by the oral cavity sensor 110 to the face sensor 110 to the voice 230 of the speaker acquired by the voice acquisition sensor 130. Complex system for improving the articulation and listening, characterized in that the conversion to the voice data 310 together with the speech feature (220) of the.
The method of claim 1,
Composite system for improving articulation and hearing, characterized in that it comprises a power supply for supplying power to at least one sensor of the oral tongue sensor, facial sensor, voice acquisition sensor, vocal cord sensor, dental sensor of the sensor unit 100. The method of claim 1,
The sensor unit is a composite for improving the articulation and hearing, characterized in that the wired or wireless communication unit 400 that can communicate with each other when one or more of the data analysis unit to the database unit is located and operated outside system.
The method of claim 1,
The data conversion unit 300 includes a database unit 350 including a position 210 of the sensor unit, a speaker's speech feature 220, and at least one voice data index 360 corresponding to the speaker's voice 230. Complex system for improving the articulation and listening, characterized in that interlocked with.
The method of claim 22,
The database unit 350 may include the duration of speech, frequency according to speech, amplitude of speech, electromyography of head and neck muscles according to speech, position change of head and neck muscles according to speech, positional change due to bending and rotation of oral tongue. Based on one or more pieces of information, the phoneme unit index (361), syllable unit index (362), word unit index (363), phrase unit index (364), sentence unit index (365), and continuous speech unit index ( 366), a complex system for improving articulation and listening, comprising at least one voice data index 360 of the phonetic high and low index 367.
The method of claim 1,
The data expression unit, together with the phonetic apparatus 1000, further improves the articulation and listening, characterized in that the display 2000 further represents to the outside as one or more additional expressions of phonological symbols, phonetic symbols, guide markers, pictures. Complex system.
The method according to any one of claims 1 to 16,
The data converting unit 300 is configured to capture the at least one piece of imaging information of the head and neck articulation organ change information 161, the head and neck facial expression change information 162, and the non-verbal expression 163 by the imaging sensor 160. Composite system for improving the articulation and listening, characterized in that the mapping with the voice data 310 based on the physical characteristics of the articulation organ.
The method of claim 1,
The sound generator 1000 of the data expression unit 500 is composed of one or more of the data receiver 1100, the speaker unit 1200, the conduction vibration unit 1300, and the electric messaging unit 1400. Complex system for improving the articulation and hearing, characterized in that provided in the audio system (3000) to similar substitute organ species (4000).
The method of claim 26,
The speaker unit 1200 constituting the electric sound generator 1000 of the data expression unit 500 may improve the articulation and listening, characterized in that the converted sound data 310 is converted into sound waves 510 and provided. Complex system.
The method of claim 27,
In the speaker unit 1200 to provide the sound data 310 to the sound wave 510,
It includes a sensitization control unit 1210 to amplify or reduce the high frequency region or the entire region of the frequency F value (formant frequency) of each consonant of the voice data 310 by one or more methods of linear, nonlinear, and compressed amplification. Complex system for improving the articulation and hearing, characterized in that.

The method of claim 26,
The conduction vibration unit 1300 constituting the electrophony device 1000 of the data expression unit 500 reconverts the converted voice data 310 into the vibration wave 520 through the vibrator 1310 and provides the converted vibration data. System for improving articulation and listening.
The method of claim 26,
One or more reference messaging electrodes on the inner or outer surface of the cochlear 3320 of the inner ear 3310 of the auditory system 3000 may be configured as the electric messaging unit 1400 of the sound generator 1000 of the data expression unit 500. 1410 is disposed, and one or more active messaging electrodes 1420 are disposed on one surface of the cochlea 3320 to flow current, thereby reconverting the voice data 310 to the stimulator 530. Complex system for improving the articulation and hearing, characterized in that.
The method of claim 26,
The sound signal device 1000 of the data expression unit has the data receiver 1100 and the speaker unit 1200 to the conduction vibration unit 1300 adjacent to or inside the outer ear 3100 of the auditory system 3000 of one or more of the speaker and the listener. Is inserted into the complex data for improving articulation and listening, characterized in that to provide the voice data 310 to the middle ear (3200) by one or more of the method of transmission, amplification, reduction.
The method of claim 26,
In the sound generator 1000 of the data expression unit, a data receiver 1100 adjacent to the outer ear 3100 of the auditory system 3000 of one or more of the speaker and the listener receives the voice data 310 and is adjacent to the middle ear 3200. The conduction vibration unit 1300 to the electric messaging unit 1400 provides the voice data 310 to the middle ear (3200) by providing one or more methods of transmitting, amplifying, or reducing a complex system for improving articulation and listening.
The method of claim 26,
The phonetic apparatus 1000 of the data expression unit is a data receiver 1100 located on one side outer surface 4100 of one or more head and neck of the speaker, the listener receives the voice data 310, and the conduction vibration unit 1300 successively Composite system for improving articulation and listening, characterized in that the voice data is provided to the inner ear (3300) of the auditory system (3000) via one or more of the methods of transmitting, amplifying, reducing the medial side neck bone (4300).

The method of claim 26,
The sound signal device 1000 of the data expression unit receives the voice data 310 by the data receiver 1100 located on one side outer surface 4100 of one or more head and neck among the speaker and the listener, and the middle ear 3200 of the auditory system 3000. The conduction vibration unit (1300) located in the complex system for improving articulation and listening, characterized in that to provide the voice data 310 to the cleaning bone (3220) by one or more of the method of transmission, amplification, reduction.
The method of claim 26,
In the sound generator 1000 of the data expression unit, a data receiver 1100 located at one or more head and neck uniaxial outer surfaces 4100 of the speaker and the listener receives the voice data 310 and the first conduction unit adjacent to the data receiver 1100. The eastern portion 1301 transmits the voice data 310 in advance, and the second conductive vibration portion 1302 located on one surface of the middle ear 3200 of the auditory system 3000 is transmitted from the first conductive vibration portion 1301. Composite system for improving the articulation and listening, characterized in that the provided sound data 310 to the cleaning bone (3220) by one or more methods of transmission, amplification, reduction.


The method of claim 26,
The phonetic apparatus 1000 of the data expression unit is a data receiver 1100 located on one side outer surface 4100 of one or more head and neck among the speaker and the listener receives the voice data 310, and the inner ear 3300 of the auditory system 3000. The electrical messaging unit 1400 located in the complex for improving articulation and listening, characterized in that the voice data 310 to provide to the auditory nerve 3320 of the inner ear (3300) by one or more of the method of transmission, amplification, reduction. system.
The method of claim 26,
The sound transduction device 1000 of the data expression unit has a data receiver 1100 located on one side outer surface 4100 of one or more heads and listeners, receiving the voice data 310, and leading to one side of the head and neck 4200. 3330 is an electric messaging unit (1400), the complex system for improving articulation and listening, characterized in that the voice data 310 to the cerebral (3330) to provide, at least one method of transmitting, amplifying, reducing.

Images