KR102071421B1 - The Assistive Speech and Listening Management System for Speech Discrimination, irrelevant of an Environmental and Somatopathic factors - Google Patents

Abstract

The present invention grasps the physical characteristics of the head and neck articulation organ of the speaker according to the speaker's intention to speak through the sensor of the head and neck including the oral cavity sensor, and signal the signal to the speaker having a limited hearing due to environmental or physical obstacles An apparatus and a system for efficiently delivering to a listener.
At least one utterance characteristic of the speaker based on the sensor unit 100 for measuring the physical characteristics of the articulation organ adjacent to one surface of the head and neck of the speaker 10, and the position 210 of the sensor unit and the measured physical characteristics of the articulation organ. A data analysis unit 200 for grasping 220, a data converter 300 for converting the position 210 and the one or more speech features 220 into voice data 310, and The data expression unit 500 expresses the voice data 310 to the outside in the form of one or more of the sound wave 510, vibration wave 520, the stimulator 530, the data expression unit 500 To provide the voice data 310 to one or more of the speaker, the listener is characterized in that it is configured as a transom device (1000).

Description

The Assistive Speech and Listening Management System for Speech Discrimination, irrelevant of an Environmental and Somatopathic factors}

The present invention recognizes the physical characteristics of articulation organs of the head and neck, including the oral cavity through the sensor, grasps the intention of ignition through this signal, and signals them to speakers or listeners who are limited in hearing due to environmental or physical obstacles. An apparatus and system for efficient delivery are provided.

Voices produced by articulation organs are called speech or verbal sounds for the communication of linguistic information and vocalization in non-verbal cases. The major structures of the human body that are involved in the production of voice are the nervous system and respiratory system.

The nervous system is involved in the central nervous system and the peripheral nervous system. The central nervous system contains the skull or cranial cell nucleus, which is necessary for language generation, and the cerebellum has the function of precisely controlling the muscle control for movement. Play a dominant role in function The cranial nerve involved in speech production includes the fifth cranial nerve involved in jaw movement, the seventh cranial nerve involved in lip movement, the tenth cranial nerve involved in movement of the pharynx and larynx, and the eleventh cranial nerve involved in movement of the pharynx. And the 12th nerve involved in the movement of the tongue. Among the peripheral nerves, especially the laryngeal nerves and the recurrent laryngeal nerves branching from the vagus nerve are directly involved in laryngeal movement.

Speech is also produced by the lower respiratory system, the larynx, and the vocal tracts working closely together. The vocal cords are the source of voice, and the flow of exhaled air from the lungs causes the vocal cords to vibrate and exhalation control provides efficient sound energy.

When the vocal cords are properly tensioned and closed, the vocal cords are vibrated by exhalation (breathing airflow) and the gates are opened and closed at regular intervals to control the respiratory air passage through the gates.

In order for a person to use a horse for communication, it must go through several physiological processes. The articulation process refers to a process of forming phonemes, which are units of speech sounds, after the sound is amplified and supplemented through a resonance process. The tongue is considered to be the most important articulator, but actually the phoneme involves not only the tongue but also various structures of the mouth and face. These articulators include movable structures such as the tongue, lips, soft palate, jaws, and immovable structures such as teeth and hard palates. These articulators block or restrict the flow of air to form consonants and vowels.

It is not easy to distinguish the tongue as the first articulator because its parts do not show distinct boundaries, but in terms of function, it is helpful to understand pathological articulation as well as normal articulation. The tongue can be divided from the front into the apex (tip), the blade (blade), the tongue (dorsum), the body of the tongue, and the root of the tongue (root). The tip of the tongue is the part that is used when we point out the tongue or articulate / d / (eg, “La La La”), which is the first sound of the syllable, and the tongue is made from the front of the mouth, such as the alveolar sounds. It is mainly used to articulate phonemes, and the tongue is the part of the tongue that is commonly used to articulate back sounds such as velar sounds.

Secondly, as an articulator, the lips form the mouth of the mouth and play an important role in facial expression and articulation of the head and neck. In particular, the vowels are distinguished by phonemes as well as the movement of the tongue. The bilabial sounds can be pronounced only when the lips are closed. The shape of the lips is modified by the surrounding muscles. For example, the circumference of the mouth (orbicularis oris muscle) that surrounds the lips plays an important role in pronounced lip vowels and / or right round vowels such as / lip / constriction. Quadratus labii superior muscle and quadrates labii inferior muscle open the lips. In addition, the risorius muscle plays an important role in pulling the corners of the lips and smiling or contracting the lips to make sounds like / which should be pronounced.)

The third articulator is divided into the jaw and teeth, the jaw does not move (upper maxilla), and the mandible (lower mandible) to move up and down and left and right. These jaws are the strongest and largest of the facial bones and are driven by four pairs of muscles. The movement of the lower jaw changes the size of the mouth, which is important not only for chewing but also for vowel production.

The fourth articulator is the gum and hard palate, and the gum is the area where the / c / or / ㅅ / speech sounds are articulated, and the hard palate is the hard and rather flat area behind the gum, where the sound of the / ㅈ / series is articulated. .

The last articulator is classified as an articulator that moves to the Yeongrin Palate because the muscles of the Yeonglin Palate contract and form a closed lover's head and thus oral sounds.

Articulation

Some of the sounds are produced by the vocal cords through the vocal tract in the oral cavity, more accurately speaking, with some obstruction in the central part of the oral passage, or otherwise without any interruption. The former is usually called the consonant and the vowel.

1) consonant articulation

Consonants should be examined according to how and where they are spoken. Each column represents the articulation position and each line represents the articulation method. If you first classify according to the articulation method, depending on what kind of disturbed respiratory airflow in the central part can be divided into the sound of clogging and the sound of mute.

The sound of clogging is the sound that blocks and blows the airflow completely in the oral cavity, and the sound of clogging is the sound of narrowing a part of the saint and passing the airflow through the narrow passage.

The sound of clogging can again be divided into nasal resonances and non-acoustic sounds. At the same time, the nasal stops (nasal stops), which are accompanied by the opening of the nasal passages to open the nasal passages and accompanied by the resonance of the nasal cavity, belong to the former, and the nasal passages are lifted up against the pharyngeal wall. The latter are the oral blockage sounds (oral stops) that block and prevent airflow from reaching the nasal passages. Depending on the length and method of occlusion, oral clog sounds are considered to be closed (stop) or ruptured (plosive), electric (trill), and snowballs (or flap / tap). can see. The mute sound is divided into a fricative (approach) and an approach sound (approximant). When a passage of air flow is made on the side of the tongue, it is called lateral sound.

In addition, there is a wave sound (affricate) that uses a combination of multi-block and unblocked articulation methods. Finally, it is expressed as / r / or / l / in the alphabet, but it is expressed as / ㄹ / in Korean. (liquid) and not in Korean, but there are electric sounds that vibrate the articulation organs and speak the sound.

When classified according to the position of articulation, bilabial refers to a sound related to the articulation of two lips, and the Korean language / ㅂ, ㅃ, ㅍ, ㅁ /, etc. belong to this. All of the yangyang in modern Korean (standard language) are sounds that block both lips, but they can also narrow the gap between the two lips, rubbing the airflow between them (sheep friction), and dropping both lips (sheep rolling) . Labiodentals refer to sounds related to articulation of the lower lip and upper teeth, and do not exist in Korean. In Korean, there is no pure sound, but [f, v] in English belongs to this pure sound. Dental is the sound that occurs when the airflow narrows or closes at the back of the upper teeth, and is sometimes called interdental because of friction between them. Alveolar is a sound produced by the constriction or closure of air currents near the upper gums, which belong to the Korean ㄷ, ㄸ, ㅌ, ,, ㅆ, //. In Korean, / ㅅ, ㅆ / is the sound of airflow narrowing in the alveolar area, and / s, z / in English and the airflow narrowing are almost similar.

Palatoalveolar, also known as postalveolar, is the sound of the tip of the tongue or forearm touching the posterior neck, not in Korean, but in English or French. Alveolopalatal is also called prepalatal because it is articulated in front of the palate, or near the alveolar.

The three patters of Korean are /.,., And .. Retroflex differs from other tongues where the tip of the tongue or the upper surface of the tongue is articulated by touching or approaching the palate, and the lower surface of the tongue is articulated by touching or approaching the palate. The palatal sound refers to the sound that the body touches or approaches the oral palate. Velar is the sound of articulation as the body touches or approaches the study site. Korean closed sound / ㄱ, ㅋ, ㄲ / and nasal / ㅇ / belongs to this. The palatal masturbation (uvular) refers to the sound that the body touches or approaches the palate, the tip of the study palate. Pharyngeal refers to the sound that articulation is made in the pharyngeal cavity. Lastly, the glottal refers to the sound that the vocal cords are used as an articulation organ, and there is only a voiceless vocal friction / ㅎ / as a phoneme in Korean.

2) Vowel Articulation: Vowel articulation is the three most important variables: the tongue height, front and back position, and the shape of the lips. In the first variable, the opening of the vowel, or the opening of the vowel, is determined by the height of the tongue. The sound of opening the mouth less is called a close vowel, or a high vowel, and the sound of throwing away the mouth loudly. Is called open vowel or low vowel. The sound between the high and low vowels is called the mid vowel, which is the close-mid vowel, or half-close vowel, with the mouth open again. It can be subdivided into more open-mid vewels or half-open vewels. The second variable, the posterior position of the tongue, is in fact determined based on which part of the tongue is the narrowest, that is, which part of the tongue is closest to the palate.

The narrow part of the tongue is called the front vowel, the back vowel is called the back vowel, and the middle vowel is called the central vowel. Finally, the most important variable in vowel articulation is the shape of the lips. When the articulation is rounded vowels are rounded vowels, rounded vowels are called rounded vowels.

Speech disorders mean that voice, intensity, sound quality, and fluidity are not appropriate for gender, age, size, social environment, or geographic location. This can be caused either innately or acquiredly and can be treated to some extent by increasing or decreasing the vocal cords that are part of the larynx through surgery. However, it is not a complete treatment, and the effect is not accurate.

The functions of the larynx include swallowing, coughing, obstruction, breathing, and vocalization. The methods for determining the function of the larynx include a history test, a speech pattern, an acoustic test, and an aerodynamic test.

 This method of grasping the larynx can be used to determine the degree of speech disorder.

Different types of speech disorders are classified into functional speech disorders and organic speech disorders. Most of these types have abnormalities in the vocal cords, which are part of the larynx, and these vocal cords are often disturbed due to swelling, tearing, and the occurrence of abnormal substances due to external environmental factors.

In addition, in order to replace the function of the vocal cords, a vibration generator capable of artificially generating vibrations may be used.

One method of the vibration generator is a speaker method, which consists of a magnet and a coil, and the magnetic force and repulsive force are alternately generated by causing the magnetic force and repulsive force to be reversed by changing the direction in which the current flows in the coil. .

Another method using the piezoelectric phenomenon is that the piezoelectric crystal unit receives a low frequency signal voltage and causes distortion, thereby causing the diaphragm to vibrate to generate sound. Therefore, it is possible to perform the function of the vocal cords using a vibration generator using these principles.

However, in this case, the sound that appears outside is simply a function of vibrating the vocal cords, and it is not easy to grasp the speaker's intention. In addition, the vibration generator is located in the vocal cords and should be carried at all times. The above-mentioned utterance disorder and the above-mentioned utterance abnormalities can be sought for therapeutic methods such as surgery on the larynx or vocal cords. However, these surgical methods or treatments are sometimes impossible and thus are not a complete solution.

The Rion EPG, Flecher, which was widely commercialized under the name of Rion in 1973 by the University of Reading, Fujimura, Japan, and Tatsumi, used by companies such as WinEPG and Articulate Instruments Ltd. This application includes Kay Palatometer, developed by UCLA Phonetics Lab for research purposes, and Complete Speech (Logomertix), developed by Schmidt.

However, the conventional techniques have a limitation in igniting based on passive articulation organs, and by using oral sulcus which is an active articulation organ itself, or realization of utterance according to actual articulation method by linkage of oral lingual articulation with other articulation organs. There was a definite limit.

Various sensors have been developed to detect state changes and movements, and based on the sensors, it is possible to detect changes in pressure, temperature, distance, and friction.

In addition, the element of the body that controls hearing comprises an auditory system 3000 including an outer ear 3100, the middle ear 3200, and an inner ear 3300, when the auditory system 3000 is incomplete and does not function properly. , Head and neck outer side (4100), head and neck inner side (4200), head and neck similar inner organs (4300), including the replacement of the organs (4000). There are two types of disorders related to hearing, which are caused by environmental factors and physical factors such as preneural hearing loss due to physical damage to the auditory system and sensorineural hearing loss due to biological damage. Specifically, the obstacle caused by environmental factors is that the sound of the surrounding environment, such as a voice transmitted by the medium air, is not properly reached from the outer ear (3100) to the middle ear (3200) or is disturbed by the noise of the surrounding environment. to be. In addition, there is a lack of air as a medium, or even in the sea or the space, such as space, environmental problems that can not properly listen to the sound, such as voice.

The present invention has been proposed to solve the above-mentioned problems, an object of the present invention is to grasp the articulation of the speaker according to the speaker's intention through the sensor of the head and neck including the oral cavity, and to signal the environmental and physical It is an object of the present invention to provide an apparatus and a system for efficiently delivering to a speaker or a listener who have a limited hearing due to obstacles.

An object of the present invention is to implement a good quality appropriate speech in the case that it is unable to perform a normal function in the speech and can not be corrected or treated, so that the speaker or the listener can listen to the speech regardless of environmental or physical disorders. To help.

In accordance with the present invention provided to solve the problems of the prior art as described above, the head and neck neck physical characteristics-based complex system for improving hearing, the sensor unit for measuring the physical characteristics of the articulation engine adjacent to one surface of the head and neck of the speaker; A data analysis unit for identifying one or more speech characteristics of the speaker based on the position of the sensor unit and the measured physical characteristics of the articulation engine, and a data converter for converting the position of the one or more sensor units and the one or more speech characteristics into voice data And a data expression unit for expressing the voice data to the outside in the form of at least one of sound waves, vibration waves, and a stimulator of the speaker, wherein the data expression unit is configured as a phonetic apparatus to provide the voice data to one or more of the speaker and the listener. do.

According to the complex system for improving the articulation and hearing of the present invention, when there is a serious limitation in selective hearing due to noise and speech of a plurality of speakers, the speaker's speech is controlled by the speaker himself or the listener's hearing system. To communicate effectively.

In addition, when the intention to speak according to the speaker's speech is expressed as a character, it is applied to Speech to Text, thereby enabling Silent Speech. In this way, when communicating with the hearing impaired, the speaker speaks and the hearing impaired as the listener recognizes this as visual material, thus eliminating communication difficulties.

In addition, it can be used for public transportation, public facilities, military facilities and operations, underwater activities, etc., which are affected by noise in communication. Since the diagram is presented intuitively in the form of hearing, sight, and touch, it is expected that the quality of communication and the convenience of living will be excellent.

1 is an exemplary view of a sensor unit configuration according to the present invention
Figure 2 is an exemplary view of the position of the sensor unit according to the present invention
3 is an exemplary view of the configuration of the sensor unit and the data analysis unit according to the present invention
Figure 4 is an illustration of the action of oral tongue for vowel ignition utilized in the present invention
5 is an illustration of an oral tongue sensor according to the present invention.
Figure 6 is another exemplary view of the oral tongue sensor according to the present invention
Figure 7 is another illustration of the oral tongue sensor according to the present invention
8 is another exemplary view of the oral tongue sensor according to the present invention.
9 is another exemplary view of the oral tongue sensor according to the present invention.
Figure 10 is an integrated example of the oral tongue sensor according to the present invention
11 is a cross-sectional view showing the attachment form of the oral tongue sensor according to the present invention.
12 is a perspective view showing the configuration of a mouthwash sensor according to the present invention
Figure 13 is a block diagram showing the configuration of the circuit portion of the oral tongue sensor according to the present invention
Figure 14 is an illustration of the utilization of the oral cavity sensor according to the various ignition according to the present invention
15 is a configuration example of the sensor unit, data analysis unit, database unit according to the present invention
Figure 16 is a principle diagram for grasping the physical characteristics of the articulation engine measured by the data analysis unit according to the present invention as a utterance feature
17 is a more detailed principle diagram of grasping the physical characteristics of the articulation engine measured by the data analysis unit according to the present invention as a utterance characteristic.
18 is a standard speech feature matrix diagram of a vowel for the data interpreter according to the present invention to grasp the articulation physics characteristics as speech features.
19 is a standard speech feature matrix diagram of a consonant in which a data interpreter according to the present invention grasps the physical characteristics of articulator organs as speech features.
20 is a diagram illustrating an algorithm process performed by the data interpreter according to the present invention to grasp the physical characteristics of articulator organs as utterance features.
21 is a detailed illustration of an algorithm process performed by a data interpreter according to the present invention to grasp the physical characteristics of articulator organs as utterance features.
22 is a detailed principle diagram of an algorithm process for identifying a utterance characteristic progressed by the data analysis unit according to the present invention.
Figure 23 is an illustration of the oral cavity sensor according to the present invention to grasp the specific vowels uttered by the speaker as a utterance feature
24 is an exemplary view showing that the oral cavity sensor according to the present invention measures a specific consonant uttered by the speaker and the data interpreter grasps it as an Alveolar Stop.
25 is an exemplary view showing that the oral cavity sensor and the facial sensor according to the present invention measure a specific consonant uttered by a speaker and the data interpreter grasps it as a bilabial stop.
FIG. 26 illustrates actual experimental data of the oral cavity sensor and the facial sensor, which actually measure a specific consonant uttered by a speaker, and analyzes the data as a voiced bilabial stop / bur / and a voiceless bilabial stop.
27 is an exemplary view showing that the oral tongue sensor, face sensor, voice acquisition sensor, vocal cord sensor, dental sensor measures a specific consonant uttered by the speaker and the data interpreter grasps it as a voiced labiodental fricative according to the present invention.
28 is an exemplary view showing that the oral tongue sensor, face sensor, voice acquisition sensor, vocal cord sensor, dental sensor measures a specific consonant uttered by the speaker and the data interpreter grasps it as a Voiceless Labiodental Fricative according to the present invention.
29 is an exemplary view showing that the articulation engine physical characteristics are acquired by the sensor unit according to the present invention and the data analysis unit is linked with the database.
30 is a mouth oral sensor, facial sensor, voice acquisition sensor, vocal cord sensor, tooth sensor according to the present invention to measure the specific consonants and vowels uttered by the speaker and the data interpreter is called / beef / to [bif] Illustrative diagram showing grasping
31 is an exemplary view showing a database unit used when grasping the voice data acquired by the sensor unit according to the present invention.
32 is an exemplary view showing that the sensor unit is interlocked with the communication unit to be connected to the outside according to the present invention.
33 is an exemplary view of a database unit interworking with a data analysis unit according to the present invention.
34 is another exemplary diagram of a database unit interworking with a data analysis unit according to the present invention.
35 is a structural diagram showing that a sensor unit, a data analysis unit, a data expression unit, and a database unit are linked according to the present invention.
36 is an exemplary view illustrating that the sensor unit, the data analysis unit, the data expression unit, and the database unit operate in accordance with the present invention.
37 is an exemplary view showing that a data expression unit expresses voice data according to the present invention.
38 is an exemplary view showing that the data expression unit expresses the voice data in the form of a visual material including a character and a voice according to the present invention.
FIG. 39 is yet another exemplary diagram illustrating that the data expression unit expresses voice data in visual form and text form including text according to the present invention.
40 is yet another exemplary diagram showing that the data expression unit expresses voice data in visual form and voice form including text according to the present invention.
FIG. 41 is yet another exemplary view showing that the data expression unit audibly expresses voice data to visual data including speech data and standard speech of voice data according to the present invention.
FIG. 42 is an exemplary view illustrating that the data expression unit visually expresses voice data in letters and audibly expresses standard speech of the voice data in sentence units according to the present invention.
43 is a view showing another example in which the data expression unit visually expresses the voice data as a character in a word unit and a corresponding picture or picture in a word form and in a voice form according to the present invention.
FIG. 44 is yet another exemplary diagram showing that the data expression unit expresses and provides voice data in the form of text and voice as a continuous speech unit according to the present invention.
FIG. 45 is yet another exemplary diagram illustrating that the data expression unit expresses voice data in text, but provides visual and audio together with a high and low index of a corresponding sound.
46 is an exemplary view showing that the imaging sensor picks up the trauma of the head and neck articulation organ that changes according to the utterance of the speaker and grasps the data interpreter according to the present invention.
FIG. 47 is an exemplary diagram illustrating that a data interpreter combines mutual information through a standard speech feature matrix based on information captured by an imaging sensor and speech features grasped by the remaining sensors.
48 is a confusion matrix for recognizing and classifying a speaker's speech to correct the speaker's speech according to the present invention.
49 is a diagram showing the Confusion Matrix as a percentage according to the present invention.
50 is an exemplary view showing an auditory system and a pseudo-alternative organ associated with the present invention.
FIG. 51 is an exemplary view illustrating that an electric sound device is located at the outer ear of the auditory system so that the data receiving unit receives voice data and the speaker unit transmits the voice data as sound waves to the middle ear.
FIG. 52 is an exemplary view illustrating that an electric sound device is located at the outer ear of an auditory system so that a data receiving unit receives voice data and the speaker unit transmits the voice data as sound waves, but amplifies and transmits the voice data to the middle ear.
FIG. 53 is an exemplary view illustrating that the data receiver of the sound recording apparatus is located in the outer ear of the auditory system to receive voice data, and the conduction vibration unit located inside the ear canal transmits the voice data as a vibration wave to the middle ear.
54 is a data receiving unit of the transom device located on one side of the head and neck of the similar substitute organs to receive voice data, and the conduction vibration unit adjacent to it transmits the voice data as a vibration wave through the medial side bone of the head and neck; An illustration showing delivery to the inner ear
55 is according to the present invention, the data receiving unit of the transom device is located on one outer surface of the head and neck of the similar substitute organs to receive the voice data, the conduction vibration unit located on one side of the middle ear transmits the voice data as a vibration wave to deliver to the cleaning bone Illustrative diagram showing that
56 shows that the data receiver of the transom device is located on one outer side of the head and neck of the similar substitute organs to receive voice data, and the first conduction vibration unit adjacent thereto transmits the voice data in advance by vibrating waves. Exemplary diagram showing that the second conduction vibration unit located on one side forwards the voice data transmitted from the first conduction vibration unit to the cleaning bone
57 is a data receiving unit of the transom device located on one side outer surface of the head and neck of similar substitute organs to receive voice data, one or more reference messaging electrode located outside the cochlea of the inner ear and one or more active located inside the cochlea Exemplary figure showing that the scorpion electrode portion consisting of a scorpion electrode transmits the voice data to the stimulator of the electrostatic stimulus to replace the role of the cochlea and to transmit to the auditory nerve
58 shows, according to the present invention, a data receiving unit of the transom device is located on one outer surface of the head and neck of a similar substitute organ species to receive voice data, and one or more reference messaging electrodes located inside the cochlea of the inner ear and one or more activities located inside the cochlea Exemplary figure showing that the scorpion electrode portion consisting of a scorpion electrode transmits the voice data to the stimulator of the electrostatic stimulus to replace the role of the cochlea and to transmit to the auditory nerve
59 is a data receiving unit of the transom device located in the outer surface of the head and neck of the similar substitute organs to receive voice data, and one or more reference messaging electrode located inside the cochlea of the inner ear and a single active located inside the cochlea Exemplary figure showing that the scorpion electrode portion consisting of a scorpion electrode transmits the voice data to the stimulator of the electrostatic stimulus to replace the role of the cochlea and to transmit to the auditory nerve
60 is according to the present invention, the data receiving unit of the transom device is located on one outer surface of the head and neck of the similar substitute organs to receive voice data, and one or more reference messaging electrodes adjacent to the cerebral column leading to one inner surface of the head and neck of the similar alternative organs; An example showing that the scorpion electrode portion consisting of one or more active scorpion electrodes transmits the voice data to the stimulus of the auditory organ and replaces the role of the auditory nerve and transfers it to the cerebrum.
61 is a view illustrating the type of the vibrator utilized in the conduction vibration unit and its operation principle according to the present invention,

Hereinafter, with reference to the accompanying drawings will be described in detail according to an embodiment of the present invention.

The following examples of the present invention are not intended to limit or limit the scope of the present invention only to embody the present invention. From the detailed description and examples of the present invention, those skilled in the art to which the present invention pertains can easily be interpreted as belonging to the scope of the present invention.

Details for carrying out the present invention will be described in detail with reference to FIGS. 1 to 60. 1 and 2, the sensor unit 100 of the present invention is located in the oral cavity sensor 110 located in the head and neck (11). The face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, the dental sensor 150, and the imaging sensor 160 are configured.

More specifically oral sensor 110 located in the head and neck. The facial sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the dental sensor 150 are uttered according to the location of the sensor unit 210 where the respective sensors are located 210 and the utterance of the speaker 10. ), The speaker's voice 230, speech history information 240, and speech variation 250 are provided.

According to FIG. 3, the data analysis unit 200 acquires such data, and the data conversion unit 300 processes the data into voice data 310.

4 and 5, in the case of oral tongue sensor 110, is fixed to one side of the oral tongue 12, or wrapped around the surface, or inserted into the inside, low altitude, front and rear tongue, bending degree, extension, Identify the independent physical properties of one or more of the oral tongue itself: rotation, tension, contraction, relaxation, vibration.

6 and 7, in grasping the independent physical characteristics of the oral tongue itself, the oral tongue sensor 110 includes accelerations in the x-axis, y-axis, and z-axis directions, among the amount of change in the rotation angle per unit time. By grasping one or more, grasping the speech characteristics 220 by the physical characteristics of other articulation organs, including oral cavity (12).

In addition, according to FIG. 8, the oral tongue sensor 110 includes a piezoelectric element in which polarization occurs due to a change in the crystal structure 111 according to a physical force generated by contraction or relaxation of oral tongue caused by ignition. By determining the degree of bending of the oral tongue through 112, it is possible to grasp the ignition feature 220 by the physical characteristics of the articulation organ including the oral tongue.

According to FIG. 9, the oral tongue sensor 110 has a triboelectric generator generated by an approach and contact caused by the oral tongue 12 interacting with other articulation organs inside and outside the head and neck 11. In order to determine the associated physical properties, the triboelectric element 113 is used to grasp the ignition characteristics 220 of the speaker 10.

10, 11, and 12, the operation principle of the oral cavity sensor 110 is composed of a composite thin film circuit can be implemented in a single film form.

At this time, the oral tongue sensor 110 is composed of a circuit portion 114, a capsule portion 115 surrounding the circuit portion 114, and an adhesive portion 116 to be fixed to one surface of the oral tongue 12.

6, 7, 8, and 9, the oral tongue sensor 110, according to the characteristics of each sensor, the degree of rupture, friction, resonance caused by the adjacent or in contact with other articulators inside and outside the head and neck 11 It is possible to grasp one or more physical characteristics of the degree of access.

According to FIG. 13, the circuit unit 114 of the oral cavity sensor 110 includes a communication chip, a sensing circuit, and an MCU.

According to FIG. 14, according to the various consonants of the speaker 10, the present invention can grasp the speech feature 220 according to the consonant utterances.

12 is an illustration showing the operation of the oral tongue sensor according to the Bilabial Sound (the labyrinth), the Alveolar Sound (the alveolar sound), and the Palatal Sound (the palate).

According to FIG. 15, a sensor near the head and neck articulation organ including the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, the tooth sensor 150, and the imaging sensor 160. The unit 100 includes a position 210 of the sensor unit in which the sensor unit is located in the head and neck articulation organ, speech characteristics 220 according to speech, voice 230 of the speech speaker according to speech, start of speech, stop speech, and end of speech. Ignition history information 240 is determined.

At this time, the speech feature 220 refers to at least one basic physical speech feature of closed rupture speech, friction speech, rupture speech, non-negative speech, active speech, sibilant speech, voice-free speech, voiced speech speech that occurs when a human speaks. . The speaker's voice 230 is also an auditory speech feature accompanied by the speech feature.

In addition, according to FIG. 15, the utterance history information 240 grasps the information by the EMG or tremor of the vocal cords through the vocal cord sensor 140.

The data analysis unit is located near the head and neck articulation organ consisting of oral tongue sensor 110, face sensor 120, voice acquisition sensor 130, vocal cord sensor 140, teeth sensor 150, imaging sensor 160 In the physical characteristics of the speaker's articulation organ measured by (100), the speech variation 250 generated according to the speaker's gender, race, age, and native language is identified.

At this time, the utterance variation 250 is an associative syllable caused by assimilation, dissimilation, elimination, attachment, stress, and reduction of consonants. Negative (Syllabic cosonant), Flapping, Tensification, Labilalization, Velarization, Dentalizatiom, Palatalization, Nasalization, Stress Shift), or the second articulation phenomenon of lengthening (Lengthening).

According to Figure 15, the present invention includes the head and neck articulation change information 161 of the head and neck according to the ignition outside the head and neck in addition to the sensors adjacent to the head and neck articulation, and thus the head and neck facial expression change information 162, non-verbal expression And an imaging sensor 160 for grasping the information 163.

According to FIG. 15, the data analysis unit 200 may include a location 210 of the sensor unit measured by the head and neck articulator sensors 110, 120, 130, 140, and 150, a speech feature 220 according to speech, and speech. Recognizes the speaker 230, speech history information 240, and the speech variation 250 according to.

In addition, when the data converter 300 converts the data into the voice data 310 and processes the data, the data analyzer 300 is linked with the database 350.

The head and neck articulation change information 161, the head and neck facial expression change information 162, and the non-verbal expression information 163 measured by the imaging sensor 160 are recognized and processed as voice data 310.

In recognizing and processing the voice data 310 identified in association with the imaging sensor, the data analysis unit 200 is also linked with the database unit 350.

According to FIG. 31, the database unit 350 includes a phoneme unit 361, an index syllable unit index 362, a word unit index 363, a phrase unit index 364, and a sentence unit index 365. And a speech data index 360 including a continuous speech index 366 and a high and low index 367 of pronunciation.

Through the voice data index 360, the data analyzer 200 may process various speech-related information acquired by the sensor unit 100 as voice data.

16, 17, 18 and 19, the data analysis unit 200 first obtains the physical characteristics of the articulation organ measured from the sensor unit 100 including the oral cavity sensor 110.

When the articulation organ physical characteristics are acquired due to the oral cavity sensor, the oral cavity sensor senses the articulator physical characteristics and creates a matrix value of the sensed physical characteristics.

Thereafter, the data analysis unit 200 grasps the utterance feature 220 of the vowel corresponding to the matrix value of the physical characteristic in the standard utterance feature matrix 205 of the vowel.

In this case, the standard speech feature matrix 205 of the consonants may exist as one or more of consonant utterance symbols, binary numbers and real numbers.

In addition, according to FIG. 16, the data analysis unit 200 is a consonant uttered by the speaker through the physical characteristics of the oral tongue measured by the sensor unit and other articulation organs inside and outside the head and neck, and thus the lexical unit stress that appears accordingly. Identify one or more speech features 220 of stress, tonic stress.

According to FIG. 20. The data analyzing unit 200, in grasping the physical characteristics of the articulation engine measured by the sensor unit 100, acquiring articulation engine physical characteristics, and each consonant unit of the acquired articulation engine physical characteristics Determining the pattern of, extracting a unique feature from each consonant pattern, classifying the extracted features, and recombining the features of the classified pattern. Identify by specific speech characteristics.

According to FIGS. 21, 22, and 23, in the speech feature grasping algorithm performed by the data analyzing unit 200, the step of identifying the pattern of the unit of each consonant may include: If) is the oral hypothesis, the pattern of the consonant unit is identified based on the x, y, and z axes.

The algorithm is applied to one or more of K-nearset Neihbor (KNN), Artificial Neural Network (ANN), Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Restricted Boltzmann Machine (RBM), and Hidden Markov Model (HMM). Can be based.

22 and 23, when the oral tongue sensor 110 is driven by a sensor that detects a change amount or an angle change amount of the vector amount, the change in the vector amount and the angle change amount are determined by measuring the utterance of the speaker. It is recognized as a vowel [i] with Tongue Height and Tongue Frontness.

As another method, when the oral tongue sensor 110 is a sensor driven based on the principle of piezoelectric or triboelectric signal, the oral tongue sensor 110 may be caused by the change of the electrical signal due to piezoelectricity and the proximity or friction of the oral tongue sensor and the articulators inside and outside the mouth. The triboelectric signal is identified and recognized as a vowel [i] with dullness and legend.

In addition, in the case of [u] based on the same principle, it measures the height (Tongue Height: High) and the backness (Backness) to determine the corresponding collection.

In the case of [ae], based on the same principle, it measures the Tongue Height (Low) r and the Tongue Frontness and identifies them as the corresponding vowels.

In addition, according to FIG. 23, the oral cavity sensor 110 measures vowels such as [i], [u], and [ae] generated by the speaker's speech as the speech characteristics 220.

This vowel speech feature 220 corresponds to the phoneme unit index 361 of the consonant of the database 350.

According to FIG. 24, the oral cavity sensor 110 measures a specific consonant uttered by the speaker, and the data analyzer 200 measures the utterance feature 220.

The consonant utterance feature 220 of the consonant corresponds to the phoneme unit index 361 of the consonant of the database unit 350, and the data analyzer 200 is an Alveolar Stop on which the voice data 310 is based. Figure out.

According to FIG. 25, the oral tongue sensor 110 and the face sensor 120 measure a specific consonant uttered by the speaker, and the data analyzer 200 recognizes this as a utterance feature 220.

The consonant utterance feature 220 of the consonant corresponds to the phoneme unit index 361 of the consonant of the database unit 350, and the data analysis unit 200 serves as a bilabial stop on which the voice data 310 is based. Figure out.

FIG. 26 is an actual experimental result according to the present invention. The oral tongue sensor 110 and the face sensor 120 measure a specific consonant uttered by the speaker, and the data analyzer recognizes the utterance feature 220.

The consonant utterance feature 220 of the consonant corresponds to the phoneme unit index 361 of the consonant of the database unit 350, and this is interpreted by the data interpreter 200 as the basis of the voice data 310. Inverters and voiceless bilabial stops are identified as perfers.

According to FIG. 27, the oral tongue sensor 110, the face sensor 120, and the voice acquisition sensor 130. The vocal cord sensor 140 and the dental sensor 150 measure the specific consonant uttered by the speaker with the utterance feature 220.

The consonant utterance feature 220 of the consonant corresponds to the phoneme unit index 361 of the consonant of the database unit 350, and the data interpreter 200 is a voiced labiodental fricative on which the voice data 310 is based. Figure out.

According to FIG. 28, the oral tongue sensor 110, the face sensor 120, and the voice acquisition sensor 130. The vocal cord sensor 140 and the dental sensor 150 measure the specific consonant uttered by the speaker with the utterance feature 220.

The consonant utterance feature 220 of the consonant corresponds to the phoneme unit index 361 of the consonant of the database unit 350, and the data analysis unit 200 is a voiceless labiodental fricative on which the voice data 310 is based. Figure out.

According to Figure 29, the imaging sensor 160, the speaker 10, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130. Articulation change information (161), head and neck facial expression change information (162), non-verbal expression information (163) of the head and neck generated when the vocal cord sensor 140, the teeth sensor 160 is used in the situation of ignition The voice data 310 is recognized and processed.

In particular, the face sensor located on one side of the head and neck has its own potential with respect to the reference sensor 121 and has a potential difference between the anode sensor 122 and the cathode sensor 123, which is captured by the imaging sensor 160. It is transmitted to the data converter 300 as voice data 310 along with the physical information of the head and neck articulation change 161, the head and neck facial expression change 162, and the non-verbal expression information 163.

According to FIG. 30, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, the dental sensor 150, and the imaging sensor 160 according to the present invention are provided by the speaker. The specific consonants and vowels measured are measured, and the data analysis unit 200 recognizes the consonants and the vowels as the speech features 220.

The utterance features 220 of the respective consonants 220, [b], [i], and [f] correspond to phoneme indexes 361 of the consonants of the database unit 350, respectively. ) Recognizes this as voice data 310 called / beef / to [bif].

According to FIG. 31, the voice data index 360 of the database unit 350 includes a phoneme unit index 361, a syllable unit index 362, a word unit index 363, and a phrase unit index 364. , Sentence unit index 365, continuous speech index 366, and high and low index 367 of pronunciation.

According to FIG. 32, the present invention includes a communication unit 400 capable of interworking communication when one or more of the data analysis unit and the data conversion unit are located outside and operate.

The communication unit may be implemented by wire or wireless. In the case of wireless, various methods such as Bluetooth, Wi-Fi, 3G, 4G, and NFC may be used.

33 and 34, according to the present invention, the database unit linked to the data analyzer according to the present invention uses the voice data index. The speech variation 250 is identified as the voice data 310.

FIG. 33 is actual data in which a sensor unit measures various consonant utterance features including the high front tense vowel and high back tense vowel of FIG. 23, the alveolar sounds of FIG. 24, and the voiceless labiodental fricative of FIG. 28.

FIG. 34 is actual data in which a sensor unit measures various consonant utterance features including the high front lax vowel of FIG. 23, the alveolar sounds of FIG. 24, and the bilabial stop sounds of FIG. 25, and reflects the data analyzer.

According to FIG. 35, it can be seen that the sensor unit 100, the data analysis unit 200, the data converter 300, the data expression unit 500, and the database unit 350 are organically interoperable systems. have.

In addition, according to FIG. 36, the sensor unit is located in an actual articulation engine, measures physical characteristics of the articulation engine according to the utterance of the speaker, and transmits the physical characteristics to the data analyzer, which interprets the data as voice data.

The interpreted voice data is transmitted to the data representation unit, and it can be seen that the database unit works in conjunction with the interpretation process and the representation process of the voice data.

37 to 41, the physical characteristics of the head and neck articulator of the speaker obtained by the sensor unit 100 are determined by the sensor 210 through the data analyzer 200, the position 210 of the sensor unit, speech characteristics 220, and the speaker 230. ), The speech history information 240, and the utterance variation 250 is identified.

Thereafter, the information is converted into the voice data 310 by the data converter 300, and is externally represented by the data expression unit 500.

In this case, FIG. 37 illustrates that the data expression unit 500 audibly expresses the voice data 310.

38 illustrates that the data expression unit 500 visually expresses the voice data 310, the physical characteristics of the speaker's articulation engine measured by the data analysis unit 200 are the voice data indexes of the database unit 350. Compared with (360), it provides a broad description of the actual standard phonetic sound and a numerical value and a voice that measure one or more of bullish noon, similar proximity, and intention to speak.

FIG. 39 illustrates that the data expression unit 500 expresses the voice data 310 visually and aurally, and indicates the physical characteristics of the speaker's articulation engine measured by the data analysis unit 200. Compared with the voice data index 360, it provides a narrow description of the actual standard pronunciation along with a numerical value and a voice which measure one or more of the accent noon, similar proximity, and intention to speak.

40 illustrates that the data expressing unit 500 visually expresses the voice data 310, and indicates the physical characteristics of the speaker's articulation engine measured by the data analyzing unit 200. Compared with (360), a numerical value measuring one or more of the accent noon, similar proximity, and intention to speak, along with a narrow description of the actual standard pronunciation, and the corresponding speech data 310 is a word as a word. In the case of corresponding to the unit index 363, it shows that the corresponding image and the corresponding voice are provided together.

FIG. 41 illustrates that the data expression unit 500 expresses the voice data 310 visually and aurally, and indicates the physical characteristics of the speaker's articulation engine measured by the data analysis unit 200. Compared to the voice data index 360, the voice data 310 provided by the speaker is provided with a numerical value measuring one or more of the accent noon, similar proximity, and intention to speak, along with a narrow description of the actual standard pronunciation. ) To provide correction images to utter the pronunciation so that it can be corrected and strengthened.

FIG. 42 illustrates that the data expression unit 500 visualizes the voice data 310 in a text form and provides a sound signal. The data expression unit 500 provides a database of physical characteristics of the speaker's articulation engine measured by the data analysis unit 200. Speech data index 360 of one or more of consonant phoneme unit index 361, syllable unit index 362, word unit index 363, phrase unit index 364, sentence unit index 365 of section 350 Compare with The voice data 310 measures the one or more of stressed noon, pseudo-proximity, and speech intent together with a narrow description of actual standard pronunciation related to the speaker's voice data 310. It provides a voice and sound to help the speaker to correct and reinforce the voice data 310.

FIG. 43 illustrates that the data expression unit 500 visualizes the voice data 310 as one or more of a voice, a picture, a picture, and an image.

At this time, the data analysis unit 200 measures the physics characteristics of the speaker's articulation organ by using the consonant phoneme index index 361, syllable unit index 362, word unit index 363, and the like of the database unit 350. One or more of the phrase unit index 364 and the sentence unit index 365 are compared with the voice data index 360.

In addition, when visualized as a letter, both a narrow description and a broad description of the actual standard pronunciation are provided. Through this, the voice data 310 is provided as a voice and a sound measured by measuring one or more of bullish noon, similar proximity, and intention of speaking together with a narrow description and a broad description of the actual standard pronunciation. Helps the speaker to correct and enhance voice data 310.

FIG. 44 illustrates that the data expression unit 500 visualizes the voice data 310 in a text form and provides the physical characteristics of the speaker's articulation engine measured by the data analysis unit 200. Speech data index of one or more of the consonant phoneme unit index 361, syllable unit index 362, word unit index 363, phrase unit index 364, sentence unit index 365 and continuous speech index 366 360).

The voice data 310 is used as a voice and a sound of a continuous speech unit that measures one or more of stressed noon, similar proximity, and intention to speak, together with a narrow description and a broad description of the actual standard pronunciation. Providing helps the speaker to correct and reinforce the voice data 310.

FIG. 45 illustrates that the data expression unit 500 visualizes the voice data 310 in text form and provides a sound signal. The data analysis unit 500 measures physical characteristics of the speaker's articulation engine measured by the data analysis unit 200. Phoneme consonant index (361), syllable unit index (362), word unit index (363), phrase unit index (364), sentence unit index (365), continuous speech index (366) Compare to one or more voice data index 360 of the high and low index (367).

The voice data 310 is provided as a voice and a sound by measuring one or more of the accent noon, similar proximity, and intention to speak together with a narrow description and a broad description of the actual standard pronunciation. Helps to calibrate and enhance voice data 310.

According to FIG. 46, the imaging sensor 160 captures an appearance change of the speaker's head and neck articulation engine according to the utterance, and the data analyzer 200 uses the change information 161 and the head and neck part of the speaker's head and neck articulation engine. The facial expression change information 162 is grasped.

At this time, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130 of the sensor unit 100. Vocal cord sensor 140. The data analysis unit 200 also considers the speaker's utterance feature 210 identified through the dental sensor 150.

According to FIG. 47, the oral tongue sensor 110, the face sensor 120, and the voice acquisition sensor 130 of the sensor unit 100. Vocal cord sensor 140. The dental sensor 150 grasps the speaker's utterance feature 210, and the imaging sensor 160 grasps the change information 161 of the head and neck articulation organ and the head and neck facial expression change information 162.

The data analysis unit 200 combines speech information corresponding to the change information 161 of the head and neck articulation organ and the head and neck facial expression change information 162 based on the standard speech feature matrix 205.

According to FIGS. 47 and 54, the data analysis unit 200 may represent a feature extraction algorithm using Variance of Time Domain, Cepstral Coefficient in the frequency domain, and Linear Predict Coding Coefficient in order to identify the utterance characteristics.

Variance, which represents the degree of variance of the data, is calculated according to Equation 1 below, where n is the network of the population, is the mean of the population of the collected articulator physical properties, and is the data of the collected articulator physical properties. .

[Equation 1]

Cepstral Coefficient is calculated by the following Equation 2 to formulate the strength of the frequency. Denotes an Inverse Fourrier Transform, which is an inverse Fourier series transform, and X (f) denotes the spectrum of frequencies for the signal. In this example, Cofficent of Cepstral utilizes the value when n = 0.

[Equation 2]

Linear Predict Coding represents the linear characteristic of frequency and is calculated according to Equation 3 below. Next n is the number of samples, and is the linear predictive coding coefficient. As the coefficient of Cepstral, the value when n = 1 was used.

[Equation 3]

In addition, ANN was used to classify the data of the articulator organs according to similarity and generate prediction data to classify each data. Through this, the speaker can grasp the noon degree, proximity similarity, and intention of the utterance contents in preparation for the standard utterance for the first utterance.

Based on this, the speaker gets feedback on the contents of the utterances and continuously executes the utterance for utterance correction. Through this repetitive articulator data input method, many articulator physical data are gathered and the accuracy of ANN is increased.

In this study, the input consonant physics was selected as 10 consonants, and 5 extraction positions were classified into Bilabial, Alveolar, Palatal, Velar, and Glottal. To this end, 10 consonants corresponding to the five articulation positions were pronounced 100 times in order, 1000 times in total, 50 times in total, and 500 times in total.

Accordingly, as shown in FIG. 48, a confusion matrix for consonant classification was formed. On the basis of this, considering that the number of consonants spoken in each of the articulation positions is different, it is shown as a percentage as shown in FIG. 49.

Through this, it can be seen that the speaker cannot utter consonants properly with respect to Palatal, which has low noon and close similarity as compared to standard speech.

In addition, according to FIG. 48, 17% of cases attempt to utter consonants related to Palatal but erroneously utter consonants related to Alveolar. This means that the speaker does not clearly recognize the difference between the consonant associated with Palatal and the consonant associated with Alveolar.

According to FIG. 50, an element of the body that controls hearing includes an auditory system 3000 including an outer ear 3100, a middle ear 3200, and an inner ear 3300, and the auditory system 3000 is incomplete and functions. If not completely, the head and neck outer side (4100), head and neck side inner surface (4200), head and neck similar inner organs (4000), including the side neck bone (4300) supplement and replace it.

The types of disability related to hearing are disorders due to environmental factors and physical factors such as preneural hearing loss due to physical damage to the auditory system and sensorineural hearing loss due to biological damage.

Specifically, the obstacle caused by environmental factors is that the sound of the surrounding environment, such as a voice transmitted by the medium air, is not properly reached from the outer ear (3100) to the middle ear (3200) or is disturbed by the noise of the surrounding environment. to be.

In addition, there is a lack of air as a medium, or even in the sea or the space, such as space, environmental problems that can not properly listen to the sound, such as voice.

As an example of a physical disorder, the damage associated with the outer ear 3100 is amplification limited by damage to the ear canal and eardrum.

In order to solve this problem, in the case of all-negative hearing loss, the sound wave is linearly amplified and delivered to the eardrum.

Injury associated with the middle ear 3200 may be limited in amplification due to damage to the inner ear bones.

In this case, there is a method of directly stimulating the scavenging bone located in the middle ear of the auditory system, or using the bone conduction effect through the medial neck lateral bone 4300 in the pseudolarge tubulomas of the non-acoustic system.

Injury associated with the inner ear 3300 is limited in the generation of waveforms through endoscopic fluid oscillation due to cochlear damage, and thus the voice cannot be converted into a hearing signal and thus cannot reach the auditory nerve.

In order to solve this problem, there is a method of disposing a electrode in the cochlea and transmitting a hearing signal to the auditory nerve in the form of a conventional cochlear implant. Alternatively, it may be solved by a method of directly transmitting a hearing signal to the cerebrum as in the conventional artificial brain stem.

According to FIG. 51, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located in the outer ear of the auditory system to receive voice data, and the speaker unit 1200 is also located on one side of the outer ear to convert the voice data 310 into the sound wave 510. It is sent out and delivered to the middle ear, especially the tympanic membrane 3210.

According to FIG. 52, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side of the outer ear including the auricle 3110 of the auditory system to receive voice data, and the speaker unit 1200 is also located on one side of the outer ear and the voice data ( 310 is transmitted to the sound wave 510, but the high-frequency region or the entire region of the voice data 310 is amplified or reduced through the increase / decrease control unit 1210 to transmit to the middle ear, especially the eardrum 3210.

In this case, the increase / decrease control unit 1210 selectively adjusts or decreases the F value (Formant Frequency), which is a unique frequency of each consonant of the speaker's voice data 310, by classifying F1, F2, and F3. It becomes possible.

According to FIG. 53, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located in the outer ear of the auditory system to receive voice data, and the conduction vibration unit 1300 is located on one surface of the ear canal 3120 to vibrate the voice data 310. 520 to middle ear 3200, particularly tympanic membrane 3210.

According to FIG. 54, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 positioned on the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. In this case, the data receiving unit 1100 of the sound source device 1000 is located on one side outer surface 4100 of the head and neck part of the similar substitute organ model 4000 to receive the voice data 310, and the conduction vibration unit 1300 adjacent thereto is head and neck. The voice data 310 is transmitted to the inner ear 3300 through the side end bone 4300 as a medium.

According to FIG. 55, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do. Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side outer surface (4100) of the head and neck of the similar replacement organs (4000) to receive the voice data 310, the conduction team located on one surface of the middle ear (3200) The eastern portion 1300 transmits the voice data 310 to the vibration wave 520 and transmits the voice data 310 to the inner ear 3200, particularly, the cleaning bone 3220.

According to FIG. 56, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 positioned on the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310. The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000.

At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side outer surface 4100 of the head and neck of the similar substitute organ model 4000 to receive the voice data 310 and the first conduction vibration unit 1301 adjacent thereto. The voice data 310 is transmitted in advance by the vibration wave 520, and the second conduction vibration unit 1302 located in the middle ear 3200 follows the voice data 310 transmitted from the first conduction vibration unit 1301. Inner ear (3200), in particular delivered to the cleaning bone (3220).

According to FIG. 57, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do.

Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310. The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000.

At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side outer surface 4100 of the head and neck of the similar substitute organ species 4000, and receives the voice data 310, the cochlea 3310 of the inner ear (3300). The electrical messaging unit 1400 composed of at least one reference messaging electrode 1410 located at an outer surface of the at least one active messaging electrode 1420 located at an inner surface of the cochlear 3310 has a voice data stimulus 530. And send it to the inner ear 3200, especially the cleaning bone 3210. Accordingly, the auditory nerve 3320 receives the hearing stimulus 530.

According to FIG. 58, the data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side outer surface 4100 of the head and neck of the similar substitute organ species 4000, and receives the voice data 310, the cochlea 3310 of the inner ear (3300). The electrical messaging unit 1400 consisting of one or more reference messaging electrodes 1410 located on one inner surface of the cochlear tube and one or more active messaging electrodes 1420 located on one inner surface of the cochlea are configured to convert the voice data 310 into the audio stimulator 530. It is sent to the inner ear 3200, in particular, to the cleaning bone 3210. Accordingly, the auditory nerve 3320 receives the hearing stimulus 530.

According to FIG. 59, the data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the sound source device 1000 is located on one side outer surface 4100 of the head and neck of the similar substitute organs 4000 to receive the voice data 310, the cochlea 3310 of the inner ear (3300) The electrical messaging unit 1400 composed of one or more reference messaging electrodes 1410 and a single active messaging electrode 1420 located on one inner surface of the inner ear 3200 transmits voice data 310 to the stimulator 530. In particular, to deliver to clean bone 3210. Accordingly, the auditory nerve 3320 receives the hearing stimulus 530.

According to FIG. 60, the oral tongue sensor 110, the face sensor 120, the voice acquisition sensor 130, the vocal cord sensor 140, and the tooth sensor 150 located in the head and neck of the speaker sense physical characteristics of the speaker's articulation organ. do. Based on this, the data analysis unit 200 grasps the speech feature 220 and the speaker's voice 230. Based on this, the data converter 300 is interlocked with the database unit 350 including at least one voice data index 360 corresponding to the speaker's speech feature 220 and the speaker's voice 230. Generate 310.

The data expression unit 500 transmits the voice data 310 to the electrophony apparatus 1000. At this time, the data receiving unit 1100 of the transom device 1000 is located on one side outer surface 4100 of the head and neck of the similar substitute organs 4000 to receive the voice data 310, and leads to one side inner surface 4200 of the head and neck. The electrical messaging unit 1400 including one or more reference messaging electrodes 1410 and one or more active messaging electrodes 1420 adjacent to the 3330 transmits the voice data 310 to the hearing stimulus 530 to the cerebrum 3330. To pass on. Accordingly, the cerebral 3330 directly receives the hearing stimulus 530.

According to FIG. 61, the conduction vibration unit 1300 constituting the electric sound device 1000 of the data expression unit 500 reconverts the converted voice data 310 into the vibration wave 520 through the vibrator 1310. In this case, various kinds of vibrators and operating principles thereof may be provided.

First, there are two oscillator models, W-Type and C-Type, which are Lorentz forces. The two types of vibrators form magnetic fields using cylindrical magnets and donut magnets as shown in the speaker concept diagrams of Figs. 1 and 2 on the left side, and then use a Lorentz force applied by current by placing a coil in the magnetic field. To work.

Alternatively, as shown in Figs. 3 and 4) on the right, the E-Type vibrator is an electromagnet-type vibrator with two R + V composites and a single V oscillator with both a speaker function and a vibrator function. There is this. Both models operate using magnetic forces between a cylindrical electromagnet and a disc-shaped metal plate attached to a donut magnet.

In addition to the method described in the drawings, the sensor unit may include the following.

1. Pressure sensor: MEMS sensor, Piezoelectric method, Piezoresistive method, Capacitive method, Pressure sensitive rubber method, Force sensing resistor (FSR) method, Inner particle deformation method, Buckling measurement method.

2. Friction sensor: Micro hair array method, friction temperature measurement method.

3. Electrostatic sensor: electrostatic consumption, electrostatic generation.

4. Electric resistance sensor: DC resistance measurement method, AC resistance measurement method, MEMS, Lateral electrode array method, Layered electrode method, Field Effect Transistor (FET) method (Organic-FET, Metal-oxide-semiconductor-FET, Piezoelectric-oxide) -semiconductor -FET etc.).

5. Tunnel Effect Tactile Sensor: Quantum tunnel composites, Electron tunneling, Electroluminescent light.

6. Thermal resistance sensor: thermal conductivity measurement method, thermoelectric method.

7. Optical sensor: light intensity measurement, refractive index measurement.

8. Magnetism based sensor: Hall-effect measurement method, Magnetic flux measurement method.

9. Ultrasonic based sensor: Acoustic resonance frequency method, Surface noise method, Ultrasonic emission measurement method.

10. Soft material sensors: rubber, powder, porous materials, sponges, hydrogels, aerogels, carbon fibers, nanocarbon materials, carbon nanotubes, graphene, graphite, composites, nanocomposites, metal-polymer composites, ceramic-polymer composites Pressure, stress, or strain measurement method using materials such as conductive polymers, Stimuli responsive method.

11. Piezoelectric sensor: Ceramic materials such as quartz, lead zirconate titanate (PZT), polymer materials such as PVDF, PVDF copolymers, and PVDF-TrFE, and nanomaterials such as cellulose and ZnO nanowires.

10: speaker 11: head and neck 12: buccal theory 13: vocal cord
Reference Signs List 100 sensor portion 110 oral cavity sensor 111 crystal structure 112 piezoelectric element
120: face sensor 121: reference sensor 122: anode sensor 123: cathode sensor
130: voice acquisition sensor 140: vocal cord sensor
160: imaging sensor 161: change information of the articulator
162: facial expression change information of the head and neck 163: non-verbal expression
200: data analysis unit 205: standard speech feature matrix
210: position of sensor unit 220: speech feature 230: speaker's voice
240: ignition history information
250: ignition mutation
300: data conversion unit 310: voice data
350: database unit 360: voice data index
361: Phoneme unit index of consonants 362: Syllable unit index 363: Word unit index
364: phrase index 365: sentence index 366: continuous speech index
367: High and low index of pronunciation
400: communication unit
500: data expression unit 510: sound wave 520: vibration wave 530: electrical stimulator
1000: electric sound device 1100: data receiver
1200: speaker portion 1210: increase and decrease control unit
1300: conduction vibration unit 1301: first conduction vibration unit 1302: second conduction vibration unit 1310: vibrator
1400: electrical messaging unit 1410: reference messaging electrode 1420: active messaging electrode
2000: display
3000: Auditory System
3100: outer ear 3110: auricle 3120: ear canal
3200: middle ear 3210: eardrum 3220: cleaning bone
3300: inner ear 3310: cochlea 3320: auditory nerve 3330: brain
4000: Similar replacement organ 4100: One side of head and neck
4200: one side of head and neck 4300: one side of head and neck

Claims (37)

A sensor unit 100 for measuring physical characteristics of the articulation organ adjacent to one surface of the oral cavity and the head and neck of the speaker 10,
A data analyzer 200 for identifying one or more utterance features 220 of the speaker based on the position 210 of the sensor unit and the measured physical characteristics of the articulator;
A data converter 300 for converting the position 210 and the one or more utterance features 220 of the one or more sensor units into voice data 310;
It includes a data expression unit 500 for expressing the voice data 310 to the outside in the form of at least one of the sound wave 510, vibration wave 520, the stimulator 530,
The data expression unit 500 is composed of a phonetic apparatus 1000 to provide the voice data 310 to one or more of the speaker and the listener;

The data analysis unit 200
One or more of the consonants uttered by the speaker through the physical characteristics of the oral tongue measured by the sensor unit 100 and other articulation organs, the resulting lexical stress and sentence stress Identify features 220,
In grasping the speech feature 220 based on the physical characteristics of the articulation organ measured by the sensor unit 100, the speaker's pronunciation and the speech based on a standard speech feature matrix 205 consisting of a numerical value including binary or real number. Measuring utterance features 220 of one or more of stress noon, pseudo-proximity, or utterance intent
Complex system for improving articulation and listening, characterized in that.
The method of claim 1,
The sensor unit 100 is fixed to one side of the oral tongue, or wrapped around the surface of the oral tongue, or inserted into the interior of the oral tongue at the time based on the x-axis, y-axis, z-axis direction of the oral tongue according to the ignition By determining the amount of change in the amount of the vector according to the oral cavity, oral tongue sensor 110 to grasp the physical properties of one or more of the low altitude, front and rear tongue, flexion, extension, rotational, tension, contraction, relaxation, vibration Complex system for improving the articulation and listening, comprising.
The method of claim 1,
The sensor unit 100 is fixed to one side of the oral tongue, or wrapped around the surface of the oral tongue, or inserted into the inside of the oral tongue, the unit time based on the x-axis, y-axis, z-axis direction of the oral tongue according to the ignition Oral sensor (110) to grasp the physical characteristics of one or more of the low altitude, front and rear tongue, flexion, extension, rotation, tension, contraction, relaxation, vibration of the oral tongue by grasping the amount of change of the rotation angle per rotation Complex system for improving articulation and listening, characterized in that it comprises a).
The method of claim 1,
The sensor unit 100 is fixed to one side of the oral tongue, or surrounds the surface of the oral tongue, and the polarization is generated by the change of the crystal structure 111 according to the physical force generated by contraction or relaxation of the oral tongue by ignition. Articulation and listening characterized in that it comprises a oral tongue sensor 110 for grasping the physical characteristics of the articulatory organ including the oral tongue by grasping the degree of bending of the oral tongue through the piezoelectric element 112 to generate an electrical signal. Complex system for improvement. The method of claim 1,
The sensor unit 100 has a rupture degree, friction degree, resonance degree according to the triboelectric generator generated by the approach and contact caused by interaction with other articulation organs inside and outside the head and neck. Complex system for improving articulation and hearing, characterized in that it comprises a buccal sensor (110) consisting of a triboelectric charging element (113) to grasp one or more physical characteristics of the approach.
delete delete The method of claim 1,
In the data analysis unit to grasp the physical characteristics of the articulation engine measured by the sensor unit 100 as a utterance feature 220,
Recognizing the physical characteristics of the articulator as a pattern of each consonant unit,
Extracting a feature of the pattern of the consonant unit and classifying the feature of the pattern of the consonant unit according to similarity;
Recombining the features of the pattern of the consonant unit,
Comprehensive system for improving the articulation and listening, characterized in that to identify the speech characteristics according to the step of interpreting the physical characteristics of the articulation organ as speech characteristics.
The method of claim 1,
The data analysis unit causes an associative, dissimilation, elimination, attachment, stress, and weakening of the consonants due to the physical characteristics measured by the sensor unit. Asphalt, Sylllabic cosonant, Flapping, Tensification, Labilization, Velarization, Dentalizatiom, Palatalization, A complex system for improving articulation and hearing, characterized by measuring a speech variation (250), which is one or more secondary articulation of nasalization, stress shift, and lengthening.
The method according to any one of claims 2 to 5,
The oral cavity sensor is a complex system for improving articulation and hearing, characterized in that consisting of a circuit portion for sensor operation, the capsule portion surrounding the circuit, the adhesive portion attached to one side of the oral tongue.
The method of claim 10,
The oral tongue sensor is a film having a thin film circuit complex system for improving articulation and listening, characterized in that it operates adjacent to the oral cavity.
The method of claim 1,
The sensor unit 100 may include one or more reference sensors 121 for generating a reference potential for measuring nerve signals of head and neck muscles adjacent to one or more facial muscles, and one or more bipolar sensors for measuring nerve signals of the head and neck muscles ( 122) and a face sensor 120, comprising a more than one cathode sensor 123, characterized in that the composite system for improving the articulation and hearing.
The method of claim 12,
The data analyzing unit 200 acquires the position 210 of the sensor unit based on the face sensor 120, based on the reference sensor 121 of the anode sensor 122 and the cathode sensor 123. Comprehensive system for improving the articulation and hearing, characterized in that to grasp the potential difference to determine the position of the face sensor 120.
The method of claim 12,
The data analyzer 200 acquires the speaker's utterance feature 220 based on the face sensor 120, based on the reference sensor 121 and the anode sensor 122 and the cathode sensor 123. Comprehensive system for improving the articulation and listening, characterized in that to grasp the potential difference of the speech characteristics (220) by the physical characteristics of the articulation engine generated in the head and neck of the speaker.

The method of claim 1,
The sensor unit 100 to the data analysis unit 200 detect the electromyography or tremor of the vocal cords adjacent to the vocal cords of the head and neck of the speaker 10, and at least one of the utterance start, ignition stop, and utterance end of the narrator 10. Complex system for improving articulation and hearing, characterized in that it comprises a vocal cord sensor (140) to grasp the utterance history information (240).
The method of claim 1,
The data analysis unit 200 changes information of the head and neck articulation organ of the speaker according to the utterance, change information 162 of the head and neck facial expression of the speaker, head and neck, chest, upper limbs, lower extremity A composite system for improving articulation and listening, characterized in that it is linked with the imaging sensor 160 for imaging the head and neck of the speaker 10 to grasp the non-verbal expression (163).
The method of claim 1,
The sensor unit may further include a dental sensor 150 adjacent to one surface of the tooth to determine a signal generation position according to a change in electric capacity generated due to contact between the oral tongue and the lower lip. Complex system for improvement.
The method of claim 2,
The data analysis unit 200 is a complex system for improving the articulation and listening, characterized in that to obtain the voice of the speaker 230 according to the utterance through the voice acquisition sensor 130 adjacent to one surface of the head and neck. The method of claim 18,
The data conversion unit 300 uses the speaker 230 acquired by the voice acquisition sensor 130 to position the sensor unit 210 to the speaker obtained by the oral cavity sensor 110 or the face sensor 110. Complex system for improving the articulation and listening, characterized in that the conversion to the voice data 310 together with the speech feature 220 of the.
The method of claim 1,
Complex system for improving articulation and hearing, characterized in that it comprises a power supply for supplying power to one or more sensors of the oral tongue sensor, facial sensor, voice acquisition sensor, vocal cord sensor, dental sensor of the sensor unit 100. The method of claim 1,
The sensor unit is a composite for improving the articulation and hearing, characterized in that the wired or wireless communication unit 400, which can communicate with each other when one or more of the data analysis unit to the database unit is located and operated outside system.
The method of claim 1,
The data conversion unit 300 includes a database unit 350 including a position 210 of the sensor unit, a speaker's speech feature 220, and at least one voice data index 360 corresponding to the speaker's voice 230. Complex system for improving the articulation and hearing, characterized in that interlocked with.
The method of claim 22,
The database unit 350 may include a duration of speech, frequency according to speech, amplitude of speech, muscle electromyography of head and neck muscles according to speech, position change of head and neck muscles according to speech, positional change due to bending and rotation of oral tongue. Based on one or more pieces of information, the phoneme unit index (361), syllable unit index (362), word unit index (363), phrase unit index (364), sentence unit index (365), and continuous speech unit index ( 366), a complex system for improving articulation and listening, comprising at least one voice data index 360 of the phonetic high and low index 367.
The method of claim 1,
The data expression unit, together with the phonetic apparatus 1000, further improves articulation and listening, characterized in that the display 2000 further expresses to the outside as one or more additional expressions of phonological symbols, phonetic symbols, guide marks, and pictures. Complex system.
The method of claim 16,
The data converting unit 300 is configured by the image sensor 160 to change the image information of one or more of the head and neck articulation organ change information 161, head and neck facial expression change information 162, non-verbal expression 163 of the sensor unit 100 Complex system for improving articulation and listening, characterized in that the mapping with the voice data 310 based on the physical characteristics of the articulation organ.
The method of claim 1,
The sound generator 1000 of the data expression unit 500 is composed of one or more of the data receiver 1100, the speaker unit 1200, the conduction vibration unit 1300, and the electric messaging unit 1400. Complex system for improving the articulation and hearing, characterized in that provided in the audio system (3000) to the similar substitute organ species (4000).
The method of claim 26,
The speaker unit 1200 constituting the electric sound generator 1000 of the data expression unit 500 may improve the articulation and listening, characterized in that the converted voice data 310 is converted into sound waves 510 and provided. Complex system.
The method of claim 27,
In the speaker unit 1200 to provide the sound data 310 to the sound wave 510,
It includes a sensitization control unit 1210 to amplify or reduce the high frequency region or the entire region of the frequency F value (formant frequency) of each consonant of the voice data 310 by one or more of linear, nonlinear, and compressed amplification methods. Complex system for improving the articulation and hearing, characterized in that.

The method of claim 26,
The conduction vibration unit 1300 constituting the electrophony device 1000 of the data expression unit 500 reconverts the converted voice data 310 into the vibration wave 520 through the vibrator 1310 and provides the converted sound data. System for improving articulation and listening.
The method of claim 26,
One or more reference messaging electrodes on the inner or outer surface of the cochlea 3320 of the inner ear 3310 of the auditory system 3000 may be configured as an electrical messaging unit 1400 of the sound generator 1000 of the data representation unit 500. 1410 is disposed, and one or more active messaging electrodes 1420 are disposed on one surface of the cochlea 3320 to flow current, thereby reconverting the voice data 310 to the stimulator 530. Complex system for improving the articulation and hearing, characterized in that.
The method of claim 26,
The sound signal device 1000 of the data expression unit has the data receiver 1100 and the speaker unit 1200 to the conduction vibration unit 1300 adjacent to or inside the outer ear 3100 of the auditory system 3000 of one or more of the speaker and the listener. Is inserted into the complex data for improving articulation and listening, characterized in that to provide the voice data 310 to the middle ear (3200) by one or more of the method of transmission, amplification, reduction.
The method of claim 26,
In the audio expression device 1000 of the data expression unit, a data receiver 1100 adjacent to the outer ear 3100 of the auditory system 3000 of one or more of the speaker and the listener receives the voice data 310 and is adjacent to the middle ear 3200. The conduction vibration unit 1300 to the electric messaging unit 1400 provides the voice data 310 to the middle ear (3200) by using one or more methods of transmitting, amplifying and reducing the complex system for improving articulation and listening.
The method of claim 26,
The phonetic apparatus 1000 of the data expression unit is a data receiver 1100 located on one side outer surface 4100 of one or more head and neck of the speaker, the listener receives the voice data 310, the continuous vibration unit 1300 is continuous Composite system for improving articulation and listening, characterized in that the voice data is provided to the inner ear (3300) of the auditory system (3000) via one or more of the methods of transmitting, amplifying, reducing the medial side neck bone (4300).

The method of claim 26,
In the sound generator 1000 of the data expression unit, the data receiver 1100 located at one or more outer surfaces 4100 of the head and neck of the speaker and the listener receives the voice data 310 and the middle ear 3200 of the auditory system 3000. The conduction vibration unit (1300) located in the complex system for improving articulation and listening, characterized in that to provide the voice data 310 to the cleaning bone (3220) by one or more methods of transmission, amplification, reduction.
The method of claim 26,
In the sound generator 1000 of the data expression unit, a data receiver 1100 located on one or more head and neck uniaxial outer surfaces 4100 of the speaker and the listener receives the voice data 310 and the first conduction unit adjacent to the data receiver 1100. The eastern portion 1301 transmits the voice data 310 in advance, and the second conductive vibration portion 1302 located on one surface of the middle ear 3200 of the auditory system 3000 is transmitted from the first conductive vibration portion 1301. Composite system for improving articulation and listening, characterized in that the provided sound data 310 to the cleaning bone (3220) by one or more methods of transmission, amplification, reduction.


The method of claim 26,
In the electric sound generator 1000 of the data expression unit, the data receiver 1100 located at one or more outer surfaces 4100 of the head and neck of the speaker and the listener receives the voice data 310 and the inner ear 3300 of the auditory system 3000. The electrical messaging unit 1400 located in the complex for improving articulation and listening, characterized in that the voice data 310 to provide to the auditory nerves 3320 of the inner ear (3300) by one or more of the methods of transmission, amplification, reduction. system.
The method of claim 26,
The sound transduction device 1000 of the data expression unit receives the voice data 310 by the data receiver 1100 located on one side outer surface 4100 of the head and neck of one or more of the speaker and the listener, and leads to the inner surface 4200 of the head and neck. 3330), the electric messaging unit (1400) is a complex system for improving articulation and listening, characterized in that to provide the voice data (310) to the cerebral (3330) by one or more methods of transmission, amplification, reduction.

Images