JP2004525572A - Apparatus and method for ear microphone - Google Patents

Abstract

Detection system. The detection system includes a housing (150, 150 ') positionable with respect to the individual's ear and a microphone (34, 34') positioned relative to the housing for insertion at least partially into the individual's ear. The microphone is operable to detect a change in air pressure in the ear while the individual is performing the initiation activity and to generate an electrical signal corresponding to the change in air pressure detected internally. Processing circuitry (14, 14 ', 14 ", 36, 36', 42) is coupled to the microphone for processing the electrical signal to produce a corresponding output. Detect changes in the ear. Various alternative systems and sensors for use in the present invention are also disclosed.

Description

【Technical field】
[0001]
(Related application)
This application is related to US Provisional Application No. 60 / 280,282, filed March 30, 2001, US Patent Application No. 09 / 897,696, filed July 2, 2001, and July 31, 2001. Claim the benefit of U.S. Patent Application Serial No. 09 / 919,291, filed on even date, the entire disclosures of which are incorporated herein by reference.
[0002]
(Field of the Invention)
The present invention relates generally to sensors that are placed against the ear. More specifically, this sensor is used to detect human physical or mental activity (eg, speech, thinking, tongue movement with respect to the oral cavity, biological functions, etc.), and is used for system control functions. Provides output that can be transformed. In addition, this sensor is used to detect human speech and other verbal utterances using microphones and deliver sound to the human ear using speakers, but with reduced feedback from the speakers to the microphone. ing.
[Background Art]
[0003]
(Background of the Invention)
An apparatus and method for detecting thought is disclosed in U.S. Patent Application No. 6,024,700, the entire disclosure of which is incorporated by reference. This thinking can lead to detectable air pressure or sound in one or both ears of the user, which can be detected by a detector (eg, a microphone). Exemplary outputs from such systems and methods for detecting thoughts may be one or more separate outputs (eg, separate outputs indicating each alphanumeric character, direction, etc.).
[0004]
Apparatus and methods for detecting physical activity (eg, mouth and tongue movements) are described in US Patent Application Serial No. 09 / 706,091, filed November 3, 2000, the entire disclosure of which is incorporated by reference. Incorporated by reference). This physical activity leads to detectable air pressure or sound in one or both ears of the user.
[0005]
The sound produced by the human ear is sometimes referred to as autoacoustic. Self-acoustic sounds have traditionally been used in diagnostics, for example, to indicate ear function or ear condition. For example, in response to sound input to the ear, the ear has been found to provide a detectable self-acoustic output.
[0006]
Currently, there are available controllers that allow a disabled person who cannot use their arms or legs to operate an electric wheelchair. Such controllers include trackball or joystick type devices, which are inserted into the mouth of the individual; and the individual operates the controller using movements of the mouth and / or tongue. To provide mechanical input. Such devices are difficult to operate and are problematic if the device falls off or irritates the mouth.
[0007]
Other controllers exist so that disabled individuals can perform their functions with mechanical assistance. Operation of such a controller typically requires a signal such as an incident electromagnetic signal (eg, infrared or ultraviolet light / emission) that is directed to the individual; An individual may modulate an incident electromagnetic signal (eg, by blinking his eyes, moving his head, or by some such activity). The need for an incident electromagnetic signal is inconvenient for several reasons: some special equipment is needed to provide the signal, and this signal must be properly oriented or aligned. Rather, the detector and the modulated signal must be properly aligned, this signal should not have deleterious effects on the user (eg, causing eye damage), and so on.
[0008]
Currently, there are speech recognition software programs available that receive an input signal that is representative of the human language and execute commands in converting this signal to text form or interpreting the language. This input signal is generated by a microphone placed in front of the speaker's mouth.
[0009]
Furthermore, wireless mobile phones are also referred to as mobile phones, which have become very popular communication devices. However, most cell phones include a transceiver (eg, a radio frequency (ie, RF) transceiver) for establishing a communication link with a remote location (eg, a cell phone tower). To perform a conversation with another person using a wireless telephone, the user must hold the telephone near the user's ears and mouth. This has the disadvantage of occupying at least one use of the user's hand. In many situations, free use of both hands of a wireless telephone is desirable. The same is true for the recipient, ie, the telephone found in a wired telephone system. For example, a user of a wired telephone system may want to type a computer while speaking on the phone. In addition, medical professionals and others have shown health concerns for wireless telephone users who are immersed in prolonged use of RF transceivers near the user's head.
[0010]
There are many commercially available headsets available to users of wireless and / or wired telephone systems. These headsets are intended to assist the user in conducting a conversation without the use of the user's hands and to position the telephone (and any RF transceiver) away from the user's head Is done. These headsets typically include earpieces that include speakers. The earpiece may be removably positioned relative to the user's ear and may broadcast sound to the user's ear. The headset also typically includes a microphone located on a support member, which places the microphone against the mouth of the user. Microphones are used to detect speech and other utterances uttered by the user's mouth. The detected sound is converted into an electrical signal and transmitted to a telephone to the backbone telecommunications network and to another person's telephone. In this way, the user can perform a completely simultaneous transmission and reception conversation with another person.
[0011]
However, headsets can be cumbersome to use. More specifically, care must be taken to ensure that the microphone is properly positioned and that it remains in that position. The need to adjust the headset during a conversation can be distracting to the user. In addition, improper positioning of the microphone can make detection of the user's language poor and / or unreliable. This problem is exacerbated by environmental noise (e.g., sound passing by a vehicle, conversation occurring near a user, etc.) detected by a generally existing microphone. The detected environmental noise is ultimately transmitted by the telephone.
[0012]
Thus, there is a need in the art for easy use of telephone headsets that accurately detects the user's language and reduces the detection of environmental noise, even when talking at low volume.
DISCLOSURE OF THE INVENTION
[Means for Solving the Problems]
[0013]
(Summary of the Invention)
According to one aspect of the invention, the invention is a detection system. The detection system includes a housing positionable relative to the human ear; a microphone positioned relative to the housing for insertion at least partially into the human ear; A microphone operable to detect a change and to generate an electrical signal corresponding to the internally detected air pressure change; and coupled to a microphone for processing the electrical signal to generate a corresponding output. A processing circuit.
[0014]
According to yet another aspect of the present invention, the present invention is a sensor for detecting a change in air pressure in a human ear. The sensor has a housing having an inner portion adapted to be inserted at least partially into the human ear and an outer portion adapted to engage at least a portion of the pinna; An internal microphone positioned relative to an internal portion of the housing for detecting air pressure; and an external microphone positioned relative to an external portion of the housing for detecting an air pressure change occurring externally to the ear.
[0015]
According to one aspect of the invention, the earset comprises: a housing positionable relative to the human ear; a microphone positioned relative to the housing for insertion into the human ear; A microphone operable to detect an air pressure change in the ear and to generate an electrical microphone signal corresponding to the air pressure change detected therein; a sound positioned relative to the housing and corresponding to an electric speaker signal A speaker operable to generate a modified microphone signal coupled to receive the microphone signal and the speaker signal, and having a reduced feedback component of the microphone signal (feedback). Ingredients modified microphone To generate the phone signals, resulting from detection by the microphone of the sound generated by the speaker).
[0016]
(Detailed description of the invention)
The following is a detailed description of the invention in connection with the accompanying drawings, wherein like reference numerals refer to like elements throughout. In order to illustrate the invention in a clear and concise manner, the drawings need not be shown to scale, and certain features may be shown in somewhat schematic form.
[0017]
One embodiment of the present invention is to monitor air pressure changes in or near the human ear over a period of time to provide for physical and / or mental activity of the human (eg, human thinking, human language and And / or detecting activity occurring in connection with movement associated with the oral cavity). As an example, movement of the tongue in the oral cavity can be detected or sensed to provide a useful output. As another example, an activity may be a mental event, such as in a thought, producing a detectable air pressure change within and / or near the ear, as described in more detail in US Pat. No. 6,024,700. Can be targeted. More specifically, thoughts cause a reaction in the human anatomy, which accomplishes a change in the ear (perhaps by muscle contraction), thereby allowing detectability in or near the ear canal Causes a great change in air pressure. Exemplary outputs may include information similar to an information signal generated by a computer mouse, a click button on a mouse, a computer joystick, and the like.
[0018]
The present invention is more aesthetically appealing and more comfortable to the user than the systems disclosed in the above-mentioned US Patent No. 6,024,700 and US Patent Application No. 09 / 706,091, and has a reduced environmental or ambient noise. Has been found to be poorly detected. As described in more detail below, the sensor of the present invention comprises a microphone positioned against or in the user's ear and detects air pressure changes in the ear. This microphone is referred to herein as an internal microphone. Air pressure changes can be caused by one or more factors, including vibration of the eardrum, vibration of bones in the ear, vibration of other anatomical structures in the ear, and bone and / or tissue of the user. Vibrations that are conducted to the ear and cause air pressure changes in the ear. As a result, the sensor may not be fully detectable when a person speaks at normal levels or very low volume (e.g., usually not sufficiently detected by a microphone placed in front of the person's mouth, or close to the person speaking). (At a lower, decibel, or louder level than is detectable by another individual located), and can be used to detect human language. The term speech, as used herein, is taken to include spoken words and utterances, songs, and other utterances generated by humans. The language thus detected can be used for a number of purposes, for example, processing the detected language using speech recognition software or detecting using a communication device such as a mobile phone. Retransmitting the input language (which allows separation of the language input device from the RF transceiver).
[0019]
It should be noted that the term air pressure change is used in its broadest sense and includes, for example, sound waves (whether or not audible to a user), pressure fluctuations, vibrations, resonance, and the like. is there. Further, the term air pressure change, as used herein, includes vibrations conducted by the user's bones and tissues that are transmitted to the ear. These conducted vibrations can vibrate the housing that supports the internal microphone, which provides sound detection by the internal microphone. The conducted vibrations may also cause the sound to resonate and / or amplify in the anatomical portion of the ear, thereby resulting in detection of the sound by the internal microphone. Air pressure changes can be caused by one or more factors, including vibration of the eardrum, vibration of bones in the ear, vibration of other anatomical structures in the ear, and bone and / or tissue of the user. Vibrations that are conducted to the ear and cause air pressure changes in the ear.
[0020]
In addition to internal microphones, the present invention may also include external microphones. The external microphone detects air pressure changes or sounds originating from outside the user's ear. As described in more detail below, these sounds are converted to electrical signals and compared to electrical signals corresponding to the sounds detected by the internal microphone. Each signal may be processed to distinguish in-ear air pressure changes from externally generated ambient noise, speech, and the like.
[0021]
The present invention also provides for the detection and monitoring of various biological processes, including human heart rate, respiratory and gastronomic events that produce detectable air pressure changes in or near the ear, Can be used as a medical diagnostic tool. Thus, by monitoring the air pressure near or inside the ear, the human heartbeat, breathing and any irregularities associated therewith can be studied. The sound detected by the sensors of the present invention can be amplified to a certain level, studied by medical personnel, and / or processed by devices programmed to analyze such biological functions.
[0022]
The present invention can provide an output having a characteristic continuity, for example, similar to the signal generated by moving a computer mouse along a surface. The electrical signals generated by the sensors may include identifiable information generated by two- or three-dimensional movement of a particular body part, particularly by tongue, jaw, and oral and nasal movements. The signal output obtained from the sensor is similar to the signal generated by a computer joystick with top, bottom, left, right, front, and back signal outputs. The intensity of the signal or other component can be used as a measure of the speed characteristic of the activity.
[0023]
By measuring air pressure in both ears using separate sensors, at least two electrical signals can be generated and processed to produce a two-dimensional (or stereophonic) information pattern. Information from each sensor, along with similarities and differences in the data streams, can be used to identify further information from humans. In some cases, the additional information improves control command generation, thought detection, language recognition, biological process detection, and other functions of the systems described herein.
[0024]
The present invention can be used for many additional purposes. One exemplary use is to provide input to a computer or some other electrical or electronic device. An exemplary input is an electrical signal. However, it is understood that the signal generated by the sensor used to detect a change in air pressure may be other than electrical, or the electrical signal generated by the sensor may be converted to a non-electrical form. Should be. Examples of alternative signal types include, for example, optical signals, fluid signals, radio frequency (RF) signals, and the like. The input may control a computer or other device, or the input may be used for some other purpose. In order to facilitate the description of the invention herein and to avoid complexity, the invention is directed to uses for providing electrical input to a computer (e.g., whether digital or analog). , A personal computer or some other computer for controlling the operation of a computer). It is understood that the present invention can be used for many other purposes.
[0025]
One example of the use of the present invention in combination with a computer controlled using the present invention is to provide functions and capabilities for persons with disabilities. For example, the present invention enables a disabled or healthy person to control the operation of one machine in a manufacturing facility, control the operation of an electric wheelchair or similar device, control the operation of a video game, and the like. Can be used to It is understood that these are merely exemplary and that the present invention may be used for many other purposes.
[0026]
In the present invention, it is not necessary that the individual be subjected to a stimulus signal (eg, an incident acoustic or electromagnetic signal). Rather, in the present invention, the activity of the individual (eg, tongue movement including tongue clicking on the teeth or pallet) is used to emit air pressure or sound to one or both ears of the individual. These air pressures or sounds can be detected or sensed and used as outputs of the invention, which are provided as inputs to a computer or some other device. Thus, the present invention exhibits a non-stimulatory signal (ie, a signal generated by an individual's activity) without having to direct the stimulus to the individual.
[0027]
According to embodiments of the present invention, the sensor senses or detects air pressure, changes in air pressure, or sounds produced by the individual's ear. These pressure changes can be caused by the individual's eardrum or other anatomy in the ear. In addition, this pressure change may occur in other parts of the individual's body, and vibrations or air pressure changes may occur and be transmitted to the ear by bone or tissue detected by the sensor.
[0028]
For ease of description herein, a sensing or detecting event is referred to as detection, and what is detected is referred to as a change in the ear. Also, for ease of description herein, activities that cause a detectable change are described as "initial activities". The initiation activity may be one or more physical or mental activities (thinking, talking, tongue movements in the mouth (sometimes referred to as "tongue activity"), other movements in the mouth or nostrils or associated with the mouth or nostrils or Activity, clicking or other activity of the tongue on teeth or pallets, exhalation or inspiration by the lungs, heart beats, and nasal activity). By way of example, movement of the tongue results in a detectable air pressure. These movements can be two-dimensional (eg, up / down, left / right, in / out, etc.) or three-dimensional (any combination of front-back, left-right, and up-down). They produce their output even if the corresponding output by the sensor is one-dimensional for one sensor or two-dimensional for two sensors (one per ear).
[0029]
The present invention monitors changes in the human ear that occur instantaneously or nearly instantaneously in response to initiation activity to provide a substantially real-time detection and control system. In addition, monitoring of this change is passive, thus avoiding potential health and / or environmental concerns associated with subjecting the body to electrical signals and / or irradiation. Further, changes in the ear uniquely correspond to one of a variety of initiation activities that allow a system requiring multiple control functions to detect and differentiate between multiple different initiation activities (eg, a unique signal). With signature).
[0030]
According to one aspect of the invention, the sensor is in electrical communication with a processing circuit, senses a change in the ear, and converts the sensed change into an electrical signal. This electrical signal is then processed to provide control instructions or some other useful output (eg, an output similar to that generated by a computer mouse or joystick corresponding to a particular initiation activity). Exemplary control functions include controlling a video game display, controlling one medical device (eg, a wheelchair), and controlling computer functions to provide a handless mouse, keyboard, joystick. But not limited to these.
[0031]
Turning now to the drawings, FIG. 1A is a block-level illustration showing a system 10 for detecting initiation activity and providing an output corresponding to the detected activity. The system 10 includes a pressure sensor 12 coupled to a processing circuit 14. The sensor 12 comprises an inner ear microphone, as described in more detail below. The sensor 12 detects changes in the ear resulting from initiation activity by the individual wearing the sensor 12. The processing circuit 14 includes a data collection circuit 16 (for example, a computer sound card). Other exemplary data acquisition circuits include a PCI 9118HG data acquisition card manufactured by Adlink Technology or a DAQi250 data acquisition card manufactured by Ines Company Gmbh (Germany). The data acquisition circuit may include an analog-to-digital (A / D) converter that converts analog signal data to digital signal data. Buffer 17 stores a portion of the signal from data collection circuit 16 (assuming that the signals may be relatively continuous) until filtration and signal detection can be performed as described in further detail below. May be provided for: The processing circuit 14 also receives the digital signal data from the data acquisition circuit 16 and the buffer 17, performs various signal processing functions on the digital signal data, detects the occurrence of initiation activity, and detects the occurrence of initiation activity. A processor 18 for determining the type is provided. The system 10 also includes an output peripheral 20 coupled to the processor 18 for executing one or more controls provided by the processor 18 corresponding to the initiation activity. Those skilled in the art will recognize that, depending on the application, the analog-to-digital converter function and the buffer function may be omitted or performed by software.
[0032]
FIG. 1B is a block-level illustration illustrating another embodiment of a system 22 for detecting initiation activity and providing an output corresponding to the detected activity. System 22 includes sensor 12 having an internal microphone (described in more detail below). The electrical signal generated by the sensor 12 is amplified using an amplifier 24 as needed. However, in some applications, amplifier 24 is not required, depending on the equipment that receives and processes the electrical signal output by sensor 12.
[0033]
The electrical signal is then received by the interface adapter 26. This interface adapter 26 may be a mechanical connection, such as an electrical connector received by a corresponding jack on the device that ultimately receives and processes the electrical signal output by the sensor 12. Interface adapter 26 may also include more complex equipment, such as a universal serial bus (USB) adapter. As will be apparent to those skilled in the art, depending on the processor, device or application that receives the electrical signal generated by the sensor 12, the interface adapter 26 may be optional or the physical interface between the sensor 12 and the device. And / or any device for establishing a logical connection to receive the electrical signal generated by the sensor 12.
[0034]
The electrical signal is then received by the computer interface 28. This computer interface 28 is optional, depending on the configuration of the system 22, as well as the amplifier 24 and the interface adapter 26. This computer interface 28 may be a mechanical connection, such as a jack or a receptacle, or may be a more complex device (eg, a sound board for a computer). In one embodiment, the amplifier 24 and / or the interface adapter 26 are omitted and the signal generated by the sensor 12 is an input to the processing circuit 14 'via a conventional computer sound board, wherein the sound board is It is used to convert an analog signal generated by the sensor 12 into a digital signal.
[0035]
The electrical signal is then processed by processing circuit 14 '. Processing circuit 14 'may take the form of processing circuit 14 illustrated in FIG. 1A and may optionally include such devices (e.g., analog-to-digital converters, buffers, and / or processors 18'). Processor 18 'may be configured to execute logic for various applications that utilize the signals generated by sensor 12.
[0036]
In the exemplary embodiment, processor 18 'is programmed to execute a speech recognition software program. As is known in the art, speech recognition software converts the spoken language into text that can be manipulated electronically using, for example, a word processing program. This text may be output to output peripheral 20. For example, text may be displayed on a display or printed by a printer. The text may also be stored for later retrieval by storage device 30 on computer-readable media (including, but not limited to, magnetic and optical storage devices). Alternatively, the electrical signal itself or a recognized language derived therefrom controls a machine such as a self-powered wheelchair, robotic arm, computer, transport vehicle, home and industrial electrical equipment or machine, etc. Can be used to
[0037]
FIG. 1C is a block-level illustration illustrating a system 32 for detecting initiation activity and providing an output corresponding to the detected activity. This system 32 comprises a sensor 12 having at least an internal microphone 34. This sensor 12 and internal microphone 24 will be described in more detail below. Sensor 12 outputs an electrical signal that is amplified as needed by amplifier 24. This electrical signal is then received by the communication device 36 via a suitable interface adapter 26, if necessary. The communication device may be, for example, either a telephone hardwired to a telephone system, as shown in the illustrated embodiment, or a wireless telephone such as a mobile telephone. Alternatively, communication device 36 may be a radio, a portable computing device, or the like. In one embodiment, the signal generated by the sensor 12 is an input to a personal computer, a personal digital assistant (PDA), etc., and via a network (eg, LAN, WAN, Internet, etc.) to another location or Transmitted to the device. In another configuration, the communication device may be replaced with another type of device, such as a recorder for recording the user's language for later retrieval or an amplification system for disseminating the language to a live audience. .
[0038]
Further, the sensor 12 may include a speaker 38 that is used to convey (ie, spread) sound to the user. In this way, the sensor 12 and the communication device 34 can be used as a two-way communication device.
[0039]
FIG. 1D is a block-level illustration illustrating a system 40 for detecting initiation activity and providing an output corresponding to the detected activity. The system 40 comprises a sensor 12, which preferably comprises an internal microphone 34 (FIG. 2B) described in more detail below. Sensor 12 is connected to medical diagnostic device 42 via amplifier 24, interface adapter 26, and computer interface 28, if desired. The medical diagnostic device 42 may be used by a medical practitioner to detect air pressure detected by the sensor 12 corresponding to a patient's biological processes (heart beat, breathing sound, gastronomic sound, etc.). It has an audio output 44 (eg, speakers, stethoscope accessory, etc.) to obtain. To assist healthcare professionals in listening to biological processes, medical diagnostic devices optionally include filters (hardware or software) to provide these sounds before disseminating them to medical workers. Can be separated. In another embodiment, the medical diagnostic device 42 has a video output 46 (eg, an LCD or CRT screen) so that the sound emitted by the heart and detected by the sensor 12, for example, in the patient's ear, It can be converted to a graph (eg, amplitude versus time) and displayed on video output 46 in a manner similar to an electrocardiogram display.
[0040]
Medical diagnostic device 42 may also include a recording device 48 (eg, a digital or analog data storage medium) for storing detection of a patient's biological process. The recorded sound can be compared to subsequent detections. This comparison can be made by an individual or by software programmed to separate the differences between the first and second detections.
[0041]
The medical diagnostic device 42 may also include a processor 50 that executes programmed logic (eg, software) to analyze detected pneumatic pressure changes. The software can be programmed to search for signals generated by the sensor for patterns, irregularities (including those not normally detectable by humans), differences from baseline detection, and the like.
[0042]
Further, data collected by or calculated by the medical diagnostic device 42 from the sensor 12 may be communicated to other locations. For example, the medical diagnostic device 42 may be deployed in an ambulance and communicate information about a patient to a destination hospital. As another example, data can be gathered by one medical worker and communicated to another medical worker (eg, a specialist in another city).
[0043]
In another embodiment, the sensor may be located remotely from the medical diagnostic device 42. For example, an individual may use sensor 12 from a location such as his / her home. The information detected by the sensor 12 may then be communicated to a remote medical diagnostic device 42. The communication may be made with respect to the telephone or other communication device discussed above with respect to the system 32 illustrated in FIG. 1C. Alternatively, the signal generated by sensor 12 may be an input to a personal computer, PDA, etc., and may be communicated to medical diagnostic device 42 via a network (eg, LAN, WAN, Internet, etc.).
[0044]
FIG. 1E is a block diagram illustrating a system 52 for detecting initiation activity and providing an output corresponding to the detected activity. This system 52 comprises a sensor 12 which preferably has an internal sensor 34. In an exemplary embodiment of the sensor 12, the sensor 12 has an additional pressure detector or external microphone 54. Use of the external microphone 54 is optional. As described in more detail below with respect to FIG. 2B, the internal microphone 34 is located on a housing 150 (FIG. 2B) that is inserted at least partially into the individual's ear. That is, the internal microphone 34 is at least inserted into the cavity defined by the outer portion of the ear (described in more detail below with respect to FIG. 2A). As a result, the internal microphone 34 detects a change in air pressure located in the ear. These air pressure changes are the result of the initiation activity, and in part, to outwardly emitted sounds (eg, other people's language, environmental noise, etc.). External microphone 54 is located in housing 150 (FIG. 2B) and generally faces away from the individual wearing sensor 12. As a result, the external microphone 54 detects an air pressure change located outside the ear. These air pressure changes are the result of externally generated noise (such as other people's language, environmental noise, etc.) and, in part, the initiating activity of the individual wearing the sensor 12, especially noise for that individual's language.
[0045]
The internal microphone 34 is connected to a processing circuit 14 "or another device used to receive electrical signals generated by the microphones 34 and 54, respectively, in response to a sensed air pressure change. , Using separate and distinct inputs, or channels, to the processing circuit 14 ". In one embodiment, internal microphone 34 is connected to the left channel input of a computer sound card or computer interface 28a via amplifier 24a and interface adapter 26a. The external microphone 54 is connected to the right channel input of the computer sound card or the computer interface 28b via the amplifier 24b and the interface adapter 26b.
[0046]
The processing of the unique signals generated by the microphones 34 and 54 is described in more detail below with respect to FIG. 3B. This unique signal can be used to distinguish between the initiation activity emitted by the user and the sound emitted externally. In an alternative configuration of the system 52, the system 52 may be adapted to cancel noise emitted outward from the detection of the internal microphone 34.
[0047]
When the test indicates that the user speaks (or causes an air pressure change in the ear from another type of initiation activity), the intensity of the signal generated by the internal microphone 34 corresponding to the language (or initiation activity) will typically be It was shown that the intensity of the signal generated by the external microphone 54 corresponding to the same language (or starting activity) was stronger. Also, if the test indicates that the sound is emitted by a source other than the user (e.g., another person is speaking), the strength of the signal generated by the external microphone 54 corresponding to this sound will typically be It is stronger than the intensity of the signal generated by the corresponding internal microphone 34. These sound energy differences, or relative signal strengths, can be used to determine whether the source of the detected air pressure change is from a user or external to the user. .
[0048]
For example, if the user is speaking, the internal microphone 34 may detect the user's language and external noise (eg, air conditioner and computer noise). In this example, external microphone 54 may detect the language of the user, but only to a lesser extent than internal microphone 34. The external microphone 54 also detects external noise, which is detected to a greater extent by the external microphone 54 than by the internal microphone 34. Thus, the processing circuit 14 "can be programmed to compare the signals and recognize that the source of the language is from the user. Further, the processing circuit 14" can identify the language and noise components. Alternatively, it can be programmed to separate the user's language by comparing the two signals. As a result, a relatively noise free speech signal can be generated, which can be used with speech recognition software, as indicated above. In alternative embodiments, the techniques described above may be used to distinguish between the language of the user and the language of another individual. The language of both individuals can then be analyzed as needed. As will be appreciated by those skilled in the art, the foregoing techniques may be applied to the detection of other types of initiation activity (thinking, oral-related movements, biological processes, etc.).
[0049]
2A and 2B, an external view and a cross-sectional view of the ear 100 are shown, respectively. FIG. 2B also shows sensor 12 in cross section. According to Henry Gray's famous textbook "Anatomy", the human ear is divided into three parts, including the outer ear 102, the middle ear (tympanic) 104, and the inner ear (maze) 106. The middle ear 104 and the inner ear 106 are not described in great detail herein. The outer ear 102 includes enlarged portions, namely, pinna 108 (also called auricle) and eustachian tube 110 (also called ear canal or ear canal). The pinna 108 serves to collect the vibrations of the air surrounding the individual's head. The Eustachian tube 110 transmits the vibration to the tympanic chamber, that is, the eardrum 112.
[0050]
The pinna 108 has a generally oval shape with a larger end facing upwards and an irregularly concave slightly forward facing outer surface. The pinna 108 has many bumps and depressions. Typically, the ear 100 has protruding and curved edges, or earrings 114. Approximately parallel to the ear ring 114 is another curved ridge, or anti-ring 116. The opposite ring 116 is branched so as to form a triangular depression, that is, a fovea (also called a triangular fossa) of the opposite ring 118. The narrow, curved depression between the ear ring 114 and the annulus 116 is referred to as a fossa of the helical or scapha 120. The annulus 116 also has a deep, large cavity, ie, the concha 122 (the concha 122 has an upper portion called the concha of the ear and a lower portion called the concha of the concha due to the start of the cuff 114 (ie, the cuff leg). Bend around). The instep 122 faces inward with respect to the opening of the ear canal 110. Protruding from the front of the concha 122 and posterior to the rear (typically relative to the opening of the Eustachian tube 110) is a pointed ridge or tragus 124. Opposite the tragus 124 is a nodule, or tragus 126. A notch-like depression, or intertrabecular notch 128, is between the tragus 124 and the antitragus 126. The earlobe 130 is below the tragus 124 and the antitragus 126.
[0051]
The eustachian tube 110 is an elliptical columnar passage and extends from the bottom of the concha 122 to the eardrum 112. The Eustachian tube 110 measures approximately one inch and a half when measuring from the tragus 124 to the eardrum 112. The Eustachian tube is approximately one inch long when measured from the bottom of the concha 122 to the eardrum 112. The Eustachian tube 110 forms a gentle "S" curve, initially pointing inward, forward and slightly upward (ie, outward). The Eustachian tube 110 then travels inward and backwards (ie, midway), and then travels inward, forward, and slightly downward (ie, inward).
[0052]
It is not clear which physical, chemical, or neural mechanism causes or produces sounds originating from the ear in or near the ear in response to air pressure changes or various initiation activities of the user. However, due to the oral cavity being connected to the ear through the Eustachian tube, movement and speech cause a change in air pressure, air pressure or airflow to or from the ear, which can be detected by the sensor 12. Air pressure can be induced. Regardless of the exact physical, chemical or neural mechanism, empirical testing has shown that the initiation activity described herein produces a change in air pressure within or near the human ear And that the changes in barometric pressure have substantially their own signature and are therefore substantially unique for a given initiation activity of the individual. Thus, changes in air pressure can be monitored near the ear and used to detect user initiation activity.
[0053]
Further, some initiation activities (eg, tongue movement) may generate a detectable pressure wave having a strength corresponding to the direction, speed and / or intensity of the movement. The present invention may use a single sensor 12 for one ear 100, but two sensors 12 (one for each ear 100) are used to obtain additional information, so that each sensor 12 Different and / or cumulative information that may be correlated by the processor may be detected.
[0054]
The present invention uses the various forms of the terms "change in air pressure", "change in the ear" and "sound emitted or produced by the ear" in their broadest sense to characterize the measured parameter. Alternatively, the change in air pressure can be characterized as a sound wave. These sound waves (or vibrations) can propagate through media other than air, such as bone and tissue. As is well known to those skilled in the art, when a sound wave diverges from its source, its intensity attenuates (the energy per unit area decreases with the inverse square of the distance), but the total energy is constant. Therefore, it is desirable to bring the microphone 34 sufficiently close to the sound source of the sound wave and to increase the intensity level of the resulting change as much as possible.
[0055]
The frequency range in which sound waves are audible to humans is from about 20 Hz to about 20 KHz, but the present invention does not care whether changes in the ear are audible. This is because the microphone 34 is sufficiently sensitive to a frequency detection range sufficient to detect a change in air pressure at a high frequency or a low frequency, and has a frequency detection range sufficient to detect a change in air pressure at a high or low frequency. This is because it is selected to have Thus, a frequency range suitable for detecting any onset activity (eg, about 10 Hz to about 20 KHz) may be monitored, and such variations are contemplated to be within the scope of the present invention.
[0056]
FIG. 2B illustrates that at least a portion of the human ear 100 (ie, if not deeper within the ear 100 (eg, within the concha 122, the opening of the Eustachian tube 110 or slightly within the Eustachian tube 110), 1 shows the sensor 12 inserted in a cavity defined by (1). The sensor 12 includes a housing 150, an internal microphone 34, and, optionally, an external microphone 54. In the embodiment shown, the housing 150 has an exterior 152 and an interior 154. However, the housing 150 can take many different configurations. The housing is preferably analogous to the insertable or partially insertable hearing aid housing, especially the digital hearing aid housing, for the ear 100 and / or the ear canal 110. External 152 is optional. The exterior 152 shown is made of a material such as plastic and is larger than the opening in the ear canal 110 and engages the pinna 108 or engages the ear 100 and covers the entire pinna 108 ( For example, similar to the outside of a general headphone assembly). In one embodiment, the exterior 152 fits within the concha 122 and is at least partially maintained by the tragus 124 and / or the antitragus 126. Such an arrangement isolates, at least in part, the internal microphone 34 from externally generated noise and air pressure changes.
[0057]
Alternatively, the housing 150 may resemble a small earphone, as found in a conventional wireless telephone headset, or as used in a personal audio / music player. Earset 150 may be maintained by insertion into ear 100, by a member placed on or suspended from the ear, and / or by a headset assembly. The illustrated housing 150 is made from any suitable material, such as a plastic, rubber or gel-like material. If desired, housing 150 'or portions thereof may be made of a flexible material, a sound absorbing material (or sound insulation material), and / or may contain a sound insulating material (e.g., foam).
[0058]
Interior 154 may be made of a flexible material (eg, rubber) and is dimensioned and shaped to fit snugly within ear 100. Such materials are sometimes referred to in the art as soft-solids. If desired, the entire housing 150, or portions thereof, can be made of a flexible material, a sound absorbing material (or sound insulating material), and / or can contain a sound insulating material (eg, foam).
[0059]
The internal microphone 34 is arranged in the inside 154 of the housing 150. Accordingly, interior 154 is sized and shaped to position interior microphone 34 with respect to ear 100 and / or ear canal 110 (if desired). In one embodiment, interior 154 places internal microphone 34 on concha 122. In another embodiment, the interior 154 places the internal microphone 34 at an opening in the ear canal 110 where the ear canal 110 mates with the concha 122. It should be understood that the internal 154 and / or the internal microphone 34 need not enter the ear canal 110. In yet another embodiment, and as described by way of example in FIG. 2B, interior 154 places internal microphone 34 within ear canal 110. In another embodiment, interior 154 places microphone 34 and / or speaker 38 (FIG. 16, described below) in concha 122. In another embodiment, interior 154 places microphone 34 and / or speaker 38 at an opening in ear canal 110 where ear canal 110 mates with concha 122. It should be understood that interior 154, microphone 34 and / or speaker 38 need not enter ear canal 110. In still another embodiment, interior 154 extends into ear canal 110 and places microphone 34 and / or speaker 38 within ear canal 110. When placed within the Eustachian tube 110, the internal microphone 34 enters the Eustachian tube 110 at a depth of about 0.1 inches to about 0.5 inches, as measured from the opening of the Eustachian tube 110.
[0060]
Housing 150 with both exterior 152 and interior 154 can be tailored to the individual and can create a close and comfortable fit to the individual's ear. Alternatively, the housing may have a standard, or "stock" design for all individuals, made in many sizes. As those skilled in the art will appreciate, many alternative configurations for housing 150 are possible and each is considered to be within the scope of the present invention.
[0061]
In one embodiment, microphone 34 is held in place by an adhesive. The interior 154 of the housing 150 has a recess 156 in which the microphone 34 is located. Preferably, air near the eardrum and / or air in the ear canal 110 is in fluid communication with air near the microphone 34. Thus, the sound or air pressure change generated in the ear 100 is directly transmitted to the microphone 34 through the air medium. Other sounds conducted by the user's bones and tissue may be mechanically propagated by the housing 150 to the microphone 34. In one embodiment, microphone 34 is between about 1 mm and about 6 mm in diameter. However, those skilled in the art will recognize that microphone 34 need not be disk-shaped. In an alternative embodiment, the microphone 34 is located within a hollow cavity defined by the housing 150, and an opening in the wall of the interior 154 of the housing 150 provides air inside the housing 150 and the interior of the ear canal 110. Provided to achieve fluid communication with air.
[0062]
By inserting the microphone 34 into the ear 100 and / or the ear canal 110, the microphone 34 is shielded from environmental noise. More specifically, the housing 150 and the user's head at least partially block externally generated sound waves before reaching the microphone 34.
[0063]
In one embodiment, microphone 34 is a directional microphone modified to detect air pressure changes from a particular direction. Directional microphones are oriented as desired to detect a variety of different air pressure changes caused by different types of initiation activity. For example, the microphone may be directed toward a desired sound source (eg, the eardrum 112, the wall of the Eustachian tube 110, or the bone structure around the opening of the Eustachian tube 110). Because the microphone is directional, the microphone detects less environmental noise (the source of this noise is outside the ear and is typically from a direction that does not match the microphone's directional sensitivity). In another embodiment of the present invention, microphone 34 is a noise cancellation microphone, further reducing the detection of environmental noise.
[0064]
If the microphone 34 is desired for such factors as, for example, comfort, detection of certain air pressure changes caused by certain types of initiation activity, optimizing detection of the user's language, etc. It should be understood that the various anatomical structures can be moved closer or further away therefrom. It is noted that microphone 34 may detect the user's language speaking at various volumes.
[0065]
The microphones 34 and 54 can be in many different forms (eg, silicon or semiconductor microphones (also referred to as pressure sensors)) (eg, US Pat. Nos. 4,533,795; 4,922,471; 156,585, each of which is incorporated herein by reference in its entirety)). The foregoing device is exemplary, and other electroacoustic transducers from many different vendors may be used.
[0066]
In the illustrated embodiment, when the sensor 12 is inserted into the ear 100, a slightly positive pressure is generated by the compression of air within the ear canal 100. This slightly positive pressure, undetectable in an individual, is believed to improve the overall operating characteristics and sensitivity of the sensor 12.
[0067]
The microphone 34 can be used to initiate various forms of initiating activity (e.g., human language speaking at different volumes, groans, whistling, singing, coughing, physical movements of the human (e.g. Open mouth, human breathing, human heartbeat) and the like. In addition, air pressure changes in the ear caused by thought can be recognized by detecting changes in the ear when the trained individual thinks.
[0068]
The use of a sensor with only the internal microphone 34 on one of the individual's ears 100 (ie, without the external microphone 54) has shown that it can be used to detect the initiation activity described herein. . However, empirical trials have shown that by using two such sensors 12, one in each ear of an individual, the performance of systems such as systems 10, 22, 32, 40, and 52 may have more information It was shown to improve about 6-fold due to the detection of Note that in certain circumstances (eg, when using a mobile phone while driving a car), the use of the sensor 12 in both ears is discouraged. The circuit routines, processing routines and logic routines described herein are modified to process signals from the second earset 12 or sensor 12 (sensor 12 with or without external microphone 54). Can be done. Such modifications will be apparent to those skilled in the art.
[0069]
Although not shown in FIG. 2B, speakers 38 (FIGS. 1C and 16) are located on or within housing 150 of sensor 12 and propagate sound to the individual. For example, when using the sensor 150 as a microphone for the communication device 36, the sensor 12 may also be used to broadcast a received sound to a user.
[0070]
As shown, the sensor 12 also includes an external microphone 54. The external microphone 54 is located on the exterior 152 of the housing 150 and is directed outside the wearer of the sensor 12 assembly. External microphone 54 may be secured to housing 150 with an adhesive and may be located in a recess defined by exterior 152. Similar to the internal microphone 34, the external microphone 54 is small (eg, about 1 mm to about 6 mm, but need not be disc-shaped).
[0071]
The location of the external microphone 54 allows the external microphone 54 to detect air pressure changes that are near the wearer's ear but have a sound source external to the wearer of the sensor 12. In one embodiment, external microphone 54 may be a noise cancellation microphone, if desired, as is known in the art.
[0072]
The internal microphone 34 is electrically connected to the amplifier 24 by a lead 158, and the external microphone 54 is electrically connected to the amplifier 24 by a lead 160. Although shown as a single unit in FIG. 2B, amplifier 24 includes separate amplifier circuits 24a and 24b (FIG. 1E) for each signal generated by both internal microphone 34 and external microphone 54.
Amplifier 24 is electrically connected to interface adapter 26 (not shown in FIG. 2B) by conductor 162. More specifically, conductor 162 carries the amplified signal separately from microphones 34 and 54 to different interface adapters 26a and 26b. As those skilled in the art will appreciate, if the amplifier 24 is omitted, the microphones 34 and 54 and / or the speaker 38 may be directly coupled to the interface adapter 26 via a wire. If two sensors 12 are used by placing one sensor 12 in each human ear 100, processing circuitry or other devices that receive signals from the sensors 12 include an internal microphone 34 for each sensor 12 and Four signals corresponding to each of the external microphones 54 are received.
[0073]
The microphones 34 and 54 of the sensor 12 monitor air pressure changes and convert the air pressure changes into analog electrical signals 190 as shown in FIG. 2C. In signal 190, there are at least two signal components, a high frequency component 192 and a low frequency component 194. Further, other frequencies may also be present in the electrical signal 190, and the present invention may be adjusted to analyze various signal frequencies, as described herein.
[0074]
In an alternative embodiment, the internal microphone 34 and the external microphone 54 are provided in a headphone-type assembly having a band located around the user's head and a hub located in one or both ears 100 of the user. One exemplary headphone and internal microphone assembly that may be used is a model 4190 microphone manufactured by Blueel & Kjaer, Denmark.
[0075]
A method 200 for practicing the present invention is disclosed in FIG. 3A. Method 200 includes detecting initiation activity by monitoring changes in ear 100 using internal microphone 34 of sensor 12 at step 202. External microphone 54 is optional in the performance of method 200. Once a start activity is detected at step 202, one or more control instructions or other outputs corresponding to the detected start activity are provided at step 204 to perform the desired output function.
[0076]
A method 200 'for practicing the present invention is disclosed in FIG. 3B. The method 200 'involves detecting a change in air pressure using both the internal microphone 34 and the external microphone 54. More specifically, in step 202 ′, changes in air pressure within ear 100 and / or ear canal 110 are detected by internal microphone 34. These detections may be the result of initiation activity, but are generated by sound components and / or the language of the wearer external to the person wearing the sensor 12 and through the air from the wearer's mouth through the wearer's ear. Sound components propagated to the 100 regions may also be included. In step 202 ′, a change in air pressure near (but external to) the human ear 100 wearing the sensor 12 is also detected by the external microphone 54. These detections are primarily generated by sound components generated outside the person wearing the sensor 12 and / or the language of the wearer and propagated from the mouth of the wearer through the air to the ear 100 area of the wearer. This is the result of the sound component. The detection is converted by microphones 34 and 54 into respective electrical signals (referred to herein as internal and external signals).
[0077]
Next, in step 206, the internal signal and the external signal are compared. If the user produces a pressure change in the ear 100 from speech or other type of initiation activity, the intensity of the signal generated by the internal microphone 34 corresponding to the initiation activity will typically be the corresponding intensity generated by the external microphone 54. Signal strength. The test indicates that if the sound is generated by a sound source other than the user (eg, another human language), the intensity of the signal generated by the external microphone 54 corresponding to this sound is typically generated by the internal microphone 34. It was also shown that the intensity of the corresponding signal was stronger.
[0078]
Using the signal intensity difference, the sound source of the detected air pressure change (ie, the sound source from the user or from outside the user) can be reliably determined. From a further comparison of the internal and external signals, two components from each signal are derived. Two components corresponding to each signal are detected by the external microphone 54, depending on the component associated with the air pressure change caused by the initiation activity and externally generated noise and / or sound (depending on the system in which the sensor 12 is used). (Which may or may not include the user's language). It is noted that for initiation activities other than language, the initiation activity component of the external signal may be almost undetectable.
[0079]
Subsequent processing of the internal and external signals depends on the system in which sensor 12 is used and what type of initiation activity is detected. For example, the signal may be used by a processor or other device that accepts the signal to produce a corresponding output signal. However, in most applications, it is advantageous to isolate the components of the internal signal generated by the initiation activity and, if necessary, eliminate any externally generated components of the internal signal as far as possible. It is. Thus, in step 208, the method 200 'distinguishes the starting active component of the internal microphone signal. In another embodiment of step 208, method 200 'may cancel noise (or all sounds) detected by external microphone 54 from detection of internal microphone 34. More specifically, components generated outside the internal signal are filtered or mechanically removed from the internal signal. The signal obtained in step 208 is used in step 204 'to provide an appropriate output response to a control command or start action.
[0080]
A similar process for processing external signals is performed in step 210 to derive an externally generated sound signal (e.g., isolating another human language from noise and the human language wearing sensor 12). Do). Thereafter, at step 212, an appropriate output response to the control command or externally generated sound may be generated.
[0081]
A method for detecting a change in the ear 100 (step 202) is shown in FIG. The microphone 34 is placed in the user's ear 100 and the user's starting activity should be detected at step 214. However, initiating activity can cause changes in or near other parts of the body. Thus, in an alternative embodiment of the present invention, the sensor 12 may be placed on, in, or near other parts of the body, with any initiation by analyzing physiological or pneumatic changes. Detecting activity is contemplated to be within the scope of the present invention.
[0082]
Changes in the ear 100 are monitored by the microphone 34 at step 216 and converted to electrical signals at step 218 for further analysis. After being converted to an electrical signal at step 218, the electrical signal is analyzed at step 220 to detect initiation activity. Although it is contemplated that initiation activity can be detected at step 220 by simply analyzing a signal corresponding to a change in air pressure or a change in the ear 100 without further data processing, step 220 is typically Data processing with signal analysis. If a sensor with an external microphone is used, the foregoing logic involves capturing an electrical signal corresponding to a change in barometric pressure outside the ear 100 and using this signal in the analysis of step 220 described above. It can be modified as follows.
[0083]
An exemplary method of analyzing and processing the electrical signal corresponding to the monitored pressure (step 220) is shown in FIG. Again, the analysis logic can be adapted to include processing of the second electrical signal delivered from the external microphone 54, as described herein. An analog electrical signal (an example of which is shown in FIG. 2C) is converted at step 222 to a digital signal as shown by the example of FIG. As is well known to those skilled in the art, an analog signal can be converted to a digital signal by sampling the analog signal at a selected frequency and identifying the amplitude of the signal at each sampling point. Each sampled data point then serves as a digital word in memory and is used for further analysis. In FIG. 6, a sampled analog signal is shown, where the dashed line indicates an exemplary analog signal for a particular time period, and the points on the dashed line are the sampled analog signals stored in memory. Represents the amplitude value. It is desirable that the frequency of sampling be sufficient to capture enough data points to sufficiently represent the analog signal. By way of example, the sampling rate may be 32 kHz, and the total signal time length analyzed may be 2048 ms. However, alternatively, other sampling rates and data acquisition time frames may be utilized, and such variations are contemplated to be within the scope of the present invention.
[0084]
Once the analog signal has been converted to digital signal data in step 222, the digital data is analyzed and processed in step 224, for example, by a signal processor to detect the presence of an initiating act. As indicated above, step 224 includes comparing the internal and external signals, and filtering or mathematical manipulation of the signals based on the comparison (to isolate the desired components of detection and / or undesired detection). To remove components). Additionally or alternatively, data analysis and processing may be performed on multiple segments (eg, as shown in FIGS. 7 and 8). As shown in FIG. 7, the processing of step 224 may include analyzing the first data segment in step 226, followed by analyzing the second data segment in step 228. Once the various data segments have been analyzed separately, these data segments are analyzed together at step 230. If all data segments have not yet been analyzed in step 232, the method returns to step 228 and the next data segment is analyzed, after which all preceding segments are analyzed together in step 230. This process continues until all data segments have been analyzed at step 232, thereby allowing results to be produced at step 234 using the analyzed data segments.
[0085]
The data segment analysis may be viewed graphically in FIG. 8, where the digital signal data 236 is shown as being continuous for simplicity. The total length of the data for analysis can be separated into 64 segments, each of which is 32 ms in length. Note that signal 236 includes both high frequency component 238 and low frequency component 240. Data segments associated with the initiating act may possibly be found in either component, or the data of the initiating act may span multiple data segments, so that the data segments may be analyzed separately and together. Thus, in step 226 of FIG. 7, the first data segment is analyzed (region 242), then in step 228 the second data segment is analyzed (region 244), and in step 230 both data segments are joined together. (Area 246). The process then continues for all data segments, so that the data analysis of the present invention may analyze both high and low frequency signals to detect initiating actions.
[0086]
Returning to FIG. 5, at step 224, once data from the sensor that is deemed to be initial data is found in the data signal, at step 248, subsequent analysis is performed to determine the type of act of initiation. . Such analysis may include feature extraction and analysis using a neural net, tuned to recognize each signal / feature of such a signal. If the neural network determines that the signal represents the act of initiating a particular feature, the neural network provides an output or outputs it for an application as described herein. The occurrence of the output that results is produced. However, or alternatively, once the act of initiation is detected, other techniques may be utilized to identify the type of act of initiation and any such technique may fall within the scope of the invention. Is contemplated.
[0087]
One exemplary method of analyzing a digital signal in a data segment (step 224) is shown in FIG. For each data segment of 32 ms, these data are transformed at step 250 from the time domain to the frequency domain using, for example, a fast Fourier transform (FFT), as is well known to those skilled in the art. As is well known, the time domain signal f (t) is tied to the frequency domain f (jω) according to the following equation:
F (f (t)) = ∫f (t) e^−jωtdt = f (jω) Equation 1
Here, F (f (t)) is a traditional Fourier transform. As is well known to those skilled in the art, the fast Fourier transform is related to the traditional Fourier transform. This is because the fast Fourier transform is an efficient algorithm for calculating the discrete Fourier transform. After the digital signal data has been transformed into the frequency domain by a fast Fourier transform, the frequency domain data is processed at step 252 to distinguish between noise data and data related to the initiation action. As is well known to those skilled in the art, the separation of data from noise is often simplified in the frequency domain. This is because, unlike noise, data signals have some physical characteristics. The data signal in the time domain has a smaller amplitude than the noise, but the data signal has a larger amplitude in the frequency domain than the noise. Therefore, the fast Fourier transform is a typical method for noise separation. Additionally or alternatively, signal data from external microphone 54 may be used to derive a signal component, as described in further detail above.
[0088]
The details around the data processing of digital signal data can be achieved through various data processing techniques, as is well known to those skilled in the art, and any data processing methodology is contemplated to fall within the scope of the present invention. You. While many different data processing methodologies may be used, an exemplary methodology is disclosed below, with the following methods and systems.
[0089]
Referring to FIG. 10, a system 270 and method are described. One or more sensors 12 sense changes in the user's ear 100 and, if desired, external to the user's ear 100. The analog signal from the sensor is provided to processor 18 via a data acquisition card, an analog-to-digital converter, and buffers 16/17. The signal received from the sensor is substantially continuous, at least for each time period during which the initiation action is performed; therefore, buffer 17 stores a portion of the signal sufficient for analysis by processor 18. obtain.
[0090]
In one embodiment, processor 18 may include a bandpass filter 272, a frequency spectrum filter 274, a signal detector 276, a signal comparator 278, a feature extraction portion 280, and a neural network 282. System 270 also includes an output 284, which may be connected to a desired output peripheral 20.
[0091]
To summarize the operation of the overall system 270, the sensor 12 and data acquisition, A / D, and buffers 16/17 provide signals to the bandpass filter 272. An example of raw data or a signal supplied to the bandpass filter 272 is shown in the graph 286 of FIG. The raw signal is presented to a bandpass filter, which directs it to the frequency domain using fast Fourier transform techniques. This fast Fourier transform converts a digital signal into the frequency domain. In bandpass filters, for example, frequencies higher or lower than the frequency range representing the initiation action are removed from the signal. Frequencies above and below the frequency range of interest are typically due to noise. An example of the signal after being filtered by a bandpass filter is shown at 288 in the graph of FIG. Various bandpass filters may be used to provide bandpass filtering, excluding signal frequencies above and below the desired frequency range.
[0092]
Portions of the signal represented at 288 (e.g., portions 288a and 288b) may not represent an act of initiation, for example, because they are relatively low power and thus may still be noise. is there. Thus, the frequency spectrum filter 274 performs further filtering according to the power of the various parts of the signal to determine the parts that are due to the initiation action and therefore should be considered for further analysis. Power filtering may be performed by slicing the signal of FIG. 12 into multiple windows or segments (eg, represented at 290a, 290b,... 290i in FIG. 13). It is understood that the graphs of FIGS. 12 and 13 are at different scales. Therefore, windows 290a-290i are at time t_aAnd time t_b(Which is the time t shown for signal portion 288c in FIG. 12)._aAnd time t_bIs the same as the time frame between).
[0093]
Frequency filtering suppresses or eliminates frequencies where the power of the signal does not exceed a predetermined threshold or value, and thus appears to represent noise. By eliminating these noise components, a signal representing the initiation action can be obtained. To perform frequency filtering, for example, the frequency spectrum for the signal is calculated using the following equation:
P_f  = Mag_f ²  + Phase_f ²      Equation 2
Where f = F₀... F_iAnd [F₀F_i] Represents the frequency range over which the signal resulting from tongue movement is expected.
[0094]
Power is literally a function of the square of the absolute value plus the square of the phase. The power as calculated above for each window 290a, 290b,... 290i is reconstructed to create the graph 292 shown in FIG. Graph 292 shows values 292a, 292b,... 292i from the mentioned calculations. Curve 292 is relatively smooth and represents the frequency spectrum in which the signal caused by the act of initiation can be found in graph 288 of FIG. Typically, the signal caused by the act of initiating is relatively high power and occurs at a time approximately at the center of graph 292 (eg, over time frame T shown in FIG. 13). It is the point in time at which this time frame exists and its duration that either detects the signal or determines the point in time at which the signal 288 represents the act of initiation. Thus, in effect, the signal detector component 276 of the system 270 is a combination of the graphs of FIGS. 12 and 13 and the analysis just described to provide a signal detection function. Time frame T is also shown in the graph of FIG. 12, and thus specifies the portion 288d of signal 288c (blocked window 288e shown) that is considered to be caused by the act of initiating.
[0095]
As an alternative to, or in addition to, the filtering and detection operations of the frequency spectrum filter 274, the signal detector 276, and the feature extraction 278, the signal comparator 278 performs the method 200 'to provide a signal indicating the act of initiating ( That is, a signal portion 288d) can be generated. The signal portion 288d or at least features of the signal may then be provided to the neural network 282. Using the principle of feature extraction, the features of the signal portion 288d are provided to this neural network. In neural network 282, this feature is compared to other features to which the neural network has been adjusted. Adjustment of the neural network is a well-known procedure. The neural network may determine whether an input feature (eg, a feature representing signal portion 288d) is an acceptable match or acceptably correlated for adjustment of the neural network; This neural network results in the generation of output 284. Output 284 may be an electrical signal, similar to the type of signal produced by a computer mouse, joystick, or other device. Thus, in one example, the movement of the tongue as the user's tongue moves from the lower left front of the mouth to the upper right of the back of the mouth will produce an output signal similar to the movement of the mouse from the lower left to the upper right of the mouse pad. Can occur.
[0096]
For example, the features extracted from signal 288 may be any features or features indicative of features that distinguish the curve representing the signal from others. Various features are used in the feature extraction method, which are well known. In the present invention, an exemplary feature is the smoothed frequency spectrum of signal portion 288d. Other features may be the log of the frequency spectrum, the frequency spectrum itself, and the like.
[0097]
Neural network 282 may be a conventional neural network tuned in a representative manner. Neural network 282 may compare the features of signal portion 288d to its adjustments and determine whether the features are more similar to one adjusted feature or to another adjusted feature. obtain. If the input features of the signal portion 288d are significantly similar to one tuned feature, the neural network will result in the generation of a signal at approximately the output, for example, as described above. If the input features are not sufficiently similar to any of the adjusted features, or are relatively similar to two or more adjusted features, the neural network will not generate an output signal at the output. Because otherwise, uncertainties can result in the generation of unwanted output signals.
[0098]
As described above, if two sensors 12 are used, the system 270 may operate each signal from each sensor 12 sequentially or may have parallel processing capability, so that both The signals from the sensors can be processed substantially simultaneously. Output 284 may reflect the results of signal analysis of signals emanating from both sensors, and may be used to provide an output signal at output 284 that reflects substantially three-dimensional data.
[0099]
Another embodiment of the invention is directed to a communication system comprising a communication device and an ear microphone (ie, earset) assembly. The communication system allows a user to talk to a remotely located person. The ear microphone assembly (also referred to herein as an earset) includes a microphone and a speaker supported by a housing. The housing is held by the user's ears and allows the user of the communication system to use his hands freely while talking to a remotely located person. This microphone is pointing towards the user's ear canal and detects sounds coming from or coming out of the ear (or changes in air pressure occurring inside the ear), allowing the user to speak accurately and reliably. To detect. The location of this microphone may also help reduce the detection of externally generated sounds. The ear microphone assembly allows for the separation of a cellular or wireless telephone's speech input device from the telephone's RF transceiver.
[0100]
Further, the earset assembly of the present invention allows a user to speak more quietly (eg, whisper or nearly whisper) than with a conventional headset. This allows for more personal conversations and less confusion with others. Speaking more gently requires less concentration to maintain the conversation, thereby allowing the individual to at least partially engage in other activities while speaking. There is also a great deal of evidence to show.
[0101]
The earset of the present invention does not rely on the directionality of the microphone or the detection of sound coming from the user's mouth. Thus, the need to repeatedly adjust the position of this earset, which would otherwise distract the user and require the use of the user's hand. Also, the size and placement of this earset is small, resulting in a more aesthetically appealing device. Such devices can be used sparingly. For example, the device does not draw much attention when used in public, by others, or by persons seen by others (eg, television newscasters or intelligence agents).
[0102]
As a result, sensors can be used to detect human speech. Glossary is used in its broadest sense and is the spoken word and utterance, as well as other utterances produced by the user (eg, a "tongue" sound produced by complaining, whistling, singing, coughing, lip or tongue movement Are also noted. For ease of description herein, a microphone sensing or detecting event is referred to as detection, and what is detected is referred to as a change within the ear, or simply a change in air pressure. You. The present invention provides a substantially real-time speech detection system that monitors changes within the human ear that occur immediately or almost immediately in response to human speech.
[0103]
Referring now to the drawings, FIG. 15 is a block diagram illustrating a communication system 32 'for establishing dual (two-way) audio communication between two or more individuals. The communication system 32 'includes a communication network 37 or a skeletal network. The communication network 37 establishes a communication link with the at least one communication device 36 'so that the user of the communication device 36' can use the remotely located telephone 31, as is known in the art. Enables conversation with a remotely located person. In the illustrated embodiment, communication device 36 'and remote phone 31 are wireless phones (e.g., mobile phones). However, those skilled in the art will recognize that communication device 36 'and / or remote telephone 31 may include other types of devices, such as hard-wired (landline) telephones, radios, personal digital assistants (PDAs), portable or stationary computers, and the like. Understand). Communication network 37 may also be an alternative type of network (eg, Internet, WAN, or LAN).
[0104]
Communication system 32 'includes an ear microphone assembly (or earset 12'), which has a microphone 34 'and a speaker 38' supported by a housing 150 '(FIG. 16). The physical arrangement of the earset 12 'will be described in further detail below. The microphone 34 'is used to detect sounds originating or coming out of the user's ear (sometimes referred to as air pressure changes in the ear) that are the result of the user's speech. Microphone 34 'converts these detections into electrical signals. This electrical signal is amplified by an amplifier 24 'as needed. This amplified electrical signal is then received by the communication device 36 'via the appropriate interface adapter 26'. Interface adapter 26 'may be, for example, a jack or other electrical connector that is received by a corresponding receptacle of communication device 36'.
[0105]
The inner portion 154 'of the housing 150' has a recess 156 'in which the microphone 34' is located. Preferably, the air adjacent to the eardrum 112 and / or the air in the ear canal 110 is in fluid communication with the air adjacent to the microphone 34 '. In this manner, sound or air pressure changes generated inside the ear 100 are transmitted directly to the microphone 34 'through an air medium. Other sounds transmitted by the user's bones and tissues may be transmitted mechanically via the housing 150 'to the microphone 34'. In one embodiment, microphone 34 'is held in place using an adhesive. Microphone 34 'is, in one embodiment, smaller than 2 mm. In an alternative embodiment, the microphone 34 'is located in a hollow cavity defined by the housing 150', and the opening in the wall of the housing 150 'that defines the cavity defines the air and ear canal in this cavity. Provided to establish fluid communication with the air in 110.
[0106]
The inner portion 154 'of the housing 150' has a second recess 157 in which the speaker 38 'is located. Preferably, speaker 38 'responds to the speech of a remotely located person using remote telephone 31 and broadcasts the sound received by communication device 36'. This sound is a reproduction of a remotely located human story and is made audible to the user by the speaker 38 '.
[0107]
Microphone 34 'is electrically connected to amplifier 24' using conductor 158 '. Speaker 38 'is also electrically connected to amplifier 24' using conductor 160 '. Amplifier 24 'is electrically connected to interface adapter 26' (FIG. 15) using conductor 162 '. More specifically, conductor 162 'carries the amplified signal from microphone 34' to interface adapter 26 'and carries the signal to be converted to sound from interface adapter 26' to the speaker. As those skilled in the art will appreciate, amplifier 24 'may be omitted or bypassed, and microphone 34' and / or speaker 38 'may be directly coupled to interface adapter 26' by a wire.
[0108]
The speaker 38 'is used to transmit (i.e., broadcast) sound to the user. These sounds include sounds generated in response to signals received by communication device 36 'through communication network 37. In this manner, the earset 12 'and the communication device 36' can be used as a two-way communication device.
[0109]
In one embodiment, earset 12 'is coupled to the communication device using three wires. The first of these wires is used as normal ground. The second of these conductors carries the electrical signal to be converted to sound waves to speaker 38 '. The third of these conductors carries an electrical signal representing the detected sound from the microphone 34 'to the communication device 36' for transmission to the communication network 37. The third conductor also carries power for microphone 34 'and amplifier 24'. In this embodiment, the interface adapter 26 'can be implemented using a 2.5 mm jack, as is known in the art.
[0110]
Using the microphone 34 'in one of the individual's ears 100 and using one earset 12' can be used to detect a talk, resulting in communication by the communication device 36 ', and can be remotely located. Has been shown to be able to listen to this user using the remote telephone 31. However, empirical testing has shown that by using two such earsets, one in each of the individual's ears, the performance of the system 32 'may be reduced due to the detection of more information. It was shown to be improved.
[0111]
A block diagram of the ear microphone assembly and, in particular, the amplifier 24 'is shown in FIG. Since the microphone 34 'is located in close proximity to the speaker 38', the microphone 34 'tends to detect sound generated by the speaker 38'. These detections are in addition to detecting the user's story. The sound generated by the speaker 38 'and detected by the microphone 34' is referred to herein as feedback, and is indicated by arrow 51 in FIG. In one embodiment, the sensitivity of the earset 12 'is adjusted to minimize detection of sound from the speaker 38' and / or minimize delivery of feedback components to the communication device 36 '. Is done. For example, if desired, a potentiometer may be used to adjust the gain of amplifier 24 '. Physical separation between the speaker 38 'and the microphone 34' to reduce the detection of feedback is also possible.
[0112]
In an exemplary embodiment, amplifier 24 'is configured to cancel at least some, if not all, of the feedback components of the electrical signal generated by microphone 34'. In this embodiment, the speaker 38 'and the microphone 34' are placed in close physical proximity so that the feedback detected by the microphone 34 'is very similar to the sound generated by the speaker 38'. You. FIG. 17 illustrates an exemplary amplifier circuit 24 'for canceling at least a portion of the feedback component. As will be apparent to those skilled in the art, various alternative analog or digital circuits may be used, each falling within the scope of the invention.
[0113]
The illustrated amplifier circuit 24 'receives an electrical signal output from a microphone 34' (herein referred to as a microphone signal). This microphone signal is filtered by the filter 53. The filter 53 may be, for example, a filter for removing low-frequency components (for example, frequencies less than about 400 Hz) of the microphone signal. The filtered microphone signal is then amplified by an amplifier 55 (eg, a low power, non-inverting operational amplifier). The increase in amplifier 55 is selected to adjust the microphone signal to a voltage level that meets the input requirements of communication device 36 '.
[0114]
As shown, a speaker 38 'is coupled to the communication device 36' to receive an electrical signal for conversion to a sound to be disseminated to a user of the earset 12 '. This signal is referred to herein as a speaker signal. This speaker signal is also filtered by the filter 58. Filter 58 may be, for example, a filter for removing low frequency components (eg, frequencies below about 400 Hz) of the speaker signal. The filtered speaker signal is then amplified by amplifier 60. Amplifier 60 may be, for example, a low power inverting operational amplifier. The increase in amplifier 60 is selected to adjust the loudspeaker signal to have an amplitude equal to or approximately equal to the amplified feedback component of the microphone signal.
[0115]
The amplified microphone signal and the amplified speaker signal are then combined to eliminate the feedback component of the microphone signal and produce a modified microphone signal. It should be noted that the polarity or phase of the amplified microphone signal and / or the amplified speaker signal can be adjusted to properly combine the signals. The combination of the signals can be performed by the adder 56. As will be apparent to those skilled in the art, in analog systems, signals can be combined by simply sending the signals together. In one example, the conductors carrying the signals are directly connected together. Alternatively, an analog or digital circuit or process may be used to perform the combined function of adder 56.
[0116]
Note that if the speaker signal needs to compensate for any propagation delay of feedback 51, it may be delayed by a delay element. The output of summer 56 further modulates the modified microphone signal (eg, removes high frequency components of the modified microphone signal (eg, frequencies greater than about 4 KHz for the communication systems described herein)). For filter 62.
[0117]
Many alternatives to the exemplary amplifier circuit 24 'are contemplated and each is considered to fall within the scope of the present invention.
[0118]
As another example, high and low frequency filters can be replaced by band pass filters. In another example modification, the speaker signal may be amplified and / or filtered before being applied to the speaker.
[0119]
In yet another example modification, analog microphone and speaker signals can be converted to digital signals and processed using digital signal processing techniques to obtain a microphone signal with no or little feedback components.
[0120]
Processing of microphone signals by the communication device 36 'for transmission is well known in the art and will not be described in further detail.
[0121]
With further reference to FIG. 18, in another embodiment of the present invention, the earset 12 ′ includes a microphone 34 ′ (referred to herein as an internal microphone 34 ′) directed to the user's ear canal. An external microphone 54 'may be provided. The external microphone 54 'detects a change in air pressure generated outside the user's ear, that is, a sound. As described in more detail below, these sounds are converted to electrical signals and compared to the electrical signals corresponding to the sounds detected by the internal microphone 34 '. Each signal can be processed to identify changes in air pressure within the ear from externally generated noise, speech, and the like.
[0122]
An external microphone 54 'is located on the outer portion 72' of the housing 150 'and is pointed away from the wearer of the earset 12' assembly. External microphone 54 'may be adhesively secured to housing 150' and may be located in a recess defined by external portion 72 '. Like the internal microphone 34 ', the external microphone 54' is small (e.g., less than 2 mm in size).
[0123]
The location of the external microphone 54 'allows the external microphone 54' to detect changes in air pressure near the wearer's ears but with an external source to the user of the earset 12 '. In one embodiment, external microphone 54 'is an omnidirectional microphone.
[0124]
FIG. 18 is a block diagram illustrating a system 32 "for detecting user conversation. The system 32" includes an internal microphone 34 ', speaker 38', and amplifier 24a, as described in more detail above. An earset 12 having a '. Further, the earset 12 'of the system 32 "has an external microphone 54'. As will be apparent to those skilled in the art, the use of the external microphone 54 'is optional. 16) is positioned above and generally directed away from the individual wearing the earset 12 '. As a result, the external microphone 54' detects air pressure changes outside the ear. Predominantly externally generated noise (such as other people's conversations, environmental noise, etc.), and some if the conversation travels from the user's mouth to the external microphone 54 'via air, the earset 12' Is the result of the noise generated for the conversation of the individual wearing.
[0125]
The external microphone 54 'generates an electric signal corresponding to the sound detected by the external microphone 54'. External microphone 54 'is electrically coupled to communication device 36' using a separate and different input, i.e., channel, than that used for internal microphone 34 '. The signal generated by the external microphone can be amplified by amplifier 24b 'and coupled to communication device 36' using interface adapter 26b '. Communication device 36 'correlates the two signals generated by microphones 34', 54 ', as described below. Alternatively, the internal microphone 34 'and the external microphone 54' are respectively connected to the left and right channel inputs of the processing circuit for correlating the signal, as discussed below.
[0126]
The unique signals generated by the internal microphone 34 'and the external microphone 54' may be used to distinguish between user-generated speech and externally generated sound. In an alternative configuration of system 32 ", system 32" may be adjusted to cancel externally generated noise from the detection of internal microphone 34 '.
[0127]
When the user speaks, both the internal microphone 34 'and the external microphone 54' detect the conversation. Sound generated by sources other than the user (eg, the noise of another individual, traffic, machines, air conditioners, or computers, etc.) is referred to herein as noise. Both the external microphone 54 'and the internal microphone 34' detect noise. Accordingly, communication device 36 '(or other processing circuitry) may be programmed to separate the user's conversation by identifying (i.e., separating) the speech and noise components. As a result, a relatively noise free speech signal may be generated, which signal may be communicated by the communication device 36 'to the communication network 37 (FIG. 15). One of ordinary skill in the art will be able to assist in separating the starting active component and the noise component in the manner described herein for system 32 "(eg, by using method 300 described below). It will be appreciated that the earset 12 'may be used with other systems (e.g., systems 10, 22, 32, 40 and 52 described above).
[0128]
In one embodiment, signal separation may be performed by solving equations 1 and 2 shown below for the sound component signal ("S") and the noise component signal ("N"). Impulse response of internal microphone (F_MI) And the external microphone impulse response (F_ME) Reflects microphone sensitivity, microphone frequency response, ear and housing resonance characteristics, and the like. Y_IRepresents the entire signal generated by the internal microphone and Y_ERepresents the entire signal generated by the external microphone. Assuming that the entire system is linear (the features of the system are additive and homogeneous), the system can be represented by Equations 3 and 4 as follows (the asterisk, or "*", is a convolution) Operator):
F_MI* S + F_MI* N = Y_I          Equation 3
F_ME* S + F_ME* N = Y_E          Equation 4.
[0129]
Output signal Y_IAnd Y_EAnd the known impulse response F_MIAnd F_MEBy using, the two equations can be solved in real time for the two unknown signals S and N.
[0130]
A method 300 for detecting conversation using the system 32 "is illustrated in FIG. 19. The method 300 includes detecting air pressure changes using both the internal microphone 34 'and the external microphone 54'. More specifically, at step 302, changes in air pressure within the ear 100 are detected by the internal microphone 34 '. These detections may be the result of a user speaking, but the earset 12 It may also include noise components generated outside of the individual wearing the 'and / or sound components generated by the user's speech as well as sound components transmitted from the user's mouth to the area of the user's ear 100 via air. In step 302, a change in air pressure near the user's ear 100 but outside the user's ear is applied to the external microphone 54 '. These detections are mainly due to noise generated outside the user and / or sound components generated by the user's speech and from the user's mouth to the area of the user's ear 100 via air. The detection is converted into respective electrical signals (referred to herein as internal and external signals) by microphones 34 'and 54', which are described in more detail above. As discussed, it may be processed to reduce any detected feedback from speaker 38 '.
[0131]
Next, in step 304, the speech and noise components are separated as described above. The conversation signal obtained from step 304 is used in step 306 to provide a signal conveyed by communication device 36 '.
[0132]
The illustrations described herein illustrate the configuration, function, and operation of various systems for detecting changes in the human ear and generating output signals or control instructions corresponding to initiation activity. Each functional block may represent a module, segment, or portion of software code that includes one or more executable instructions for performing the specified logical function.
[0133]
Although the block diagrams and flowcharts show a particular order of execution, it is understood that the order of execution may be different from that shown. For example, the order of execution of two or more blocks may be changed relative to the order shown. Also, two or more blocks shown in succession may be performed simultaneously or partially simultaneously. Further, various blocks may be omitted. It is understood that all such variations are within the scope of the present invention.
[0134]
Although the invention has been shown and described with respect to certain preferred embodiments, it is obvious that equivalent changes and modifications will become apparent to those skilled in the art upon reading and understanding this specification and the accompanying drawings. is there. In particular, with respect to various functions that may be performed by the components (assemblies, devices, circuits, etc.) described above, the terms used to describe such components (including references to “means”) are: Unless otherwise indicated, the identification of the described components, even if not structurally equivalent to the disclosed structure that functions in the exemplary embodiments of the invention illustrated herein. It is intended to correspond to any component that performs the function of (i.e., one that is functionally equivalent). Moreover, while particular features of the invention may be disclosed in connection with only one of several embodiments, such features are desired for any given or particular application and It can be combined with one or more other features of other embodiments, as may be advantageous.
[Brief description of the drawings]
[0135]
FIG. 1A is a block-level diagram illustrating a system used to detect air pressure fluctuations and provide a control function corresponding to the detected air pressure in accordance with the present invention.
FIG. 1B is a block-level diagram illustrating a system in which air pressure fluctuations are detected and processed and, in the illustrated embodiment, processed by a speech recognition software program for interpreting a human language. is there.
FIG. 1C is a block-level diagram illustrating the system where air pressure fluctuations are detected and retransmitted by the communication device.
FIG. 1D is a block-level diagram illustrating the system in which air pressure fluctuations are detected and used by a medical diagnostic device.
FIG. 1E is a block-level diagram illustrating a system having a sensor with an internal microphone and an external microphone.
FIG. 2A is a schematic diagram of an ear.
FIG. 2B is a cross-sectional view of a sensor embodiment for monitoring air pressure changes in a human ear.
FIG. 2C is a graph illustrating an exemplary electrical signal generated by a sensor according to the present invention.
FIG. 3A is a flow chart diagram illustrating a method of detecting a pneumatic pressure change and providing a control command in response to the detected change in accordance with the present invention.
FIG. 3B is a flowchart diagram illustrating another method of detecting a pneumatic change and providing a control command in response to the detected change in accordance with the present invention.
FIG. 4 is a flowchart diagram illustrating a monitoring method according to the present invention.
FIG. 5 is a flow chart diagram illustrating a method of processing electrical signals corresponding to mouth / tongue activity, thinking, language and / or another type of initiation activity.
FIG. 6 is a graph illustrating the conversion of an analog electrical signal to digital signal data according to the present invention.
FIG. 7 is a flowchart diagram illustrating a method for analyzing digital signal data according to the present invention.
FIG. 8 is a graph illustrating a method of analyzing digital signal data using the flowchart of FIG. 7, in accordance with the present invention.
FIG. 9 is a flowchart diagram illustrating a method of processing digital signal data according to the present invention.
FIG. 10 is a system diagram illustrating a system including portions and functions of the present invention.
FIG. 11 is a graph illustrating exemplary raw signal information detected by a sensor used in the present invention to detect air pressure changes.
FIG. 12 is a graph of frequencies obtained by filtering the signal information of FIG. 11 (for example, frequencies filtered to remove noise).
FIG. 13 is a graph showing power spectrum window slicing of the curve of FIG.
FIG. 14 is a graph of such a power spectrum.
FIG. 15 is a block diagram illustrating a communication system according to an embodiment of the invention.
FIG. 16 is a cross-sectional view of an ear microphone assembly, or earset, positioned against a human ear, and the ear is also shown in cross-section.
FIG. 17 is a block diagram of an ear microphone assembly.
FIG. 18 is a block diagram of an ear microphone assembly according to another aspect of the present invention.
FIG. 19 is a flowchart of a method for processing a signal generated by the ear microphone assembly of FIG. 17;

Claims (31)

A detection system, comprising:
Housing (150, 150 ') positionable with respect to the individual's ear;
A microphone (34, 34 ') positioned relative to the housing for insertion into an individual's ear, wherein the microphone detects a change in air pressure within the ear while the individual performs initiation activity. A microphone operable to generate an electrical signal corresponding to a pneumatic pressure change detected therein; and a microphone coupled to process the electrical signal to generate a corresponding output. Processing circuits (14, 14 ', 14 ", 36, 36', 42);
A detection system comprising: The system of claim 1, wherein the microphone is positioned for placement in the concha. The system according to claim 1, wherein the microphone is arranged for placement in an Eustachian tube. The speech recognition system (22) of claim 1, wherein the initiation activity is a language and the processing circuitry performs logic to perform automated speech recognition and generate a corresponding output. system. The communication system (32, 32 ', 32 ") according to claim 1, wherein the initiation activity is a language and the system comprises a communication device for communicating the corresponding output to a remote location. ,system. The medical diagnostic system (40) according to claim 1, wherein the initiation activity is a biological process, and wherein the processing circuitry executes logic for performing a medical diagnosis. 7. The medical diagnostic system according to claim 6, wherein the housing and the microphone are located remotely from the processing circuit, and the electrical signal is transmitted from the microphone to the processing circuit by a communication medium. 2. The medical diagnostic system of claim 1, wherein the initiating activity is a biological process, wherein the system includes an audio output and a video output for providing biometric information to a health care provider. A system comprising one. 9. The medical diagnostic system according to claim 8, wherein the housing and the microphone are located remotely from the processing circuit, and the electrical signal is transmitted from the microphone to the processing circuit by a communication medium. 2. The system of claim 1, wherein the initiation activity is a thought, the processing circuitry performs logic to recognize the thought from the electrical signal, and the output is a computing device or equipment. 20) A system which is a control command for controlling the item of 20). The system of claim 10, wherein the recognition logic includes neural network matching logic. 2. The system of claim 1, wherein the initiation activity is a movement associated with the oral cavity, the processing circuitry performs logic to recognize the movement from the electrical signal, and the output is calculated. A system that is a control instruction for controlling an item of a device or equipment. 13. The system of claim 12, wherein said recognition logic includes neural network matching logic. 13. The system according to any of the preceding claims, wherein the system is located relative to the housing, located adjacent to the ear, and detects a change in air pressure external to the individual's ear, The system further comprising a second microphone (54, 54 ') operable to generate an electrical signal corresponding to an externally detected air pressure change. 15. The system of claim 14, wherein the processing circuit compares an electrical signal corresponding to the internally detected air pressure change with an electrical signal corresponding to the externally detected air pressure change, A system that performs logic to distinguish between detecting pneumatic pressure changes caused by the initiation activity and detecting pneumatic pressure changes generated by a source external to the individual. 16. The system according to any of claims 14 to 15, wherein the processing circuit comprises: an electrical signal corresponding to the internally detected air pressure change; and an electrical signal corresponding to the externally detected air pressure change. And performing logic to determine the starting activity component of each signal and the external source component of each signal. 17. The system according to any one of claims 14 to 16, wherein the processing circuit performs logic to eliminate at least an external source component of an electrical signal corresponding to the internally detected pneumatic pressure change. system. A sensor (12, 12 ') for detecting a change in air pressure in a human ear, the sensor comprising:
An inner portion (154, 154 ') adapted for at least partial insertion into an individual's ear and an outer portion (152, 152') adapted to engage at least a portion of the pinna of the ear A housing (150, 150 ') having:
An internal microphone (34, 34 ') positioned with respect to the interior part of the housing to detect a change in air pressure generated from within the ear; and to detect a change in air pressure generated externally to the ear, External microphones (54, 54 ') positioned relative to the outer part of the housing;
A sensor comprising: 20. The sensor of claim 18, wherein the internal microphone is positioned for placement on the concha. 19. The sensor according to claim 18, wherein the internal microphone is arranged for placement in the ear canal. 21. A sensor according to any of claims 18 to 20, wherein the amplifiers (24, 24a, 24b, 24 ', 24a', 24b) for separately amplifying the electrical signals generated by the internal and external microphones. ') Further comprising a sensor. 22. Sensor according to any of claims 18 to 21, wherein the electrical signals generated by the internal and external microphones are separate to processing circuits (14, 14 ', 14 ", 36, 36', 42). Sensors connected by channels of 23. The sensor according to any of claims 18 to 22, wherein a positive pressure is generated in the ear canal when inserting the interior portion of the housing into the ear. 24. The sensor according to any of claims 18 to 23, further comprising a speaker (38, 38 ') for spreading sound to the individual. An earset (12, 12 '), wherein the earset comprises:
Housing (150, 150 ') positionable with respect to the individual's ear;
A microphone (34, 34 ') positioned relative to the housing for insertion into an individual's ear, wherein the microphone detects a change in air pressure in the ear while the individual is speaking; A microphone operable to generate an electrical microphone signal corresponding to the air pressure change detected therein;
A speaker (38, 38 ') disposed relative to the housing and operable to generate a sound corresponding to an electrical speaker signal; and coupled to receive the microphone signal and the speaker signal; And a circuit (24 ') operable to produce a modified microphone signal having a reduced feedback component of the microphone signal, the feedback component being provided by the speaker to produce a modified microphone signal. A circuit resulting from the detection of the generated sound by the microphone,
An earset comprising: 26. The earset according to claim 25, wherein the circuit comprises:
An amplifier (55) for amplifying the microphone signal;
An amplifier (60) for amplifying the speaker signal;
Combining means (56) for combining the amplified microphone signal and the amplified speaker signal to generate the modified microphone signal;
An earset comprising: 27. The earset according to any of claims 25 to 26, wherein the microphone and the speaker are arranged for placement on the concha. 27. The earset according to any of claims 25 to 26, wherein the microphone and the speaker are arranged for placement in the ear canal. 29. The earset according to any of claims 25 to 28, wherein the earset is positioned relative to the housing, positioned adjacent the ear, and detects a change in air pressure external to the individual's ear; An earset further comprising a second microphone (54, 54 ') operable to generate an electrical signal corresponding to the externally detected air pressure change. 30. The earset of claim 29, wherein a processing circuit (14, 14 ', 14 ", 36, 36', 42) includes an electrical signal corresponding to the internally detected pneumatic pressure change and an external signal. Comparing an electrical signal corresponding to the detected air pressure change to distinguish between the detection of the air pressure change generated in the language of the individual and the detection of the air pressure change caused by an external source to the individual. An earset that performs the logic of 31. A communication system (32, 32 ', 32 ") comprising, in combination, an earset according to any of claims 25 to 30, and further comprising a communication device (36, 36'), wherein the earset and The communication device is coupled to receive the modified microphone signal and deliver an output corresponding to the modified microphone signal to a remote location, the communication device receiving the signal whose speaker signal is generated by the communication device. A communication system that is adapted to:

Images