WO2014146552A1 - Doppler ultrasonic pickup analyzing and processing method and device - Google Patents

Abstract

A Doppler ultrasonic pickup analyzing and processing method and device, the method comprising the following steps: transmitting an ultrasonic wave signal of a fixed frequency to a sound producing target such as human tissue or a resonance part both comprising vocal cords and vibrating with the vocal cords, and a non-living sound producing object, and receiving a reflected echo signal of the ultrasonic wave signal returned from the sound producing target (S101); amplifying the reflected echo signal, and comparing the amplified signal with the ultrasonic wave signal or a reference ultrasonic wave signal to obtain a Doppler frequency shift signal comprising the sound production feature of the sound producing target (S102); and outputting the Doppler frequency shift signal as an audio signal or a visible spectrogram for a corresponding application, or as a light signal (S103). The method, based on the Doppler ultrasonic principle, transmits an ultrasonic wave signal to a sound producing target, receives an echo signal for analysis and processing, extracts a Doppler frequency shift signal comprising the sound production feature of the sound producing target, and outputs the Doppler frequency shift signal as an audio signal, a visible spectrogram, or a light signal, thus overcoming the defects of an ordinary microphone and a bone conduction microphone.

Description

 Doppler ultrasonic pickup analysis processing method and device

 Technical field

 The invention relates to the field of sound pickup technology, and in particular relates to a Doppler ultrasonic sound collection analysis processing method and device.

 Background technique

So far, the method of converting the mechanical vibration generated by the sounding object into an electrical signal is mostly done by a microphone. The early microphone built-in toner cartridge caused the sound to cause air vibration, and the vibration of the air caused the toner to vibrate synchronously, causing the toner resistance to change, thereby obtaining an electrical signal reflecting the characteristics of the sound. The working principle of the modern moving coil microphone is that the sound vibrates through the air, and the coil winding on the diaphragm and the magnet surrounding the moving coil head form a magnetic line cut, thereby generating a weak current signal corresponding to the sound. Another type of electret microphone works on the principle that the sound vibrates through the air, causing the distance between the upper diaphragm and the lower metal piece to change, causing the capacitance to change, forming a current impedance that matches the sound characteristics.

Conventional microphones have some obvious shortcomings. For example, since the sound of a vocal cord or a musical instrument is always transmitted to the microphone through the synchronous vibration of the air, the sound of the surrounding environment is inevitably transmitted to the microphone and then amplified, and the unwanted electrical signal is transmitted through the speaker or the earphone. Change to ambient noise release. In order to let the other party hear clearly in a noisy environment, you must let go of your throat and ignore privacy. In addition, in order to get a better pickup effect, the sound should be directed at the direction of the microphone and cannot exceed a certain distance. A fixed-position microphone inevitably limits the range of motion and face orientation of the lecturer and singer, and the wireless microphone that is carried or fixed on the head is both inconvenient and affects the appearance. Another problem that often occurs is that positive feedback of the sound signal is easily generated between the microphone and the speaker, and an annoying whistling sound occurs. A similar problem is also manifested by severe accent in the communication (the caller can hear his own voice). Repeat).

In order to solve these problems, many patents have been disclosed at home and abroad, but the main difference between the disclosed bone conduction microphone (pickup) and the conventional microphone is that the vibration from the skin or bone is directly converted into an electrical signal by the intermediary of air or not. . On the one hand, the vibration of the vocal cords causes the resonance of the throat, the mouth, the nose, the head cavity and the chest air, and on the other hand, the vibration of the muscles, bones, fat and skin tissue connected to the vocal cords. The resistance of the former method is small, and the sound of the vocal cord increases due to resonance. The latter method is completely different. Non-elastic body tissues, such as muscle, fat and connective tissue, have a great damping effect on the transmission of sound, the vibration transmitted to the skin is very weak, and the sound characteristics are also significantly changed. Therefore, the bone sensing microphone preferably conducts sound through the bones with better elasticity and less damping. The microphone needs to be close to the bones (such as the tibia, frontal bone and cervical vertebrae), but the farther away from the sound belt, the worse the sound transmission effect. The choice of suitable bone surface is limited, inconvenient and not beautiful. In short, bone conduction microphones are also very limited.

 Summary of the invention

SUMMARY OF THE INVENTION An object of the present invention is to provide a Doppler ultrasonic pickup analysis processing method and apparatus for a vocal cord, a human tissue or a resonance portion that vibrates with a vocal cord, and a non-vival sounding body in order to overcome the above-mentioned disadvantages in the prior art.

 The present invention is achieved in such a manner that a Doppler ultrasonic sounding analysis processing method includes the following steps:

And transmitting an ultrasonic signal of a certain frequency to an utterance target including a vocal cord, a human body tissue or a resonance portion vibrating with the vocal cord, and a non-vival sounding body, and receiving the Doppler frequency of the ultrasonic signal returned from the utterance target Transmitting the reflected echo signal of the signal; amplifying the reflected echo signal and comparing the ultrasonic signal or the reference ultrasonic signal to obtain a Doppler shift signal containing the utterance characteristic of the utterance target.

The Doppler frequency shift signal is divided into three outputs: one signal is subjected to audio amplification processing and then output as an audio signal; and one signal is processed to obtain a characteristic parameter of the sounding vibration of the sounding target, and then converted into a sounding target The vocal characteristics and the visual spectrum output of the vocal quality indicator are used accordingly; the signal processing is output as a light signal reflecting the utterance condition of the utterance target.

The human tissue vibrating with the vocal cord includes the bones and skin of the human body; the resonance portion refers to a cavity in the human body, including the frontal sinus, the ethmoid sinus, the sphenoid sinus, the maxillary sinus, the sinus, the trachea, the esophagus, the oral cavity, and the pharynx. Cavity, larynx, stomach, and chest; the non-vival sounding body includes a vibrating or resonant cavity of the instrument, a device in operation, a machine or tool, and an artificial or natural material that is audible due to load.

The vocal characteristics and vocal quality indicators include: vocal cord vibration frequency anomalies, vibration intensity anomalies, time anomalies, spectral distribution anomalies, spectral dispersion anomalies, and spectral envelope anomalies that can be used for vocal cord, pharyngeal cavity, and related muscle group lesion diagnosis;

The vocalist's pitch, timbre, intensity, voice, resonance position accuracy and resonance intensity can be used to assist vocal teaching and vocal training; vocal cord vibration frequency characteristics, vibration intensity characteristics, and voice of a person who can be used for voiceprint confirmation Time value characteristics, spectrum distribution characteristics, spectral dispersion characteristics, spectral envelope characteristics, resonance peak characteristics when transmitting specific speech, resonance position characteristics, resonance intensity of different resonance positions, spectrum distribution characteristics; can be used for instrumental performance training, instrument quality Accuracy or instrument production process improvement refers to the pitch, sound quality, resonance position accuracy and resonance intensity of the instrument used; the equipment, machine or machine that can be used for defect detection, design optimization or noise reduction measures of production equipment, machines or tools The amplitude of the noise generated by the tool - The distribution of the formants in the frequency spectrum and the difference in amplitude values at different locations.

 The frequency of the ultrasonic signal is not lower than 0.02 MHz The transmission of the ultrasonic signal and the acceptance of the reflected echo signal include continuous transmission and reception modes transmitted and received by different ultrasonic transducers, and rotation and transmission of pulsed transmissions and received by the same ultrasonic transducer. Receive mode.

The characteristic parameters of the vocal vibration of the vocal target include the dominant frequency and resonant frequency of the sound, the resonance peak, the spectral distribution, the amplitude corresponding to each frequency, the spectral dispersion, the spectral envelope, the vibration phase, the real-time frequency, and the real-time amplitude.

 The visible spectrum includes a spectral distribution map, a frequency shift-time spectrum, an amplitude-time spectrum, an amplitude-frequency spectrum, a power spectrum, and a frequency shift. - Amplitude - Time 3D spectrum.

It is still another object of the present invention to provide a Doppler ultrasonic pickup analysis processing apparatus including a central control unit and an ultrasonic pickup module coupled to the central control unit for alignment under the control of the central control unit The sounding target transmits an ultrasonic signal of a certain frequency, and receives a reflected echo signal including the Doppler frequency shift signal returned from the sounding target; the Doppler frequency shift signal generating module is configured to be in the central control Under unit control, the reflected echo signal is amplified and compared with the ultrasonic signal to obtain a Doppler shift signal containing the utterance characteristic of the utterance target; and an output module for the Doppler shift The signal is divided into three outputs: one signal is amplified by audio and then output as an audio signal; one signal is processed to obtain characteristic parameters of the vocal vibration of the utterance target, and then converted into vocal characteristics and vocal quality indicators that reflect the utterance target. Visual spectrum output; one signal processing as a light signal reflecting the vocalization status of the vocal target Out.

The ultrasonic sound collection module includes: an ultrasonic oscillator for transmitting an ultrasonic signal to the sounding target; and a piezoelectric ceramic wafer for receiving the reflected echo of the ultrasonic signal including a Doppler shift signal signal.

The Doppler shift signal generating module includes: a frequency selective amplifier for performing frequency selective amplification on the reflected echo signal including the Doppler shift signal received by the piezoelectric ceramic wafer; and a modulator And comparing the amplified signal of the frequency selective amplifier with the ultrasonic signal emitted by the ultrasonic oscillator to form a stable high frequency radio frequency oscillation signal; and a band pass filter for removing the The noise in the high-frequency RF oscillating signal is decomposed and mixed with the frequency to extract the available Doppler shift signal.

The output module includes: a sound output module, configured to: a channel of the Doppler frequency shift signal is amplified by audio and then broadcasted through a sound output device; and a visible spectrum output module is used for the Doppler The signal of the hopping signal is analyzed and processed to obtain the characteristic parameter of the vocal vibration of the vocal target, and then converted into a visible spectrum output capable of providing the vocal characteristics and the vocal quality indicator of the vocal target; the light monitoring module is used for Passing a signal of the Doppler shift signal The LED driver circuit is then output to the LED for light monitoring of the audible condition.

 The sound output module includes an audio amplifier and a sound output device coupled to the audio amplifier.

 The sound output device includes a speaker or an earphone.

 The visual spectrum output module includes a spectrum analysis processor and a display unit connected to the spectrum analysis processor.

 The spectrum analysis processor is a band pass filter array or a Fourier transformer composed of a plurality of band pass filters having different band pass frequencies.

 The light monitoring module includes an LED driving circuit and an LED lamp connected to the LED driving circuit.

The invention is based on the principle of Doppler ultrasound, and transmits ultrasonic waves to a sounding target such as a vocal cord and a tissue or a part that resonates with the vocal cord. Due to the vibration of the vocal target, the received echo is inconsistent with the transmitted wave, and after amplification, the original The transmitted wave signal or the reference signal is mixed and demodulated, and the Doppler signal including the characteristic parameters of the sounding body vibration is extracted, including frequency, amplitude, phase and spectral distribution, etc., and the Doppler signal is amplified by processing and convertible. It is broadcasted by the speaker after the audio signal, and can also be converted into visual graphic output, which is used in various aspects, such as vocal teaching aid, spectrum analysis of vocal cord lesions, analysis of equipment running characteristics, detection of bearing material defects and voiceprint confirmation, overcoming common Disadvantages of microphones and bone sensing microphones.

 DRAWINGS

 1 is a flowchart of a Doppler ultrasonic sound collection analysis processing method according to an embodiment of the present invention;

 2 is a structural block diagram of a Doppler ultrasonic sounding analysis process according to an embodiment of the present invention;

 FIG. 3 is a schematic diagram of an array of band pass filters according to an embodiment of the present invention; FIG.

 4A-4C are schematic diagrams showing a Doppler spectrum distribution according to an embodiment of the present invention;

 FIG. 5 is a schematic diagram of a Doppler shift-time spectrum according to an embodiment of the present invention; FIG.

 6 is a frequency-frequency spectrum diagram of a spindle head box of a lathe according to an embodiment of the present invention;

 FIG. 7 is a schematic diagram showing an amplitude-time spectrum of sounding of internal defects of a carrier material according to an embodiment of the present invention; FIG.

 Figure 8 is a schematic view showing the structure of an ultrasonic pickup module in which a piezoelectric ceramic wafer can be closely connected to the skin;

 Figure 9 A-9B shows the structure of two types of hand-held ultrasonic pickup modules;

 FIG. 10 is a block diagram showing the software flow of signal processing of the Doppler ultrasonic sound collection analysis processing method according to an embodiment of the present invention.

 detailed description

 Referring to FIG. 1, the Doppler ultrasonic sound collection analysis processing method comprises the following steps:

 S101 Transmitting an ultrasonic signal of a certain frequency to a quasi-sounding target including a vocal cord, a human body tissue or a resonance portion vibrating with the vocal cord, and a non-vival sounding body, and receiving the ultrasonic signal including the Doppler returned from the utterance target The reflected echo signal of the frequency shifted signal.

 S102 : amplifying the reflected echo signal and comparing the ultrasonic signal or the reference ultrasonic signal to obtain a Doppler shift signal containing the utterance characteristic of the utterance target.

 S103 : dividing the Doppler frequency shift signal into three outputs: wherein one signal is output by audio after being amplified by audio, and one signal is processed to obtain characteristic parameters of the sounding vibration of the sounding target, and then converted into a reflectable The vocalization characteristics of the vocal target and the visual spectrum output of the vocal quality indicator are used accordingly; the signal processing is output as a light signal reflecting the utterance condition of the utterance target.

 In the embodiment of the present invention, the frequency of the ultrasonic signal is not lower than 0.02 MHz. The human body tissue vibrating with the vocal cord includes the bones and skin of the human body; the resonance portion refers to an uncontrollable and controllable cavity in the human body, the former including the frontal sinus, the ethmoid sinus, the sphenoid sinus, the maxillary sinus, the sinus, The trachea and the esophagus; the latter includes the oral cavity, the pharyngeal cavity, the larynx cavity, the stomach and the chest cavity; the non-vival sounding body includes a vibrating component or a resonance cavity of the instrument, a device in operation, a machine or a tool, and a sounding device that is subjected to a load Artificial or natural materials; the vocal characteristics and vocal quality indicators include: vocal cord vibration frequency anomalies, vibration intensity anomalies, time anomalies, spectral distribution anomalies, spectral dispersion anomalies, and can be used for the diagnosis of vocal cords, pharyngeal cavities, and related muscle groups. Spectral envelope anomaly; vocalist's pitch, timbre, pitch, voice, resonance position accuracy, and resonance intensity that can be used to assist vocal teaching and vocal training; vocal cord vibration frequency characteristics of a person who can be used for voiceprint confirmation, Vibration intensity characteristics, speech time-value characteristics, spectral distribution characteristics, spectral dispersion characteristics, spectral envelope characteristics, and transmission characteristics Resonance peak characteristics in speech, resonance position characteristics, resonance intensity and spectral distribution characteristics of different resonance positions; can be used for musical instrument performance training, instrument quality identification, or musical instrument production process improvement, reference to the instrument's pitch, sound quality, resonance position accuracy And resonance intensity; the amplitude of the noise generated by the running equipment, machine or tool that can be used for defect detection, design optimization, or noise reduction measures in production equipment, machines, or tools. - The distribution of the formants in the frequency spectrum and the difference in amplitude values at different locations.

 In the embodiment of the present invention, the visible spectrum includes a spectrum distribution map, a frequency shift-time spectrum, an amplitude-time spectrum, and an amplitude. Frequency spectrum, power spectrum and frequency shift - amplitude - time 3D spectrum.

In the embodiment of the present invention, the characteristic parameters of the vocalization vibration of the utterance target include a sound main frequency and a resonance frequency, a resonance peak, a spectrum distribution, a corresponding amplitude of each frequency, a spectrum dispersion, a spectrum envelope, a vibration phase, a real-time frequency, and a real-time. amplitude.

The method of the embodiment of the invention extracts the available Doppler frequency shift signal, and one channel of the signal can be monitored or played by the speaker after being amplified by audio, and one signal can be used for the light monitoring of the sounding state after being processed, and the first signal is processed by the spectrum analysis. Spectrogram, including frequency shift - Time charts or other visual graphics for reference in industry, medicine or music teaching.

When the present invention is applied to a reference including a diagnosis of vocal cords, pharyngeal cavities and related muscle groups, the vocal characteristics and vocal quality indicators include vocal cord vibration frequency anomalies, vibration intensity anomalies, temporal anomalies, abnormal spectral distribution, and abnormal spectral dispersion. And the spectrum envelope is abnormal.

The present invention includes, when used in assisted vocal teaching and vocal training, the vocal characteristics and vocal quality indicators including the vocalist's pitch, timbre, pitch, voice, resonance position accuracy, and resonance intensity.

When used for sound ray confirmation by correlation spectrum analysis by pickup, the vocal characteristics and vocal quality indicators include vocal cord vibration frequency characteristics, vibration intensity characteristics, speech time value characteristics, spectral distribution characteristics, and spectral dispersion of the voiceprint confirmer. Degree characteristics, spectral envelope characteristics, resonance peak characteristics when transmitting specific speech, resonance position characteristics, resonance intensity of different resonance positions, and spectral distribution characteristics.

When the present invention is applied to musical instrument performance training, musical instrument quality identification, and reference to improved musical instrument production process, the sounding characteristics and sound quality indicators include the pitch, sound quality, resonance position accuracy, and resonance intensity of the instrument.

When the present invention is applied to an auxiliary operation including production equipment, machine or tool defect detection, design optimization, and noise reduction measures, the sound generation characteristics include the amplitude of noise generated by the operating equipment, machine or tool - The distribution of the formants in the frequency spectrum and the difference in amplitude values of different parts.

The invention is applied to the prediction and early warning of the detection of the defects of the carrier material and the sudden destruction event. The vocal characteristics include real-time frequency characteristics of noise generated by the carrier material, real-time amplitude characteristics, real-time amplitude exceeding a certain level, spectral distribution characteristics, amplitude distribution characteristics, amplitude - The distribution of the formants in the frequency spectrum and the difference in amplitude values at different locations.

 The embodiment of the invention further provides a Doppler ultrasonic sound collection analysis processing device, see FIG. 2 As shown, the Doppler ultrasonic sound collection analysis processing apparatus includes a central control unit and an ultrasonic sound pickup module, a Doppler shift signal generation module, and an output module connected to the central control unit: an ultrasonic sound pickup module, And transmitting an ultrasonic signal of a certain frequency to the utterance target under the control of the central control unit, and receiving the reflected echo signal including the Doppler frequency shift signal returned by the ultrasonic signal from the utterance target; Doppler shift a signal generating module, configured to: after being amplified by the central control unit, compare the reflected echo signal with the ultrasonic signal to obtain a Doppler frequency shift signal containing a sounding feature of the sounding target; and an output module For dividing the Doppler frequency shift signal into three outputs: one signal is output by audio after being amplified by audio, and one signal is processed to obtain characteristic parameters of the sounding vibration of the sounding target, and then converted into a reflectable The vocal characteristics of the vocal target and the visual spectrum of the vocal quality indicator are output; the signal is processed as a reflection Sonification said light signal output of the target condition.

 See Figure 2 As shown in the embodiment of the present invention, the ultrasonic pickup module includes: an ultrasonic oscillator for transmitting an ultrasonic signal to the sounding target; and a piezoelectric ceramic wafer for receiving the ultrasonic signal including Doppler The reflected echo signal of the frequency shifted signal.

In the embodiment of the present invention, the ultrasonic oscillator is at least one, and the piezoelectric ceramic wafer is at least one, and the ultrasonic oscillator can emit ultrasonic waves to a part of the human body that resonates with the vocal cord or the body, and other non-vival sounding bodies. The piezoelectric ceramic wafer can receive the ultrasonic waves reflected by the ultrasonic emission target, and compare the transmitted wave signal (or the reference ultrasonic signal) with the reflected echo signal through the Doppler shift signal generating module to obtain the ultrasonic emission target. The Doppler frequency shift signal of the sounding characteristic, the Doppler frequency shift signal is processed and amplified by the processor into an audio signal, and is sent to a speaker or a headphone through a wired or wireless transmission mode, and the Doppler frequency shift can also be performed. The signal is further spectrally analyzed for use in various research and analysis.

 See Figure 2 As shown in the embodiment of the present invention, the Doppler shift signal generating module includes: a frequency selective amplifier for receiving the reflected echo signal including the Doppler frequency shift signal received by the piezoelectric ceramic wafer Performing frequency selective amplification and outputting; a modulator for comparing the signal amplified by the frequency selective amplifier with the ultrasonic signal emitted by the ultrasonic oscillator, and modulating into a stable high frequency radio frequency oscillation signal; The pass filter is configured to remove the noise and the decomposed mixed frequency in the high frequency radio frequency oscillation signal, and extract the available Doppler frequency shift signal.

In the embodiment of the present invention, the output module includes: a sound output module, configured to: the one signal of the Doppler frequency shift signal is amplified by audio and then broadcasted through the sound output device; the visible spectrum output module is used Performing an analysis process on a signal of the Doppler shift signal to obtain a characteristic parameter of the utterance vibration of the utterance target, and then converting it into a visible spectrum output capable of providing an utterance characteristic and a utterance quality indicator of the utterance target; a light monitoring module, configured to transmit a signal of the Doppler frequency shift signal The LED driver circuit is then output to the LED for light monitoring of the audible condition.

 See Figure 2 As shown in the embodiment of the present invention, the sound output module includes an audio amplifier and a sound output device connected to the audio amplifier. The Doppler ultrasonic sound collection analysis processing device according to the embodiment of the present invention may be used as a portable personal voice amplifier when used for audio output. In an embodiment of the invention, the sound output device comprises a speaker or an earphone.

 See Figure 2 As shown in the embodiment of the present invention, the visible spectrum output module includes a spectrum analysis processor and a display unit connected to the spectrum analysis processor. The spectrum analysis processor is a band pass filter array or a Fourier transformer composed of a plurality of band pass filters having different band pass frequencies. The display unit has at least two display modes: 1) digital tube mode; 2) liquid crystal display mode; see FIG. 2, in the embodiment of the invention, the light monitoring module includes an LED driving circuit and an LED connected to the LED driving circuit light.

 In the embodiment of the present invention, the central control unit serves as a central unit for detection control and data processing, and its basic functions are as follows:

Determine the correct steps of signal acquisition, determine whether the initial conditions are correct or not during the acquisition; perform statistics and calculation on the sampled data; send the calculation results to the audio amplifier for amplification; send the audio signal to the speaker for playback; send the calculation result to the spectrum analysis processing Send graphics to display display; store test results or connect via interface RAM data memory stores data; audible and visual alarm control. When the sound and light alarm is performed, the buzzer can be connected to the central control unit (such as the INT0 of the single chip microcomputer). Mouth) connected to form. When the conditions are right (such as the skin temperature of the pickup area no longer changes), the buzzer sounds, indicating that the ultrasonic wave can be started. When the test is completed, the prompt can be ended. When the operation is wrong, it can automatically alarm.

 In the embodiment of the present invention, the power supply of the Doppler ultrasonic sound collection and analysis device can be 6V or 9V. Rechargeable battery, the switching regulator power supply circuit can be purchased directly for the appropriate product installation. The output DC voltage is required to be stable and sufficient for all modules and devices.

The other parts of the Doppler ultrasonic sounding analysis processing device, such as buttons, power switches, sockets, plugs, wiring, etc., have no special requirements, and can be assembled for ready-made products.

 The Doppler ultrasonic sound collection and analysis processing device according to the embodiment of the present invention can be connected to a processing computer, and the connection manner can be a wired connection or a wireless connection method (such as Wi-fi or blue tooth), the data signal obtained by the Doppler ultrasonic sounding analysis processing device is transmitted to the processing computer for further processing, classification, drawing and storage.

In order to effectively pick up the sound signal from the utterance target, in the embodiment of the invention, the transmission of the ultrasonic signal and the received form of the reflected echo signal can be transmitted and received by different ultrasonic transducers in a continuous transmission and acceptance mode. Or use the same ultrasonic transducer to rotate the transmitted and received pulsed transmit and receive modes.

In the embodiment of the present invention, after the above two ultrasonic pickup extraction methods are adopted and processed by corresponding, the audio output and the spectrum pattern output are obtained. Each output has a special purpose.

 Referring to Figure 2, the ultrasonic oscillator (ultrasonic transducer) produces no less than 0.02MHz when in use. The sinusoidal wave signal excites the piezoelectric ceramic wafer to emit ultrasonic waves toward the vocal target. When the transmitted wave encounters a vibrating sounding target, an ultrasonic receiving echo containing a Doppler shift signal is generated, and the piezoelectric ceramic wafer (when the pulse mode is used, the piezoelectric ceramic wafer is simultaneously echo-receiving the wafer, also The wafer is emitted. When the continuous mode is adopted, the piezoelectric ceramic wafer includes a transmitting wafer, an echo receiving wafer, and the echo receiving signal received by the echo receiving signal, and the echo signal is amplified by the frequency selective amplifier. The reference signal of the same frequency as the transmitted signal is compared, and then the bandpass filter is used to remove the noise and decompose the mixed frequency, and the available Doppler shift signal is extracted: one signal enters the audio amplifier and is amplified, and then monitored or played by the speaker. Second signal The LED driver circuit can be used for light monitoring of the audible condition. The third signal will enter the spectrum analysis processor and display the spectrum map on the display. Time chart or other visual graphic for industrial, medical or music teaching reference. The central control unit transmits control commands to all of the above components via wires.

In the embodiment of the present invention, the ultrasonic sound collection module (included in the ultrasonic pickup) and the analysis processing host (including the central control unit, the Doppler shift signal generation module, and the output module) may be connected by wire or wirelessly. .

In use, the side of the ultrasonic transducer of the ultrasonic pickup module that emits and receives the ultrasonic wave should be placed close to the target of the sounding object, and close to the target object, or connected with the target object, or the resonance of the target object. The surface of the cavity. In order to make the ultrasonic transducer of the ultrasonic pickup module close to the sounding target, such as the neck skin of the vocal cord portion of the human, the elastic elastic band, the nylon buckle, the female snap fastener and the vacuum suction device can be used for tightening. In order to make the ultrasonic transducer of the ultrasonic pickup module abut against the target, or connect with the target, or the surface of the resonant cavity of the target, and enhance the efficiency of transmitting and receiving ultrasonic waves, on the ultrasonic transducer surface and A couplant may be applied between the target or the surface of the target junction or the resonant cavity of the target to vent air between the surfaces.

 In the embodiment of the present invention, the shape of the pickup including the ultrasonic pickup module may be determined according to different uses:

 a) Magnification for vocal cord vibration: It can be designed with a decorative tie, scarf, bib or collar shape. Figure 8 As shown, the piezoelectric ceramic wafer 1 and the connecting wire 2 are preferably concealed in these decorative articles 3, and are connected to the control unit 5 of the power supply and the device by the retractable wires 4, and the control member 5 Can be placed in a jacket pocket or other unobtrusive parts.

 b) For vocal music teaching or lesion diagnosis, when exploring the resonance part of the body: it can be designed as a hand-held type, see Figure 9A The end face contacting the skin should be smooth and smooth. The piezoelectric ceramic wafer 1 has a film or protective layer 6 on the outside, which can transmit ultrasonic waves and prevent the wafer from being eroded by sweat. The handle 7 has a moderate length and passes through the wire 4 Connect to the Analysis Processing Host 8.

 It can also be wireless, as shown in Figure 9B. The battery is built in the handle 10 and has an antenna 9 . The shape is similar to a normal hand-held wireless microphone.

 c ) Used for instrument sound amplification or equipment vibration monitoring: It can be designed as a button shape, bonded with a coupling agent on the instrument sound board or running equipment, and wirelessly connected with the analysis processing host.

 d) for portable personal speech amplifiers: see Figure 9A The design is connected to the hand-held speaker (horn) via a retractable wire. The power battery, Doppler shift signal generation module, and audio amplifier can all be integrated with the speaker.

 Next, the device used to implement the present invention will be described.

 The piezoelectric ceramic wafer adopts or orders a piezoelectric ceramic wafer of a general medical Doppler ultrasonic machine, and the ultrasonic frequency emitted by the piezoelectric ceramic wafer is not lower than 0.02 MHz. . When using continuous ultrasound emission - In the receive mode, there is another piezoelectric ceramic wafer in the pickup for receiving the reflected echo; the spectrum analysis processor can use the well-established Doppler ultrasonic signal processor for medicine in the market, such as DSP2407A. Can be purchased directly.

 Referring to Figure 10, the ultrasonic Doppler sound signal algorithm uses the DSP2407A embedded AD for the input ultrasound Doppler shift signal. Module; if you do not use the A/D conversion circuit in the existing ultrasonic signal processor, you can also use the 12-bit integrated circuit of the MAX1911 as the A/D. Conversion circuit; if the existing ultrasonic signal processor is not used, the AT89S52 MCU can also be used as the central control processing unit for operation control and data processing.

 The Doppler ultrasonic pickup analysis processing method and apparatus according to the embodiment of the present invention have the following advantages: Since any ultrasonic wave is emitted from the vibrating sound body and the Doppler shift signal is obtained, any noise from the environment is not picked up by air propagation; Because of the special principle of pickup, even if the speaker is very close to the pickup, there will be no feedback whistling, which will eliminate the accent in the remote communication; 3 With a reasonable design, the compact pickup can be worn with you, without affecting the appearance, freeing the hands of the microphone and overcoming any constraints on the position and orientation of the microphone. It can also be set on the resonance box of the instrument to amplify its sound; 4) has a much better pickup capability than a bone sensing microphone. It can be used to detect the resonance effect of variable and non-variable cavities in various parts of the human body. It can also be used to detect the vibration characteristics of musical instruments or various running equipment and load-bearing materials.

The Doppler ultrasound sound collection analysis processing apparatus according to the embodiment of the present invention can be applied to medical spectrum analysis. Spectral analysis can provide valuable reference for the diagnosis of vocal cord or intramuscular muscle lesions; the Doppler ultrasound acquisition and analysis device of the present invention can be applied to vocal teaching spectrum analysis; The Doppler ultrasonic sounding analysis processing device according to the embodiment of the present invention can be applied to voiceprint confirmation, and the present invention can solve these problems to some extent, and the main steps are as follows: 1. Establish the spectrum feature model of the voiceprint confirmer (voiceprint model): (1) Firstly, the voiceprint confirmer is required to send a specific voice sound according to the unified standard, such as y (clothing) sound for 5 seconds; (2) The ultrasonic pickup is placed on the neck to receive the Doppler frequency shift signal of the vocal cord sound, and the characteristic parameters of the human voice band vibration are obtained after the amplification process, including frequency characteristics, vibration intensity characteristics, speech time value characteristics, spectrum distribution characteristics, and frequency spectrum. Discrete features, spectral envelope characteristics, resonance peak characteristics when a particular speech is sent; 3 The ultrasonic pickup is placed at a portion that can resonate with the vocal cords, and receives the Doppler shift signal of the sounds of the parts. After the amplification process, the characteristic parameters of the resonance portion of the voiceprint are obtained, and the sound vocal characteristics are included in the sound vocal characteristics. Positional characteristics, resonance intensity and spectral distribution characteristics of different resonance positions; 4) The individual voiceprint model is established according to the characteristic parameters of the vocal cord and the vocalization of the resonance part, and is stored in the voiceprint database of the person. 2. Voiceprint confirmation: (1 For the case where you need to confirm the voiceprint in person, such as bank withdrawal, suspect confirmation or inheritance successor, use ultrasonic pickup to test the characteristic parameters of the vocal cord and resonance part of the voice, and compare it with the voiceprint model in the database. Obtained confirmation or negation; 2 For remote voiceprint confirmation, such as caller confirmation or network transaction user identity confirmation, it is necessary to confirm that the person prepares the ultrasonic pickup self-detection vocal cord and formulates the characteristic parameters of the resonance part vocalization, and remotely communicates through the processing device connected to the pickup. The sent to the voiceprint confirmation center is compared to the center's voiceprint model. Once confirmed, you can conduct online transactions and other services.

 Applying the present invention to voiceprint confirmation has the following advantages: (1) Accepting the essence of the individual vocal cords, no or less modification of various organs, personal characteristics are obvious, easy to distinguish; (2) In addition to the vocal vocal characteristics, it can also pick up the vocal characteristics of multiple resonance parts, so the voiceprint model can be accurately established, even if the physical condition and age change, due to many modeling parameters, it can be effectively eliminated. Better recognition effect; ( 3) Unlike ordinary microphones, the sensitivity of ultrasonic pickups is high, and the quality of sound pickup is easy to control; (4) When voiceprint modeling and voiceprint confirmation, it is completely immune to environmental noise; (5) ) It is possible to perform voiceprint modeling and voiceprint confirmation simultaneously by multiple people without interfering with each other.

The Doppler ultrasonic sound collection analysis processing device of the embodiment of the invention can be used for instrument pickup and spectrum analysis: the Doppler ultrasonic pickup is closely attached to the surface of the resonance cavity of the instrument, and the obtained Doppler frequency shift signal is converted. The audio signal is amplified and broadcast, which completely shields the ambient noise, including the sound of other instruments in the orchestra. Spectral analysis of Doppler shift signals can also be performed in different ways, such as: (1) Pitch adjustment: it is more intuitive and accurate to change the past ear calibration to visual adjustment; (2) ) Voice improvement: Quantify, analyze and contrast the quality of the instrument performance by the width of the resonant frequency, spectral dispersion, uniformity of the chord sound distribution, chord amplitude, etc. to improve the playing skills and improve the sound; (3) Musical Instrument Quality: Use the same method of playing to compare the quality and tone of the same instrument in order to select and improve the instrument making process.

 The Doppler ultrasonic sound collection analysis processing device according to the embodiment of the present invention can be used for the sound pickup and spectrum analysis of a running device, a machine or a tool: Equipment, machines, or tools can cause severe vibrations and strong noise if certain components fail or become defective during operation. By using the technology of the present invention, the spectrum analysis of noise can help to find and analyze the noise source. Take the gearbox as an example: use the gearbox box as the resonance box, and use the ultrasonic pickup to stick to the surface of the box to get the frequency of the resonance vibration of the box at different speeds. - Amplitude spectrum. Figure 6 is a frequency-amplitude spectrum of the 900 rpm sensor that is attached to the rear wall of a lathe headstock. In the figure, the horizontal axis is the frequency f, the unit is Hz, and the vertical axis is the amplitude. P(f) in decibels (dB). At 900/min, there are 4 pairs of gears meshing frequency (ie, the number of meshings per second) is 499, which corresponds to the highest amplitude on the spectrum. 500. There is a pair of gears with a meshing frequency of 1722, which corresponds to the 1718 peak frequency on the spectrum. The other pair of gear meshing frequency is 1238, corresponding to the spectrum on the 1234 Peak frequency. There is another pair of gear meshing frequencies of 343.5, corresponding to the spectrum 343 Peak frequency. Therefore, the reason for the noise is that the number of meshing gears of the same meshing frequency is too large. To reduce noise, it is necessary to redesign the gear ratio and gear pairing. In addition, it was found that the volume (amplitude) obtained by the pickups at different parts on the rear wall of the cabinet was inconsistent. The volume is the largest in the middle of the two supporting ribs. For shock absorption, the design may consider increasing the density of the ribs or increasing the thickness of the box.

 The Doppler ultrasonic pickup analysis processing device according to the embodiment of the present invention can be used for pickup and spectrum analysis of a carrier material: In most man-made materials, the internal defects are vibrated and audible under the action of external force or residual stress, accompanied by the expansion of defects. Attaching the pickup to the surface of these materials and applying a coupling agent between it and the ultrasonically-emitting ceramic wafer can detect the weak Doppler shift signal caused by the internal defect vibration, and perform spectrum analysis after amplification processing. Obtain information such as spectrum distribution and amplitude distribution. Amplitude - The time spectrum (shown in Figure 7) is an example. The horizontal axis is time and the vertical axis is amplitude. For the number of amplitudes beyond the predetermined values P0 and -P0, there are 4 amplitudes exceeding the value P0. 1 time amplitude exceeds value -P0 The more the amplitude of the excess value, the faster the internal defects of the material develop. When the count reaches a certain value, it indicates that the material is about to undergo sudden damage, and it needs to be replaced in time or pay close attention to the development trend and early warning.

 In summary, the present invention has the following features: (1) noise from the environment can be completely shielded; (2) There will be no feedback whistling, which can effectively eliminate the accent in communication; (3) the pickup can be worn with you, without having to hold the microphone, overcoming any constraints on the position and orientation; (4) ) has a much better pickup capability than a bone sensing microphone. It can be used to detect the resonance effect of variable and non-variable cavities in various parts of the human body. Can also be used to detect the vibration characteristics of the instrument or various operating equipment, bearing materials; (5 The spectrum analysis of the sounding of the sounding body can be performed in the form of visible spectrogram, frequency shift-time map, etc. (6) Spectral analysis can provide a useful reference for the diagnosis of vocal cord and throat lesions; (7) Spectrum analysis can be used for intuitive vocal teaching, making it easy for students to master correct vocal skills; (8) The Doppler ultrasonic sound collection analysis processing device according to the embodiment of the present invention can perform real-time data acquisition, highly automated operation and information processing, and has advanced human-machine interface settings, which can be used for sound amplification and synthesis, It can be used in industrial equipment, analysis of machine vibration characteristics and bearing material defects, and voiceprint confirmation.

 The present invention is based on the principle of Doppler ultrasound, by vocalizing a target For example, the vocal cord and the tissue or part that resonates with the vocal cord transmit ultrasonic waves. Due to the vibration of the vocal target, the received echo is inconsistent with the transmitted wave, and after being amplified, the original transmitted signal is mixed and demodulated to extract the inclusion. The Doppler signal of the characteristic information of the vibration of the vocal target, including frequency, amplitude, phase and spectral distribution, etc., the Doppler signal is amplified by processing, can be converted into an audio signal, and then broadcasted by a speaker or an earphone, or converted into a Spectrogram output is used in various aspects, such as vocal teaching aids, vocal cord lesion spectrum analysis, equipment operating characteristics analysis, carrier material defect detection and voiceprint confirmation, overcoming the shortcomings of ordinary microphones and bone sensing microphones.

Claims (10)

1.  A Doppler ultrasound pickup analysis processing method, comprising the steps of:

   And transmitting an ultrasonic signal of a certain frequency to an utterance target including a vocal cord, a human body tissue or a resonance portion vibrating with the vocal cord, and a non-vival sounding body, and receiving the Doppler frequency of the ultrasonic signal returned from the utterance target a reflected echo signal of the shifted signal;

   Amplifying the reflected echo signal and comparing the ultrasonic signal or the reference ultrasonic signal to obtain a Doppler shift signal containing the utterance characteristic of the utterance target;

   The three channels of the Doppler shift signal are outputted:

   One channel of the signal is amplified by audio and output as an audio signal;

   A signal is processed to obtain a characteristic parameter of the vocal vibration of the utterance target, and then converted into a visible spectrum output reflecting the utterance characteristic and the utterance quality indicator of the utterance target for corresponding use;

   After one signal processing, it is output as a light signal reflecting the utterance condition of the utterance target.
2. The Doppler ultrasonic sound collection analysis processing method according to claim 1, wherein the human body tissue vibrating with the vocal cord includes a bone and a skin of the human body; and the resonance portion refers to a cavity in the human body, including the amount Sinus, ethmoid sinus, sphenoid sinus, maxillary sinus, sinus, trachea, esophagus, oral cavity, pharyngeal cavity, larynx cavity, stomach and chest cavity; the non-vival sounding body includes a vibrating component or a resonance cavity of a musical instrument, a device in operation, Machine or tool and artificial or natural materials that are audible due to load;

   The vocal characteristics and vocal quality indicators include:

   Acoustic band vibration frequency anomaly, vibration intensity anomaly, time anomaly, spectral distribution anomaly, spectral dispersion anomaly, and spectral envelope anomaly for vocal cord, pharyngeal cavity, and related muscle mass lesion diagnosis;

   The pitch, tone, intensity, voice, resonance position accuracy and resonance intensity of the singer that can be used to assist vocal teaching and vocal training;

   The vocal cord vibration frequency characteristics, vibration intensity characteristics, speech time value characteristics, spectral distribution characteristics, spectral dispersion characteristics, spectral envelope characteristics, resonance peak characteristics when a specific speech is emitted, and resonance position characteristics of a person who can be used for voiceprint confirmation Resonance intensity and spectral distribution characteristics of different resonance positions;

   It can be used for musical instrument performance training, instrument quality appraisal or musical instrument production process improvement, reference to the instrument's pitch, sound quality, resonance position accuracy and resonance intensity;

   Defect detection, design optimization, or noise reduction measures that can be used in production equipment, machines, or tools to assist in the use of operating equipment, machines, or tools to generate noise in the amplitude-frequency spectrum of the formant distribution and differences in amplitude values at different locations.
3. The Doppler ultrasonic pickup analysis processing method according to claim 1, wherein the ultrasonic signal has a frequency of not less than 0.02 MHz; and the transmission of the ultrasonic signal and the reception of the reflected echo signal are different The ultrasonic transducer transmits and receives continuous transmission and reception modes and rotates the transmitted and received pulsed transmission and reception modes with the same ultrasonic transducer.
4. The Doppler ultrasonic sounding analysis processing method according to claim 1, wherein the characteristic parameters of the sounding vibration of the sounding target include a sound main frequency and a resonance frequency, a resonance peak, a spectrum distribution, a corresponding amplitude of each frequency, and a spectrum. Discrete, spectral envelope, vibration phase, real-time frequency, real-time amplitude.
5. The Doppler ultrasound pickup analysis processing method according to claim 1, wherein the visible spectrum includes a spectrum distribution map, a frequency shift-time spectrum, an amplitude-time spectrum, an amplitude-frequency spectrum, Power spectrum and frequency shift-amplitude-time 3D spectrum.
6. A Doppler ultrasonic sound collection analysis processing apparatus, comprising: a central control unit and a connection with the central control unit:

   An ultrasonic sound collection module, configured to transmit an ultrasonic signal of a certain frequency to the sounding target under the control of the central control unit, and receive the reflected echo signal including the Doppler frequency shift signal returned by the ultrasonic signal from the sounding target ;

   a Doppler shift signal generating module, configured to, after being controlled by the central control unit, amplify the reflected echo signal and compare the ultrasonic signal to obtain a Doppler frequency of the utterance characteristic of the utterance target Shift signal

   An output module for dividing the Doppler shift signal into three outputs:

   One channel of the signal is amplified by audio and output as an audio signal;

   A signal is processed to obtain a characteristic parameter of the vocal vibration of the utterance target, and then converted into a visible spectrum output capable of reflecting the utterance characteristic and the utterance quality indicator of the utterance target;

   After one signal processing, it is output as a light signal reflecting the utterance condition of the utterance target.
7. The apparatus according to claim 6, wherein the ultrasonic pickup module comprises:

   An ultrasonic oscillator for transmitting an ultrasonic signal to the sounding target;

   a piezoelectric ceramic wafer for receiving the reflected echo signal of the ultrasonic signal including a Doppler shift signal.
8. The Doppler ultrasonic sounding analysis processing apparatus according to claim 6, wherein the Doppler shift signal generating module comprises:

   a frequency selective amplifier for selecting and amplifying the reflected echo signal including the Doppler shift signal received by the piezoelectric ceramic wafer;

   a modulator for comparing the amplified signal of the frequency selective amplifier with the ultrasonic signal emitted by the ultrasonic oscillator to form a stable high frequency radio frequency oscillation signal;

   A band pass filter is used to remove the noise and the decomposed mixed frequency in the high frequency radio frequency oscillating signal, and extract the available Doppler shift signal.
9. The apparatus according to claim 6, wherein the output module comprises:

   a sound output module, configured to amplify one signal of the Doppler frequency shift signal by audio and then broadcast through a sound output device;

   a visible spectrum output module, configured to analyze and process a signal of the Doppler shift signal to obtain a characteristic parameter of the utterance vibration of the utterance target, and then convert the utterance characteristic and the utterance quality of the utterance target Visual spectrum output of the indicator;

   The light monitoring module is configured to output a signal of the Doppler frequency shift signal to the LED light for the sound monitoring of the sounding state after passing through the LED driving circuit.
10. The Doppler ultrasonic sound collection analysis processing apparatus according to claim 9, wherein said sound output module comprises an audio amplifier and a sound output device connected to said audio amplifier; said sound output device comprising a speaker or an earphone;

    The visual spectrum output module includes a spectrum analysis processor and a display unit connected to the spectrum analysis processor; the spectrum analysis processor adopts band pass filtering composed of a plurality of band pass filters having different band pass frequencies Array or Fourier transformer;

    The light monitoring module includes an LED driving circuit and an LED lamp connected to the LED driving circuit.

Images