CN117133257A - Real-time pitch adjustment method and device and tuning equipment - Google Patents
Real-time pitch adjustment method and device and tuning equipment Download PDFInfo
- Publication number
- CN117133257A CN117133257A CN202211172436.XA CN202211172436A CN117133257A CN 117133257 A CN117133257 A CN 117133257A CN 202211172436 A CN202211172436 A CN 202211172436A CN 117133257 A CN117133257 A CN 117133257A
- Authority
- CN
- China
- Prior art keywords
- time
- real
- audio
- fundamental frequency
- frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 230000005236 sound signal Effects 0.000 claims abstract description 50
- 238000007781 pre-processing Methods 0.000 claims abstract description 36
- 239000002131 composite material Substances 0.000 claims abstract description 22
- 238000013507 mapping Methods 0.000 claims abstract description 4
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 239000007787 solid Substances 0.000 claims description 6
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000010355 oscillation Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000004148 unit process Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/44—Tuning means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Tone Control, Compression And Expansion, Limiting Amplitude (AREA)
Abstract
The invention discloses a real-time sound level adjusting method, which comprises the following steps: s1, inputting target audio, preprocessing a sound signal, and acquiring fundamental frequency information of a composite wave of the target audio in unit time; s2, inputting real-time audio, converting sound signals into electric signals, preprocessing the electric signals, and obtaining fundamental frequency information of a real-time audio unit time composite wave; s3, adjusting the fundamental frequency of the real-time audio to be the fundamental frequency of the target audio, and performing frequency mapping on all real-time audio signals according to the fundamental frequency adjustment proportion of the real-time audio to obtain output audio; s4, converting the adjusted output audio frequency from a frequency domain signal to a time domain signal and playing the time domain signal, and finishing the tone processing. Meanwhile, the invention also discloses a real-time sound level adjusting device and tuning equipment. The output audio after the tone adjustment still maintains the characteristic of the original real-time audio on tone.
Description
Technical Field
The invention relates to the technical field of tuning equipment, in particular to a real-time pitch adjustment method and device.
Background
Tuning devices, also referred to as audio signal processing devices, refer to components, devices or equipment that modify and process audio signals in a sound system. The tuning device is mainly used for amplifying an input audio signal, adjusting the frequency of the signal, combining the signal and distributing the signal so as to achieve the functions of modifying tone, beautifying tone or obtaining some special effects. Tone compensation at different frequencies for different situations can also improve the sound refinement. Secondly, to improve the quality of the transmission channel itself, to improve the signal-to-noise ratio and to reduce distortion or to compensate for acoustic imperfections in certain environments. Most of these similar techniques and devices cannot be tuned in real time or the time delay of real time tuning is too long, and the human ear may feel uncomfortable.
For some sound changing devices, the received sound can be directly pulled up or down by the same frequency value, or the frequency ratio value is uniformly changed, so that the purpose of changing the sound is achieved. The parameters can be uniformly set at this time, and the trouble of too large time delay is avoided. However, if the frequency adjustment is performed in real time with respect to the audio signal inputted in real time, a problem of time delay may occur. The reason is that: the frequency adjustment value is not fixed for each instant of audio to be processed, so different adjustments are made for different frequencies at different times.
Disclosure of Invention
The invention aims to solve the technical problem of providing a real-time pitch adjustment method and device, so as to solve the problem of overlong tuning time of the existing tuning equipment.
In order to solve the technical problems, the technical scheme of the invention is as follows:
the real-time sound level adjusting method is characterized by comprising the following steps of:
s1, inputting target audio, preprocessing a sound signal, and acquiring fundamental frequency information of a composite wave of the target audio in unit time;
s2, inputting real-time audio, converting sound signals into electric signals, preprocessing the electric signals, and obtaining fundamental frequency information of a real-time audio unit time composite wave;
s3, adjusting the fundamental frequency of the real-time audio to be the fundamental frequency of the target audio, and performing frequency mapping on all real-time audio signals according to the fundamental frequency adjustment proportion of the real-time audio to obtain output audio;
s4, converting the adjusted output audio frequency from a frequency domain signal to a time domain signal and playing the time domain signal, and finishing the tone processing.
Preferably, step S2 further includes: and performing short-time-interval Fourier transform on the preprocessed real-time audio signal, and comparing the short-time-interval Fourier transform with the corresponding fundamental frequency of the target audio, so as to find out the fundamental frequency information of the target audio of the preprocessed real-time audio signal.
Preferably, in step S3: decomposing the waveform of the real-time audio into a fundamental frequency sine wave and a plurality of sine waves with high-order frequencies, wherein the high-order frequencies are integral multiples of the fundamental frequency; if the real-time audio adjustment value is X, the N-order harmonic frequency adjustment value is NX.
Preferably, the frequency adjustment for real-time audio maintains the relationship,symbol X represents frequency; x is X Primordia The fundamental frequency of the composite wave after the target audio frequency is converted into the electric signal; x is X Solid base The fundamental frequency of the composite wave after the real-time audio is converted into the electric signal; x is X Real world Any other frequency that is real-time audio; x is X Original source Frequency for any other target audio; x is X Out of Is output and will be originally X Real world Is to be converted.
The invention also discloses a real-time sound level adjusting device, which comprises:
the voice signal preprocessing component is used for preprocessing the voice signal to acquire fundamental frequency information of the composite wave in the unit time of the audio frequency and corresponding amplitude and phase information of the fundamental frequency information;
the fundamental frequency information storage unit is used for storing fundamental frequency information of the target audio frequency unit time complex wave;
the frequency modulation unit is used for adjusting the fundamental frequency of the real-time audio to the fundamental frequency of the target audio, and the N harmonic frequencies of the real-time audio are also adjusted in the same proportion;
the frequency domain and time domain conversion unit is used for converting the frequency-modulated real-time audio into a time domain signal;
and a playing unit for playing the converted time domain signal.
Preferably, the sound signal preprocessing component comprises a first sound signal preprocessing unit and a second sound signal preprocessing unit; the first sound signal preprocessing unit converts an input target audio signal into an electric signal, and preprocesses the electric signal to acquire fundamental frequency information of an audio unit time complex wave; the second sound signal preprocessing unit converts an input real-time audio signal into an electric signal, preprocesses the electric signal, and acquires fundamental frequency information of an audio unit time composite wave and corresponding amplitude and phase information thereof.
The invention also discloses tuning equipment for implementing the method or adopting the device.
Compared with the prior art, the invention has the beneficial effects that:
the invention obtains standard frequency from the target audio, then obtains audio frequency unit time complex wave fundamental frequency information from the real-time audio, although the fundamental frequency of the real-time audio is changed in real time, a certain relation exists between the fundamental frequency and the fundamental frequency of the target audio, and the higher harmonic of the real-time audio can be adjusted according to the relation, and the amplitude and phase information corresponding to the fundamental frequency of the real-time audio cannot be changed, so that the method not only reserves the fundamental frequency, but also reserves the higher harmonic, and the processed real-time audio can be still in fidelity. The invention can achieve the degree of real-time tuning or the time delay of real-time tuning is very short, so that the human ear can not sense.
Drawings
FIG. 1 is a flow chart of a method for real-time pitch adjustment according to the present invention.
Detailed Description
The following describes the embodiments of the present invention further with reference to the drawings. The description of these embodiments is provided to assist understanding of the present invention, but is not intended to limit the present invention. In addition, the technical features of the embodiments of the present invention described below may be combined with each other as long as they do not collide with each other.
Example 1
Referring to fig. 1, a real-time pitch adjustment method includes the following steps:
s1, inputting target audio, preprocessing a sound signal, and acquiring fundamental frequency information of a composite wave of the target audio in unit time;
the fundamental frequency is the lowest oscillation frequency of the free-oscillating system, the lowest frequency in the complex wave. Harmonic components of composite vibrations or waveforms (e.g., acoustic waves) that have the lowest frequency and typically have the greatest amplitude-also known as the "fundamental"; harmonics, as interpreted literally, have the meaning of "multipart", and harmony, means multipart coordination. Wave, refers to a waveform. Taken together, there are a wide variety of waveforms synthesized.
The fundamental frequency information of the target audio is fundamental frequency information with a time sequence concept, which can be musical instrument or singing voice, and is used as target frequency for subsequent pitch adjustment.
Acquiring fundamental frequency information of a target audio unit moment, wherein X is identified Primordia For the fundamental frequency of the complex wave after conversion into an electrical signal, f (X Primordia ) Is X Primordia Corresponding amplitude and phase. The relative N-harmonic frequency can naturally be obtained after the fundamental frequency is obtained.
S2, inputting real-time audio, converting sound signals into electric signals, preprocessing the electric signals, and obtaining fundamental frequency information of a real-time audio unit time composite wave;
in the case of karaoke, real-time audio is the singing voice of the person being recorded by the microphone; when playing a violin, real-time audio is the instrument sound recorded by the microphone.
Further, the preprocessed real-time audio signal is subjected to short-time-interval Fourier transform, and then the short-time-interval Fourier transform is compared near the fundamental frequency of the corresponding target audio, so that the fundamental frequency information of the target audio of the preprocessed real-time audio signal is found out.
S3, adjusting the fundamental frequency of the real-time audio to be the fundamental frequency of the target audio, and performing frequency mapping on all real-time audio signals according to the fundamental frequency adjustment proportion of the real-time audio to obtain output audio;
the input real-time audio needs to be adjusted not only for the fundamental frequency, but also for the corresponding N times harmonic frequency of the fundamental frequency.
Any periodic waveform can be decomposed into one fundamental sine plus a number of sine waves of higher order frequencies, which are integer multiples of the fundamental frequency.
If the fundamental frequency adjustment value is X, the corresponding second harmonic frequency adjustment value is 2X, the third harmonic frequency adjustment value is 3X, and the N harmonic frequency adjustment value is NX.
When we input audio signal in real time, the preprocessing step can obtain the fundamental frequency signal, which is marked as X Solid base For the fundamental frequency of the complex wave after conversion into an electrical signal, f (X Solid base ) Is X Solid base Corresponding amplitude and phase. It is necessary to ensure that,here we denote the frequency by X; x is X Primordia A fundamental frequency of a complex wave that converts the target audio into an electrical signal; x is X Solid base The fundamental frequency of the composite wave after the real-time audio is converted into the electric signal; x is X Real world Any other frequency, X, that is real-time audio Original source Is the frequency of any other target audio; x is X Out of Will be originally at X when audio output Real world To which frequency information is to be converted. In other words, the real-time audio is at X when frequency conversion is performed Real world Information on the frequency is to be converted into frequency +.>And (3) upper part. With the representation of the sound signal (t, X, f (X, t)), real-time audio can be represented as (t, X) Real world ,f(X Real world T), the converted sound can be expressed as +.>The converted information is discrete, and we can use the pseudo-formThe curves are combined to produce information at each frequency bin.
S4, converting the adjusted real-time audio frequency from a frequency domain signal to a time domain signal and playing the time domain signal, and finishing the pitch processing, namely finishing the whole real-time tuning process.
Example two
Referring to fig. 1, a real-time pitch adjustment device includes:
the voice signal preprocessing component is used for preprocessing the voice signal to acquire fundamental frequency information of the composite wave in the unit time of the audio frequency and corresponding amplitude and phase information of the fundamental frequency information;
the frequency comparison unit is used for comparing the fundamental frequency information of the real-time audio frequency unit time composite wave with the fundamental frequency information of the target audio frequency unit time composite wave;
the frequency modulation unit is used for adjusting the fundamental frequency of the real-time audio to the fundamental frequency of the target audio, and the N harmonic frequencies of the real-time audio are also adjusted in the same proportion;
the frequency domain and time domain conversion unit is used for converting the frequency-modulated real-time audio into a time domain signal;
and a playing unit for playing the converted time domain signal.
In one embodiment, the sound signal preprocessing component comprises a first sound signal preprocessing unit and a second sound signal preprocessing unit; the first sound signal preprocessing unit converts an input target audio signal into an electric signal, and preprocesses the electric signal to acquire fundamental frequency information of an audio unit time complex wave; the second sound signal preprocessing unit converts an input real-time audio signal into an electric signal, preprocesses the electric signal, and acquires fundamental frequency information of an audio unit time composite wave and corresponding amplitude and phase information thereof.
In another embodiment, the sound signal preprocessing component may use only one sound signal preprocessing unit, and the sound signal preprocessing unit processes the target audio and the real-time audio information sequentially. The voice signal preprocessing unit firstly converts an input target audio signal into an electric signal, performs preprocessing on the electric signal to obtain fundamental frequency information of an audio unit time complex wave, and stores the fundamental frequency information into the frequency comparison unit, then converts the input real-time audio signal into the electric signal, performs preprocessing on the electric signal to obtain the fundamental frequency information of the audio unit time complex wave and corresponding amplitude and phase information thereof, and finally compares the fundamental frequency information stored in the frequency comparison unit successively to obtain the proportional relation between the fundamental frequency information and the frequency comparison unit.
Example III
A tuning device may be used to perform the method of embodiment one or the apparatus of embodiment two.
The embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to the described embodiments. It will be apparent to those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, and yet fall within the scope of the invention.
Claims (7)
1. The real-time sound level adjusting method is characterized by comprising the following steps of:
s1, inputting target audio, preprocessing a sound signal, and acquiring fundamental frequency information of a composite wave of the target audio in unit time;
s2, inputting real-time audio, converting sound signals into electric signals, preprocessing the electric signals, and obtaining fundamental frequency information of a real-time audio unit time composite wave;
s3, adjusting the fundamental frequency of the real-time audio to be the fundamental frequency of the target audio, and performing frequency mapping on all real-time audio signals according to the fundamental frequency adjustment proportion of the real-time audio to obtain output audio;
s4, converting the adjusted output audio frequency from a frequency domain signal to a time domain signal and playing the time domain signal, and finishing the tone processing.
2. The method for adjusting a pitch in real time according to claim 1, wherein step S2 further comprises: and performing short-time-interval Fourier transform on the preprocessed real-time audio signal, and comparing the short-time-interval Fourier transform with the corresponding fundamental frequency of the target audio, so as to find out the fundamental frequency information of the target audio of the preprocessed real-time audio signal.
3. The method for real-time pitch adjustment according to claim 1, wherein in step S3: decomposing the waveform of the real-time audio into a fundamental frequency sine wave and a plurality of sine waves with high-order frequencies, wherein the high-order frequencies are integral multiples of the fundamental frequency; if the real-time audio adjustment value is X, the N-order harmonic frequency adjustment value is NX.
4. A method of real-time pitch adjustment according to claim 1, wherein: the frequency adjustment for real-time audio maintains the following relationship,symbol X represents frequency; x is X Primordia The fundamental frequency of the composite wave after the target audio frequency is converted into the electric signal; x is X Solid base The fundamental frequency of the composite wave after the real-time audio is converted into the electric signal; x is X Real world Any other frequency that is real-time audio; x is X Original source Frequency for any other target audio; x is X Out of Is output and will be originally X Real world Is to be converted.
5. A real-time pitch adjustment device, comprising:
the voice signal preprocessing component is used for preprocessing the voice signal to acquire fundamental frequency information of the composite wave in the unit time of the audio frequency and corresponding amplitude and phase information of the fundamental frequency information;
the fundamental frequency information storage unit is used for storing fundamental frequency information of the target audio frequency unit time complex wave;
the frequency modulation unit is used for adjusting the fundamental frequency of the real-time audio to the fundamental frequency of the target audio, and the N harmonic frequencies of the real-time audio are also adjusted in the same proportion;
the frequency domain and time domain conversion unit is used for converting the frequency-modulated real-time audio into a time domain signal;
and a playing unit for playing the converted time domain signal.
6. The real-time sound level adjustment device of claim 5, wherein the sound signal preprocessing component comprises a first sound signal preprocessing unit and a second sound signal preprocessing unit; the first sound signal preprocessing unit converts an input target audio signal into an electric signal, and preprocesses the electric signal to acquire fundamental frequency information of an audio unit time complex wave; the second sound signal preprocessing unit converts an input real-time audio signal into an electric signal, preprocesses the electric signal, and acquires fundamental frequency information of an audio unit time composite wave and corresponding amplitude and phase information thereof.
7. A tuning device for carrying out the method of any one of the preceding claims 1 to 4 or employing the apparatus of any one of the claims 5 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211172436.XA CN117133257A (en) | 2022-09-26 | 2022-09-26 | Real-time pitch adjustment method and device and tuning equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211172436.XA CN117133257A (en) | 2022-09-26 | 2022-09-26 | Real-time pitch adjustment method and device and tuning equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117133257A true CN117133257A (en) | 2023-11-28 |
Family
ID=88855211
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211172436.XA Pending CN117133257A (en) | 2022-09-26 | 2022-09-26 | Real-time pitch adjustment method and device and tuning equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117133257A (en) |
-
2022
- 2022-09-26 CN CN202211172436.XA patent/CN117133257A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4286510B2 (en) | Acoustic signal processing apparatus and method | |
| RU2487426C2 (en) | Apparatus and method for converting audio signal into parametric representation, apparatus and method for modifying parametric representation, apparatus and method for synthensising parametrick representation of audio signal | |
| US9584906B2 (en) | Mixing device, mixing signal processing device, mixing program and mixing method | |
| RU2565009C2 (en) | Apparatus and method of processing audio signal containing transient signal | |
| CN101505443B (en) | Virtual supper bass enhancing method and system | |
| CN107331403B (en) | Audio optimization method based on algorithm, intelligent terminal and storage device | |
| US20050065781A1 (en) | Method for analysing audio signals | |
| JP6452653B2 (en) | A system for modeling the characteristics of musical instruments | |
| EP3121608B1 (en) | Method of modeling characteristics of a non linear system. | |
| US7933768B2 (en) | Vocoder system and method for vocal sound synthesis | |
| US7680665B2 (en) | Device and method for interpolating frequency components of signal adaptively | |
| JP2007243709A (en) | Gain control method and gain control apparatus | |
| JP6482880B2 (en) | Mixing apparatus, signal mixing method, and mixing program | |
| JP4303026B2 (en) | Acoustic signal processing apparatus and method | |
| CN117133257A (en) | Real-time pitch adjustment method and device and tuning equipment | |
| WO2020179472A1 (en) | Signal processing device, method, and program | |
| Mu | Perceptual quality improvement and assessment for virtual bass system | |
| CN110225433B (en) | Nonlinear measurement and tone quality tuning method of loudspeaker system | |
| CN117116245B (en) | Method, device, equipment and storage medium for generating harmonic wave of sound signal | |
| CN116486828B (en) | Audio data processing method, device and system | |
| US7211721B2 (en) | System and methods for memory-constrained sound synthesis using harmonic coding | |
| US11425500B2 (en) | Apparatus for generating audio signal to compensate for missing components in the audio signal | |
| JP6793422B1 (en) | Audio compensator, singing system, audio compensator, and program | |
| US3819861A (en) | Sound enhancing system for musical instruments | |
| JPH0537371A (en) | D/a converter |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |