CN112687248B - Audio playing control method and device based on intelligent DJ sound system - Google Patents
Audio playing control method and device based on intelligent DJ sound system Download PDFInfo
- Publication number
- CN112687248B CN112687248B CN202011524631.5A CN202011524631A CN112687248B CN 112687248 B CN112687248 B CN 112687248B CN 202011524631 A CN202011524631 A CN 202011524631A CN 112687248 B CN112687248 B CN 112687248B
- Authority
- CN
- China
- Prior art keywords
- audio
- signals
- frequency domain
- intelligent
- sound system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000005236 sound signal Effects 0.000 claims abstract description 164
- 230000009466 transformation Effects 0.000 claims abstract description 31
- 230000001360 synchronised effect Effects 0.000 claims abstract description 30
- 239000000872 buffer Substances 0.000 claims description 20
- 238000001914 filtration Methods 0.000 claims description 12
- 238000011426 transformation method Methods 0.000 claims description 8
- 230000000694 effects Effects 0.000 abstract description 5
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 239000013078 crystal Substances 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000003062 neural network model Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Landscapes
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention discloses an audio playing control method and device based on an intelligent DJ sound system, wherein the method comprises the following steps: the method comprises the steps that multiple microphone devices based on an intelligent DJ sound system respectively collect multiple audio signals of a user in real time; the multi-microphone device synchronizes the collected plurality of audio signals to obtain synchronized plurality of audio signals; performing reverberation removal processing on the synchronized plurality of audio signals to obtain a plurality of audio signals after reverberation removal, and performing frequency domain transformation processing on the plurality of audio signals after reverberation removal to obtain a plurality of audio frequency domain signals; combining the plurality of audio frequency domain signals with accompaniment audio signals provided by the intelligent DJ sound system to obtain combined audio signals; and outputting the combined signals to a player corresponding to the intelligent DJ sound system for playing. In the embodiment of the invention, the user can experience better tone quality and sound effect when singing, and the user experience is improved.
Description
Technical Field
The invention relates to the technical field of sound control, in particular to an audio playing control method and device based on an intelligent DJ sound system.
Background
With the development of intelligent technology, more and more sound systems and related product manufacturers apply the intelligent technology to sound systems and related products; and these intelligent sound systems are typically equipped with a voice acquisition device; when the voice acquisition devices acquire, sound played by sound equipment can be acquired and reverberation is caused, so that acquired user audio signals are greatly weakened, and the quality of audio played later is poor; particularly in an intelligent DJ sound system, reverberation is severe when applied to K songs, resulting in extremely poor user experience.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, and provides an audio playing control method and device based on an intelligent DJ sound system, which can experience better tone quality and sound effect when a user sings K, and improve the user experience.
In order to solve the above technical problems, an embodiment of the present invention provides an audio playing control method based on an intelligent DJ sound system, where the method includes:
the method comprises the steps that multiple microphone devices based on an intelligent DJ sound system respectively collect multiple audio signals of a user in real time;
the multi-microphone device synchronizes the collected plurality of audio signals to obtain synchronized plurality of audio signals;
performing reverberation removal processing on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system to obtain a plurality of audio signals after reverberation removal;
performing frequency domain transformation processing on the plurality of audio signals after the reverberation removal to obtain a plurality of audio frequency domain signals;
combining the plurality of audio frequency domain signals with accompaniment audio signals provided by the intelligent DJ sound system to obtain combined audio signals;
and outputting the combined signals to a player corresponding to the intelligent DJ sound system for playing.
Optionally, the method further comprises:
the intelligent DJ sound system receives a user playing demand instruction and calls out corresponding accompaniment audio signals in a corresponding database based on the playing demand instruction.
Optionally, the multiple microphone device based on the intelligent DJ sound system respectively collects multiple audio information of the user in real time, including:
after receiving a user playing demand instruction, the intelligent DJ sound system starts the multi-microphone device;
the started multi-microphone device collects a plurality of audio signals of a user in real time and carries out filtering processing on the collected audio signals in real time, wherein the filtering processing is carried out by a bilinear transformation method.
Optionally, the multi-microphone device synchronizes the collected plurality of audio signals, including:
a buffer area is additionally arranged in each microphone device in the multi-microphone devices;
each microphone device in the multi-microphone devices respectively caches the audio acquired in real time into a respective cache region;
the same number of audio signals are respectively extracted from each buffer zone in the multi-microphone device based on a preset clock period.
Optionally, after the same number of audio signals are respectively extracted from each buffer in the multi-microphone device based on the preset clock period, the method further includes:
and automatically adjusting the audio signal acquisition rate of the corresponding microphone equipment according to the number of the audio signals cached in each cache region.
Optionally, the reverberation parameter of the intelligent DJ sound system is determined by the direction of sound placement and the breadth of the placement space in the intelligent DJ sound system.
Optionally, the performing reverberation removal processing on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system includes:
and performing reverberation removal processing of a weighted prediction error mode on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system.
Optionally, the performing frequency domain transform processing on the plurality of audio signals after the reverberation removal to obtain a plurality of audio frequency domain signals includes:
and carrying out frequency domain transformation processing on the plurality of audio signals after the reverberation removal based on Fourier transformation to obtain a plurality of audio frequency domain signals.
Optionally, the combining based on the plurality of audio frequency domain signals and the accompaniment audio signal provided by the intelligent DJ sound system includes:
performing frequency domain transformation processing on the accompaniment audio signals to obtain accompaniment audio frequency domain signals;
extracting characteristic points of the plurality of audio frequency domain signals and the accompaniment audio frequency domain signal characteristic points to obtain first characteristic points of the plurality of audio frequency domain signals and second characteristic points of the accompaniment audio frequency domain signals;
and combining the first characteristic points of the plurality of audio frequency domain signals based on the similarity of the second characteristic points of the accompaniment audio frequency domain signals.
In addition, the embodiment of the invention also provides an audio playing control device based on the intelligent DJ sound system, which comprises:
and the acquisition module is used for: the multi-microphone device is used for respectively acquiring a plurality of audio signals of a user in real time based on the intelligent DJ sound system;
and a synchronization module: the multi-microphone device is used for synchronizing the acquired plurality of audio signals to obtain synchronized plurality of audio signals;
reverberation removal module: the method comprises the steps of performing reverberation removal processing on the synchronized plurality of audio signals based on reverberation parameters of the intelligent DJ sound system to obtain a plurality of audio signals after reverberation removal;
a frequency domain transformation module: the method comprises the steps of performing frequency domain transformation processing on a plurality of audio signals after reverberation removal to obtain a plurality of audio frequency domain signals;
and a merging module: the audio frequency domain signal processing unit is used for combining the plurality of audio frequency domain signals with accompaniment audio signals provided by the intelligent DJ sound system to obtain combined audio signals;
and a play control module: and the integrated signal is used for outputting the integrated signal to a player corresponding to the intelligent DJ sound system for playing.
In the embodiment of the invention, the multi-microphone equipment based on the intelligent DJ sound system respectively collects a plurality of audio signals of a user in real time; the multi-microphone device synchronizes the collected plurality of audio signals to obtain synchronized plurality of audio signals; performing reverberation removal processing on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system to obtain a plurality of audio signals after reverberation removal; performing frequency domain transformation processing on the plurality of audio signals after the reverberation removal to obtain a plurality of audio frequency domain signals; combining the plurality of audio frequency domain signals with accompaniment audio signals provided by the intelligent DJ sound system to obtain combined audio signals; outputting the combined signals to a player corresponding to the intelligent DJ sound system for playing; the user can experience better tone quality and sound effect when singing, and the user experience degree is improved.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings which are required in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of an audio playing control method based on an intelligent DJ sound system according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an audio play control device based on an intelligent DJ sound system according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Examples
Referring to fig. 1, fig. 1 is a flow chart of an audio playing control method based on an intelligent DJ sound system according to an embodiment of the invention.
As shown in fig. 1, an audio playing control method based on an intelligent DJ sound system, the method includes:
s11: the method comprises the steps that multiple microphone devices based on an intelligent DJ sound system respectively collect multiple audio signals of a user in real time;
in the implementation process of the invention, the multi-microphone device based on the intelligent DJ sound system respectively collects a plurality of audio information of a user in real time, and the method comprises the following steps: after receiving a user playing demand instruction, the intelligent DJ sound system starts the multi-microphone device; the started multi-microphone device collects a plurality of audio signals of a user in real time and carries out filtering processing on the collected audio signals in real time, wherein the filtering processing is carried out by a bilinear transformation method.
Specifically, when the intelligent DJ sound system is started, the intelligent DJ sound system is connected with the intelligent DJ system through a user intelligent terminal, corresponding operation is performed on an operation interface corresponding to the user terminal, a user playing demand instruction is generated, the instruction is transmitted to the intelligent DJ sound system in a wired or wireless transmission mode, after receiving the playing demand instruction, the intelligent DJ sound system starts microphone equipment in the intelligent DJ sound system, and filters a plurality of acquired audio signals in real time, wherein the filtering is performed by a bilinear transformation method; the filtering is performed by the bilinear transformation method, so that most of noise in the audio signals collected by the microphone equipment can be effectively removed.
S12: the multi-microphone device synchronizes the collected plurality of audio signals to obtain synchronized plurality of audio signals;
in the implementation process of the present invention, the multi-microphone device synchronizes the collected plurality of audio signals, including: a buffer area is additionally arranged in each microphone device in the multi-microphone devices; each microphone device in the multi-microphone devices respectively caches the audio acquired in real time into a respective cache region; the same number of audio signals are respectively extracted from each buffer zone in the multi-microphone device based on a preset clock period.
Further, after extracting the same number of audio signals from each buffer area in the multi-microphone device based on the preset clock period, the method further includes: and automatically adjusting the audio signal acquisition rate of the corresponding microphone equipment according to the number of the audio signals cached in each cache region.
Specifically, a storage device is additionally arranged in each of the plurality of microphone devices to serve as a buffer area, and then each of the plurality of microphone devices respectively buffers the audio acquired in real time into the respective buffer area; respectively extracting the same number of audio signals from each buffer area in the multi-microphone device according to a preset clock period; the predetermined clock period may be a crystal frequency of the microphone apparatus chip.
And the audio signal acquisition rate of the corresponding microphone equipment is automatically adjusted according to the number of the audio signals cached in each cache area; the number of the audio signals cached in each cache area is more than twice the number extracted in each preset clock period; by the mode, the problem of synchronization of the collected audio signals among the microphone devices can be solved.
S13: performing reverberation removal processing on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system to obtain a plurality of audio signals after reverberation removal;
in the implementation process of the invention, the reverberation parameter of the intelligent DJ sound system is determined by the placement direction of the sound in the intelligent DJ sound system and the width of the placement space.
Further, the performing reverberation removal processing on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system includes: and performing reverberation removal processing of a weighted prediction error mode on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system.
Specifically, the reverberation parameter of the intelligent DJ sound system is determined by the direction of sound placement and the width of the placement space in the intelligent DJ sound system; firstly, determining the position where the intelligent DJ sound system is placed and the size of a placed space, then calculating according to the position and the size of the space, so as to obtain a reverberation parameter, namely determining the spaciousness parameter according to multiplication of the first distance and the second distance according to a first distance and a second distance from the position to the boundary of the space along a preset first direction and a second direction, and then determining the reverberation parameter according to the spaciousness parameter; and the first direction and the second direction are in an orthogonal relationship.
And then removing the reverberation through a weighted prediction error mode, and particularly carrying out reverberation removal processing of the weighted prediction error mode on the synchronized plurality of audio signals according to the reverberation parameters of the intelligent DJ sound system.
S14: performing frequency domain transformation processing on the plurality of audio signals after the reverberation removal to obtain a plurality of audio frequency domain signals;
the invention provides a method for performing frequency domain transformation processing on a plurality of audio signals after removing reverberation to obtain a plurality of audio frequency domain signals, comprising the following steps: and carrying out frequency domain transformation processing on the plurality of audio signals after the reverberation removal based on Fourier transformation to obtain a plurality of audio frequency domain signals.
Specifically, fourier transform is used to perform frequency domain transform processing on the reverberations removed audio signals, so as to obtain a plurality of audio frequency domain signals.
S15: combining the plurality of audio frequency domain signals with accompaniment audio signals provided by the intelligent DJ sound system to obtain combined audio signals;
in the implementation process of the present invention, the combining the accompaniment audio signals provided by the intelligent DJ sound system based on the plurality of audio frequency domain signals includes: performing frequency domain transformation processing on the accompaniment audio signals to obtain accompaniment audio frequency domain signals; extracting characteristic points of the plurality of audio frequency domain signals and the accompaniment audio frequency domain signal characteristic points to obtain first characteristic points of the plurality of audio frequency domain signals and second characteristic points of the accompaniment audio frequency domain signals; and combining the first characteristic points of the plurality of audio frequency domain signals based on the similarity of the second characteristic points of the accompaniment audio frequency domain signals.
Specifically, firstly, carrying out frequency domain transformation processing on an accompaniment audio signal by utilizing Fourier transformation to obtain an accompaniment audio frequency domain signal; then extracting characteristic points of a plurality of audio frequency domain signals and characteristic points of accompaniment audio frequency domain signals in an artificial intelligence mode to obtain first characteristic points of the plurality of audio frequency domain signals and second characteristic points of the accompaniment audio frequency domain signals; specifically, a neural network model is adopted, the model is a training convergence model, and then merging processing is carried out according to the similarity of a first characteristic point of a plurality of audio frequency domain signals and a second characteristic point of an accompaniment audio frequency domain signal; the similarity is Euclidean distance similarity, namely combining is performed by calculating Euclidean distance similarity between the first characteristic and the second characteristic.
S16: and outputting the combined signals to a player corresponding to the intelligent DJ sound system for playing.
In the implementation process of the invention, the combined signal is output to a player corresponding to the intelligent DJ sound system for playing
In the implementation process of the invention, the method further comprises the following steps: the intelligent DJ sound system receives a user playing demand instruction and calls out corresponding accompaniment audio signals in a corresponding database based on the playing demand instruction.
Specifically, after receiving a user playing demand instruction, the intelligent DJ sound system calls out a corresponding accompaniment audio signal in a corresponding database according to the user playing demand instruction; the corresponding database stores therein corresponding accompaniment audio data.
In the embodiment of the invention, the multi-microphone equipment based on the intelligent DJ sound system respectively collects a plurality of audio signals of a user in real time; the multi-microphone device synchronizes the collected plurality of audio signals to obtain synchronized plurality of audio signals; performing reverberation removal processing on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system to obtain a plurality of audio signals after reverberation removal; performing frequency domain transformation processing on the plurality of audio signals after the reverberation removal to obtain a plurality of audio frequency domain signals; combining the plurality of audio frequency domain signals with accompaniment audio signals provided by the intelligent DJ sound system to obtain combined audio signals; outputting the combined signals to a player corresponding to the intelligent DJ sound system for playing; the user can experience better tone quality and sound effect when singing, and the user experience degree is improved.
Examples
Referring to fig. 2, fig. 2 is a schematic structural diagram of an audio playing control device based on an intelligent DJ sound system according to an embodiment of the invention.
As shown in fig. 2, an audio play control device based on an intelligent DJ sound system, the device comprising:
acquisition module 21: the multi-microphone device is used for respectively acquiring a plurality of audio signals of a user in real time based on the intelligent DJ sound system;
in the implementation process of the invention, the multi-microphone device based on the intelligent DJ sound system respectively collects a plurality of audio information of a user in real time, and the method comprises the following steps: after receiving a user playing demand instruction, the intelligent DJ sound system starts the multi-microphone device; the started multi-microphone device collects a plurality of audio signals of a user in real time and carries out filtering processing on the collected audio signals in real time, wherein the filtering processing is carried out by a bilinear transformation method.
Specifically, when the intelligent DJ sound system is started, the intelligent DJ sound system is connected with the intelligent DJ system through a user intelligent terminal, corresponding operation is performed on an operation interface corresponding to the user terminal, a user playing demand instruction is generated, the instruction is transmitted to the intelligent DJ sound system in a wired or wireless transmission mode, after receiving the playing demand instruction, the intelligent DJ sound system starts microphone equipment in the intelligent DJ sound system, and filters a plurality of acquired audio signals in real time, wherein the filtering is performed by a bilinear transformation method; the filtering is performed by the bilinear transformation method, so that most of noise in the audio signals collected by the microphone equipment can be effectively removed.
Synchronization module 22: the multi-microphone device is used for synchronizing the acquired plurality of audio signals to obtain synchronized plurality of audio signals;
in the implementation process of the present invention, the multi-microphone device synchronizes the collected plurality of audio signals, including: a buffer area is additionally arranged in each microphone device in the multi-microphone devices; each microphone device in the multi-microphone devices respectively caches the audio acquired in real time into a respective cache region; the same number of audio signals are respectively extracted from each buffer zone in the multi-microphone device based on a preset clock period.
Further, after extracting the same number of audio signals from each buffer area in the multi-microphone device based on the preset clock period, the method further includes: and automatically adjusting the audio signal acquisition rate of the corresponding microphone equipment according to the number of the audio signals cached in each cache region.
Specifically, a storage device is additionally arranged in each of the plurality of microphone devices to serve as a buffer area, and then each of the plurality of microphone devices respectively buffers the audio acquired in real time into the respective buffer area; respectively extracting the same number of audio signals from each buffer area in the multi-microphone device according to a preset clock period; the predetermined clock period may be a crystal frequency of the microphone apparatus chip.
And the audio signal acquisition rate of the corresponding microphone equipment is automatically adjusted according to the number of the audio signals cached in each cache area; the number of the audio signals cached in each cache area is more than twice the number extracted in each preset clock period; by the mode, the problem of synchronization of the collected audio signals among the microphone devices can be solved.
Reverberation removal module 23: the method comprises the steps of performing reverberation removal processing on the synchronized plurality of audio signals based on reverberation parameters of the intelligent DJ sound system to obtain a plurality of audio signals after reverberation removal;
in the implementation process of the invention, the reverberation parameter of the intelligent DJ sound system is determined by the placement direction of the sound in the intelligent DJ sound system and the width of the placement space.
Further, the performing reverberation removal processing on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system includes: and performing reverberation removal processing of a weighted prediction error mode on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system.
Specifically, the reverberation parameter of the intelligent DJ sound system is determined by the direction of sound placement and the width of the placement space in the intelligent DJ sound system; firstly, determining the position where the intelligent DJ sound system is placed and the size of a placed space, then calculating according to the position and the size of the space, so as to obtain a reverberation parameter, namely determining the spaciousness parameter according to multiplication of the first distance and the second distance according to a first distance and a second distance from the position to the boundary of the space along a preset first direction and a second direction, and then determining the reverberation parameter according to the spaciousness parameter; and the first direction and the second direction are in an orthogonal relationship.
And then removing the reverberation through a weighted prediction error mode, and particularly carrying out reverberation removal processing of the weighted prediction error mode on the synchronized plurality of audio signals according to the reverberation parameters of the intelligent DJ sound system.
Frequency domain transform module 24: the method comprises the steps of performing frequency domain transformation processing on a plurality of audio signals after reverberation removal to obtain a plurality of audio frequency domain signals;
the invention provides a method for performing frequency domain transformation processing on a plurality of audio signals after removing reverberation to obtain a plurality of audio frequency domain signals, comprising the following steps: and carrying out frequency domain transformation processing on the plurality of audio signals after the reverberation removal based on Fourier transformation to obtain a plurality of audio frequency domain signals.
Specifically, fourier transform is used to perform frequency domain transform processing on the reverberations removed audio signals, so as to obtain a plurality of audio frequency domain signals.
The merging module 25: the audio frequency domain signal processing unit is used for combining the plurality of audio frequency domain signals with accompaniment audio signals provided by the intelligent DJ sound system to obtain combined audio signals;
in the implementation process of the present invention, the combining the accompaniment audio signals provided by the intelligent DJ sound system based on the plurality of audio frequency domain signals includes: performing frequency domain transformation processing on the accompaniment audio signals to obtain accompaniment audio frequency domain signals; extracting characteristic points of the plurality of audio frequency domain signals and the accompaniment audio frequency domain signal characteristic points to obtain first characteristic points of the plurality of audio frequency domain signals and second characteristic points of the accompaniment audio frequency domain signals; and combining the first characteristic points of the plurality of audio frequency domain signals based on the similarity of the second characteristic points of the accompaniment audio frequency domain signals.
Specifically, firstly, carrying out frequency domain transformation processing on an accompaniment audio signal by utilizing Fourier transformation to obtain an accompaniment audio frequency domain signal; then extracting characteristic points of a plurality of audio frequency domain signals and characteristic points of accompaniment audio frequency domain signals in an artificial intelligence mode to obtain first characteristic points of the plurality of audio frequency domain signals and second characteristic points of the accompaniment audio frequency domain signals; specifically, a neural network model is adopted, the model is a training convergence model, and then merging processing is carried out according to the similarity of a first characteristic point of a plurality of audio frequency domain signals and a second characteristic point of an accompaniment audio frequency domain signal; the similarity is Euclidean distance similarity, namely combining is performed by calculating Euclidean distance similarity between the first characteristic and the second characteristic.
Play control module 26: and the integrated signal is used for outputting the integrated signal to a player corresponding to the intelligent DJ sound system for playing.
In the implementation process of the invention, the combined signal is output to a player corresponding to the intelligent DJ sound system for playing
In the implementation process of the invention, the method further comprises the following steps: the intelligent DJ sound system receives a user playing demand instruction and calls out corresponding accompaniment audio signals in a corresponding database based on the playing demand instruction.
Specifically, after receiving a user playing demand instruction, the intelligent DJ sound system calls out a corresponding accompaniment audio signal in a corresponding database according to the user playing demand instruction; the corresponding database stores therein corresponding accompaniment audio data.
In the embodiment of the invention, the multi-microphone equipment based on the intelligent DJ sound system respectively collects a plurality of audio signals of a user in real time; the multi-microphone device synchronizes the collected plurality of audio signals to obtain synchronized plurality of audio signals; performing reverberation removal processing on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system to obtain a plurality of audio signals after reverberation removal; performing frequency domain transformation processing on the plurality of audio signals after the reverberation removal to obtain a plurality of audio frequency domain signals; combining the plurality of audio frequency domain signals with accompaniment audio signals provided by the intelligent DJ sound system to obtain combined audio signals; outputting the combined signals to a player corresponding to the intelligent DJ sound system for playing; the user can experience better tone quality and sound effect when singing, and the user experience degree is improved.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be implemented by a program to instruct related hardware, the program may be stored in a computer readable storage medium, and the storage medium may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.
In addition, the foregoing describes in detail the method and apparatus for controlling audio playing based on the intelligent DJ sound system according to the embodiments of the present invention, and specific examples should be adopted herein to illustrate the principles and embodiments of the present invention, where the foregoing description of the embodiments is only for helping to understand the method and core idea of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (9)
1. An audio playing control method based on an intelligent DJ sound system is characterized by comprising the following steps:
the method comprises the steps that multiple microphone devices based on an intelligent DJ sound system respectively collect multiple audio signals of a user in real time;
the multi-microphone device synchronizes the collected plurality of audio signals to obtain synchronized plurality of audio signals;
performing reverberation removal processing on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system to obtain a plurality of audio signals after reverberation removal;
performing frequency domain transformation processing on the plurality of audio signals after the reverberation removal to obtain a plurality of audio frequency domain signals;
combining the plurality of audio frequency domain signals with accompaniment audio signals provided by the intelligent DJ sound system to obtain combined audio signals;
outputting the combined audio signals to a player corresponding to the intelligent DJ sound system for playing;
the combining based on the plurality of audio frequency domain signals with an accompaniment audio signal provided by the intelligent DJ sound system includes:
performing frequency domain transformation processing on the accompaniment audio signals to obtain accompaniment audio frequency domain signals;
extracting characteristic points of the plurality of audio frequency domain signals and the accompaniment audio frequency domain signal characteristic points to obtain first characteristic points of the plurality of audio frequency domain signals and second characteristic points of the accompaniment audio frequency domain signals;
and combining the first characteristic points of the plurality of audio frequency domain signals based on the similarity of the second characteristic points of the accompaniment audio frequency domain signals.
2. The audio play control method according to claim 1, characterized in that the method further comprises:
the intelligent DJ sound system receives a user playing demand instruction and calls out corresponding accompaniment audio signals in a corresponding database based on the playing demand instruction.
3. The audio play control method according to claim 1, wherein the multi-microphone device based on the intelligent DJ sound system collects a plurality of audio information of the user in real time, respectively, comprising:
after receiving a user playing demand instruction, the intelligent DJ sound system starts the multi-microphone device;
the started multi-microphone device collects a plurality of audio signals of a user in real time and carries out filtering processing on the collected audio signals in real time, wherein the filtering processing is carried out by a bilinear transformation method.
4. The audio playback control method of claim 1, wherein the multi-microphone apparatus synchronizes the plurality of collected audio signals, comprising:
a buffer area is additionally arranged in each microphone device in the multi-microphone devices;
each microphone device in the multi-microphone devices respectively caches the audio acquired in real time into a respective cache region;
the same number of audio signals are respectively extracted from each buffer zone in the multi-microphone device based on a preset clock period.
5. The audio playback control method as set forth in claim 4, wherein after the same number of audio signals are respectively extracted from each buffer in the multi-microphone apparatus based on the preset clock period, further comprising:
and automatically adjusting the audio signal acquisition rate of the corresponding microphone equipment according to the number of the audio signals cached in each cache region.
6. The audio playback control method of claim 1, wherein the reverberation parameter of the intelligent DJ sound system is determined by a direction in which sound is placed in the intelligent DJ sound system and a width of a placement space.
7. The audio playback control method of claim 1, wherein the performing reverberation removal processing on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system includes:
and performing reverberation removal processing of a weighted prediction error mode on the synchronized plurality of audio signals based on the reverberation parameters of the intelligent DJ sound system.
8. The audio playback control method of claim 1, wherein the performing frequency domain transform processing on the reverberated plurality of audio signals to obtain a plurality of audio frequency domain signals comprises:
and carrying out frequency domain transformation processing on the plurality of audio signals after the reverberation removal based on Fourier transformation to obtain a plurality of audio frequency domain signals.
9. An audio play control device based on intelligent DJ sound system, the device comprising:
and the acquisition module is used for: the multi-microphone device is used for respectively acquiring a plurality of audio signals of a user in real time based on the intelligent DJ sound system;
and a synchronization module: the multi-microphone device is used for synchronizing the acquired plurality of audio signals to obtain synchronized plurality of audio signals;
reverberation removal module: the method comprises the steps of performing reverberation removal processing on the synchronized plurality of audio signals based on reverberation parameters of the intelligent DJ sound system to obtain a plurality of audio signals after reverberation removal;
a frequency domain transformation module: the method comprises the steps of performing frequency domain transformation processing on a plurality of audio signals after reverberation removal to obtain a plurality of audio frequency domain signals;
and a merging module: the audio frequency domain signal processing unit is used for combining the plurality of audio frequency domain signals with accompaniment audio signals provided by the intelligent DJ sound system to obtain combined audio signals;
and a play control module: the audio signal processing unit is used for outputting the combined audio signal to a player corresponding to the intelligent DJ audio system for playing;
the combining based on the plurality of audio frequency domain signals with an accompaniment audio signal provided by the intelligent DJ sound system includes:
performing frequency domain transformation processing on the accompaniment audio signals to obtain accompaniment audio frequency domain signals;
extracting characteristic points of the plurality of audio frequency domain signals and the accompaniment audio frequency domain signal characteristic points to obtain first characteristic points of the plurality of audio frequency domain signals and second characteristic points of the accompaniment audio frequency domain signals;
and combining the first characteristic points of the plurality of audio frequency domain signals based on the similarity of the second characteristic points of the accompaniment audio frequency domain signals.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011524631.5A CN112687248B (en) | 2020-12-22 | 2020-12-22 | Audio playing control method and device based on intelligent DJ sound system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011524631.5A CN112687248B (en) | 2020-12-22 | 2020-12-22 | Audio playing control method and device based on intelligent DJ sound system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112687248A CN112687248A (en) | 2021-04-20 |
| CN112687248B true CN112687248B (en) | 2023-10-31 |
Family
ID=75450229
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011524631.5A Active CN112687248B (en) | 2020-12-22 | 2020-12-22 | Audio playing control method and device based on intelligent DJ sound system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112687248B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5811708A (en) * | 1996-11-20 | 1998-09-22 | Yamaha Corporation | Karaoke apparatus with tuning sub vocal aside main vocal |
| KR19980067955A (en) * | 1997-02-13 | 1998-10-15 | 배순훈 | Automatic pitch adjustment circuit for singing cycle |
| US5857171A (en) * | 1995-02-27 | 1999-01-05 | Yamaha Corporation | Karaoke apparatus using frequency of actual singing voice to synthesize harmony voice from stored voice information |
| CN101404156A (en) * | 2007-10-02 | 2009-04-08 | 株式会社音特技术 | Wireless music accompaniment apparatus having control function of audio signal output level |
| CN103474082A (en) * | 2013-09-16 | 2013-12-25 | 无敌科技(西安)有限公司 | Multi-microphone vocal accompaniment marking system and method thereof |
| CN106228977A (en) * | 2016-08-02 | 2016-12-14 | 合肥工业大学 | The song emotion identification method of multi-modal fusion based on degree of depth study |
| CN106303826A (en) * | 2016-08-19 | 2017-01-04 | 广州番禺巨大汽车音响设备有限公司 | Method and system based on DAC-circuit output sound system sound intermediate frequency data |
| CN107452394A (en) * | 2017-07-31 | 2017-12-08 | 上海斐讯数据通信技术有限公司 | A kind of method and system that noise is reduced based on frequency characteristic |
| CN107481709A (en) * | 2017-08-11 | 2017-12-15 | 腾讯音乐娱乐（深圳）有限公司 | Audio data transmission method and device |
| CN111161751A (en) * | 2019-12-25 | 2020-05-15 | 声耕智能科技(西安)研究院有限公司 | Distributed microphone pickup system and method under complex scene |
| CN111510820A (en) * | 2020-03-11 | 2020-08-07 | 杭州楷知科技有限公司 | Microphone equipment expansion method and device and microphone equipment synchronization method and device |
-
2020
- 2020-12-22 CN CN202011524631.5A patent/CN112687248B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5857171A (en) * | 1995-02-27 | 1999-01-05 | Yamaha Corporation | Karaoke apparatus using frequency of actual singing voice to synthesize harmony voice from stored voice information |
| US5811708A (en) * | 1996-11-20 | 1998-09-22 | Yamaha Corporation | Karaoke apparatus with tuning sub vocal aside main vocal |
| KR19980067955A (en) * | 1997-02-13 | 1998-10-15 | 배순훈 | Automatic pitch adjustment circuit for singing cycle |
| CN101404156A (en) * | 2007-10-02 | 2009-04-08 | 株式会社音特技术 | Wireless music accompaniment apparatus having control function of audio signal output level |
| CN103474082A (en) * | 2013-09-16 | 2013-12-25 | 无敌科技(西安)有限公司 | Multi-microphone vocal accompaniment marking system and method thereof |
| CN106228977A (en) * | 2016-08-02 | 2016-12-14 | 合肥工业大学 | The song emotion identification method of multi-modal fusion based on degree of depth study |
| CN106303826A (en) * | 2016-08-19 | 2017-01-04 | 广州番禺巨大汽车音响设备有限公司 | Method and system based on DAC-circuit output sound system sound intermediate frequency data |
| CN107452394A (en) * | 2017-07-31 | 2017-12-08 | 上海斐讯数据通信技术有限公司 | A kind of method and system that noise is reduced based on frequency characteristic |
| CN107481709A (en) * | 2017-08-11 | 2017-12-15 | 腾讯音乐娱乐（深圳）有限公司 | Audio data transmission method and device |
| CN111161751A (en) * | 2019-12-25 | 2020-05-15 | 声耕智能科技(西安)研究院有限公司 | Distributed microphone pickup system and method under complex scene |
| CN111510820A (en) * | 2020-03-11 | 2020-08-07 | 杭州楷知科技有限公司 | Microphone equipment expansion method and device and microphone equipment synchronization method and device |
Non-Patent Citations (2)
| Title |
|---|
| Novel sound mixing method for voice and background music;Wataru Owaki,et al.;《2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)》;全文 * |
| 谈流行歌曲伴奏制作的音频调制;杨德华等;《音乐大观》(第4期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112687248A (en) | 2021-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110503976B (en) | Audio separation method and device, electronic equipment and storage medium | |
| CN110675886B (en) | Audio signal processing method, device, electronic equipment and storage medium | |
| CN110797038B (en) | Audio processing method and device, computer equipment and storage medium | |
| JPH0997091A (en) | Method for pitch change of prerecorded background music and karaoke system | |
| US20220051685A1 (en) | Method for transforming audio signal, device, and storage medium | |
| CN111640411B (en) | Audio synthesis method, device and computer readable storage medium | |
| CN104707331B (en) | A kind of game body-sensing production method and device | |
| CN111210850B (en) | Lyric alignment method and related product | |
| CN110475181B (en) | Equipment configuration method, device, equipment and storage medium | |
| CN112687248B (en) | Audio playing control method and device based on intelligent DJ sound system | |
| CN112017622A (en) | Audio data alignment method, device, equipment and storage medium | |
| CN115910018B (en) | Method and device for improving voice privacy of silence cabin | |
| CN113921007B (en) | Method for improving far-field voice interaction performance and far-field voice interaction system | |
| CN109741761A (en) | Sound processing method and device | |
| TWI779261B (en) | Wind shear sound filtering device | |
| Kyriakakis et al. | Virtual microphones for multichannel audio applications | |
| CN113393850A (en) | Parameterized auditory filter bank for end-to-end time domain sound source separation system | |
| CN110491413B (en) | Twin network-based audio content consistency monitoring method and system | |
| CN102682766A (en) | Self-learning lover voice swapper | |
| CN111885474A (en) | Microphone testing method and device | |
| JP3412209B2 (en) | Sound signal processing device | |
| CN113436644B (en) | Sound quality evaluation method, device, electronic equipment and storage medium | |
| CN115114475B (en) | Audio retrieval method for matching short video sounds with live soundtracks of music | |
| CN113611266B (en) | Audio synchronization method, device and storage medium suitable for multi-user K songs | |
| KR100359988B1 (en) | real-time speaking rate conversion system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |