CN110620986B - Scheduling method and device of audio processing algorithm, audio processor and storage medium - Google Patents
Scheduling method and device of audio processing algorithm, audio processor and storage medium Download PDFInfo
- Publication number
- CN110620986B CN110620986B CN201910910143.9A CN201910910143A CN110620986B CN 110620986 B CN110620986 B CN 110620986B CN 201910910143 A CN201910910143 A CN 201910910143A CN 110620986 B CN110620986 B CN 110620986B
- Authority
- CN
- China
- Prior art keywords
- audio
- processed
- algorithm
- frame
- audio processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/04—Time compression or expansion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
Abstract
The invention discloses a scheduling method of an audio processing algorithm, which comprises the following steps: according to a preset shortening proportion, shortening the frame length of an initial audio frame on multiple channels to obtain an audio frame to be processed; wherein, the audio frame to be processed comprises a plurality of sub-frames; selecting a current subframe to be processed from a plurality of subframes; acquiring automatic feedback control algorithm programs of all channels written in a current subframe to be processed, and dividing the acquired automatic feedback control algorithm programs into a plurality of groups of algorithm programs with target quantity according to a preset shortening ratio; and reserving one group of algorithm programs on the current subframe to be processed, sequencing the subframes on a channel according to the frame sequence of the subframes, and scheduling the rest groups of algorithm programs on a plurality of target subframes in sequence according to the group from the next subframe of the current subframe to be processed. The invention also discloses a scheduling device of the audio processing algorithm, an audio processor and a storage medium. The invention can effectively reduce the audio processing delay by shortening the length of the audio frame, and the audio processing delay is low.
Description
Technical Field
The present invention relates to the field of audio processing technologies, and in particular, to a method and an apparatus for scheduling an audio processing algorithm, an audio processor, and a storage medium.
Background
Digital audio processors are widely used in modern conference centers, broadcast projects, and the like. With the rapid development of society and science and technology, the demand of applying digital audio processors to small-sized space scenes such as conference rooms and classrooms is becoming strong.
The human ear can distinguish sounds at 0.1s time intervals. In a large application scene, because a speaker is far away from a listener, the sound source of the speaker is far smaller than the sound coming out of a loudspeaker, and the listener cannot easily perceive the difference between the speaker and the listener. Smaller spatial applications require a lower delay in the digital audio processor to allow the audio signal to reach the ear more quickly, so that the speaker's voice and the speaker's voice are mixed together and cannot be distinguished by the listener. Therefore, reducing the delay of the digital audio processor is a major research direction in the field of audio processing technology.
The existing digital audio processor is generally a multi-channel audio processor, can realize the output of multi-channel audio and meet the requirements of people on 3D (three-dimensional) surround sound and the like. The input and output of the multiple channels determine that each channel has pre and post audio processing algorithms and that each channel can participate in matrix mixing. These audio processing algorithms mainly include: automatic Gain Control (AGC), Compressor (COM), Parametric Equalizer (PEQ), Automatic Feedback Control (AFC), limiter (Lim), Automatic Noise Suppression (ANS), and Automatic remix processing (Automatic Mixer), etc., which are widely and mature in application.
Although it is possible to increase the processing speed by shortening the audio frame length to reduce the delay, when the audio frame length is shortened to be shorter than the time for performing all audio processing algorithms, the audio signal is lost due to a processing error. In the above audio processing algorithm, the AFC algorithm consumes the longest time, and it needs to be calculated once after accumulating a certain number of audio samples, that is, the AFC algorithm does not consume the time linearly when the audio frame length is shortened. When the delay is reduced by shortening the audio frame length, the audio frame length cannot be shortened too much due to the above-mentioned characteristics of the AFC algorithm, so that a large delay still exists in the current audio processing technology.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a scheduling method and device of an audio processing algorithm, an audio processor and a storage medium, and aims to solve the technical problem of large delay in the existing audio processing technology.
In order to achieve the above object, the present invention provides a scheduling method of an audio processing algorithm, comprising: according to a preset shortening proportion, shortening the frame length of an initial audio frame on multiple channels to obtain an audio frame to be processed; wherein the audio frame to be processed comprises a plurality of sub-frames; selecting a current subframe to be processed from a plurality of subframes; acquiring automatic feedback control algorithm programs of all channels written in the current subframe to be processed, and dividing the acquired automatic feedback control algorithm programs into a plurality of groups of algorithm programs with target quantity according to the preset shortening ratio; and reserving one group of the algorithm programs on the current subframe to be processed, sequencing the subframes on a channel according to the frame sequence of the subframes, and sequentially scheduling the remaining groups of the algorithm programs on a plurality of target subframes according to the group from the next subframe of the current subframe to be processed.
Optionally, other audio processing algorithm programs except for the automatic feedback control algorithm program are written in the current subframe to be processed; after the step of reserving one group of the algorithm programs on the current subframe to be processed, sequencing the remaining groups of the algorithm programs on a plurality of target subframes in groups in sequence from the next subframe of the current subframe to be processed according to the frame sequence of the subframes on the channel, the scheduling method of the audio processing algorithm further comprises the following steps: taking the algorithm program reserved for the current subframe to be processed and the other audio processing algorithm programs as algorithms to be operated; and running the algorithm to be run according to a preset execution sequence to realize audio processing on the current subframe to be processed.
Optionally, after the step of running the to-be-run algorithm according to the preset execution sequence to perform audio processing on the current to-be-processed subframe, the method for scheduling an audio processing algorithm further includes: when an audio processing algorithm program finishes running, acquiring a processing object frame of the running audio processing algorithm program; taking the next subframe of the processing object frame as a new current subframe to be processed; and writing the operated audio processing algorithm program into a new current subframe to be processed.
Optionally, after the step of writing the operated audio processing algorithm program into the new current subframe to be processed, the audio processing algorithm scheduling method further includes: and returning to the step of acquiring the automatic feedback control algorithm programs of all the channels written in the current subframe to be processed, and dividing the acquired automatic feedback control algorithm programs into a plurality of groups of algorithm programs with target quantity according to the preset shortening ratio.
Optionally, the initial audio frame comprises a plurality of sub-audio frames; the method comprises the following steps of shortening the frame length of an initial audio frame on multiple channels according to a preset shortening ratio to obtain an audio frame to be processed, and specifically comprises the following steps: and respectively shortening the frame length of each sub audio frame according to a preset shortening proportion, and taking each sub audio frame with the shortened frame length as the audio frame to be processed.
Optionally, before the step of shortening the frame length of the initial audio frame on the multiple channels according to the preset shortening ratio to obtain the audio frame to be processed, the method for scheduling an audio processing algorithm further includes: acquiring an initial audio frame on multiple channels; writing an automatic feedback control algorithm program into a current to-be-processed sub audio frame of the initial audio frame, wherein a subframe corresponding to the current to-be-processed sub audio frame after the frame length of the current to-be-processed sub audio frame is shortened is the current to-be-processed subframe.
Optionally, the acquiring an initial audio frame on multiple channels specifically includes: acquiring a source audio signal input to a multi-channel; and performing framing processing on the source audio signal to obtain an initial audio frame.
In addition, to achieve the above object, the present invention further provides a scheduling apparatus for an audio processing algorithm, including: the frame length shortening module is used for shortening the frame length of the initial audio frame on multiple channels according to a preset shortening proportion to obtain an audio frame to be processed; wherein the audio frame to be processed comprises a plurality of sub-frames; the acquisition module is used for selecting a current subframe to be processed from a plurality of subframes; the grouping module is used for acquiring the automatic feedback control algorithm programs of all channels written in the current subframe to be processed and dividing the acquired automatic feedback control algorithm programs into a plurality of groups of algorithm programs with target quantity according to the preset shortening ratio; and the scheduling module is used for reserving one group of the algorithm programs on the current subframe to be processed, sequencing the subframes on a channel according to the frame sequence of the subframes, and sequentially scheduling the remaining groups of the algorithm programs on a plurality of target subframes according to the group from the next subframe of the current subframe to be processed.
Further, to achieve the above object, the present invention also provides an audio processor, comprising: a memory, a processor and a scheduler of an audio processing algorithm stored on the memory and executable on the processor, the scheduler of the audio processing algorithm implementing the steps of the scheduling method of the audio processing algorithm as described above when executed by the processor.
In addition, to achieve the above object, the present invention further provides a storage medium, wherein the storage medium stores a scheduling program of an audio processing algorithm, and the scheduling program of the audio processing algorithm implements the steps of the scheduling method of the audio processing algorithm when being executed by a processor.
The scheduling method, the device, the audio processor and the storage medium of the audio processing algorithm provided by the embodiment of the invention obtain the audio frame to be processed comprising a plurality of subframes by shortening the frame length of an initial audio frame, obtain the current subframe to be processed from the plurality of subframes, divide AFC algorithm programs of each channel written on the current subframe to be processed into a plurality of groups of algorithm programs with target quantity, sequentially distribute the groups of algorithm programs to the current subframe to be processed and a plurality of target subframes behind the current subframe to be processed by scheduling, so that the AFC algorithm on each channel can be executed by distributing the programs to different subframes, ensure the smooth execution of the AFC algorithm, simultaneously shorten the execution time of the current subframe to be processed, solve the problem of possible execution abnormity of the AFC algorithm programs after the frame length is shortened, effectively reduce the audio processing delay by shortening the audio frame length, the audio processing latency is low.
Drawings
Fig. 1 is a schematic structural diagram of a terminal \ device in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating an exemplary method for scheduling audio processing algorithms according to the present invention;
FIG. 3 is a flowchart illustrating steps before step S202 of an embodiment of the scheduling method of the audio processing algorithm according to the invention in FIG. 2;
FIG. 4 is a detailed flowchart of step S302 of the scheduling method of the audio processing algorithm according to the embodiment of the invention in FIG. 3;
FIG. 5 is a flowchart illustrating steps after step S404 of an embodiment of the scheduling method of the audio processing algorithm according to the invention in FIG. 4;
FIG. 6 is a block diagram of a scheduling apparatus for audio processing algorithm according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The hardware operation environment related to the embodiment of the invention is an audio processor. The internal structure of the audio processor generally comprises an input part and an output part, and the audio processor of the embodiment of the invention also comprises a processing module with draggable programming, and can be formed by a user freely building a system. The audio processor of the embodiment of the invention is a multi-channel audio processor, and can carry out multi-channel processing on audio signals so as to realize multi-channel input and output.
Fig. 1 is a schematic diagram of an audio processor in a hardware operating environment according to an embodiment of the present invention.
The audio processor may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. Alternatively, the user interface 1003 may include a standard wired interface, a wireless interface. The user interface 1003 may be communicatively coupled with the microphone via a wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the audio processor architecture shown in fig. 1 does not constitute a limitation of the audio processor and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein a scheduler of an operating system, a network communication module, a user interface module, and an audio processing algorithm.
In the audio processor shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and communicating with the backend server; the user interface 1003 is mainly used for connecting a microphone and performing data communication of audio signal frames with the microphone; and the processor 1001 may be configured to invoke a scheduler of the audio processing algorithm stored in the memory 1005 and perform the following operations: according to a preset shortening proportion, shortening the frame length of an initial audio frame on multiple channels to obtain an audio frame to be processed; wherein the audio frame to be processed comprises a plurality of sub-frames; selecting a current subframe to be processed from a plurality of subframes; acquiring automatic feedback control algorithm programs of all channels written in the current subframe to be processed, and dividing the acquired automatic feedback control algorithm programs into a plurality of groups of algorithm programs with target quantity according to the preset shortening ratio; and reserving one group of the algorithm programs on the current subframe to be processed, sequencing the subframes on a channel according to the frame sequence of the subframes, and sequentially scheduling the remaining groups of the algorithm programs on a plurality of target subframes according to the group from the next subframe of the current subframe to be processed.
Optionally, other audio processing algorithm programs except for the automatic feedback control algorithm program are written in the current subframe to be processed; after the step of reserving one group of the algorithm programs on the current subframe to be processed, sequencing the remaining groups of the algorithm programs on a plurality of target subframes in groups in sequence from the next subframe of the current subframe to be processed according to the frame sequence of the subframes on the channel, the scheduling method of the audio processing algorithm further comprises the following steps: taking the algorithm program reserved for the current subframe to be processed and the other audio processing algorithm programs as algorithms to be operated; and running the algorithm to be run according to a preset execution sequence to realize audio processing on the current subframe to be processed.
Optionally, after the step of running the to-be-run algorithm according to the preset execution sequence to perform audio processing on the current to-be-processed subframe, the method for scheduling an audio processing algorithm further includes: when an audio processing algorithm program finishes running, acquiring a processing object frame of the running audio processing algorithm program; taking the next subframe of the processing object frame as a new current subframe to be processed; and writing the operated audio processing algorithm program into a new current subframe to be processed.
Optionally, after the step of writing the operated audio processing algorithm program into the new current subframe to be processed, the audio processing algorithm scheduling method further includes: and returning to the step of acquiring the automatic feedback control algorithm programs of all the channels written in the current subframe to be processed, and dividing the acquired automatic feedback control algorithm programs into a plurality of groups of algorithm programs with target quantity according to the preset shortening ratio.
Optionally, the initial audio frame comprises a plurality of sub-audio frames; the method comprises the following steps of shortening the frame length of an initial audio frame on multiple channels according to a preset shortening ratio to obtain an audio frame to be processed, and specifically comprises the following steps: and respectively shortening the frame length of each sub audio frame according to a preset shortening proportion, and taking each sub audio frame with the shortened frame length as the audio frame to be processed.
Optionally, before the step of shortening the frame length of the initial audio frame on the multiple channels according to the preset shortening ratio to obtain the audio frame to be processed, the method for scheduling an audio processing algorithm further includes: acquiring an initial audio frame on multiple channels; writing an automatic feedback control algorithm program into a current to-be-processed sub audio frame of the initial audio frame, wherein a subframe corresponding to the current to-be-processed sub audio frame after the frame length of the current to-be-processed sub audio frame is shortened is the current to-be-processed subframe.
Optionally, the acquiring an initial audio frame on multiple channels specifically includes: acquiring a source audio signal input to a multi-channel; and performing framing processing on the source audio signal to obtain an initial audio frame.
Referring to fig. 2, a first embodiment of a scheduling method of an audio processing algorithm includes:
step S202, according to a preset shortening proportion, shortening the frame length of an initial audio frame on multiple channels to obtain an audio frame to be processed; wherein the audio frame to be processed comprises a plurality of sub-frames;
in this embodiment, the audio processing is real-time processing, that is, after the microphone collects the audio signal, the audio signal is input to the audio processor of the embodiment of the present invention, and the audio processor immediately processes the audio signal and then outputs the processed audio signal through the speaker. Specifically, after an initial audio frame is input into the multi-channel audio processor of this embodiment, the audio processor shortens the frame length of the initial audio frame according to a preset shortening ratio, so as to obtain an audio frame to be processed. The preset shortening ratio may be 1/2, that is, the frame length of the initial audio frame is shortened to half of the original frame length, and the preset shortening ratio may also be other suitable ratio values. Furthermore, the resulting audio frame to be processed comprises a plurality of sub-frames.
In an embodiment, the initial audio frame comprises a plurality of sub-audio frames; the step S202 specifically includes: and respectively shortening the frame length of each sub audio frame according to a preset shortening proportion, and taking each sub audio frame with the shortened frame length as the audio frame to be processed.
In this embodiment, the audio processor respectively shortens the frame length of each sub-audio frame of the initial audio frame according to the same preset shortening ratio, so as to obtain a plurality of sub-frames corresponding to the plurality of audio frames one to one. Wherein the plurality of sub-frames constitute an audio frame to be processed.
Referring to fig. 3, in an embodiment, before the step S202, the method for scheduling an audio processing algorithm further includes:
step S302, acquiring an initial audio frame on multiple channels;
the audio processor obtains an initial audio frame from a plurality of channels.
Specifically, referring to fig. 4, in an embodiment, step S302 specifically includes:
step S402, acquiring a source audio signal input to a multi-channel;
the source audio signal is an audio signal collected by a microphone, and is transmitted to multiple channels of an audio processor after the source audio signal is collected by the microphone. In this embodiment, after the audio processor collects the source audio signal, the source audio signal is subjected to preliminary processing, such as noise reduction processing.
Step S404, performing framing processing on the source audio signal to obtain an initial audio frame.
The source audio signal collected by the microphone is a sound signal, the audio processor also performs sound-electricity conversion on the source audio signal to obtain an electric signal, and further performs digital-to-analog conversion on the electric signal to obtain an analog audio signal. Further, the audio processor performs framing processing on the analog audio signal to obtain an initial audio frame including a plurality of sub-audio frames. In the framing process, the frames may be of equal frame length, or may be of unequal frame length.
Step S304, writing an automatic feedback control algorithm program into a current to-be-processed sub audio frame of the initial audio frame, wherein a subframe corresponding to the current to-be-processed sub audio frame after the frame length of the current to-be-processed sub audio frame is shortened is the current to-be-processed subframe.
The audio processor writes an AFC-algorithm program onto the current pending sub-audio frame of the initial audio frame. When the audio processor processes the initial audio frame, the audio processor sequentially processes the sub-audio frames according to the frame sequence, wherein the current sub-audio frame to be processed is the sub-audio frame played to the output port. In an embodiment, the audio processor writes the AFC algorithm program into the current sub-audio frame to be processed, and also writes other audio processing algorithm programs, including an AGC algorithm program, a COM algorithm program, a PEQ algorithm program, a Lim algorithm program, an ANS algorithm program, an automatic remix processing algorithm program, and the like. The algorithm programs sequentially perform audio processing on the currently processed sub-audio frames according to a preset execution sequence.
Step S204, selecting a current subframe to be processed from the plurality of subframes;
the audio processor acquires the current pending subframe in which the AFC algorithm program is written.
Step S206, obtaining the automatic feedback control algorithm programs of all channels written in the current subframe to be processed, and dividing the obtained automatic feedback control algorithm programs into a plurality of groups of algorithm programs with target quantity according to the preset shortening ratio;
in this embodiment, the audio processor is a multi-channel audio processor, the sub-frames to be processed correspond to AFC algorithm programs in each channel, and the AFC algorithm programs in each channel process the sub-frames to be processed. Since the AFC algorithm program is calculated once after accumulating a certain number of audio sampling points, after the frame length of the initial audio frame is shortened, there is a possibility that the audio sampling points required for the AFC algorithm program on each channel to be executed are not accumulated after the subframe to be processed is played, and abnormal phenomena such as execution loss and the like occur when the AFC algorithm program of each channel processes the subframe to be processed. In this embodiment, the audio processor divides AFC algorithm programs of each channel into a plurality of sets of algorithm programs of a target number, leaves one set on a subframe to be processed for processing, and schedules the other sets to subsequent frames of the current subframe to be processed. Wherein the setting of the target number is related to a preset shortening ratio. Specifically, the target number is an integer part of the reciprocal of the preset shortening ratio. For example, if the preset shortening ratio is 1/2, the target number is 2.
Step S208, a group of the algorithm programs is reserved on the current subframe to be processed, the subframes are sorted on the channel according to the frame sequence of the subframes, and the remaining groups of algorithm programs are sequentially scheduled to a plurality of target subframes according to the group from the next subframe of the current subframe to be processed.
And the audio processor reserves a group of algorithm programs on the current subframe to be processed to carry out audio processing on the subframe, sorts the algorithm programs according to frames, and sequentially schedules the rest groups of algorithm programs on a plurality of target subframes behind the current subframe to be processed.
In this embodiment, a to-be-processed audio frame including multiple subframes is obtained by shortening the frame length of an initial audio frame, a current to-be-processed subframe is obtained from the multiple subframes, AFC algorithm programs of channels written in the current to-be-processed subframe are divided into multiple sets of algorithm programs of a target number, and the sets of algorithm programs are sequentially distributed to the current to-be-processed subframe and multiple target subframes after the current to-be-processed subframe through scheduling, so that AFC algorithms on the channels can be executed by distributing to different subframes, smooth execution of the AFC algorithms can be guaranteed, execution time of the current to-be-processed subframe is shortened, the problem of execution abnormality possibly existing in the AFC algorithm programs after the frame length is shortened is solved, delay of audio processing can be effectively reduced by shortening the frame length of the audio frame, and audio processing delay is low.
Referring to fig. 4, in an embodiment, other audio processing algorithm programs besides the automatic feedback control algorithm program are written on the current subframe to be processed; after the step S208, the method for scheduling an audio processing algorithm further includes:
step S402, using the algorithm program reserved by the current subframe to be processed and the other audio processing algorithm programs as algorithms to be operated;
the other audio processing algorithm programs include an AGC algorithm program, a COM algorithm program, a PEQ algorithm program, a Lim algorithm program, an ANS algorithm program, an automatic mixing processing algorithm program, and the like. The audio processor takes all audio processing algorithm programs as algorithms to be run.
And S404, operating the algorithm to be operated according to a preset execution sequence to realize audio processing on the current subframe to be processed.
The preset execution sequence is an execution sequence under a common rule among algorithms. And the audio processor sequentially runs the algorithm to be run according to a preset execution sequence to complete the audio processing of the current subframe to be processed.
Referring to fig. 5, in an embodiment, after the step S404, the method for scheduling an audio processing algorithm further includes:
step S502, when an audio processing algorithm program finishes running, acquiring a processing object frame of the running audio processing algorithm program;
an audio processing algorithm includes the same algorithm processing on multiple channels. When the same audio processing algorithm program on multiple channels is executed, the audio processor acquires the processing object frame of the audio processing algorithm program.
Step S504, regard said next subframe which processes the target frame as the new current subframe to be processed;
and the audio processor takes the next subframe of the processing object frame on multiple channels according to the frame sequence as a new current subframe to be processed.
Step S506, writing the operated audio processing algorithm program into a new current subframe to be processed.
And the audio processor writes the running audio algorithm program into the new current subframe to be processed so as to perform audio processing on the new subframe to be processed when the new subframe to be processed is played.
In an embodiment, the executed audio processing algorithm is an automatic feedback control algorithm, and after step S506, the method for scheduling an audio processing algorithm further includes: returning to the step S206.
After the AFC algorithm programs on the multiple channels are divided into multiple groups of algorithm programs of the target number, the audio processor acquires a new current subframe to be processed, the AFC algorithm programs are written into the new current subframe to be processed, the step S206 is returned to, so that the new current subframe to be processed is grouped in the AFC algorithm programs on the multiple channels, algorithm scheduling is carried out again, cyclic grouping scheduling of the AFC algorithm is achieved, and multi-frame subframes are processed.
Referring to fig. 6, an embodiment of the present invention further provides a scheduling apparatus for an audio processing algorithm, where the scheduling apparatus for an audio processing algorithm includes:
a frame length shortening module 610, configured to shorten a frame length of an initial audio frame on multiple channels according to a preset shortening ratio, and obtain an audio frame to be processed; wherein the audio frame to be processed comprises a plurality of sub-frames;
an obtaining module 620, configured to select a current subframe to be processed from a plurality of subframes;
a grouping module 630, configured to obtain automatic feedback control algorithm programs of each channel written on the current subframe to be processed, and divide the obtained automatic feedback control algorithm programs into multiple sets of algorithm programs of a target number according to the preset reduction ratio;
and the scheduling module 640 is configured to reserve one group of the algorithm programs on the current subframe to be processed, sort the subframes on the channel according to the frame sequence of the subframes, and sequentially schedule the remaining groups of the algorithm programs on a plurality of target subframes in groups from a subframe next to the current subframe to be processed.
In this embodiment, the frame length of the initial audio frame is shortened by the frame length shortening module to obtain an audio frame to be processed including a plurality of subframes, the obtaining module obtains a current subframe to be processed from the plurality of subframes, the grouping module divides AFC algorithm programs of each channel written on the current subframe to be processed into a plurality of sets of algorithm programs of a target number, the scheduling module distributes each set of algorithm programs to the current subframe to be processed and a plurality of target subframes after the current subframe to be processed by scheduling in sequence, so that the AFC algorithm on each channel can be executed by being dispersed to different sub-frames, the AFC algorithm can be ensured to be executed smoothly, meanwhile, the execution time of the current subframe to be processed is shortened, the problem of execution abnormity possibly existing in an AFC algorithm program after the frame length is shortened is solved, the audio processing delay can be effectively reduced by shortening the audio frame length, and the audio processing delay is low.
Optionally, other audio processing algorithm programs except for the automatic feedback control algorithm program are written in the current subframe to be processed; the scheduling apparatus of the audio processing algorithm further comprises: the algorithm execution module is used for taking the algorithm program reserved by the current subframe to be processed and the other audio processing algorithm programs as algorithms to be operated; and running the algorithm to be run according to a preset execution sequence to realize audio processing on the current subframe to be processed.
Optionally, the scheduling apparatus of the audio processing algorithm further includes: the algorithm writing module is used for acquiring a processing object frame of an audio processing algorithm program after the operation of the audio processing algorithm program is finished; taking the next subframe of the processing object frame as a new current subframe to be processed; and writing the operated audio processing algorithm program into a new current subframe to be processed.
Optionally, the running audio processing algorithm program is an automatic feedback control algorithm program, and the scheduling device for the audio processing algorithm further includes: and the return module is used for returning to the step of acquiring the automatic feedback control algorithm programs of all the channels written in the current subframe to be processed after the operated audio processing algorithm program is written in the new current subframe to be processed, and dividing the acquired automatic feedback control algorithm programs into a plurality of groups of algorithm programs with target quantity according to the preset shortening ratio.
Optionally, the initial audio frame comprises a plurality of sub-audio frames; the frame length shortening module 610 is further configured to respectively shorten the frame length of each sub audio frame according to a preset shortening ratio, and use each sub audio frame after the frame length is shortened as the audio frame to be processed.
Optionally, the frame length shortening module 610 is further configured to obtain an initial audio frame on multiple channels; writing an automatic feedback control algorithm program into a current to-be-processed sub audio frame of the initial audio frame, wherein a subframe corresponding to the current to-be-processed sub audio frame after the frame length of the current to-be-processed sub audio frame is shortened is the current to-be-processed subframe.
Optionally, the frame length shortening module 610 is further configured to obtain a source audio signal input to the multiple channels; and performing framing processing on the source audio signal to obtain an initial audio frame.
In addition, an embodiment of the present invention further provides an audio processor, where the audio processor includes: a memory, a processor and a scheduler of an audio processing algorithm stored on the memory and executable on the processor, the scheduler of the audio processing algorithm implementing the steps of the scheduling method embodiment of the audio processing algorithm as described above when executed by the processor.
In addition, an embodiment of the present invention further provides a storage medium, where a scheduling program of an audio processing algorithm is stored on the storage medium, and the scheduling program of the audio processing algorithm, when executed by a processor, implements the steps of the foregoing scheduling method embodiment of the audio processing algorithm.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on this understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for causing an audio processor to execute the methods according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A method for scheduling an audio processing algorithm, the method comprising:
according to a preset shortening proportion, shortening the frame length of an initial audio frame on multiple channels to obtain an audio frame to be processed; wherein the audio frame to be processed comprises a plurality of sub-frames;
selecting a current subframe to be processed from a plurality of subframes;
acquiring automatic feedback control algorithm programs of all channels written in the current subframe to be processed, and dividing the acquired automatic feedback control algorithm programs into a plurality of groups of algorithm programs with target quantity according to the preset shortening ratio;
and reserving one group of the algorithm programs on the current subframe to be processed, sequencing the subframes on a channel according to the frame sequence of the subframes, and sequentially scheduling the remaining groups of the algorithm programs on a plurality of target subframes according to the group from the next subframe of the current subframe to be processed.
2. The method for scheduling audio processing algorithms according to claim 1, wherein other audio processing algorithm programs than the automatic feedback control algorithm program are written on the current subframe to be processed;
after the step of reserving one group of the algorithm programs on the current subframe to be processed, sequencing the remaining groups of the algorithm programs on a plurality of target subframes in groups in sequence from the next subframe of the current subframe to be processed according to the frame sequence of the subframes on the channel, the scheduling method of the audio processing algorithm further comprises the following steps:
taking the algorithm program reserved for the current subframe to be processed and the other audio processing algorithm programs as algorithms to be operated;
and running the algorithm to be run according to a preset execution sequence to realize audio processing on the current subframe to be processed.
3. The method for scheduling an audio processing algorithm according to claim 2, wherein after the step of executing the algorithm to be executed according to the preset execution sequence to perform audio processing on the current subframe to be processed, the method for scheduling an audio processing algorithm further comprises:
when an audio processing algorithm program finishes running, acquiring a processing object frame of the running audio processing algorithm program;
taking the next subframe of the processing object frame as a new current subframe to be processed;
and writing the operated audio processing algorithm program into a new current subframe to be processed.
4. The method for scheduling audio processing algorithms according to claim 3, wherein the executed audio processing algorithm is an automatic feedback control algorithm, and after the step of writing the executed audio processing algorithm into the new current subframe to be processed, the method for scheduling audio processing algorithms further comprises:
and returning to the step of acquiring the automatic feedback control algorithm programs of all the channels written in the current subframe to be processed, and dividing the acquired automatic feedback control algorithm programs into a plurality of groups of algorithm programs with target quantity according to the preset shortening ratio.
5. The method of scheduling of audio processing algorithms of claim 1 wherein said initial audio frame comprises a plurality of sub-audio frames;
the method comprises the following steps of shortening the frame length of an initial audio frame on multiple channels according to a preset shortening ratio to obtain an audio frame to be processed, and specifically comprises the following steps:
and respectively shortening the frame length of each sub audio frame according to a preset shortening proportion, and taking each sub audio frame with the shortened frame length as the audio frame to be processed.
6. The method for scheduling an audio processing algorithm according to claim 5, wherein before the step of shortening the frame length of the initial audio frame on multiple channels according to the preset shortening ratio to obtain the audio frame to be processed, the method for scheduling an audio processing algorithm further comprises:
acquiring an initial audio frame on multiple channels;
writing an automatic feedback control algorithm program into a current to-be-processed sub audio frame of the initial audio frame, wherein a subframe corresponding to the current to-be-processed sub audio frame after the frame length of the current to-be-processed sub audio frame is shortened is the current to-be-processed subframe.
7. The method for scheduling of audio processing algorithms according to claim 6, wherein said obtaining an initial audio frame over multiple channels specifically comprises:
acquiring a source audio signal input to a multi-channel;
and performing framing processing on the source audio signal to obtain an initial audio frame.
8. An apparatus for scheduling audio processing algorithms, the apparatus comprising:
the frame length shortening module is used for shortening the frame length of the initial audio frame on multiple channels according to a preset shortening proportion to obtain an audio frame to be processed; wherein the audio frame to be processed comprises a plurality of sub-frames;
the acquisition module is used for selecting a current subframe to be processed from a plurality of subframes;
the grouping module is used for acquiring the automatic feedback control algorithm programs of all channels written in the current subframe to be processed and dividing the acquired automatic feedback control algorithm programs into a plurality of groups of algorithm programs with target quantity according to the preset shortening ratio;
and the scheduling module is used for reserving one group of the algorithm programs on the current subframe to be processed, sequencing the subframes on a channel according to the frame sequence of the subframes, and sequentially scheduling the remaining groups of the algorithm programs on a plurality of target subframes according to the group from the next subframe of the current subframe to be processed.
9. An audio processor, characterized in that the audio processor comprises: memory, a processor and a scheduler of audio processing algorithms stored on the memory and executable on the processor, the scheduler of audio processing algorithms implementing the steps of the scheduling method of audio processing algorithms according to any of claims 1 to 7 when executed by the processor.
10. A storage medium having stored thereon a scheduler for an audio processing algorithm, which scheduler for the audio processing algorithm when executed by a processor performs the steps of the scheduling method for the audio processing algorithm according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910910143.9A CN110620986B (en) | 2019-09-24 | 2019-09-24 | Scheduling method and device of audio processing algorithm, audio processor and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910910143.9A CN110620986B (en) | 2019-09-24 | 2019-09-24 | Scheduling method and device of audio processing algorithm, audio processor and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110620986A CN110620986A (en) | 2019-12-27 |
| CN110620986B true CN110620986B (en) | 2020-12-15 |
Family
ID=68924063
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910910143.9A Active CN110620986B (en) | 2019-09-24 | 2019-09-24 | Scheduling method and device of audio processing algorithm, audio processor and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110620986B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111767020A (en) * | 2020-05-18 | 2020-10-13 | 深圳市东微智能科技股份有限公司 | Method, device and terminal for optimizing audio processing and readable storage medium |
| CN117527771B (en) * | 2024-01-05 | 2024-03-29 | 深圳旷世科技有限公司 | Audio transmission method and device, storage medium and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1248824A (en) * | 1998-09-17 | 2000-03-29 | 松下电器产业株式会社 | Audio signal coding device and method, decoding device and method |
| CN1199475C (en) * | 1999-12-30 | 2005-04-27 | 皇家菲利浦电子有限公司 | Method and apparatus for converting data streams |
| CN1689372A (en) * | 2001-09-29 | 2005-10-26 | 格伦迪希多媒体公司 | Method and device for selecting a sound algorithm |
| EP2355548A2 (en) * | 2009-12-29 | 2011-08-10 | GN ReSound A/S | A method for the detection of whistling in an audio system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10178489B2 (en) * | 2013-02-08 | 2019-01-08 | Qualcomm Incorporated | Signaling audio rendering information in a bitstream |
-
2019
- 2019-09-24 CN CN201910910143.9A patent/CN110620986B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1248824A (en) * | 1998-09-17 | 2000-03-29 | 松下电器产业株式会社 | Audio signal coding device and method, decoding device and method |
| CN1199475C (en) * | 1999-12-30 | 2005-04-27 | 皇家菲利浦电子有限公司 | Method and apparatus for converting data streams |
| CN1689372A (en) * | 2001-09-29 | 2005-10-26 | 格伦迪希多媒体公司 | Method and device for selecting a sound algorithm |
| EP2355548A2 (en) * | 2009-12-29 | 2011-08-10 | GN ReSound A/S | A method for the detection of whistling in an audio system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110620986A (en) | 2019-12-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10834503B2 (en) | Recording method, recording play method, apparatuses, and terminals | |
| CN105448312B (en) | Audio sync playback method, apparatus and system | |
| CN110620986B (en) | Scheduling method and device of audio processing algorithm, audio processor and storage medium | |
| CN107431871B (en) | audio signal processing apparatus and method for filtering audio signal | |
| JP2020003774A (en) | Method and apparatus for processing speech | |
| EP2830327A1 (en) | Audio processor for orientation-dependent processing | |
| CN111258530B (en) | Audio playing control method, server and audio playing system | |
| WO2010105695A1 (en) | Multi channel audio coding | |
| CN109697987B (en) | External far-field voice interaction device and implementation method | |
| CN117693791A (en) | Speech enhancement | |
| US20160066116A1 (en) | Using single bitstream to produce tailored audio device mixes | |
| CN111768791B (en) | Audio playing method and device and vehicle | |
| CN104392744A (en) | Method and apparatus for recording voice frequency | |
| CN103794216A (en) | Voice audio mixing processing method and device | |
| WO2016082579A1 (en) | Voice output method and apparatus | |
| CN110677208B (en) | Sound mixing method and system for conference system | |
| CN109901811A (en) | Applied to the sound mixing method and device in digitlization court's trial | |
| US20220392462A1 (en) | Multichannel audio encode and decode using directional metadata | |
| CN111951821B (en) | Communication method and device | |
| CN114495941A (en) | Method and device for converting single-channel audio into text, electronic equipment and storage medium | |
| US9936077B2 (en) | Methods for the encoding of participants in a conference | |
| CN107426611B (en) | multi-path output method and system based on video transcoding | |
| CN106341519B (en) | Audio data processing method and device | |
| US11922234B2 (en) | Multi-agent ring-buffer | |
| CN110910892A (en) | Conference system terminal, audio data processing method and teleconference system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 518000 R & D building 1601, block a, building 7, Vanke Cloud City Phase I, Xingke 1st Street, Xili community, Xili street, Nanshan District, Shenzhen City, Guangdong Province (16 / F, block a, building 1, international innovation Valley) Patentee after: SHENZHEN TENDZONE INTELLIGENT TECHNOLOGY Co.,Ltd. Address before: Room 401, Block D, Huahan Innovation Park, 16 Longshan Road, North District, Xili Street, Nanshan District, Shenzhen City, Guangdong Province, 518000 Patentee before: SHENZHEN TENDZONE INTELLIGENT TECHNOLOGY Co.,Ltd. |
|
| EE01 | Entry into force of recordation of patent licensing contract | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20191227 Assignee: Shandong East Microelectronics Co.,Ltd. Assignor: SHENZHEN TENDZONE INTELLIGENT TECHNOLOGY Co.,Ltd. Contract record no.: X2022440000242 Denomination of invention: Scheduling method, device, audio processor and storage medium of audio processing algorithm Granted publication date: 20201215 License type: Common License Record date: 20221018 Application publication date: 20191227 Assignee: Henan Dongwei Software Technology Co.,Ltd. Assignor: SHENZHEN TENDZONE INTELLIGENT TECHNOLOGY Co.,Ltd. Contract record no.: X2022440000241 Denomination of invention: Scheduling method, device, audio processor and storage medium of audio processing algorithm Granted publication date: 20201215 License type: Common License Record date: 20221018 Application publication date: 20191227 Assignee: Yunnan Dongwei Technology Co.,Ltd. Assignor: SHENZHEN TENDZONE INTELLIGENT TECHNOLOGY Co.,Ltd. Contract record no.: X2022440000243 Denomination of invention: Scheduling method, device, audio processor and storage medium of audio processing algorithm Granted publication date: 20201215 License type: Common License Record date: 20221018 |