CN114900775A

CN114900775A - Audio playing optimization method and device, electronic equipment and readable storage medium

Info

Publication number: CN114900775A
Application number: CN202210504753.0A
Authority: CN
Inventors: 薛震; 刘天宇
Original assignee: Shenzhen Skyworth RGB Electronics Co Ltd
Current assignee: Shenzhen Skyworth RGB Electronics Co Ltd
Priority date: 2022-05-10
Filing date: 2022-05-10
Publication date: 2022-08-12

Abstract

The application discloses an audio playing optimization method, an audio playing optimization device, electronic equipment and a readable storage medium, which are applied to the technical field of sound processing, wherein the audio playing optimization method comprises the following steps: acquiring audio data to be downmixed, and downmixing the audio data to be downmixed according to an initial debugging downmixing coefficient to obtain downmixed audio data; playing audition audio corresponding to the down-mixed audio data, and receiving feedback information of a user to the audition audio; performing iterative debugging on the initial debugging down-mixing coefficient according to the feedback information until the debugged initial debugging down-mixing coefficient is detected to have a preset sound effect; and taking the initial debugging down-mixing coefficient as a target down-mixing coefficient, and playing audio according to the target down-mixing coefficient. The method and the device solve the technical problem that the optimization effect of optimizing the multi-channel audio effect into the stereo surround effect is poor.

Description

Audio playing optimization method and device, electronic equipment and readable storage medium

Technical Field

The present application relates to the field of sound processing technologies, and in particular, to an audio playing optimization method and apparatus, an electronic device, and a readable storage medium.

Background

With the continuous development of smart tvs, users have higher and higher requirements for sound when watching smart tvs, for example, users want the sound effect of smart tvs to be better than the multi-channel stereo surround sound effect of shoulder home theaters, but the sound effect of smart tvs is usually multi-channel sound, if direct pull-up configuration will greatly increase the cost, and if the multi-channel audio sound effect is to be optimized to be stereo surround sound, the multi-channel audio sound is usually debugged by channel mapping or according to ATSC (Advanced Television systems Committee) standard down-mixing formula, but if the sound effects such as AC3 and DTS are mapped to the left and right channels of smart tvs, white sound is lost due to lack of a center channel, if the multi-channel is down-mixed to two channels by the standard down-mixing formula, uniform parameters cannot meet the sound effect requirements of each user, for example, some users want sound details to be sufficiently preserved, and some users want to be able to make the white sound clearer, so the current technology optimizes the multi-channel audio effect to the stereo surround effect with poor optimization effect.

Disclosure of Invention

The present application mainly aims to provide an audio playing optimization method, an audio playing optimization device, an electronic device, and a readable storage medium, and aims to solve the technical problem in the prior art that the optimization effect of optimizing a multi-channel audio effect into a stereo surround effect is poor.

In order to achieve the above object, the present application provides an audio playback optimization method, where the audio playback optimization method includes:

acquiring audio data to be downmixed, and downmixing the audio data to be downmixed according to an initial debugging downmixing coefficient to obtain downmixed audio data;

playing audition audio corresponding to the down-mixed audio data, and receiving feedback information of a user to the audition audio;

performing iterative debugging on the initial debugging down-mixing coefficient according to the feedback information until the debugged initial debugging down-mixing coefficient is detected to have a preset sound effect;

and taking the debugged initial debugging down-mixing coefficient as a target down-mixing coefficient, and playing audio according to the target down-mixing coefficient.

Optionally, the step of iteratively debugging the initially debugged down-mix coefficient according to the feedback information until it is detected that the debugged initially debugged down-mix coefficient has a preset sound effect includes:

detecting whether the initial debugging down-mixing coefficient has the preset sound effect or not according to the feedback information;

if so, taking the initial debugging down-mixing coefficient as the debugged initial debugging down-mixing coefficient;

if not, debugging the initial debugging down-mixing coefficient according to the feedback information, and returning to the execution step: and carrying out down mixing on the audio data to be down mixed according to the initial debugging down mixing coefficient to obtain the down mixed audio data.

Optionally, the step of detecting whether the initial debugging downmix coefficient has the preset sound effect according to the feedback information includes:

if the feedback information is the feedback information of the non-debugging type, detecting that the debugged initial debugging down-mixing coefficient has the preset sound effect;

and if the feedback information is debugging type feedback information, detecting that the debugged initial debugging down-mixing coefficient does not have the preset sound effect.

Optionally, the initial debugging downmix coefficient comprises a first initial debugging downmix coefficient,

the step of debugging the initial debugging down-mix coefficient to obtain the debugged initial debugging down-mix coefficient comprises the following steps:

acquiring a preset initial debugging down mixing coefficient according to the acquired down mixing coefficient coarse adjustment instruction;

and replacing the first initial debugging down mixing coefficient with the preset initial debugging down mixing coefficient to obtain the debugged initial debugging down mixing coefficient.

Optionally, the initial debugging downmix coefficient comprises a second initial debugging downmix coefficient,

replacing the second initial debugging down-mixing coefficient according to the obtained down-mixing coefficient fine tuning instruction;

and taking the replaced second initial debugging down-mixing coefficient as the debugged initial debugging down-mixing coefficient.

Optionally, the step of playing audio according to the target down-mix coefficient includes:

down-mixing the audio data to be down-mixed according to the target down-mixing coefficient to obtain target audio data;

acquiring volume data corresponding to the target audio data, and debugging the volume data to the target volume data with a preset sound effect;

and carrying out audio playing according to the target volume data and the target audio data.

Optionally, the down-mixing the audio data to be down-mixed according to the initial debugging down-mixing coefficient to obtain the down-mixed audio data includes:

down-mixing the audio data to be down-mixed according to the initial debugging down-mixing coefficient to obtain preliminary down-mixed audio data;

and adding preset bass audio data to the preliminary down-mixed audio data to obtain the down-mixed audio data.

In order to achieve the above object, the present application further provides an audio playback optimizing apparatus, including:

the device comprises an acquisition module, a down-mixing module and a down-mixing module, wherein the acquisition module is used for acquiring audio data to be down-mixed, and down-mixing the audio data to be down-mixed according to an initial debugging down-mixing coefficient to obtain down-mixed audio data;

the audition module is used for playing audition audio corresponding to the down-mixed audio data and receiving feedback information of a user to the audition audio;

the debugging module is used for carrying out iterative debugging on the initial debugging down-mixing coefficient according to the feedback information until the debugging initial debugging down-mixing coefficient is detected to have a preset sound effect;

and the playing module is used for taking the initial debugging down-mixing coefficient as a target down-mixing coefficient and playing audio according to the target down-mixing coefficient.

Optionally, the debugging module is further configured to:

if not, debugging the initial debugging down-mixing coefficient according to the feedback information, and returning to the execution step: and downmixing the audio data to be downmixed according to the initial debugging downmixing coefficient to obtain the downmixed audio data.

Optionally, the debugging module is further configured to:

if the feedback information is the non-debugging type feedback information, detecting that the debugged initial debugging down-mixing coefficient has the preset sound effect;

Optionally, the initial debugging downmix coefficients comprises first initial debugging downmix coefficients, and the debugging module is further configured to:

Optionally, the initial debugging downmix coefficients comprises second initial debugging downmix coefficients, and the debugging module is further configured to:

Optionally, the playing module is further configured to:

Optionally, the downmix module is further configured to:

The present application further provides an electronic device, the electronic device including: a memory, a processor and a program of the audio playback optimization method stored on the memory and executable on the processor, the program of the audio playback optimization method when executed by the processor implementing the steps of the audio playback optimization method as described above.

The present application also provides a computer-readable storage medium having stored thereon a program for implementing an audio playback optimization method, which when executed by a processor implements the steps of the audio playback optimization method as described above.

The present application also provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of the audio playback optimization method as described above.

The application provides an audio playing optimization method, an audio playing optimization device, an electronic device and a readable storage medium, namely, audio data to be downmixed are obtained, and are downmixed according to an initial debugging downmixing coefficient, so that the downmixed audio data are obtained; that is, down-mixing multi-channel audio data to be down-mixed into dual-channel down-mixed audio data by initially debugging down-mixing coefficients; playing trial listening audio corresponding to the down-mixed audio data and receiving feedback information of the user on the trial listening audio; that is, feedback information of audition audio corresponding to the down-mixed audio data of the two channels by the user is obtained, and then the initial debugging down-mixing coefficient is iteratively debugged according to the feedback information until the debugged initial debugging down-mixing coefficient is detected to have a preset sound effect; namely, the sound effect presented by the audio data of the two channels is judged, whether the audition audio is the audio meeting the user expectation is judged, the debugged initial debugging down-mixing coefficient is used as the target down-mixing coefficient, and the audio is played according to the target down-mixing coefficient. The method can realize the purpose of freely debugging the down-mixing coefficient of the multi-channel on the intelligent equipment until the debugged down-mixing coefficient is the target down-mixing coefficient with the preset sound effect, namely, the debugged down-mixing coefficient is down-mixed with the audio data of the multi-channel to achieve the sound effect expected by a user and further play the corresponding audio, namely, the purpose of optimizing the multi-channel audio data into the stereo surround sound effect of the user psychoscope is realized, so that the user does not need to worry that the stereo sound effect presented after the down-mixing lacks sound details or corresponding sounds and the like due to the unified processing of the audio data of the multi-channel during the down-mixing, but can obtain the sound effect of the psychoscope through the simple interaction between the user and the intelligent equipment, and the technical defect of poor optimization effect of optimizing the multi-channel audio effect into the stereo surround sound effect through the modes of channel mapping or a standard down-mixing formula and the like in the prior art is overcome, therefore, the debugging effect of optimizing the multi-channel audio effect into the stereo surround effect is improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and, together with the description, serve to explain the principles of the application.

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.

Fig. 1 is a schematic flowchart illustrating a first embodiment of an audio playback optimization method according to the present application;

FIG. 2 is a flowchart illustrating a second embodiment of an audio playback optimization method according to the present application;

fig. 3 is a schematic device structure diagram of a hardware operating environment related to an audio playback optimization method in an embodiment of the present application.

The objectives, features, and advantages of the present application will be further described with reference to the accompanying drawings.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Example one

First, it should be understood that if a user wants to experience stereo surround sound effect on a smart device, a plurality of speakers are usually required to be configured, for example, dolby 5.1 channels have a center channel, front left and right channels, rear left and right surround channels, and a subwoofer channel, and 7.1 channels are more added to the center channel and the middle right channel, but the configuration increase means cost increase, and for most users, the configuration of the commonly used smart device is difficult to achieve the above requirements, for example, assuming that the smart device of the user is 2.0 channels, if the user wants to experience sound effect of 5.1 channels, multi-channel sound effect needs to be converted into stereo sound effect of two channels, and at present, a channel mapping and debugging according to a standard down-mixing formula are usually adopted, namely, the center channel, the front left channel, and the rear channel are mixed into a left channel, the center channel, the front right channel and the rear right channel are mixed into the right channel, however, the method may cause the sound effect of the center channel to be lost, the latter is to mix the multi-channel audio data down to the audio data of the two channels, but because the down-mixing coefficient of the standard down-mixing formula is unified, and then the stereo sound presented after down-mixing cannot meet the requirements of all users, meanwhile, the down-mixing process may also cause the loss of sound details, that is, the optimization effect of optimizing the multi-channel audio sound effect into the stereo surround sound effect in the prior art is poor, so there is an urgent need for an audio playing optimization method that improves the debugging effect of optimizing the multi-channel audio sound effect into the stereo surround sound effect.

In a first embodiment of the audio playing optimization method, referring to fig. 1, the audio playing optimization method includes:

step S10, acquiring audio data to be down-mixed, and down-mixing the audio data to be down-mixed according to an initial debugging down-mixing coefficient to obtain down-mixed audio data;

in this embodiment, it should be noted that the audio playing optimization method is applied to an intelligent device, the intelligent device is an audio playing device that cannot autonomously generate a stereo surround sound effect, and specifically may be a smart television, a display, a box, a projector, a car machine, a tablet computer, a smart phone, and the like, the audio data to be downmixed is obtained by an audio playing optimization instruction input by a user, the audio playing optimization instruction is an instruction for optimizing a sound effect of the intelligent device to the stereo surround sound effect, and can be triggered and generated by a triggering operation of the user, for example, it is detected that the user performs a button click operation or inputs a keyboard instruction, and the like.

Additionally, it should be noted that the audio data to be downmixed is audio data to be downmixed, that is, initial audio data, specifically, audio data of a preset number of channels that the smart device has, for example, assuming that the smart device has X, Y and Z channels, audio data of channel X, audio data of channel Y, and audio data of channel Z are collected respectively and collectively used as the audio data to be downmixed.

In addition, it should be noted that the initial debugging down-mix coefficient corresponds to the audio data to be down-mixed and is used for down-mixing multi-channel audio data to be down-mixed, wherein a down-mix formula formed by the initial debugging down-mix coefficient is used for down-mixing multi-channel audio data to be down-mixed into two-channel down-mixed audio data, and specifically, an electroacoustic engineer modifies a down-mix coefficient corresponding to each audio data to be down-mixed in a standard down-mix formula according to professional standards, so the initial debugging down-mix coefficient is a down-mix coefficient modified by a user in the standard down-mix formula, wherein the initial debugging down-mix coefficient includes a modified down-mix coefficient and an unmodified down-mix coefficient, the modified down-mix coefficient is a down-mix coefficient modified by the electroacoustic engineer according to professional experience, and the unmodified down-mix coefficient is a normal down-mix coefficient in the standard down-mix formula, in an implementable manner, it is assumed that the audio data to be downmixed includes audio data of a channel a, audio data of a channel B, audio data of a channel C, audio data of a channel D, and audio data of a channel E, where a conventional downmix coefficient corresponding to the audio data of the channel a in a standard downmix formula is a, and based on the above, the audio data of the channel B corresponds to a conventional downmix coefficient B, the audio data of the channel C corresponds to a conventional downmix coefficient C, the audio data of the channel D corresponds to a conventional downmix coefficient D, and the audio data of the channel E corresponds to a conventional downmix coefficient E, and if an electroacoustic engineer adjusts the conventional downmix coefficient C to m and the conventional coefficient E to n according to professional experience, the conventional downmix coefficient a, the conventional downmix coefficient B, the conventional downmix coefficient D, the adjusted downmix coefficient m, and the adjusted downmix coefficient n are taken together as an initial debug downmix coefficient, the modified down-mixing coefficients are the down-mixing coefficients corresponding to the audio data of the channel C and the down-mixing coefficients corresponding to the audio data of the channel E, and the unmodified down-mixing coefficients are the conventional down-mixing coefficient a, the conventional down-mixing coefficient b and the conventional down-mixing coefficient d, wherein specific values of the down-mixing coefficients may be 0.1, 0.2 and 0.3, and so on.

In addition, it should be noted that, since the initially adjusted downmix coefficients are specific to the electroacoustic engineers for setting the audio coefficients of each channel according to the professional experience, that is, the audio data after the downmix is performed according to the initially adjusted downmix coefficients, the requirement of most users for the expected sound effect can be satisfied, that is, the initial debugging down-mixing coefficient can be a down-mixing coefficient with a preset sound effect, or a down-mixing coefficient which still needs to be debugged by a user according to the self-demand, when the audio data of a multi-channel is down-mixed by a standard down-mixing formula, the audio data of a bass channel can be selectively abandoned, thereby the sound effect presented by the audio data after down mixing is hard to reach the expectation of the user, and further the bass data stream is required to be added after down mixing to reduce the down mixing loss, therefore, the down-mixed audio data is down-mixed audio data to which the bass audio data is added.

As an example, step S10 includes: the method comprises the steps of obtaining an audio playing optimization instruction input by a user, obtaining audio data of a preset number of channels according to the audio playing optimization instruction, using the audio data of each channel as audio data to be downmixed together, obtaining a modified downmixing coefficient in a standard downmixing formula, using the modified downmixing coefficient as an initial debugging downmixing coefficient, and downmixing the audio data to be downmixed according to a preset downmixing formula of the initial debugging downmixing coefficient to obtain the downmixed audio data, wherein the preset number can be 1, 2 or 3 and the like.

Wherein, according to the initial debugging downmix coefficient, the downmix is performed on the audio data to be downmixed, and the step of obtaining the downmix audio data includes:

step A10, down-mixing the audio data to be down-mixed according to the initial debugging down-mixing coefficient to obtain preliminary down-mixed audio data;

step a20, adding preset bass audio data to the preliminary down-mixed audio data to obtain the down-mixed audio data.

As an example, the steps a10 to a20 include: down-mixing the audio data to be down-mixed according to a preset down-mixing formula of the initial debugging down-mixing coefficient to obtain preliminary down-mixing audio data, wherein the preliminary down-mixing audio data is the audio data after down-mixing; and adding preset bass audio data to the preliminary downmixed audio data to obtain the downmixed audio data, wherein the preset bass audio data is preset by an electroacoustic engineer according to professional experience and is used for increasing bass data flow in mixed sound.

Step S20, playing audition audio corresponding to the down-mixed audio data, and receiving feedback information of the user to the audition audio;

step S30, performing iterative debugging on the initial debugging down mixing coefficient according to the feedback information until the debugged initial debugging down mixing coefficient is detected to have a preset sound effect;

in this embodiment, it should be noted that the trial listening audio is generated by the audio data after the downmix that the initial debugging downmix coefficient corresponds to for the user to check whether the sound effect under the initial downmix coefficient is the expected sound effect, the feedback information is the feedback information that the user gave according to the trial listening audio, specifically including being used for instructing the initial debugging downmix coefficient is for possessing the information of presetting the sound effect and being used for instructing the information that generates the downmix coefficient debugging instruction, wherein, the downmix coefficient debugging instruction is used for debugging the initial debugging downmix coefficient is used for instructing the initial debugging downmix coefficient is for possessing the information of presetting the sound effect specifically can be for not detecting the user input operation instruction in the preset time period.

As an example, the steps S20 to S30 include: playing audition audio corresponding to the down-mixed audio data, and receiving feedback information of a user to the audition audio; if the feedback information is information for indicating that the initial debugging downmix coefficient is the preset sound effect, the iterative debugging is not carried out on the initial debugging downmix coefficient, the initial debugging downmix coefficient is taken as the debugged initial debugging downmix coefficient, and if the feedback information is information for indicating that the downmix coefficient debugging instruction is generated, the iterative debugging is carried out on the initial debugging downmix coefficient according to the feedback information until the debugged initial debugging downmix coefficient is detected to have the preset sound effect.

The initial debugging down mixing coefficient is iteratively debugged according to the feedback information, and the step of detecting that the debugged initial debugging down mixing coefficient has the preset sound effect comprises the following steps:

step B10, detecting whether the initial debugging down mixing coefficient has the preset sound effect according to the feedback information;

step B20, if yes, taking the initial debugging down-mixing coefficient as the debugged initial debugging down-mixing coefficient;

step B30, if not, debugging the initial debugging down-mixing coefficient according to the feedback information, and returning to the execution step: and downmixing the audio data to be downmixed according to the initial debugging downmixing coefficient to obtain the downmixed audio data.

In this embodiment, it should be noted that the debugged initial down-mix coefficient may specifically be an initial down-mix coefficient obtained by debugging one or more coefficients of the initial down-mix coefficients, for example, assuming that there are initial debugged down-mix coefficients composed of f, g, and h in a preset down-mix formula, and debugging one or more coefficients of f, g, and h according to a down-mix coefficient debugging instruction, it may be considered that the initial down-mix coefficient is debugged to be the debugged initial down-mix coefficient, and the debugged audio data is obtained by down-mixing the to-be-down-mixed audio data with the debugged down-mix coefficient.

As an example, the steps B10 to B30 include: detecting whether the initial debugging down-mixing coefficient has a preset sound effect or not according to the feedback information; if the feedback information is information for indicating that the initial debugging down-mixing coefficient is a target down-mixing coefficient with a preset sound effect, judging that the initial debugging down-mixing coefficient has the preset sound effect, and setting the initial debugging down-mixing coefficient as the debugged initial debugging down-mixing coefficient; if the feedback information is information for indicating generation of a down-mixing coefficient debugging instruction, judging that the initial debugging down-mixing coefficient does not have a preset sound effect, and returning to the execution step: and downmixing the audio data to be downmixed according to the initial debugging downmixing coefficient to obtain the downmixed audio data.

Wherein, the step of detecting whether the initial debugging down-mix coefficient has the preset sound effect according to the feedback information comprises:

step C10, if the feedback information is the feedback information of the non-debugging type, detecting that the debugged initial debugging down mixing coefficient has the preset sound effect;

and step C20, if the feedback information is debugging type feedback information, detecting that the debugged initial debugging down mixing coefficient does not have the preset sound effect.

In this embodiment, it should be noted that the information type of the feedback information includes non-debugging type feedback information and debugging type feedback information, where the non-debugging type feedback information is information that the initial debugging downmix coefficient is not debugged, and the debugging type feedback information is information that the initial debugging downmix coefficient is continuously debugged.

As an example, the step C10 to the step C20 include: if the feedback information is information that the initial debugging down mixing coefficient is not debugged, detecting that the debugged initial debugging down mixing coefficient has the preset sound effect; and if the feedback information is the information for continuously debugging the initial debugging down mixing coefficient, detecting that the debugged initial debugging down mixing coefficient does not have the preset sound effect.

The initial debugging downmix coefficient comprises a first initial debugging downmix coefficient, and the step of debugging the initial debugging downmix coefficient to obtain the debugged initial debugging downmix coefficient comprises the following steps:

step D10, obtaining a preset initial debugging down mixing coefficient according to the obtained down mixing coefficient coarse adjustment instruction;

and D20, replacing the first initial debugging down mixing coefficient with the preset initial debugging down mixing coefficient to obtain the debugged initial debugging down mixing coefficient.

In this embodiment, it should be noted that the first initial debugging downmix coefficient includes a downmix coefficient corresponding to audio data of a white-related channel and an initial debugging downmix coefficient corresponding to audio data of a background-related channel, and the preset initial debugging downmix coefficient is a debugging downmix coefficient corresponding to a user triggered downmix coefficient rough adjusting instruction, where the downmix coefficient rough adjusting instruction is a mode selecting instruction, the white-related channel is a channel associated with "white sound" on the smart device, the background-related channel is a channel associated with "background sound" on the smart device, for example, in an implementable manner, when the user clicks an "audio playback optimization setting" button on a preset display interface of the smart device, the preset display interface pops up three mix mode selection buttons of "high", "low" and "medium", when a user modifies any mode, the user can determine that a downmix coefficient rough adjusting instruction is triggered, and then different downmix coefficient rough adjusting instructions have debugging downmix coefficients preset by an electroacoustic engineer, wherein the preset debugging downmix coefficients comprise a first initial debugging downmix coefficient modified along with the mode and other debugging downmix coefficients which are not modified.

As an example, the steps D10 to D20 include: the method comprises the steps of obtaining a down-mixing coefficient rough adjusting instruction input by a user, replacing a down-mixing coefficient corresponding to audio data of a white sound related channel and an initial debugging down-mixing coefficient corresponding to audio data of a background sound related channel with a preset initial debugging down-mixing coefficient according to the down-mixing coefficient rough adjusting instruction, and obtaining the debugged initial debugging down-mixing coefficient, wherein the down-mixing coefficient rough adjusting instruction can be triggered by detecting that the user performs button clicking operation or inputs a keyboard instruction.

And step S40, taking the debugged initial debugging down-mixing coefficient as a target down-mixing coefficient, and playing audio according to the target down-mixing coefficient.

In this embodiment, it should be noted that the target down-mixing coefficient is a down-mixing coefficient with a preset sound effect, and the audio playing mode may be an audio preview mode or an audio online playing mode.

As an example, step S40 includes: and taking the debugged initial debugging down-mixing coefficient as a target down-mixing coefficient, and playing audio according to the target down-mixing coefficient. Because the audition audio that the target down-mixing coefficient corresponds satisfies the audio effect that the user expects, that is, the initial debugging down-mixing coefficient after electroacoustic engineer debugs according to professional experience has realized optimizing multichannel audio effect for the purpose of stereo surround audio to the audio effect that presents is the audio effect of user's mind, and then has avoidd the technical defect that unified parameter can't satisfy the demand of user to the audio, so, has promoted the debugging effect of optimizing multichannel audio effect for stereo surround audio.

Wherein the step of playing audio according to the target down-mix coefficient comprises:

step E10, down-mixing the audio data to be down-mixed according to the target down-mixing coefficient to obtain target audio data;

step E20, acquiring volume data corresponding to the target audio data, and debugging the volume data to the target volume data with a preset sound effect;

and E30, playing audio according to the target volume data and the target audio data.

In this embodiment, it should be noted that, the target audio data is to be downmixed audio data that is formed for using the target downmixed coefficient to downmix, bass audio data can be added in the downmixed audio data for guaranteeing the high-quality mixing effect in the downmixed process, so as to obtain the downmixed audio data, however, because the volume of audio can be slightly reduced due to the addition of the bass audio data, and then the user often needs to turn up the volume when playing audio with the target audio data, that is, adjust the gain balance output loudness, in order to debug the volume that satisfies the preset audio effect, so, the target volume data is the volume data that possesses the preset audio effect, wherein, the volume that possesses the preset audio effect is for debugging to being applicable to the user and listening, and can not lead to the volume of high-frequency distortion.

As an example, the step E10 to the step E30 include: down-mixing the audio data to be down-mixed according to a preset down-mixing formula corresponding to the target down-mixing coefficient to obtain target audio data; acquiring volume data corresponding to the target audio data, and debugging the volume data to the target volume data with a preset sound effect; and carrying out audio playing according to the target volume data and the target audio data.

The embodiment of the application provides an audio playing optimization method, namely, audio data to be downmixed are obtained, and the audio data to be downmixed are downmixed according to an initial debugging downmixing coefficient to obtain downmixed audio data; that is, down-mixing multi-channel audio data to be down-mixed into dual-channel down-mixed audio data by initially debugging down-mixing coefficients; further playing audition audio corresponding to the down-mixed audio data, and receiving feedback information of the user to the audition audio; that is, feedback information of audition audio corresponding to the down-mixed audio data of the two channels by the user is obtained, and then the initial debugging down-mixing coefficient is iteratively debugged according to the feedback information until the debugged initial debugging down-mixing coefficient is detected to have a preset sound effect; namely, the sound effect presented by the audio data of the two channels is judged, whether the audition audio is the audio meeting the user expectation is judged, the debugged initial debugging down-mixing coefficient is used as the target down-mixing coefficient, and the audio is played according to the target down-mixing coefficient. The method can realize the purpose of freely debugging the down-mixing coefficient of the multi-channel on the intelligent equipment until the debugged down-mixing coefficient is the target down-mixing coefficient with the preset sound effect, namely, the debugged down-mixing coefficient is down-mixed with the audio data of the multi-channel to achieve the sound effect expected by a user and further play the corresponding audio, namely, the purpose of optimizing the multi-channel audio data into the stereo surround sound effect of the user psychoscope is realized, so that the user does not need to worry that the stereo sound effect presented after the down-mixing lacks sound details or corresponding sounds and the like due to the unified processing of the audio data of the multi-channel during the down-mixing, but can obtain the sound effect of the psychoscope through the simple interaction between the user and the intelligent equipment, and the technical defect of poor optimization effect of optimizing the multi-channel audio effect into the stereo surround sound effect through the modes of channel mapping or a standard down-mixing formula and the like in the prior art is overcome, therefore, the debugging effect of optimizing the multi-channel audio effect into the stereo surround effect is improved.

Example two

Further, referring to fig. 2, in another embodiment of the present application, the same or similar contents as those in the first embodiment may refer to the above description, and are not repeated herein. On this basis, the initial debugging downmix coefficient includes a second initial debugging downmix coefficient, and the step of debugging the initial debugging downmix coefficient to obtain the debugged initial debugging downmix coefficient includes:

step F10, replacing the second initially debugged down-mix coefficient according to the obtained down-mix coefficient fine-tuning instruction;

step F20, using the replaced second initial debugging down mixing coefficient as the debugged initial debugging down mixing coefficient.

Additionally, it should be noted that the downmix coefficient fine-tuning instruction is configured to perform fine tuning on the initial debugging downmix coefficient, that is, replace the initial debugging downmix coefficient with a debugging downmix coefficient corresponding to the downmix coefficient fine-tuning instruction, and the second initial debugging downmix coefficient includes initial debugging downmix coefficients corresponding to audio data of all channels on the smart device.

As an example, steps F10 through F20 include: acquiring a down-mixing coefficient fine-tuning instruction input by a user, and replacing initial debugging down-mixing coefficients corresponding to audio data of a preset number of sound channels according to debugging down-mixing coefficients corresponding to the down-mixing coefficient fine-tuning instruction; and taking the initial debugging down-mixing coefficient corresponding to the replaced audio data of each sound channel as a target down-mixing coefficient, wherein the down-mixing coefficient fine-tuning instruction can be triggered by detecting that a user performs button clicking operation or inputs a keyboard instruction.

The embodiment of the application provides a method for debugging a down-mix coefficient, namely, replacing a second initial debugging down-mix coefficient according to an obtained down-mix coefficient fine tuning instruction; and taking the replaced second initial debugging down-mixing coefficient as the debugged initial debugging down-mixing coefficient. Compared with the mode of only debugging the down-mixing coefficient corresponding to the audio data of the white sound associated channel and the down-mixing coefficient corresponding to the audio data of the background sound associated channel to obtain the target audio data and further performing audio playing by using the target audio data, the method can debug the down-mixing coefficient corresponding to the audio data of each channel, namely, a user can adjust the balance of background conversation and background music and can freely adjust according to self preference, the technical defect that the user simply selects the down-mixing coefficient with the preset sound effect depending on the preset mode on the intelligent equipment is overcome, and therefore the flexibility of debugging the down-mixing coefficient is improved.

EXAMPLE III

The embodiment of the present application further provides an audio playback optimization apparatus, where the audio playback optimization apparatus includes:

Optionally, the debugging module is further configured to:

Optionally, the playing module is further configured to:

Optionally, the downmix module is further configured to:

The audio playing optimization device provided by the invention adopts the audio playing optimization method in the embodiment, and solves the technical problem of poor optimization effect of optimizing the multi-channel audio effect into the stereo surround effect. Compared with the prior art, the beneficial effects of the audio playing optimization device provided by the embodiment of the invention are the same as the beneficial effects of the audio playing optimization method provided by the embodiment, and other technical features in the audio playing optimization device are the same as the features disclosed by the embodiment method, which are not repeated herein.

Example four

An embodiment of the present invention provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the audio playing optimization method in the first embodiment.

Referring now to FIG. 3, shown is a schematic diagram of an electronic device suitable for use in implementing embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., car navigation terminals), and the like, and fixed terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 3 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 3, the electronic device may include a processing apparatus (e.g., a central processing unit, a graphic processor, etc.) that may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) or a program loaded from a storage apparatus into a Random Access Memory (RAM). In the RAM, various programs and data necessary for the operation of the electronic apparatus are also stored. The processing device, the ROM, and the RAM are connected to each other by a bus. An input/output (I/O) interface is also connected to the bus.

Generally, the following systems may be connected to the I/O interface: input devices including, for example, touch screens, touch pads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, and the like; output devices including, for example, Liquid Crystal Displays (LCDs), speakers, vibrators, and the like; storage devices including, for example, magnetic tape, hard disk, etc.; and a communication device. The communication means may allow the electronic device to communicate wirelessly or by wire with other devices to exchange data. While the figures illustrate an electronic device with various systems, it is to be understood that not all illustrated systems are required to be implemented or provided. More or fewer systems may alternatively be implemented or provided.

In particular, the processes described above with reference to the flow diagrams may be implemented as computer software programs, according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means, or installed from a storage means, or installed from a ROM. The computer program, when executed by a processing device, performs the above-described functions defined in the methods of the embodiments of the present disclosure.

The electronic equipment provided by the invention adopts the audio playing optimization method in the embodiment, and solves the technical problem of poor optimization effect of optimizing the multi-channel audio effect into the stereo surround effect. Compared with the prior art, the beneficial effects of the electronic device provided by the embodiment of the present invention are the same as the beneficial effects of the audio playing optimization method provided by the above embodiment, and other technical features of the electronic device are the same as those disclosed in the above embodiment method, which are not described herein again.

It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the foregoing description of embodiments, the particular features, structures, materials, or characteristics may be combined in any suitable manner in any one or more embodiments or examples.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

EXAMPLE five

The present embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon for performing the audio playback optimization method in the first embodiment.

The computer readable storage medium provided by the embodiments of the present invention may be, for example, a USB flash disk, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or device, or any combination thereof. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present embodiment, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, or device. Program code embodied on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

The computer-readable storage medium may be embodied in an electronic device; or may be present alone without being incorporated into the electronic device.

The computer readable storage medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring audio data to be downmixed, and downmixing the audio data to be downmixed according to an initial debugging downmixing coefficient to obtain downmixed audio data; playing audition audio corresponding to the down-mixed audio data, and receiving feedback information of a user to the audition audio; performing iterative debugging on the initial debugging down-mixing coefficient according to the feedback information until the debugged initial debugging down-mixing coefficient is detected to have a preset sound effect; and taking the debugged initial debugging down-mixing coefficient as a target down-mixing coefficient, and playing audio according to the target down-mixing coefficient.

Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The modules described in the embodiments of the present disclosure may be implemented by software or hardware. Wherein the names of the modules do not in some cases constitute a limitation of the unit itself.

The computer readable storage medium provided by the invention stores the computer readable program instruction for executing the audio playing optimization method, and solves the technical problem of poor optimization effect of optimizing the multi-channel audio effect into the stereo surround effect. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the embodiment of the invention are the same as the beneficial effects of the audio playing optimization method provided by the embodiment, and are not repeated herein.

EXAMPLE six

The computer program product provided by the application solves the technical problem that the optimization effect of optimizing the multi-channel audio effect into the stereo surround effect is poor. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the present invention are the same as the beneficial effects of the audio playing optimization method provided by the above embodiment, and are not described herein again.

The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all equivalent structures or equivalent processes, which are directly or indirectly applied to other related technical fields, and which are not limited by the present application, are also included in the scope of the present application.

Claims

1. An audio playing optimization method, characterized in that the audio playing optimization method comprises:

2. The audio playing optimization method of claim 1, wherein the step of iteratively debugging the initially debugged down-mix coefficients according to the feedback information until the debugged initially debugged down-mix coefficients are detected to have a preset sound effect comprises:

3. The audio playback optimization method of claim 2, wherein the step of detecting whether the initial debug downmix coefficients have the preset audio effect according to the feedback information comprises:

4. The audio playback optimization method of claim 2, wherein the initial debugging downmix coefficients comprise first initial debugging downmix coefficients,

5. The audio playback optimization method of claim 2, wherein the initial debugging downmix coefficients comprise second initial debugging downmix coefficients,

6. The audio playback optimization method of claim 1, wherein the step of playing back audio according to the target down-mix coefficient comprises:

7. The method as claimed in claim 1, wherein the down-mixing the audio data to be down-mixed according to the initial debugging down-mixing coefficient to obtain the down-mixed audio data comprises:

8. An audio playback optimization apparatus, comprising:

the down-mixing module is used for obtaining audio data to be down-mixed, and down-mixing the audio data to be down-mixed according to an initial debugging down-mixing coefficient to obtain down-mixed audio data;

9. An electronic device, characterized in that the electronic device comprises:

at least one processor; and the number of the first and second groups,

a memory communicatively coupled to the at least one processor; wherein, the first and the second end of the pipe are connected with each other,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the audio playback optimization method of any one of claims 1 to 7.

10. A computer-readable storage medium, having a program for implementing an audio playback optimization method stored thereon, the program being executed by a processor to implement the steps of the audio playback optimization method according to any one of claims 1 to 7.