CN111782865A

CN111782865A - Audio information processing method and device and storage medium

Info

Publication number: CN111782865A
Application number: CN202010578015.1A
Authority: CN
Inventors: 张斌
Original assignee: Tencent Music Entertainment Technology Shenzhen Co Ltd
Current assignee: Tencent Music Entertainment Technology Shenzhen Co Ltd
Priority date: 2020-06-23
Filing date: 2020-06-23
Publication date: 2020-10-16

Abstract

The embodiment of the application discloses a method and a device for processing audio information and a storage medium, wherein the method and the device are used for acquiring a disc playing operation input by a user in the process of playing a target audio; determining an audio segment to be processed corresponding to the disc playing operation in the target audio; analyzing the disc playing operation to determine a disc playing control instruction corresponding to the disc playing operation, wherein the disc playing control instruction is used for controlling the playing speed, the playing tone and one or more playing effects of the positive and negative sequence of the audio segment to be processed; processing the audio segment to be processed according to the disc playing control instruction to obtain a target audio segment; and playing the target audio segment. Therefore, the disc playing operation of the user is collected through the terminal, the disc playing effect processing of playing speed, playing tone and playing positive and negative sequence of the audio frequency segment to be processed based on the disc playing instruction is achieved, the operation is simple and fast, and the processing efficiency of the audio frequency information is greatly improved.

Description

Audio information processing method and device and storage medium

Technical Field

The present application relates to the field of audio processing technologies, and in particular, to a method and an apparatus for processing audio information, and a storage medium.

Background

The DJ player is a professional device for playing DJ music, and is also called a DJ controller, and the DJ player can realize the change of audio playing speed and tone change, so that the control of special sound effect is achieved, and the atmosphere of a performance site is driven.

With the rapid development of terminals such as tablet computers and player software thereof, simple functions related to disc playing can be realized through the player software, and meanwhile, the terminals are more and more popular with users due to the convenience in carrying and operation.

However, the existing player software can only set mixing parameters mechanically, add different sound effects, and still cannot realize many functions in the disc player, resulting in low processing efficiency of audio information.

Disclosure of Invention

The embodiment of the application provides a method and a device for processing audio information and a storage medium, which can improve the processing efficiency of the audio information.

In order to solve the above technical problem, an embodiment of the present application provides the following technical solutions:

a processing method of audio information is applied to a terminal, and the method comprises the following steps:

in the process of playing the target audio, obtaining a disc playing operation input by a user;

determining an audio segment to be processed corresponding to the disc playing operation in the target audio;

analyzing the disc playing operation to determine a disc playing control instruction corresponding to the disc playing operation, wherein the disc playing control instruction is used for controlling the playing speed, the playing tone and one or more playing effects of the positive and negative sequence of the audio segment to be processed;

processing the audio segment to be processed according to the disc playing control instruction to obtain a target audio segment;

and playing the target audio segment.

Correspondingly, the present application also provides an apparatus for processing audio information, including:

the acquisition unit is used for acquiring the disc playing operation input by a user in the target audio playing process;

the determining unit is used for determining the audio segment to be processed corresponding to the disc playing operation in the target audio;

the analysis unit is used for analyzing the disc playing operation to determine a disc playing control instruction corresponding to the disc playing operation, wherein the disc playing control instruction is used for controlling the playing speed, the playing tone and one or more playing effects of the positive and negative sequence of the audio segment to be processed;

the processing unit is used for processing the audio segment to be processed according to the disc playing control instruction to obtain a target audio segment;

and the playing unit is used for playing the target audio segment.

In some embodiments, the analysis unit is configured to:

when the motion trail information is detected to accord with a first preset direction, determining speed change parameters according to the acceleration information, wherein the speed change parameters comprise a speed change trend and a speed change amount;

when the motion track information is detected to accord with a second preset direction, tone changing parameters are determined according to the acceleration information, and the tone changing parameters comprise a tone changing trend and a tone changing quantity;

when the motion track information is detected to accord with a third preset direction, determining the setting parameters of the forward and reverse playing sequence according to the acceleration information;

and generating a disc playing control command by one or more of the variable speed parameter, the variable tone parameter and the play positive and negative sequence setting parameter.

In some embodiments, the obtaining unit is further configured to:

in the target audio playing process, a disc playing interactive interface is displayed through a touch display screen of a terminal, and the disc playing interactive interface comprises any one or more of a variable speed disc rubbing component, a variable tone disc rubbing component and a playing positive and negative sequence component;

if the user operates the variable speed rubbing disc assembly, acquiring variable speed sliding operation of the user through the variable speed rubbing disc assembly;

if the user operates the tonal modification rubbing disc assembly, acquiring tonal modification sliding operation of the user through the tonal modification rubbing disc assembly;

and if the user operates the play positive and negative sequence component, acquiring the play positive and negative sequence setting operation of the user through the play positive and negative sequence component.

In some embodiments, the analysis unit is further configured to:

analyzing the variable speed sliding operation to obtain variable speed parameters;

analyzing the tone-changing sliding operation to obtain a tone-changing parameter;

analyzing the setting operation of the positive and negative playing sequence to obtain setting parameters of the positive and negative playing sequence;

In some embodiments, the processing unit is to:

performing one or more of the following three processes on the audio segment to be processed:

determining frame shift after speed change according to the speed change parameters, and carrying out speed change processing on the audio segment to be processed through the frame shift after speed change;

determining a frequency component scaling factor according to the transposition parameter, and performing transposition processing on the audio segment to be processed through the frequency component scaling factor;

setting parameters according to the positive and negative playing sequence, and processing the positive and negative playing sequence of the audio segment to be processed;

and determining the audio segment to be processed which carries out any one or more of variable speed processing, variable tone processing and playing sequence processing as a target audio segment.

Accordingly, embodiments of the present application further provide a storage medium having a computer program stored thereon, where the computer program is executed on a computer, so that the computer executes the method for processing audio information provided in any embodiment of the present application.

In the embodiment of the application, the disc playing operation input by a user is obtained in the target audio playing process; determining an audio segment to be processed corresponding to the disc playing operation in the target audio; analyzing the disc playing operation to determine a disc playing control instruction corresponding to the disc playing operation, wherein the disc playing control instruction is used for controlling the playing speed, the playing tone and one or more playing effects of the positive and negative sequence of the audio segment to be processed; processing the audio segment to be processed according to the disc playing control instruction to obtain a target audio segment; and playing the target audio segment. Therefore, the disc playing operation of the user is collected through the terminal, the disc playing effect processing of playing speed, playing tone and playing positive and negative sequence of the audio frequency segment to be processed based on the disc playing instruction is achieved, the operation is simple and fast, and the processing efficiency of the audio frequency information is greatly improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic flowchart of a processing method of audio information provided by an embodiment of the present application;

FIG. 2 is another schematic flow chart of a method for processing audio information provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of a scene of a processing method of audio information according to an embodiment of the present application;

FIG. 4 is a schematic structural diagram of an apparatus for processing audio information according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of a terminal according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The embodiment of the application provides a method and a device for processing audio information and a storage medium.

The following are detailed below. The numbers in the following examples are not intended to limit the order of preference of the examples.

The first embodiment,

In the present embodiment, the description will be made from the viewpoint of an audio information processing apparatus that can be integrated in a terminal having an arithmetic capability with a storage unit and a microprocessor mounted thereon.

Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a method for processing audio information according to an embodiment of the present disclosure. The audio information processing method comprises the following steps:

in step 101, during the playing process of the target audio, a disc playing operation input by a user is obtained.

The target Audio format may be motion picture Experts Group Audio Layer III (MP 3), Free LosslessAudio Codec (FLAC), ogg (oggvobis), or the like.

Further, in the process of playing the target audio, a User Interface (UI) or a sensor component may be used to obtain a User's disc playing operation, where the disc playing operation may be an operation of adjusting the playing speed and the tone of the target audio.

In some embodiments, the step of obtaining the user-input disc-playing operation may include:

(1) acquiring motion trail information of a user on a terminal through a sensor assembly of the terminal;

(2) and determining the motion track information as the dish making operation.

The motion track information of the terminal can be acquired through the sensor assembly, the sensor assembly can be an acceleration sensor assembly of the terminal, the acceleration direction and the acceleration value of the terminal are acquired in real time, the motion track information is generated, and the motion track information can indicate multiple directions, such as upward relative to a horizontal plane, downward relative to the horizontal plane, leftward vertical screen or rightward vertical screen, and the like.

Further, the motion trajectory information may be determined as a corresponding dish-playing operation, and the dish-playing operation carries the motion trajectory information in a preset direction.

In step 102, in the target audio, the audio segment to be processed corresponding to the disc playing operation is determined.

The audio segment to be processed is a small segment of the target audio, that is, the terminal starts at the implementation time point of receiving the disc playing operation, and the audio segment has a short preset time duration, for example, the audio segment to be processed is 1 second, 2 seconds or 4 seconds.

In step 103, the disc-making operation is analyzed to determine a disc-making control command corresponding to the disc-making operation.

The disc playing control instruction is used for controlling one or more playing effects of the playing speed, the playing tone and the playing forward and backward sequence of the audio segment to be processed, and can be analyzed to determine that the corresponding speed change trend is to increase the playing speed or decrease the playing speed and the corresponding adjustment degree, determine that the corresponding tone change trend is to increase the tone or decrease the tone and the corresponding adjustment degree, and determine that the corresponding playing is to play in forward sequence or play in reverse sequence so as to obtain the corresponding disc playing control instruction.

In some embodiments, the step of analyzing the dish operation to determine the dish control command corresponding to the dish operation includes:

(1) when the motion trail information is detected to accord with a first preset direction, determining speed change parameters according to the acceleration information, wherein the speed change parameters comprise a speed change trend and a speed change amount;

(2) when the motion track information is detected to accord with a second preset direction, tone changing parameters are determined according to the acceleration information, and the tone changing parameters comprise a tone changing trend and a tone changing quantity;

(3) when the motion track information is detected to accord with a third preset direction, determining the setting parameters of the forward and reverse playing sequence according to the acceleration information;

(4) and generating a disc playing control command by one or more of the variable speed parameter, the variable tone parameter and the play positive and negative sequence setting parameter.

When the motion trail information is detected to accord with the first preset direction, speed change parameters are determined according to the acceleration information, the acceleration information comprises an acceleration direction and an acceleration amount, when the acceleration direction is upward, the speed change trend can be acceleration, the speed change amount is in direct proportion to the acceleration amount, otherwise, when the acceleration direction is downward, the speed change trend can be deceleration, and the speed change amount is in direct proportion to the acceleration amount.

The second preset direction of the motion track information can be set, if the vertical screen is in the second preset direction towards the left or the vertical screen is in the second preset direction towards the right, when the motion track information is detected to accord with the second preset direction, the pitch changing parameter is determined according to the acceleration information, the pitch changing parameter comprises a pitch changing trend and a pitch changing amount, the acceleration information comprises an acceleration direction and an acceleration amount, when the acceleration direction is towards the left, the pitch changing trend can be plus, the pitch changing amount is in direct proportion to the acceleration amount, otherwise, when the acceleration direction is towards the right, the pitch changing trend can be minus, and the pitch changing amount is in direct proportion to the acceleration amount. And generating a disc beating command by using the variable speed parameters and the variable tone parameters.

The third preset direction of the motion track can be set, if the vertical screen is forward or the vertical screen is backward, the third preset direction is set, when the motion track information is detected to accord with the third preset direction, the forward and backward playing sequence setting parameters are determined according to the acceleration information, the forward and backward playing sequence setting parameters comprise a sequence direction, when the acceleration direction is forward, the sequence direction can be forward playing, and when the acceleration direction is backward, the sequence direction can be backward playing.

And generating a disc playing control command by one or more of the speed changing parameter, the tone changing parameter and the playing positive and negative sequence setting parameter, so as to realize the adjustment of the speed changing, tone changing and positive and negative sequence playing effects of the digital DJ disc playing through the shaking terminal.

In step 104, the audio segment to be processed is processed according to the disc playing control instruction to obtain a target audio segment.

The frame length of the audio segment information is set to be unchanged, namely the larger the frame shift amount is, the slower the playing speed of the audio to be processed is, the smaller the frame shift amount is, the faster the playing speed of the audio to be processed is, the frame shift amount of the audio to be processed can be adjusted according to the dish playing control instruction, and then the playing speed is adjusted.

Furthermore, the playing frequency of each frame of audio frame in the audio segment to be processed can be adjusted according to the disc playing control instruction, so that the effect of changing the playing tone is achieved, the positive and negative sequence of playing of the audio segment to be processed can be adjusted according to the disc playing control instruction, the effect of changing the playing sequence is achieved, and the processed target audio segment is obtained.

In step 105, the target audio segment is played.

The target audio segment with the adjusted playing effect of one or more of the playing speed, the playing tone and the playing positive and negative sequence is played in real time, so that the playing effects of digital DJ disk playing speed change, tone change and positive and negative sequence change can be realized.

As can be seen from the above, in the embodiment of the present application, the disc playing operation input by the user is obtained in the target audio playing process; determining an audio segment to be processed corresponding to the disc playing operation in the target audio; analyzing the disc playing operation to determine a disc playing control instruction corresponding to the disc playing operation, wherein the disc playing control instruction is used for controlling the playing speed, the playing tone and one or more playing effects of the positive and negative sequence of the audio segment to be processed; processing the audio segment to be processed according to the disc playing control instruction to obtain a target audio segment; and playing the target audio segment. Therefore, the disc playing operation of the user is collected through the terminal, the disc playing effect processing of playing speed, playing tone and playing positive and negative sequence of the audio frequency segment to be processed based on the disc playing instruction is achieved, the operation is simple and fast, and the processing efficiency of the audio frequency information is greatly improved.

Example II,

The method described in the first embodiment is further illustrated by way of example.

In the present embodiment, the following description will be given taking an example in which the processing device of the audio information is specifically integrated in a terminal and the audio is music.

Referring to fig. 2, fig. 2 is another schematic flow chart of a method for processing audio information according to an embodiment of the present application. The method flow can comprise the following steps:

in step 201, the terminal determines a to-be-processed audio segment corresponding to the disc playing operation in the target audio.

And the terminal determines from the target audio that a 2-second audio segment to be processed is intercepted from the implementation point of receiving the disc playing operation.

In step 202, in the process of playing the target audio, if the user operates the variable speed rubbing disc assembly, the terminal collects the variable speed sliding operation of the user through the variable speed rubbing disc assembly.

Referring to fig. 3 together, fig. 3 is a scene schematic diagram of the audio information processing method provided in the embodiment of the present application, an operation interface of the terminal 10 is a DJ operation interface, the DJ operation interface may be an operation interface of an applet, the applet can implement quick operation of the application on the premise that the application is not installed, and the operation interface of the terminal 10 includes a speed changing rubbing tray assembly 11, a pitch changing rubbing tray assembly 12, and a play positive and negative sequence assembly 13.

Further, the speed change washboard component 11 is a component generated by simulating a DJ speed change washboard, a user can perform sliding operation on the speed change washboard component 11, and the terminal 10 collects speed change sliding operation of the user, wherein the speed change sliding operation comprises a sliding direction and a sliding distance.

In step 203, if the terminal detects that the user operates the tonal modification rubbing disc assembly, the tonal modification sliding operation of the user is collected through the tonal modification rubbing disc assembly.

Referring to fig. 3, the tonal modification rubbing disc assembly 12 is an assembly generated by a simulation DJ tonal modification rubbing disc, a user can perform a sliding operation on the tonal modification rubbing disc assembly 12, and the terminal 10 collects the tonal modification sliding operation of the user, where the tonal modification sliding operation includes a sliding direction and a sliding distance.

In step 204, if the terminal detects that the user operates the play forward/reverse order component, the play forward/reverse order setting operation of the user is collected through the play forward/reverse order component.

Referring to fig. 3, the forward and reverse play sequence module 13 is a module for generating a DJ-like play sequence, and the sequence in which the user can play the target audio based on the forward and reverse play sequence module 13 is a forward sequence or a reverse sequence.

In step 205, the terminal analyzes the sliding operation to obtain the speed change parameters, analyzes the sliding operation to obtain the pitch change parameters, and analyzes the setting operation of the positive and negative playing sequence to obtain the setting parameters of the positive and negative playing sequence.

The terminal can generate a speed change parameter according to the sliding direction and the sliding distance acquired on the speed change rubbing disc assembly 11, analyze the speed change parameter, and obtain corresponding speed change effect information, where the speed change effect information includes a speed change trend and a speed change amount, the speed change trend can be associated with the sliding direction, the speed change trend can be to increase the playing speed when the sliding direction is upward in the speed change rubbing disc assembly 11, the speed change trend can be to decrease the playing speed when the sliding direction is downward in the speed change rubbing disc assembly 11, and the speed change amount can be associated with the sliding distance, and the longer the sliding distance, the larger the speed change amount, the shorter the sliding distance, the smaller the speed change amount.

Further, the terminal may further generate a pitch change parameter according to the sliding direction and the sliding distance collected on the pitch change pickup disc assembly 12, analyze the pitch change parameter, and obtain corresponding pitch change effect information, where the pitch change effect information includes a pitch change trend and a pitch change amount, the pitch change trend may be associated with the sliding direction, the pitch change trend may be increasing pitch when the sliding direction is upward in the pitch change pickup disc assembly 12, the pitch change trend may be decreasing pitch when the sliding direction is downward in the pitch change pickup disc assembly 12, and the pitch change amount may be associated with the sliding distance, and the longer the sliding distance is, the larger the pitch change amount is, and the shorter the sliding distance is, the smaller the pitch change amount is.

The terminal can also obtain the setting parameter of the positive and negative playing sequence according to the operation of the positive and negative playing sequence component 13, and analyze the setting parameter of the positive and negative playing sequence to obtain the corresponding positive playing sequence and the reverse playing sequence.

In step 206, the terminal determines the frame shift after the speed change according to the speed change parameter, and performs speed change processing on the audio segment to be processed through the frame shift after the speed change.

The terminal can perform corresponding framing processing on the audio segment to be processed to obtain a plurality of audio frames moving by a preset frame shift amount, wherein the frame length among the plurality of audio frames is fixed, and the preset frame shift amount represents the playing speed of the audio segment to be processed.

Therefore, the terminal can determine the frame shift after the speed change according to the speed change parameters, when the speed change trend is increased, the preset frame shift is increased, the specific increasing amount is determined by the speed change amount, when the speed change trend is decreased, the preset frame shift is decreased, the specific decreasing amount is determined by the speed change amount, so as to obtain the frame shift after the speed change, and the audio frequency segment to be processed is subjected to speed change processing through the frame shift after the speed change, so that the playing speed of the audio frequency segment to be processed is adjusted.

In step 207, the terminal determines a frequency component scaling factor according to the pitch-variation parameter, performs short-time discrete fourier transform and spectral component analysis on the audio segment to be processed to obtain a corresponding frequency component, scales the frequency component by the scaling factor to obtain a target frequency component, and performs phase synthesis, inverse short-time discrete fourier transform and iterative addition on the audio segment to be processed based on the target frequency component to realize pitch-variation processing of the audio segment to be processed.

The terminal can determine a corresponding frequency component scaling factor beta according to a pitch variation trend and a pitch variation of the pitch variation parameter, wherein the frequency component scaling factor beta is a natural number, when the pitch variation trend is increased, the frequency component scaling factor beta is larger than 1, specifically, the amount larger than 1 is determined by the pitch variation, and when the pitch variation trend is decreased, the frequency component scaling factor beta is smaller than 1, specifically, the amount smaller than is determined by the pitch variation.

Further, performing short-time discrete fourier transform and spectral component analysis on the audio segment to be processed to obtain a frequency component corresponding to the audio frame information of each frame, where the larger the frequency component is, the higher the corresponding tone is, the smaller the frequency component is, and the lower the corresponding tone is, and performing corresponding scaling on the frequency component by using the frequency component scaling factor to obtain an adjusted target frequency component.

The terminal can perform phase synthesis, inverse short-time discrete Fourier transform and iterative addition on the audio segment to be processed based on the target frequency component, so as to realize the tone-changing processing of the audio segment to be processed.

In step 208, the terminal processes the positive and negative playing sequence of the audio segment to be processed according to the setting parameter of the positive and negative playing sequence.

Referring to fig. 3, the user may trigger the forward or reverse order command of the forward/reverse order component 13 to execute the forward or reverse order command, and control the audio segment to be processed to be played in forward or reverse order from the current playing time.

In step 209, the terminal determines the audio segment to be processed, which is subjected to any one or more of the variable speed processing, the variable pitch processing and the playing sequence processing, as a target audio segment, and plays the target audio segment.

The terminal plays the target audio segment with the adjusted play effect of one or more of the play speed, the play tone and the play positive and negative sequence in real time, and the play effects of digital DJ disc playing speed change, tone change and positive and negative sequence change can be realized.

Furthermore, the embodiment of the application can also realize a digital DJ disc-playing method based on the small program.

Example III,

In order to better implement the audio information processing method provided by the embodiments of the present application, the embodiments of the present application further provide an apparatus based on the audio information processing method. The terms are the same as those in the above audio information processing method, and details of implementation may refer to the description in the method embodiment.

Referring to fig. 4, fig. 4 is a schematic structural diagram of an audio information processing apparatus according to an embodiment of the present disclosure, where the audio information processing apparatus may include an obtaining unit 301, a determining unit 302, an analyzing unit 303, a processing unit 304, a playing unit 305, and the like.

The obtaining unit 301 is configured to obtain a disc playing operation input by a user in a target audio playing process.

In the process of playing the target audio, the obtaining unit 301 may obtain a user's disc playing operation through a user interface or a sensor component, where the disc playing operation may be an operation of adjusting the playing speed and the tone of the target audio.

In some embodiments, the obtaining unit 301 is configured to: in the process of playing the target audio, acquiring the motion track information of a user to the terminal through a sensor assembly of the terminal; and determining the motion track information as the dish making operation.

In some embodiments, the obtaining unit 301 is further configured to: in the target audio playing process, a disc playing interactive interface is displayed through a touch display screen of a terminal, and the disc playing interactive interface comprises any one or more of a variable speed disc rubbing component, a variable tone disc rubbing component and a playing positive and negative sequence component; if the user operates the variable speed rubbing disc assembly, acquiring variable speed sliding operation of the user through the variable speed rubbing disc assembly; if the user operates the tonal modification rubbing disc assembly, acquiring tonal modification sliding operation of the user through the tonal modification rubbing disc assembly; and if the user operates the play positive and negative sequence component, acquiring the play positive and negative sequence setting operation of the user through the play positive and negative sequence component.

An analyzing unit 302, configured to determine, in the target audio, a to-be-processed audio segment corresponding to the disc playing operation.

The audio segment to be processed is a small segment of the target audio, that is, the analysis unit 302 starts from the time point of the implementation of the disc-playing operation, and starts from the audio segment to be processed for a small preset time period, for example, the audio segment to be processed for 1 second, 2 seconds or 4 seconds.

The analyzing unit 303 is configured to analyze the disc playing operation to determine a disc playing control command corresponding to the disc playing operation, where the disc playing control command is used to control one or more playing effects of the playing speed, the playing pitch, and the playing forward and backward order of the audio segment to be processed.

The analyzing unit 303 may analyze the disc playing command, determine that the corresponding speed change trend is to increase the playing speed or decrease the playing speed and the corresponding adjustment degree, determine that the corresponding pitch change trend is to increase the pitch or decrease the pitch and the corresponding adjustment degree, and determine that the corresponding playing is to play in a forward order or a reverse order, so as to obtain the corresponding disc playing control command.

The analysis unit 303 may perform framing processing on the audio to be processed to obtain audio information composed of multiple frames of audio frames separated by a certain frame shift amount, and set the frame length of the audio information to be unchanged, that is, the larger the frame shift amount is, the slower the playing speed of the audio to be processed is, and the smaller the frame shift amount is, the faster the playing speed of the audio to be processed is.

In some embodiments, the analyzing unit 303 is configured to: when the motion trail information is detected to accord with a first preset direction, determining speed change parameters according to the acceleration information, wherein the speed change parameters comprise a speed change trend and a speed change amount; when the motion track information is detected to accord with a second preset direction, tone changing parameters are determined according to the acceleration information, and the tone changing parameters comprise a tone changing trend and a tone changing quantity; when the motion track information is detected to accord with a third preset direction, determining the setting parameters of the forward and reverse playing sequence according to the acceleration information; and generating a disc playing control command by one or more of the variable speed parameter, the variable tone parameter and the play positive and negative sequence setting parameter. In some embodiments, the analyzing unit 303 is further configured to: analyzing the variable speed sliding operation to obtain variable speed parameters; analyzing the tonal modification sliding operation to obtain tonal modification parameters; analyzing the setting operation of the positive and negative sequence of the playing to obtain setting parameters of the positive and negative sequence of the playing; and generating a disc playing control command by one or more of the variable speed parameter, the variable tone parameter and the play positive and negative sequence setting parameter.

And the processing unit 304 is configured to process the audio segment to be processed according to the disc playing control instruction to obtain a target audio segment.

The processing unit 304 may perform framing processing on the audio segment to be processed to obtain audio segment information consisting of multiple frames of audio frames separated by a certain frame shift amount, and set the frame length of the audio segment information to be unchanged, that is, the larger the frame shift amount is, the slower the playing speed of the audio segment to be processed is, the smaller the frame shift amount is, the faster the playing speed of the audio segment to be processed is, and the processing unit 304 may adjust the frame shift amount of the audio segment to be processed according to the dish playing control instruction, thereby adjusting the playing speed.

Furthermore, the processing unit 304 may further adjust the playing frequency of each frame of audio frame in the audio segment to be processed according to the disc playing control instruction, so as to achieve an effect of changing the playing tone, and the processing unit 304 may further adjust the positive and negative playing order of the audio segment to be processed according to the disc playing control instruction, so as to achieve an effect of changing the playing order, and obtain the processed target audio segment.

In some embodiments, the processing unit 304 is configured to: and executing one or more of the following three processes on the audio segment to be processed: determining the frame shift after the speed change according to the speed change parameter, and carrying out speed change processing on the audio segment to be processed through the frame shift after the speed change; determining a frequency component scaling factor according to the modulation parameter, and performing modulation processing on the audio segment to be processed through the frequency component scaling factor; setting parameters according to the positive and negative playing sequence, and processing the positive and negative playing sequence of the audio segment to be processed; and determining the audio segment to be processed which carries out any one or more of variable speed processing, variable tone processing and playing sequence processing as a target audio segment.

A playing unit 305 for playing the target audio segment.

The playing unit 305 may play the target audio segment in real time after obtaining one or more playing effects of the playing speed, the playing tone, and the playing positive and negative sequence, so as to achieve the playing effects of digital DJ disk playing, speed changing, tone changing, and positive and negative sequence changing.

The specific implementation of each unit can refer to the previous embodiment, and is not described herein again.

As can be seen from the above, in the embodiment of the present application, the disc playing operation input by the user is obtained by the obtaining unit 301 in the target audio playing process; the determining unit 302 determines a to-be-processed audio segment corresponding to the disc playing operation in the target audio; the analyzing unit 303 analyzes the disc playing operation to determine a disc playing control instruction corresponding to the disc playing operation, where the disc playing control instruction is used to control the playing speed, the playing tone, and one or more playing effects of the positive and negative order of playing of the audio segment to be processed; the processing unit 304 processes the audio segment to be processed according to the disc playing control instruction to obtain a target audio segment; the playing unit 305 plays the target audio segment. Therefore, the disc playing operation of the user is collected through the terminal, the disc playing effect processing of playing speed, playing tone and playing positive and negative sequence of the audio frequency segment to be processed based on the disc playing instruction is achieved, the operation is simple and fast, and the processing efficiency of the audio frequency information is greatly improved.

Example four,

Embodiments of the present invention also provide a terminal, as shown in fig. 5, which may include one or more computer-readable storage media, such as a memory 401, an input unit 402, a display unit 403, a sensor 404, and a processor 405 including one or more processing cores. Those skilled in the art will appreciate that the terminal structure shown in fig. 5 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:

the memory 401 may be used to store software programs and modules, and the processor 405 executes various functional applications and information processing by operating the software programs and modules stored in the memory 401. The memory 401 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the terminal, etc. Further, the memory 401 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 401 may further include a memory controller to provide the processor 405 and the input unit 402 with access to the memory 401.

The input unit 402 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, in one particular embodiment, input unit 402 may include a touch-sensitive surface as well as other input devices. The touch-sensitive surface, also referred to as a touch display screen or a touch pad, may collect touch operations by a user (e.g., operations by a user on or near the touch-sensitive surface using a finger, a stylus, or any other suitable object or attachment) thereon or nearby, and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 405, and can receive and execute commands sent by the processor 405. In addition, touch sensitive surfaces may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 402 may include other input devices in addition to a touch-sensitive surface. In particular, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 403 may be used to display information input by or provided to the user and various graphical user interfaces of the terminal, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 403 may include a Display panel, and optionally, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch-sensitive surface may overlay the display panel, and when a touch operation is detected on or near the touch-sensitive surface, the touch operation is transmitted to the processor 405 to determine the type of touch event, and then the processor 405 provides a corresponding visual output on the display panel according to the type of touch event. Although in FIG. 5 the touch-sensitive surface and the display panel are two separate components to implement input and output functions, in some embodiments the touch-sensitive surface may be integrated with the display panel to implement input and output functions.

The terminal may also include at least one sensor 404, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel according to the brightness of ambient light, and a proximity sensor that may turn off the display panel and/or the backlight when the terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal, detailed description is omitted here.

The processor 405 is a control center of the terminal, connects various parts of the entire mobile phone using various interfaces and lines, and performs various functions of the terminal and processes data by operating or executing software programs and/or modules stored in the memory 401 and calling data stored in the memory 401, thereby performing overall monitoring of the mobile phone. Optionally, processor 405 may include one or more processing cores; preferably, the processor 405 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 405.

Although not shown, the terminal may further include a camera, a bluetooth module, and the like, which will not be described herein. Specifically, in this embodiment, the processor 405 in the terminal loads the executable file corresponding to the process of one or more application programs into the memory 401 according to the following instructions, and the processor 405 runs the application program stored in the memory 401, thereby implementing various functions:

in the process of playing the target audio, obtaining a disc playing operation input by a user; determining an audio segment to be processed corresponding to the disc playing operation in the target audio; analyzing the disc playing operation to determine a disc playing control instruction corresponding to the disc playing operation, wherein the disc playing control instruction is used for controlling the playing speed, the playing tone and one or more playing effects of the positive and negative sequence of the audio segment to be processed; processing the audio segment to be processed according to the disc playing control instruction to obtain a target audio segment; and playing the target audio segment.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and parts that are not described in detail in a certain embodiment may refer to the above detailed description of the processing method for audio information, and are not described herein again.

Therefore, the terminal of the embodiment of the invention can obtain the disc playing operation input by the user in the target audio playing process; determining an audio segment to be processed corresponding to the disc playing operation in the target audio; analyzing the disc playing operation to determine a disc playing control instruction corresponding to the disc playing operation, wherein the disc playing control instruction is used for controlling the playing speed, the playing tone and one or more playing effects of the positive and negative sequence of the audio segment to be processed; processing the audio segment to be processed according to the disc playing control instruction to obtain a target audio segment; and playing the target audio segment. Therefore, the disc playing operation of the user is collected through the terminal, the disc playing effect processing of playing speed, playing tone and playing positive and negative sequence of the audio frequency segment to be processed based on the disc playing instruction is achieved, the operation is simple and fast, and the processing efficiency of the audio frequency information is greatly improved.

Example V,

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, the present application provides a storage medium, in which a plurality of instructions are stored, where the instructions can be loaded by a processor to execute the steps in any one of the audio information processing methods provided in the present application. For example, the instructions may perform the steps of:

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.

Since the instructions stored in the storage medium can execute the steps in any audio information processing method provided in the embodiments of the present application, beneficial effects that can be achieved by any audio information processing method provided in the embodiments of the present application can be achieved, and detailed descriptions are omitted here for the foregoing embodiments.

The foregoing describes in detail a method, an apparatus, and a storage medium for processing audio information provided in an embodiment of the present application, and a specific example is applied in the present application to explain the principle and the implementation of the present application, and the description of the foregoing embodiment is only used to help understand the method and the core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A method for processing audio information, which is applied to a terminal, the method comprising:

and playing the target audio segment.

2. The detection method according to claim 1, wherein the step of obtaining the user-input disc-making operation comprises:

acquiring motion trail information of a user on a terminal through a sensor assembly of the terminal;

and determining the motion track information as disc making operation.

3. The processing method according to claim 2, wherein the step of analyzing the dish operation to determine the dish control command corresponding to the dish operation comprises:

4. The processing method according to claim 1, wherein the step of obtaining the user-input disc-making operation comprises:

displaying a dish-playing interactive interface through a touch display screen of the terminal, wherein the dish-playing interactive interface comprises any one or more of a variable speed dish-rubbing component, a variable tone dish-rubbing component and a play positive and negative sequence component;

5. The processing method according to claim 4, wherein the step of analyzing the dish operation to determine the dish control command corresponding to the dish operation comprises:

6. The processing method as claimed in claim 3 or 5, wherein the step of processing the audio segment to be processed according to the dishing control instruction to obtain a target audio segment includes:

7. The processing method as claimed in claim 6, wherein the step of pitch-shifting the audio segment to be processed by the frequency component scaling factor comprises:

carrying out short-time discrete Fourier transform and spectral component analysis on the audio segment to be processed to obtain corresponding frequency components;

scaling the frequency component through the scale factor to obtain a target frequency component;

and performing phase synthesis, inverse short-time discrete Fourier transform and iterative addition on the audio segment to be processed based on the target frequency component to realize pitch modulation processing on the audio segment to be processed.

8. An apparatus for processing audio information, comprising:

and the playing unit is used for playing the target audio segment.

9. The processing apparatus according to claim 8, wherein the obtaining unit is configured to:

in the target audio playing process, acquiring the motion track information of a user to a terminal through a sensor assembly of the terminal;

and determining the motion track information as disc making operation.

10. A storage medium having stored thereon a computer program, characterized in that, when the computer program runs on a computer, it causes the computer to execute the method of processing audio information according to any one of claims 1 to 7.