CN114510290A - Sound effect processing method and device, electronic equipment, storage medium and program product - Google Patents
Sound effect processing method and device, electronic equipment, storage medium and program product Download PDFInfo
- Publication number
- CN114510290A CN114510290A CN202210095819.5A CN202210095819A CN114510290A CN 114510290 A CN114510290 A CN 114510290A CN 202210095819 A CN202210095819 A CN 202210095819A CN 114510290 A CN114510290 A CN 114510290A
- Authority
- CN
- China
- Prior art keywords
- sound effect
- algorithm library
- management list
- target
- sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000000694 effects Effects 0.000 title claims abstract description 527
- 238000003672 processing method Methods 0.000 title claims abstract description 30
- 238000012545 processing Methods 0.000 claims abstract description 118
- 238000000034 method Methods 0.000 claims abstract description 31
- 238000011068 loading method Methods 0.000 claims abstract description 16
- 238000004590 computer program Methods 0.000 claims description 21
- 230000004048 modification Effects 0.000 claims description 7
- 238000012986 modification Methods 0.000 claims description 7
- 230000006978 adaptation Effects 0.000 abstract description 13
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 239000003826 tablet Substances 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000008030 elimination Effects 0.000 description 2
- 238000003379 elimination reaction Methods 0.000 description 2
- 239000003623 enhancer Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 239000012636 effector Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000007943 implant Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
- G06F9/44526—Plug-ins; Add-ons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
- G06F8/76—Adapting program code to run in a different environment; Porting
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Stored Programmes (AREA)
Abstract
The embodiment of the application provides a sound effect processing method and device, electronic equipment, a storage medium and a program product. The method comprises the following steps: loading at least one plug-in according to the sound effect configuration file, wherein each plug-in corresponds to one sound effect algorithm library to obtain the loaded sound effect algorithm library; acquiring a sound effect processing request of a user; if the target sound effect specified by the sound effect processing request does not exist in the sound effect management list, creating the target sound effect from the loaded sound effect algorithm library; and storing the target sound effect into a sound effect management list for carrying out sound effect processing on the audio data to be processed. The method dynamically loads the sound effect algorithm library, creates the sound effect required by the user based on the loaded sound effect algorithm library for sound effect processing, and can realize the switching of the sound effect under the condition of not modifying the system source code, thereby being very convenient for expanding to different platforms and adapting to different products and effectively improving the flexibility of sound effect adaptation.
Description
Technical Field
The present application relates to the field of sound processing technologies, and in particular, to a sound processing method and apparatus, an electronic device, a storage medium, and a program product.
Background
At present, sound effects are developed on a system based on an android platform, and a plurality of selectable sound effect algorithms are available, for example, a sound effect algorithm carried by an android native system, a sound effect algorithm independently developed by a related organization, a third party payment sound effect algorithm and the like. The sound effects selected according to different product requirements are often different, which brings trouble and puzzles to the sound effect adaptation of a plurality of products.
In the prior art, the sound effect adaptation mode of different products is mainly still that the native sound effect frame of ann remains unchanged, and other sound effects are integrated into the native sound effect of ann. This allows all sound effects to be used through the android native interface.
However, due to the severe dependence on the android framework, the biggest problem in the use of sound effect is that the expandability is severely limited, the portability is very poor, and the sound effect cannot be transplanted to other non-android platforms basically.
Disclosure of Invention
The purpose of the embodiment of the application aims at solving the technical defects of poor expandability and portability caused by the sound effect adaptation mode based on the android native sound effect framework.
According to an aspect of an embodiment of the present application, there is provided a sound effect processing method, including:
loading at least one plug-in according to the sound effect configuration file, wherein each plug-in corresponds to one sound effect algorithm library to obtain the loaded sound effect algorithm library;
acquiring a sound effect processing request of a user;
if the target sound effect specified by the sound effect processing request does not exist in the sound effect management list, creating the target sound effect from the loaded sound effect algorithm library;
and storing the target sound effect into a sound effect management list for carrying out sound effect processing on the audio data to be processed.
In an alternative embodiment, creating the target sound effect from the loaded sound effect algorithm library comprises:
and creating a target sound effect from the loaded sound effect algorithm library through a factory mode.
In an alternative embodiment, the sound effect algorithm library corresponding to each plug-in is any one of the following items:
the android native system comprises a sound effect algorithm library, a sound effect algorithm library self-researched by manufacturers and a third party payment sound effect algorithm library.
In an alternative embodiment, the creating the target sound effect from the loaded sound effect algorithm library through the factory mode comprises:
acquiring type information of a target sound effect;
determining a target sound effect algorithm corresponding to the type information in the loaded sound effect algorithm library;
and creating the target sound effect through the factory mode based on the target sound effect algorithm.
In an alternative embodiment, the method further comprises:
performing sound effect processing on the audio data to be processed based on the sound effect management list;
in an optional embodiment, performing sound effect processing on the audio data to be processed based on the sound effect management list includes:
initializing the sound effects in the sound effect management list;
and according to a preset sequence, carrying out sound effect processing on the audio data to be processed in sequence by using the initialized sound effect.
In an alternative embodiment, the method further comprises:
acquiring a parameter setting instruction and/or a parameter modifying instruction of the sound effect specified by the sound effect processing request;
initializing the sound effects in the sound effect management list, comprising:
initializing the sound effects in the sound effect management list in response to the parameter setting instruction;
the audio data to be processed is subjected to sound effect processing, and the method comprises the following steps:
responding to the parameter modification instruction, and modifying the parameters of the sound effects in the sound effect management list;
and performing sound effect processing on the audio data to be processed based on the modified parameters.
In an alternative embodiment, the method further comprises:
if the sound effect management list also comprises the irrelevant sound effect which is not specified by the sound effect processing request, the irrelevant sound effect is eliminated.
According to another aspect of the embodiments of the present application, there is provided a sound effect processing apparatus, including:
the loading module is used for loading at least one plug-in according to the sound effect configuration file, and each plug-in corresponds to one sound effect algorithm library to obtain the loaded sound effect algorithm library;
the acquisition module is used for acquiring a sound effect processing request of a user;
the creation module is used for creating a target sound effect from the loaded sound effect algorithm library through a factory mode if the target sound effect specified by the sound effect processing request does not exist in the sound effect management list;
and the storage module is used for storing the target sound effect into the sound effect management list and carrying out sound effect processing on the audio data to be processed.
In an alternative embodiment, the creating module, when being used for creating the target sound effect from the loaded sound effect algorithm library, is specifically configured to:
and creating a target sound effect from the loaded sound effect algorithm library through a factory mode.
In an alternative embodiment, the sound effect algorithm library corresponding to each plug-in is any one of the following items:
the android native system comprises a sound effect algorithm library, a sound effect algorithm library self-researched by manufacturers and a third party payment sound effect algorithm library.
In an alternative embodiment, the creating module, when being used for creating the target sound effect from the loaded sound effect algorithm library through the factory mode, is specifically configured to:
acquiring type information of a target sound effect;
determining a target sound effect algorithm corresponding to the type information in the loaded sound effect algorithm library;
and creating the target sound effect through the factory mode based on the target sound effect algorithm.
In an alternative embodiment, the apparatus further comprises:
the processing module is used for carrying out sound effect processing on the audio data to be processed based on the sound effect management list;
in an optional implementation manner, when the processing module is configured to perform sound effect processing on the audio data to be processed based on the sound effect management list, the processing module is specifically configured to:
initializing the sound effects in the sound effect management list;
and according to a preset sequence, carrying out sound effect processing on the audio data to be processed in sequence by using the initialized sound effect.
In an optional implementation, the obtaining module is further configured to:
acquiring a parameter setting instruction and/or a parameter modifying instruction of the sound effect specified by the sound effect processing request;
when the processing module is used for initializing the sound effects in the sound effect management list, the processing module is specifically used for:
initializing the sound effects in the sound effect management list in response to the parameter setting instruction;
the processing module is specifically used for performing sound effect processing on audio data to be processed:
responding to the parameter modification instruction, and modifying the parameters of the sound effects in the sound effect management list;
and performing sound effect processing on the audio data to be processed based on the modified parameters.
In an alternative embodiment, the apparatus further comprises:
and the elimination module is used for eliminating the irrelevant sound effect if the irrelevant sound effect which is not specified by the sound effect processing request is also included in the sound effect management list.
According to still another aspect of embodiments of the present application, there is provided an electronic apparatus including: the sound effect processing method comprises a memory, a processor and a computer program stored on the memory, wherein the processor executes the computer program to realize the steps of the sound effect processing method provided by the embodiment of the application.
According to still another aspect of the embodiments of the present application, there is provided a computer-readable storage medium having a computer program stored thereon, where the computer program is used to implement the steps of the sound effect processing method provided by the embodiments of the present application when being executed by a processor.
According to still another aspect of the embodiments of the present application, there is provided a computer program product, which includes a computer program, and when the computer program is executed by a processor, the computer program implements the steps of the sound effect processing method provided by the embodiments of the present application.
According to the sound effect processing method and device, the electronic equipment, the storage medium and the program product, the sound effect algorithm library is dynamically loaded, the sound effect required by a user is created based on the loaded sound effect algorithm library for sound effect processing, and the sound effect can be switched without modifying system source codes, so that the sound effect processing method and device can be very conveniently expanded to different platforms and adapt to different products, and the flexibility of sound effect adaptation is effectively improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments of the present application will be briefly described below.
Fig. 1 is a schematic flow chart illustrating a sound effect processing method according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of an audio processing framework according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a sound effect processing device according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Embodiments of the present application are described below in conjunction with the drawings in the present application. It should be understood that the embodiments set forth below in connection with the drawings are exemplary descriptions for explaining technical solutions of the embodiments of the present application, and do not limit the technical solutions of the embodiments of the present application.
As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should be further understood that the terms "comprises" and/or "comprising," when used in this specification in connection with embodiments of the present application, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of other features, integers, steps, operations, elements, components, and/or groups thereof, as supported by the present technology. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. The term "and/or" as used herein indicates at least one of the items defined by the term, e.g., "a and/or B" may be implemented as "a", or as "B", or as "a and B".
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
The sound effect processing technology is widely applied to different types of products such as fixed audio equipment such as televisions and set top boxes, and mobile sound effect equipment such as mobile phones and tablet personal computers. Different types of products are often not developed with the same sound effects implanted. Even for the same type of product, such as television for example, different television manufacturers choose different sound effects to implant according to the product they develop. That is, the sound effects selected according to different product requirements are often different, which brings trouble and trouble to the sound effect adaptation of many products.
The existing sound effect adaptation mode is seriously dependent on an android frame, the biggest problem in sound effect use is that expandability is seriously limited, portability is very poor, and the sound effect adaptation mode cannot be transplanted to other non-android platforms basically.
In addition, the sound effect adaptation mode based on the android native sound effect framework can involve modifying part of android native source codes, and inconvenience is brought to maintainability of subsequent sound effect adaptation.
For different products, a whole set of sound effect frame is designed at a certain development cost in the early stage, for example, the learning cost of the android native sound effect frame is familiar, so that an adaptation layer for the android native sound effect is added and integrated into the sound effect frame; and the links such as coding and debugging are also needed, so that the time cost and the energy cost are consumed.
In view of at least one of the above technical problems or needs to be improved in the related art, the present application provides a sound effect processing method, apparatus, electronic device, storage medium, and program product for improving flexibility of sound effect adaptation.
The technical solutions of the embodiments of the present application and the technical effects produced by the technical solutions of the present application will be described below through descriptions of several exemplary embodiments. It should be noted that the following embodiments may be referred to, referred to or combined with each other, and the description of the same terms, similar features, similar implementation steps and the like in different embodiments is not repeated.
An embodiment of the present application provides a sound effect processing method, as shown in fig. 1, the method includes:
step S101: loading at least one plug-in according to the sound effect configuration file, wherein each plug-in corresponds to one sound effect algorithm library to obtain the loaded sound effect algorithm library;
step S102: acquiring a sound effect processing request of a user;
step S103: if the target sound effect specified by the sound effect processing request does not exist in the sound effect management list, creating the target sound effect from the loaded sound effect algorithm library;
step S104: and storing the target sound effect into a sound effect management list for carrying out sound effect processing on the audio data to be processed.
In the embodiment of the present application, Sound Effects, which may also be referred to as Audio Effects, refer to Effects made by Sound, including but not limited to digital Sound Effects, ambient Sound Effects, and the like, and are used to enhance the auditory experience of Sound, such as sense of reality, atmosphere, and the like.
The sound effect algorithm library refers to a collection in which a certain type of sound effect algorithm is collected. In the actual use process, the sound effect algorithm can be used for processing the audio data, and then the processed audio data is played, so that the sound effect adding effect can be realized. In the embodiment of the present application, the classification method of the sound effect algorithm is not specifically limited. By way of example, types of sound effect algorithm libraries may include, but are not limited to, libraries containing android native System-owned sound effect algorithms, libraries containing arbitrary vendor-owned (independently developed) sound effect algorithms, libraries of third party pay sound effect algorithms, and the like, wherein third party pay sound effects include, but are not limited to, Dolby Audio (Dolby Audio), DTS (Digital television System, DTS) sound effects, DBX sound effects (an Audio processing method), and the like.
In the embodiment of the application, each sound effect algorithm library exists as a plug-in. Namely, the sound effect algorithm library corresponding to each plug-in is any one of the following items: the android native system comprises a sound effect algorithm library carried by the android native system, a sound effect algorithm library researched by a manufacturer, and a third party payment sound effect algorithm library, but is not limited to the above.
In the embodiment of the present application, the sound effect configuration file is used to describe information of a plug-in (i.e. a sound effect algorithm library) to be loaded. And modifying the sound effect configuration file according to the required sound effect, and loading the sound effect algorithm library based on the modified sound effect configuration file, so that the dynamic loading of the sound effect algorithm library can be realized.
According to the embodiment of the application, the switching of the sound effects can be realized under the condition that codes are not modified, and which kind of sound effects need to be used can be configured through the sound effect configuration file. When the method is transplanted to different products and even different system platforms, the switching of the sound effect can be realized by modifying the sound effect configuration file without modifying codes.
In the embodiment of the present application, the obtaining manner of the sound effect processing request is not specifically limited, for example, a client may be provided to obtain an input or a selection of a user to generate the sound effect processing request, or other manners may also be adopted.
In the embodiment of the present application, the sound effect specified by the sound effect processing request may be one or more sound effects. That is to say, this scheme supports multiple audio coexistence, can make up different audio processing chains according to the audio of difference, comes to carry out audio processing to the audio in proper order.
In the embodiment of the present application, the target sound effect refers to a sound effect specified by the sound effect processing request and not present in the sound effect management list. The number of target sound effects may also be one or more.
In the embodiment of the application, each created sound effect is from the loaded sound effect algorithm library. Each sound effect created needs to be added to the sound effect management list for storage. For each sound effect processing request, whether the specified sound effect exists needs to be searched in the sound effect management list, if yes, the sound effect management list can be used for normally executing the subsequent sound effect processing flow, and if not, the sound effect management list needs to be created from the loaded sound effect algorithm library.
It can be understood that, for the initial sound effect processing request, the specified sound effects will not exist in the sound effect management list, that is, the specified sound effects will be the target sound effects, created from the loaded sound effect algorithm library, and added to the sound effect management list for storage.
For the subsequent sound effect processing request, the specified sound effect may be added into the sound effect management list, or may not exist in the sound effect management list, and for the sound effect which is specified and does not exist in the sound effect management list, the sound effect is used as the target sound effect, created from the loaded sound effect algorithm library, and added into the sound effect management list for storage.
In the embodiment of the application, for the sound effect processing request, the specified sound effect may exist the condition that the specified sound effect is added into the sound effect management list or does not exist in the sound effect management list, and the condition that the sound effect management list comprises the irrelevant sound effect which is not specified by the sound effect processing request may also exist, for the condition, the irrelevant sound effect can be eliminated (also called destroyed), namely, the created irrelevant sound effect is deleted from the sound effect management list, and if the sound effect needs to be used next time, the created sound effect can be re-created from the loaded sound effect algorithm library and then added into the sound effect management list for storage.
For the embodiment of the present application, on the basis of step S101, step S102 to step S104 may be executed multiple times, that is, the step numbers of step S101 to step S104 do not constitute a limitation on the number or order of execution of the steps.
According to the sound effect processing method provided by the embodiment of the application, the sound effect required by a user is created based on the loaded sound effect algorithm library through dynamic loading of the sound effect algorithm library for sound effect processing, and the sound effect can be switched under the condition that a system source code is not modified, so that the sound effect processing method can be very conveniently expanded to different platforms and adapted to different products, and the flexibility of sound effect adaptation is effectively improved.
In the embodiment of the present application, for step S103, creating audio may be understood as creating an audio object for use. Different from the prior art in which the audio effect algorithm is directly called to process audio data, in the embodiment of the application, the creation and the use (namely, the audio effect processing) of the audio effect are separated.
In a possible implementation manner, for step S103, the method specifically includes: and creating a target sound effect from the loaded sound effect algorithm library through a factory mode.
Namely, the creation and use processes of the sound effect are separated through a factory mode, and the instantiation of the sound effect is handed to a factory class.
Among them, the Factory Pattern (Factory Pattern) is one of the most commonly used design patterns in Java, and this design Pattern belongs to a creation type Pattern, which can provide a reliable way to create objects.
In factory mode, the creation logic is not exposed to the client (user) when creating the object, and the newly created object can be pointed to by using a common interface. In the embodiment of the application, the created sound effect is stored through the sound effect management list and is used for providing the user with the use of the created sound effect.
In the embodiment of the application, code duplication can be reduced through a factory mode. Because the process of creating sound effects is complex, a certain amount of codes is needed, and different sound effect algorithms are used, so that a lot of repeated codes exist. These codes for creating sound effects can be put into factory mode for uniform management. Not only reducing repeated codes, but also facilitating the later maintenance.
In addition, because the factory mode manages the creation logic of the sound effect, a user does not need to know the specific creation process and only needs to manage the sound effect, and the error easily occurring in the audio creation process is reduced.
In the embodiment of the present application, the process of creating the target sound effect from the loaded sound effect algorithm library through the factory mode specifically includes the following steps: acquiring type information of a target sound effect; determining a target sound effect algorithm corresponding to the type information in the loaded sound effect algorithm library; and creating the target sound effect through the factory mode based on the target sound effect algorithm.
In the embodiment of the present application, the sound effect processing request in step S102 may directly carry the type information of the specified sound effect, that is, the type information of the target sound effect is included. Or, after the sound effect processing request in step S102 is acquired, the type information of the target sound effect may be additionally acquired, and the acquisition manner of the type information of the target sound effect is not specifically limited in this embodiment of the application.
In the embodiment of the present application, the type information of the target sound effect is information describing which sound effect the target sound effect is specifically, for example, the sound effect enhancement equalizer (eq), the bass sound effect enhancer bassbost, the surround sound effect enhancer Virtualizer, and the like. It can be understood that, if a certain sound effect exists in a plurality of sound effect algorithm libraries, the type information of the target sound effect may also be information describing which sound effect in which sound effect algorithm library the target sound effect is, for example, a sound effect enhancement Equalizer equizer in an android sound effect algorithm library, etc.
Furthermore, a target sound effect algorithm corresponding to the type information can be searched in the loaded sound effect algorithm library through comparison, matching and the like. And processing the searched target sound effect algorithm through a factory mode to create a target sound effect.
As can be seen from the above description, in the embodiment of the present application, the sound effect management list is used to perform sound effect processing on the audio data to be processed. Namely, the sound effect processing method provided by the embodiment of the application further comprises the following steps: and performing sound effect processing on the audio data to be processed based on the sound effect management list.
Specifically, the step may include: initializing the sound effects in the sound effect management list; and according to a preset sequence, carrying out sound effect processing on the audio data to be processed in sequence by using the initialized sound effect.
As will be appreciated by those skilled in the art, sound effect processing of different sound effects generally requires attention to sequencing. For example, to prevent overload, the sound effect limiter is usually placed after the sound effect enhancement equalizer for processing; as another example, the reverb effector is usually put to the final processing. In the embodiment of the application, the preset sequence of various sound effect processing can be acquired. The predetermined sequence may be predefined, or may be a sound effect processing sequence set by the user in real time. The specific content and source of the predetermined sequence are not specifically limited in the embodiments of the present application, and those skilled in the art can set the sequence according to actual situations.
In the embodiment of the present application, after the sound effect is created, before the sound effect can be used (sound effect processing is performed), the sound effect needs to be initialized correctly. The initialization process after the sound effect is created needs to determine what parameters are set for the sound effect, so as to initialize the sound effect based on the corresponding parameters.
In the embodiment of the present application, the order of initializing the sound effects in the sound effect management list is not specifically limited, and for example, the sound effects may be executed according to the predetermined order, or may be executed simultaneously.
In the embodiment of the application, the step of initializing the sound in the sound management list and according to the predetermined sequence, the step of processing the sound of the audio data to be processed is performed in sequence by using the sound after initialization, the execution is not required to be performed completely according to the sequence, for example, after the initialization is performed on each sound in the sound management list, the sound processing is performed on the audio data to be processed by using the sound after initialization, until according to the predetermined sequence, the sound processing is performed on each sound in the sound management list by initializing each sound and processing the audio data to be processed.
In this embodiment, the sound effect processing method may further include: acquiring a parameter setting instruction and/or a parameter modifying instruction for the sound effect specified by the sound effect processing request.
The parameter setting instruction is an instruction for setting parameters of the sound effect specified by the sound effect processing request, and based on the parameter setting instruction, what parameters are set by the sound effect can be determined. In practical application, if the acquired parameter setting instruction does not contain parameter setting information of a certain sound effect, the sound effect can also adopt default parameter setting.
The step of initializing the sound effects in the sound effect management list may specifically include: and responding to the parameter setting instruction, and initializing the sound effects in the sound effect management list.
In the embodiment of the application, after the sound effect is initialized, the parameters of the sound effect can be modified. Wherein, the parameter modification instruction, that is, the instruction for modifying the parameter of at least one of the audio effects specified by the audio-effect processing request, can determine what parameter is to be reset for a certain or some of the audio effects based on the parameter setting instruction.
The step of performing sound effect processing on the audio data to be processed may specifically include: responding to the parameter modification instruction, and modifying the parameters of the sound effects in the sound effect management list; and performing sound effect processing on the audio data to be processed based on the modified parameters.
In the embodiment of the present application, as shown in fig. 2, a sound effect processing framework is provided for implementing the above embodiments. Specifically, the sound effect processing framework mainly comprises the following modules:
(1) the sound effect application layer is mainly responsible for logic processing. Such as what sound effects are to be created, what parameters are set for each sound effect, and initialization after the sound effects are created, can be set from the application layer. In conjunction with the above description, the steps of obtaining the sound effect processing request of the user, obtaining the type information of the target sound effect, obtaining the parameter setting instruction and/or parameter modification instruction of the sound effect specified by the sound effect processing request, and the like are all from the setting of the sound effect application layer.
(2) And the sound effect management layer and the sound effect application layer need to be added into a sound effect management list of the sound effect management layer for storage every time a sound effect is created. The scheme supports coexistence of multiple sound effects. Different sound effect processing chains can be combined according to different sound effect types. The sound effect processing request transferred by the sound effect application layer needs to search whether the sound effect exists in the sound effect management list, if yes, the sound effect is created, and if not, the sound effect processing request returns to failure and needs to be created again. Each created sound effect is generated by a factory model. Each created sound effect comes from the sound effect loading layer.
(3) And the sound effect loading layer implements a dynamic loading method for the sound effect algorithm library. And each sound effect algorithm library exists in a plug-in mode, and is loaded according to the sound effect configuration file.
In the embodiment of the present disclosure, the main body of the method may be a terminal device (for example, various types of audio devices), or an application installed on the terminal device (for example, a preset client or the sound effect processing framework). The terminal device includes but is not limited to a fixed terminal and/or a mobile terminal, and the like, for example: televisions, desktops, all-in-one machines, mobile phones, tablets, laptops, wearable devices, game consoles, in-vehicle terminals, robots, and the like.
The sound effect processing method provided by the embodiment of the present application can be applied to an audio technology software development scenario of a specific product, for example, an audio technology software development provided by a television manufacturer, but is not limited thereto, and suitable changes based on the scenario example can also be applied to the present application, and shall also be included in the scope of protection of the present application.
The sound effect processing method provided by the embodiment of the application can contain different types of sound effect algorithm libraries under a unified framework, and is perfectly compatible.
The sound effect processing method provided by the embodiment of the application can freely switch the sound effects required by different products, and saves the development cost of different products.
The sound effect processing method provided by the embodiment of the application has the advantages of good expansibility, portability, cross-platform performance and maintainability, high flexibility and great convenience for expanding products to other platforms in the follow-up process.
An embodiment of the present application provides a sound effect processing apparatus, as shown in fig. 3, the sound effect processing apparatus 30 may include: a loading module 301, an obtaining module 302, a creating module 303, and a saving module 304, wherein,
the loading module 301 is configured to load at least one plug-in according to the sound effect configuration file, where each plug-in corresponds to one sound effect algorithm library, and obtain a loaded sound effect algorithm library;
the obtaining module 302 is configured to obtain a sound effect processing request of a user;
the creating module 303 is configured to create a target sound effect from the loaded sound effect algorithm library through the factory mode if the target sound effect specified by the sound effect processing request does not exist in the sound effect management list;
the saving module 304 is configured to save the target sound effect into the sound effect management list, and is configured to perform sound effect processing on the audio data to be processed.
In an alternative embodiment, the creating module 303, when being configured to create the target sound effect from the loaded sound effect algorithm library, is specifically configured to:
and creating a target sound effect from the loaded sound effect algorithm library through a factory mode.
In an alternative embodiment, the audio effect algorithm library corresponding to each plug-in is any one of the following:
the android native system comprises a sound effect algorithm library, a sound effect algorithm library self-researched by manufacturers and a third party payment sound effect algorithm library.
In an alternative embodiment, the creating module 303, when being configured to create the target sound effect from the loaded sound effect algorithm library through the factory mode, is specifically configured to:
acquiring type information of a target sound effect;
determining a target sound effect algorithm corresponding to the type information in the loaded sound effect algorithm library;
and creating the target sound effect through the factory mode based on the target sound effect algorithm.
In an alternative embodiment, the apparatus further comprises:
the processing module 305 is configured to perform sound effect processing on the audio data to be processed based on the sound effect management list;
in an optional implementation manner, when the processing module 305 is configured to perform sound effect processing on the audio data to be processed based on the sound effect management list, specifically, the processing module is configured to:
initializing the sound effects in the sound effect management list;
and according to a preset sequence, carrying out sound effect processing on the audio data to be processed in sequence by using the initialized sound effect.
In an optional implementation, the obtaining module 302 is further configured to:
acquiring a parameter setting instruction and/or a parameter modifying instruction of the sound effect specified by the sound effect processing request;
when the processing module 305 is used to initialize the sound effects in the sound effect management list, specifically, it is used to:
initializing the sound effects in the sound effect management list in response to the parameter setting instruction;
when the processing module 305 is used for performing sound effect processing on the audio data to be processed, it is specifically configured to:
responding to the parameter modification instruction, and modifying the parameters of the sound effects in the sound effect management list;
and performing sound effect processing on the audio data to be processed based on the modified parameters.
In an alternative embodiment, the apparatus further comprises:
the elimination module 306 is configured to eliminate an irrelevant sound effect if the irrelevant sound effect not specified by the sound effect processing request is further included in the sound effect management list.
The apparatus in the embodiments of the present application may perform the method provided in the embodiments of the present application, and the implementation principle is similar, the actions performed by the modules in the apparatus in the embodiments of the present application correspond to the steps in the method in the embodiments of the present application, and for detailed functional description and beneficial effects generated by the modules in the apparatus, reference may be made to the description in the corresponding method shown in the foregoing specifically, and details are not repeated here.
An embodiment of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored on the memory, where the processor executes the computer program to implement the steps of the foregoing method embodiments.
In an alternative embodiment, an electronic device is provided, as shown in fig. 4, the electronic device 400 shown in fig. 4 comprising: a processor 401 and a memory 403. Wherein the processor 401 is coupled to the memory 403, such as via a bus 402. Optionally, the electronic device 400 may further include a transceiver 404, and the transceiver 404 may be used for data interaction between the electronic device and other electronic devices, such as transmission of data and/or reception of data. It should be noted that the transceiver 404 is not limited to one in practical applications, and the structure of the electronic device 400 is not limited to the embodiment of the present application.
The Processor 401 may be a CPU (Central Processing Unit), a general purpose Processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other Programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor 401 may also be a combination of computing functions, e.g., comprising one or more microprocessors, a combination of a DSP and a microprocessor, or the like.
The Memory 403 may be a ROM (Read Only Memory) or other type of static storage device that can store static information and instructions, a RAM (Random Access Memory) or other type of dynamic storage device that can store information and instructions, an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact disk Read Only Memory) or other optical disk storage, optical disk storage (including Compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), a magnetic disk storage medium, other magnetic storage devices, or any other medium that can be used to carry or store a computer program and that can be Read by a computer, without limitation.
The memory 403 is used for storing computer programs for executing the embodiments of the present application, and is controlled by the processor 401 to execute. The processor 401 is adapted to execute a computer program stored in the memory 403 to implement the steps shown in the aforementioned method embodiments.
In the embodiment of the application, the electronic device may further include a sound effect processing module, configured to perform sound effect processing on the audio.
Among them, electronic devices include but are not limited to: terminal devices such as fixed terminals and/or mobile terminals, for example: televisions, desktops, all-in-one machines, mobile phones, tablets, laptops, wearable devices, game consoles, in-vehicle terminals, robots, and the like.
Embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, and when being executed by a processor, the computer program may implement the steps and corresponding contents of the foregoing method embodiments.
Embodiments of the present application further provide a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps and corresponding contents of the foregoing method embodiments can be implemented.
The term numerical references in the description and claims of this application and the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in other sequences than illustrated or otherwise described herein.
It should be understood that, although each operation step is indicated by an arrow in the flowchart of the embodiment of the present application, the implementation order of the steps is not limited to the order indicated by the arrow. In some implementation scenarios of the embodiments of the present application, the implementation steps in the flowcharts may be performed in other sequences as desired, unless explicitly stated otherwise herein. In addition, some or all of the steps in each flowchart may include multiple sub-steps or multiple stages based on an actual implementation scenario. Some or all of these sub-steps or stages may be performed at the same time, or each of these sub-steps or stages may be performed at different times, respectively. Under the scenario that the execution time is different, the execution sequence of the sub-steps or phases may be flexibly configured according to the requirement, which is not limited in the embodiment of the present application.
The above are only optional embodiments of partial implementation scenarios in the present application, and it should be noted that, for those skilled in the art, other similar implementation means based on the technical idea of the present application are also within the scope of protection of the embodiments of the present application without departing from the technical idea of the present application.
Claims (10)
1. A sound effect processing method is characterized by comprising the following steps:
loading at least one plug-in according to the sound effect configuration file, wherein each plug-in corresponds to one sound effect algorithm library to obtain the loaded sound effect algorithm library;
acquiring a sound effect processing request of a user;
if the target sound effect appointed by the sound effect processing request does not exist in the sound effect management list, creating the target sound effect from the loaded sound effect algorithm library;
and storing the target sound effect into the sound effect management list for carrying out sound effect processing on the audio data to be processed.
2. The sound effect processing method according to claim 1, wherein the creating the target sound effect from the loaded sound effect algorithm library comprises:
and creating the target sound effect from the loaded sound effect algorithm library through a factory mode.
3. The sound effect processing method according to claim 1, wherein the sound effect algorithm library corresponding to each plug-in is any one of the following items:
the android native system comprises a sound effect algorithm library, a sound effect algorithm library self-researched by manufacturers and a third party payment sound effect algorithm library.
4. The sound effect processing method according to claim 2, wherein the creating the target sound effect from the loaded sound effect algorithm library through factory mode comprises:
acquiring type information of the target sound effect;
determining a target sound effect algorithm corresponding to the type information in the loaded sound effect algorithm library;
and creating the target sound effect through a factory mode based on the target sound effect algorithm.
5. The sound effect processing method according to any one of claims 1-4, further comprising:
performing sound effect processing on the audio data to be processed based on the sound effect management list;
based on the audio management list, audio processing is performed on the audio data to be processed, and the method comprises the following steps:
initializing the sound effects in the sound effect management list;
and sequentially carrying out sound effect processing on the audio data to be processed by utilizing the initialized sound effect according to a preset sequence.
6. The sound effect processing method according to claim 5, further comprising:
acquiring a parameter setting instruction and/or a parameter modifying instruction of the sound effect specified by the sound effect processing request;
initializing the sound effects in the sound effect management list, including:
responding to the parameter setting instruction, and initializing the sound effect in the sound effect management list;
the audio processing is carried out on the audio data to be processed, and the method comprises the following steps:
responding to the parameter modification instruction, and modifying the parameters of the sound effects in the sound effect management list;
and performing sound effect processing on the audio data to be processed based on the modified parameters.
7. The sound effect processing method according to claim 1, further comprising:
and if the sound effect management list also comprises an irrelevant sound effect which is not specified by the sound effect processing request, eliminating the irrelevant sound effect.
8. An audio processing apparatus, comprising:
the loading module is used for loading at least one plug-in according to the sound effect configuration file, and each plug-in corresponds to one sound effect algorithm library to obtain the loaded sound effect algorithm library;
the acquisition module is used for acquiring a sound effect processing request of a user;
a creation module, configured to create, if a target sound effect specified by the sound effect processing request does not exist in the sound effect management list, the target sound effect from the loaded sound effect algorithm library through a factory mode;
and the storage module is used for storing the target sound effect into the sound effect management list and carrying out sound effect processing on the audio data to be processed.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory, characterized in that the processor executes the computer program to implement the steps of the method of any of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210095819.5A CN114510290A (en) | 2022-01-26 | 2022-01-26 | Sound effect processing method and device, electronic equipment, storage medium and program product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210095819.5A CN114510290A (en) | 2022-01-26 | 2022-01-26 | Sound effect processing method and device, electronic equipment, storage medium and program product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114510290A true CN114510290A (en) | 2022-05-17 |
Family
ID=81550061
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210095819.5A Pending CN114510290A (en) | 2022-01-26 | 2022-01-26 | Sound effect processing method and device, electronic equipment, storage medium and program product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114510290A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103646656A (en) * | 2013-11-29 | 2014-03-19 | 腾讯科技(成都)有限公司 | Sound effect processing method, sound effect processing device, plug-in manager and sound effect plug-in |
| CN105094808A (en) * | 2015-06-26 | 2015-11-25 | 努比亚技术有限公司 | Control device and method |
| CN106020766A (en) * | 2016-05-26 | 2016-10-12 | 北京小米移动软件有限公司 | Music playing method and device |
| CN106251876A (en) * | 2015-06-12 | 2016-12-21 | 徐文波 | Audio mixed method based on HOOK technology and system |
| CN107135260A (en) * | 2017-05-09 | 2017-09-05 | 四川长虹电器股份有限公司 | Intelligent television UI sound effect systems and implementation method |
| CN107590152A (en) * | 2016-07-07 | 2018-01-16 | 乐视控股（北京）有限公司 | A kind of method and device for the audio pattern for adjusting audio |
| CN108255366A (en) * | 2017-04-18 | 2018-07-06 | 广州华多网络科技有限公司 | A kind of update method of live music audio, apparatus and system |
| CN109165005A (en) * | 2018-09-04 | 2019-01-08 | Oppo广东移动通信有限公司 | Audio Enhancement Method, device, electronic equipment and storage medium |
| US20190340098A1 (en) * | 2018-05-03 | 2019-11-07 | Alteros, Inc. | System and method for providing audio processing and inventory tracking and management in a cloud environment |
| CN108475186B (en) * | 2016-12-29 | 2020-02-14 | 华为技术有限公司 | Multimedia data playing method and terminal equipment |
-
2022
- 2022-01-26 CN CN202210095819.5A patent/CN114510290A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103646656A (en) * | 2013-11-29 | 2014-03-19 | 腾讯科技(成都)有限公司 | Sound effect processing method, sound effect processing device, plug-in manager and sound effect plug-in |
| CN106251876A (en) * | 2015-06-12 | 2016-12-21 | 徐文波 | Audio mixed method based on HOOK technology and system |
| CN105094808A (en) * | 2015-06-26 | 2015-11-25 | 努比亚技术有限公司 | Control device and method |
| CN106020766A (en) * | 2016-05-26 | 2016-10-12 | 北京小米移动软件有限公司 | Music playing method and device |
| CN107590152A (en) * | 2016-07-07 | 2018-01-16 | 乐视控股（北京）有限公司 | A kind of method and device for the audio pattern for adjusting audio |
| CN108475186B (en) * | 2016-12-29 | 2020-02-14 | 华为技术有限公司 | Multimedia data playing method and terminal equipment |
| CN108255366A (en) * | 2017-04-18 | 2018-07-06 | 广州华多网络科技有限公司 | A kind of update method of live music audio, apparatus and system |
| CN107135260A (en) * | 2017-05-09 | 2017-09-05 | 四川长虹电器股份有限公司 | Intelligent television UI sound effect systems and implementation method |
| US20190340098A1 (en) * | 2018-05-03 | 2019-11-07 | Alteros, Inc. | System and method for providing audio processing and inventory tracking and management in a cloud environment |
| CN109165005A (en) * | 2018-09-04 | 2019-01-08 | Oppo广东移动通信有限公司 | Audio Enhancement Method, device, electronic equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| WHSHIYUN: "android audio effects框架笔记", pages 1 - 23, Retrieved from the Internet <URL:https://blog.csdn.net/whshiyun/article/details/79806870> * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9558016B2 (en) | Platform system, method for changing support hardware configuration of universal extensible firmware interface basic input output system and computer program product | |
| EP1586967A2 (en) | A method and control system for controlling machinery | |
| CN111399840B (en) | Module development method and device | |
| KR20080023728A (en) | Selective pre-compilation of virtual code to enhance emulator performance | |
| CN114721719B (en) | Method and system for containerized deployment of heterogeneous applications in cluster | |
| CN104025046A (en) | Isa bridging with callback | |
| CN115390945A (en) | Application program running method and device, electronic equipment and readable storage medium | |
| TW202403541A (en) | System, method and device for introducing applet into third-party APP and medium | |
| CN114138363A (en) | Program data calling method, device, equipment and storage medium | |
| CN113741954A (en) | System software generation method and device, electronic equipment and storage medium | |
| CN109145598B (en) | Virus detection method and device for script file, terminal and storage medium | |
| CN107273745B (en) | Dynamic analysis method for malicious code in dynamic link library form | |
| CN114510290A (en) | Sound effect processing method and device, electronic equipment, storage medium and program product | |
| CN110018831B (en) | Program processing method, program processing apparatus, and computer-readable storage medium | |
| US7519719B2 (en) | Automatic creation of protocol dependent control path for instrument application | |
| CN112965733B (en) | Component library updating method, device, electronic equipment and readable storage medium | |
| US11846672B2 (en) | Method and device for testing system-on-chip, electronic device using method, and computer readable storage medium | |
| JP2019179284A (en) | Simulation system and simulation program | |
| CN114489698A (en) | Application program installation method and device | |
| CN112559336A (en) | Method, device and system for adaptively debugging heterogeneous computing chip and mainboard chip | |
| US8695022B2 (en) | Context for replacement functions | |
| CN112328472B (en) | Hardware simulation method and device, electronic equipment and storage medium | |
| CN110874143A (en) | Sensor data acquisition method, intelligent terminal, storage medium and electronic device | |
| CN117289913B (en) | Compiler source file processing method, electronic device and medium | |
| CN106970828A (en) | It is a kind of to be used to carry out instruction adaptive method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Room 263, block B, science and technology innovation center, 128 Shuanglian Road, Haining Economic Development Zone, Haining City, Jiaxing City, Zhejiang Province, 314400 Applicant after: Haining yisiwei IC Design Co.,Ltd. Applicant after: Beijing ESWIN Computing Technology Co.,Ltd. Address before: Room 263, block B, science and technology innovation center, 128 Shuanglian Road, Haining Economic Development Zone, Haining City, Jiaxing City, Zhejiang Province, 314400 Applicant before: Haining yisiwei IC Design Co.,Ltd. Applicant before: Beijing yisiwei Computing Technology Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Country or region after: China Address after: 314499 Building 1, Juanhu Science and Technology Innovation Park, No. 500 Shuiyueting East Road, Xiashi Street, Haining City, Jiaxing City, Zhejiang Province (self declared) Applicant after: Haining Yisiwei Computing Technology Co.,Ltd. Applicant after: Beijing ESWIN Computing Technology Co.,Ltd. Address before: Room 263, block B, science and technology innovation center, 128 Shuanglian Road, Haining Economic Development Zone, Haining City, Jiaxing City, Zhejiang Province, 314400 Applicant before: Haining yisiwei IC Design Co.,Ltd. Country or region before: China Applicant before: Beijing ESWIN Computing Technology Co.,Ltd. |