WO2020073565A1

WO2020073565A1 - Audio processing method and apparatus

Info

Publication number: WO2020073565A1
Application number: PCT/CN2019/073126
Authority: WO
Inventors: 黄传增
Original assignee: 北京字节跳动网络技术有限公司
Priority date: 2018-10-12
Filing date: 2019-01-25
Publication date: 2020-04-16
Also published as: CN111045635A; CN111045635B

Abstract

Disclosed in embodiments of the present disclosure are an audio processing method and apparatus. An implementation of the method comprises: obtaining an audio to be processed; determining whether the current device supports addition of a reverb to said audio; in response to determining that the current device supports addition of a reverb to said audio, determining a reverb algorithm according to a reverb type selected by a user; and processing said audio according to the determined reverb algorithm to obtain a processed audio. The implementation implements configuration of on/off of a reverb effect, thereby avoiding an obvious delay caused by addition of the reverb effect to the device having poor performance.

Description

Audio processing method and device

This patent application requires the priority of the Chinese patent application filed on October 12, 2018, with the application number 201811190930.2, the applicant is Beijing Weibo Vision Technology Co., Ltd., and the invention name is "audio processing method and device". The entire text is incorporated into this application by reference.

Technical field

The embodiments of the present disclosure relate to the field of computer technology, and in particular to audio processing methods and devices.

Background technique

With the continuous updating and iteration of various electronic devices, the performance of various electronic devices is currently different. As a result, the audio processing capabilities are also different. For devices with poor performance, it takes a long time to process audio. In the scene of real-time monitoring, it will cause obvious problems of audio delay after processing.

Summary of the invention

The embodiments of the present disclosure propose an audio processing method and device.

In a first aspect, an embodiment of the present disclosure provides an audio processing method including: acquiring audio to be processed; determining whether the current device supports adding reverb to audio to be processed; in response to determining that the current device supports adding reverb to audio to be processed, The reverb algorithm is determined according to the reverb category selected by the user; according to the determined reverb algorithm, the audio to be processed is processed to obtain the processed audio.

In some embodiments, the method further includes: playing the processed audio.

In some embodiments, determining whether the current device supports adding reverb to the audio to be processed includes: obtaining a device information set; and determining whether the current device supports adding reverb to the audio to be processed according to the device information set.

In some embodiments, in response to determining that the current device supports adding reverb to the audio to be processed, determining a reverb algorithm according to the reverb type selected by the user includes: in response to determining that the current device supports adding reverb to the audio to be processed, obtaining a characterizing device The algorithm category list of the correspondence between the information and the reverberation algorithm category; based on the algorithm category list, determine the reverberation algorithm category corresponding to the device information of the current device, wherein the reverberation algorithm category is used to characterize the category to which the reverberation algorithm belongs ; Determine the reverberation algorithm under the determined reverberation algorithm category according to the reverberation category selected by the user.

In some embodiments, in response to determining that the current device supports adding reverb to the audio to be processed, determining the reverb algorithm according to the reverb type selected by the user includes: in response to determining that the current device supports adding reverb to the audio to be processed, processing the audio Perform audio characteristic analysis to obtain audio characteristic data; determine the reverberation algorithm according to the audio characteristic data and the reverb type selected by the user.

In some embodiments, the category to which the reverb algorithm belongs is divided according to one of the following items: the system overhead required by the reverb algorithm architecture; and the complexity of the reverb algorithm.

In a second aspect, an embodiment of the present disclosure provides an audio processing apparatus including: a first acquiring unit configured to acquire audio to be processed; a first determining unit configured to determine whether the current device supports audio to be processed added Reverberation; the second determining unit is configured to determine the reverberation algorithm according to the reverberation category selected by the user in response to determining that the current device supports adding reverberation to the audio to be processed; The audio to be processed is processed to obtain the processed audio.

In some embodiments, the device further includes a playback unit configured to play the processed audio.

In some embodiments, the first determining unit is further configured to: obtain the device information set; and determine whether the current device supports adding reverberation to the audio to be processed according to the device information set.

In some embodiments, the second determination unit is further configured to: in response to determining that the current device supports adding reverberation to the to-be-processed audio, acquire an algorithm category that characterizes the correspondence between device information and the reverberation algorithm category List; based on the algorithm category list, determine the reverberation algorithm category corresponding to the device information of the current device, wherein the reverberation algorithm category is used to characterize the category of the reverberation algorithm; according to the reverberation category selected by the user, the determined reverberation category The reverb algorithm is determined under the category of reverb algorithm.

In some embodiments, the second determination unit is further configured to: in response to determining that the current device supports adding reverberation to the audio to be processed, perform audio characteristic analysis on the audio to be processed to obtain audio characteristic data; and the second determination unit is It is further configured to determine the reverberation algorithm according to the audio characteristic data and the reverberation category selected by the user.

In a third aspect, an embodiment of the present disclosure provides a terminal device, the terminal device includes: one or more processors; a storage device, on which one or more programs are stored; Or executed by multiple processors, so that the above one or more processors implement the method described in any one of the implementation manners of the first aspect.

According to a fourth aspect, an embodiment of the present disclosure provides a computer-readable medium on which a computer program is stored. When the program is executed by a processor, the method described in any one of the implementation manners of the first aspect is implemented.

The method and apparatus provided by the embodiments of the present disclosure can first determine whether the current device supports adding reverberation to the audio to be processed. Therefore, the reverb effect is turned on or off for different devices. In response to determining that the current device supports adding reverberation to the audio to be processed, the reverberation algorithm is determined according to the reverberation category selected by the user to achieve different environmental simulation effects. According to the determined reverberation algorithm, the audio to be processed is processed to obtain the processed audio. In this process, by configuring the reverb effect on or off, you can avoid the obvious delay caused by adding the reverb effect to devices with poor performance.

BRIEF DESCRIPTION

By reading the detailed description of the non-limiting embodiments made with reference to the following drawings, other features, objects, and advantages of the present disclosure will become more apparent:

FIG. 1 is an exemplary system architecture diagram to which an embodiment of the present disclosure can be applied;

2 is a flowchart of an embodiment of an audio processing method according to the present disclosure;

3 is a schematic diagram of an application scenario of an audio processing method according to an embodiment of the present disclosure;

4 is a flowchart of still another embodiment of the audio processing method according to the present disclosure;

5 is a schematic structural diagram of an embodiment of an audio processing device according to the present disclosure;

6 is a schematic structural diagram of an electronic device suitable for implementing embodiments of the present disclosure.

detailed description

The disclosure will be further described in detail below with reference to the drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the relevant disclosure, rather than limiting the disclosure. It should also be noted that, for ease of description, only the parts related to the relevant disclosure are shown in the drawings.

It should be noted that the embodiments in the present disclosure and the features in the embodiments can be combined with each other without conflict. The disclosure will be described in detail below with reference to the drawings and in conjunction with the embodiments.

FIG. 1 shows an exemplary system architecture 100 to which an audio processing method or apparatus of an embodiment of the present disclosure can be applied.

As shown in FIG. 1, the system architecture 100 may include

terminal devices

101, 102, and 103, a network 104, and a server 105. The network 104 is a medium used to provide a communication link between the

terminal devices

101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, and so on.

The user can use the

terminal devices

101, 102, 103 to interact with the server 105 through the network 104 to receive or send messages, and so on. Various communication client applications, such as singing applications, video recording and sharing applications, and audio processing applications, can be installed on the

terminal devices

101, 102, and 103.

The

terminal devices

101, 102, and 103 may be hardware or software. When the

terminal devices

101, 102, and 103 are hardware, they may be various electronic devices that have a display screen and support audio processing. When the

terminal devices

101, 102, and 103 are software, they can be installed in the above electronic device. It can be implemented as multiple software or software modules, or as a single software or software module. There is no specific limit here.

The server 105 may be a server that provides various services, for example, a back-end server that supports applications installed on the

terminal devices

101, 102, and 103.

It should be noted that the audio processing method provided by the embodiments of the present disclosure is generally executed by the

terminal devices

101, 102, and 103. Correspondingly, the audio processing device is generally provided in the

terminal devices

101, 102, 103.

It should be noted that the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster composed of multiple servers or as a single server. When the server is software, it can be implemented as multiple software or software modules (for example, to provide distributed services), or as a single software or software module. There is no specific limit here.

It should be understood that the numbers of terminal devices, networks, and servers in FIG. 1 are only schematic. According to the implementation needs, there can be any number of terminal devices, networks and servers.

With continued reference to FIG. 2, a flow 200 of one embodiment of an audio processing method according to the present disclosure is shown. The audio processing method includes:

Step 201: Acquire audio to be processed.

In this embodiment, the execution subject of the audio processing method (for example, the

terminal devices

101, 102, and 103 shown in FIG. 1) can acquire the audio to be processed in various ways. For example, the above-mentioned execution subject can record the voice of the user singing through the recording device to obtain the audio to be processed. Wherein, the recording device may be integrated on the above-mentioned executive body, or may be in communication connection with the executive body, which is not limited in this disclosure. For another example, the above-mentioned execution subject may also obtain pre-stored audio from the local or other storage device connected as the audio to be processed.

In this embodiment, the audio to be processed may be any audio. The determination of the audio to be processed can be specified by a technician, or can be screened according to certain conditions. For example, when a user sings through a terminal device (for example, a smartphone), the audio to be processed may be a complete audio sung by the user, or an audio segment sung by the user. In the scenario of real-time monitoring, the audio to be processed may also be an audio segment with a short singing time (for example, 30 milliseconds) by the user.

Step 202: Determine whether the current device supports adding reverberation to the audio to be processed.

In this embodiment, the above-mentioned execution subject may determine in various ways whether the current device supports adding reverberation to the audio to be processed. Wherein, the current device may be the above-mentioned execution subject. In practice, different devices have different performance. When adding reverb to audio, a device with poor processing performance needs a longer processing time when adding reverb to the audio to be processed. In a scenario that requires real-time monitoring, it will cause a significant delay and cannot meet the needs of real-time monitoring. Therefore, it can be considered that these devices do not support adding reverb. As an example, the above-mentioned execution body can obtain the performance parameters of the current device, for example, the number of computing cores in the CPU (Central Processing Unit), the size of the memory, and so on. Afterwards, it can determine whether the current device supports adding reverberation to the audio to be processed according to the preset processing logic or querying a preset performance parameter table, so as to determine whether the current device supports the audio to be processed according to the performance parameter of the current device. The performance parameter table may store the correspondence between the performance parameters of the device and whether it supports adding reverb.

In some optional implementation manners of this embodiment, determining whether the current device supports adding reverb to the audio to be processed may also include: acquiring a device information set; according to the device information set, determining whether the current device supports adding reverb to the audio to be processed .

In these implementations, the device information may be any information that can identify the device. As an example, the device information may be the device model, device name, and so on. As an example, the device information in the device information set may be device information of devices that do not support adding reverberation. At this time, the execution subject may determine whether the device information of the current device is in the device information set. If it is, it can be determined that the current device does not support adding reverb to the audio to be processed. Otherwise, it can be determined that the current device supports adding reverb to the audio to be processed. It can be understood that, in practice, the device information in the foregoing device information set may also be device information of a device that supports adding reverberation.

In this embodiment, if it is determined that the current device supports adding reverberation to the audio to be processed, step 203 may be continued.

In some optional implementations of this embodiment, if it is determined that the current device does not support adding reverb to the audio to be processed, the audio to be processed may be directly played.

Step 203: In response to determining that the current device supports adding reverberation to the audio to be processed, determine the reverberation algorithm according to the reverberation category selected by the user.

In this embodiment, in response to determining that the current device supports adding reverberation to the audio to be processed, the above-mentioned execution subject may determine the reverberation algorithm according to the reverberation category selected by the user. In practice, the reverberation algorithm can be divided into different reverberation categories according to the simulated environmental effects. For example, the reverb category can have hall effects, studio effects, valley effects, and so on. For various reverb categories, category information (such as name, picture, etc.) of each category can be displayed on the above-mentioned executive body. Each category information is associated with the reverb category indicated by the category information. Therefore, the user can perform some operations (such as a click operation) on the category information to select the reverb category.

In this embodiment, the reverberation algorithm corresponding to each reverberation category can be preset, so that the above-mentioned execution subject can determine the reverberation algorithm according to the reverberation category selected by the user.

In some optional implementations of this embodiment, in response to determining that the current device supports adding reverb to the audio to be processed, determining the reverb algorithm according to the reverb type selected by the user includes: in response to determining that the current device supports audio to be processed Add reverberation, analyze the audio characteristics of the audio to be processed, and obtain audio characteristic data; determine the reverberation algorithm according to the audio characteristic data and the reverb type selected by the user.

In these implementations, the above-mentioned execution subject may perform characteristic analysis on the audio to be processed in various ways to obtain audio characteristic data. As an example, the audio to be processed can be analyzed through some existing audio analysis applications or open source toolkits. Among them, the audio characteristics include audio frequency, bandwidth, amplitude and so on. On this basis, the reverberation algorithm can be determined according to the audio characteristic data and the reverberation category selected by the user. Specifically, in the correspondence table between the pre-established audio characteristic data and the reverb category and the reverb algorithm, the reverb algorithm matching the obtained audio characteristic data and the reverb category selected by the user can be queried .

Step 204: Process the audio to be processed according to the determined reverberation algorithm to obtain the processed audio.

In this embodiment, the above-mentioned execution subject may process the audio to be processed according to the determined reverberation algorithm to obtain the processed audio. Specifically, the audio to be processed may be input to at least one filter set according to the determined reverberation algorithm, so as to obtain the processed audio. It should be noted that the number of filters and the like corresponding to each reverberation algorithm can be preset. It should be noted that each reverberation algorithm can be obtained by combining at least one filter. For example, comb filters and all-pass filters can be selected for combination. The filter here may be a hardware module in the current device or a software module in the current device according to implementation needs.

3, FIG. 3 is a schematic diagram of an application scenario of the audio processing method according to this embodiment. In the application scenario of FIG. 3, the execution subject of the audio processing method may be the smartphone 301. The smartphone 301 first obtains audio 3011 to be processed. After that, according to the performance parameters of the mobile phone 301. The performance parameter takes the number of computing cores in the CPU as an example, the smartphone 301 takes dual cores as an example, and the preset processing logic is dual cores as an example to support adding reverb. The smartphone 301 can determine that the current device 301 supports adding reverb to the audio 3011 to be processed. In response to determining that the current device 301 supports adding reverberation to the audio to be processed, according to the reverberation category selected by the user 3012, taking the reverberation category selected by the user as a valley effect as an example, it can be determined by querying a preset correspondence table The reverb algorithm 3013 corresponding to the reverb category of the valley effect. According to the determined reverberation algorithm 3013, the audio to be processed is processed to obtain the processed audio 3011 '.

The method provided by the above embodiments of the present disclosure may determine whether the current device supports adding reverberation to the audio to be processed, so as to configure the reverberation effect to be turned on or off for different devices. In response to determining that the current device supports adding reverberation to the audio to be processed, the reverberation algorithm is determined according to the reverberation category selected by the user to achieve different environmental simulation effects. According to the determined reverberation algorithm, the audio to be processed is processed to obtain the processed audio. In this process, by configuring the reverb effect on or off, you can avoid the obvious delay caused by adding the reverb effect to devices with poor performance.

With further reference to FIG. 4, it shows a flow 400 of yet another embodiment of an audio processing method. The process 400 of the audio processing method includes the following steps:

Step 401: Acquire audio to be processed.

Step 402: Determine whether the current device supports adding reverb to the audio to be processed.

In this embodiment, for the specific processing of

steps

401 and 402 and the resulting technical effects, reference may be made to

steps

201 and 202 in the embodiment corresponding to FIG. 2, and details are not described herein again.

Step 403: In response to determining that the current device supports adding reverberation to the audio to be processed, obtain a list of algorithm categories.

In this embodiment, in response to determining that the current device supports adding reverberation to the audio to be processed, the above-mentioned execution subject may obtain the algorithm category list in various ways. As an example, a list of algorithm categories issued by a server connected by communication may be received. As an example, the algorithm category list may be stored locally in advance, so that the algorithm category list can be directly obtained locally. Among them, the algorithm category list is used to characterize the correspondence between the device information and the reverberation algorithm category. In practice, you can divide the reverberation algorithms according to certain indicators, such as the system overhead required by the algorithm architecture or the complexity of the algorithm, to obtain different types of reverberation algorithms. The reverberation algorithm category is used to characterize the category to which the reverberation algorithm belongs. As an example, it can be divided into three categories according to the system overhead required by the algorithm. The first category has low system overhead, which can be achieved by including comb filters, all-pass filters, Schroeder filters, or a combination of these filters. The second category has a large system overhead, which can be combined with a delay filter through high and low-pass filtering, or an existing filter system, such as a Muller Moorer reverberator. The third category has medium system overhead, which can be realized by a combination of a feedback network and an all-pass filter.

On this basis, by running different types of algorithms on various devices, the types of reverb algorithms supported by each device are determined. Thereby establishing the correspondence between device information and reverberation algorithm.

Step 404, based on the algorithm category list, determine the reverberation algorithm category corresponding to the device information of the current device.

In this embodiment, the execution subject may determine the reverberation algorithm category corresponding to the device information of the current device based on the algorithm category list. Specifically, the device information of the current device can be matched in the algorithm category list, so as to obtain the reverberation algorithm category corresponding to the device information of the current device.

Step 405: Determine the reverberation algorithm under the above reverberation algorithm category according to the reverberation category selected by the user.

In this embodiment, the execution subject may determine the reverberation algorithm under the reverberation algorithm category according to the reverberation category selected by the user.

It should be noted that each reverb algorithm category may include multiple algorithms. These algorithms differ according to the simulated environmental effects. Therefore, on the basis of the reverberation algorithm category determined in step 404, the above-mentioned execution subject can determine the applicable reverberation algorithm among various algorithms under the reverberation algorithm category according to the reverberation category selected by the user. It should be noted that, among the various algorithms under this category of reverberation algorithms, for determining the specific implementation of the applicable reverberation algorithm and the technical effects it brings, refer to step 203 in the embodiment corresponding to FIG. 2, here No longer.

Step 406: Process the audio to be processed according to the determined reverberation algorithm to obtain the processed audio.

In this embodiment, the specific processing of step 406 and the technical effect brought by it can refer to step 204 in the embodiment corresponding to FIG. 2, which will not be repeated here.

Step 407: Play the processed audio.

In this embodiment, the above-mentioned execution subject may play the processed audio through a playback device integrated or communicatively connected in the above-mentioned execution subject. As an example, in the scene of the user's karaoke, the audio playback device can play the processed audio, so that the user can monitor the audio with added reverberation in real time.

As can be seen from FIG. 4, compared with the embodiment corresponding to FIG. 2, the audio processing method in this embodiment adds the determination of the reverberation algorithm category based on the algorithm category list, and the determination of the reverberation under the determined reverberation algorithm category Algorithm steps. Reverberation algorithms under different reverberation algorithm categories are implemented for different devices. By setting the reverberation algorithms under different reverberation algorithm categories, it is possible to realize the better performance of equipment with better performance and make full use of its performance. For devices with poor performance, system overhead can be reduced.

With further reference to FIG. 5, as an implementation of the methods shown in the above figures, the present disclosure provides an audio processing device. The device embodiment corresponds to the method embodiment shown in FIG. 2. The device can be specifically applied to various In electronic equipment.

As shown in FIG. 5, the audio processing device 500 of this embodiment includes: a first acquisition unit 501, a first determination unit 502, a second determination unit 503, and a processing unit 504. The first acquisition unit 501 is configured to acquire audio to be processed. The first determination unit 502 is configured to determine whether the current device supports adding reverberation to the audio to be processed. The second determination unit 503 is configured to determine the reverberation algorithm according to the reverberation category selected by the user in response to determining that the current device supports adding reverberation to the audio to be processed. The processing unit 504 is configured to process the audio to be processed according to the determined reverberation algorithm to obtain the processed audio.

In this embodiment, the specific processing of the first acquiring unit 501, the first determining unit 502, the second determining unit 503, and the processing unit 504 in the audio processing device 500 and the technical effects brought about by them can refer to the corresponding Steps 201-204 in the embodiment will not be repeated here.

In some optional implementations of this embodiment, the device 500 may further include: a playback unit (not shown in the figure). The playback unit is configured to play the processed audio.

In some optional implementations of this embodiment, the first determining unit 502 may be further configured to: obtain a device information set; and determine whether the current device supports adding reverberation to the audio to be processed according to the device information set.

In some optional implementations of this embodiment, the second determining unit 503 is further configured to: in response to determining that the current device supports adding reverberation to the audio to be processed, obtain information for characterizing the device and the type of reverberation algorithm The algorithm category list of the correspondence between them; based on the algorithm category list, determine the reverberation algorithm category corresponding to the device information of the current device, where the reverberation algorithm category is used to characterize the category to which the reverberation algorithm belongs; The reverb algorithm is determined under the reverb algorithm category.

In some optional implementations of this embodiment, the second determining unit 503 is further configured to: in response to determining that the current device supports adding reverberation to the audio to be processed, perform audio characteristic analysis on the audio to be processed to obtain audio characteristics Data; determine the reverberation algorithm according to the audio characteristic data and the reverberation category selected by the user.

In some optional implementations of this embodiment, the category to which the reverb algorithm belongs is divided according to one of the following items: the system overhead required by the reverb algorithm architecture; and the complexity of the reverb algorithm.

In this embodiment, the first determining unit 502 may determine whether the current device supports adding reverberation to the audio to be processed, so as to configure the reverberation effect to be turned on or off for different devices. In response to determining that the current device supports adding reverberation to the audio to be processed, the second determining unit 503 determines a reverberation algorithm according to the reverberation category selected by the user, so as to achieve different environmental simulation effects. The processing unit 504 may process the audio to be processed according to the determined reverberation algorithm, so as to obtain the processed audio. In this process, by configuring the reverb effect on or off, you can avoid the obvious delay caused by adding the reverb effect to devices with poor performance.

Reference is now made to FIG. 6, which shows a schematic structural diagram of an electronic device (for example, the terminal device in FIG. 1) 600 suitable for implementing the embodiments of the present disclosure. Terminal devices in the embodiments of the present disclosure may include, but are not limited to, such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals ( For example, mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers, and so on. The electronic device shown in FIG. 6 is just an example, and should not bring any limitation to the functions and use scope of the embodiments of the present disclosure.

As shown in FIG. 6, the electronic device 600 may include a processing device (such as a central processing unit, a graphics processor, etc.) 601, which may be loaded into random access according to a program stored in a read-only memory (ROM) 602 or from the storage device 608 The program in the memory (RAM) 603 performs various appropriate operations and processes. In the RAM 603, various programs and data necessary for the operation of the electronic device 600 are also stored. The processing device 601, ROM 602, and RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

Generally, the following devices can be connected to the I / O interface 605: including input devices 606 such as touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc .; including, for example, liquid crystal display (LCD), speaker, vibration An output device 607 such as a storage device; a storage device 608 including, for example, a magnetic tape, a hard disk, etc .; and a communication device 609. The communication device 609 may allow the electronic device 600 to perform wireless or wired communication with other devices to exchange data. Although FIG. 6 shows an electronic device 600 having various devices, it should be understood that it is not required to implement or have all the devices shown. More or fewer devices may be implemented or provided instead.

In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product that includes a computer program carried on a computer-readable medium, the computer program containing program code for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network through the communication device 609, or from the storage device 608, or from the ROM 602. When the computer program is executed by the processing device 601, the above-described functions defined in the method of the embodiments of the present disclosure are executed.

It should be noted that the computer-readable medium described in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In this disclosure, the computer-readable signal medium may include a data signal that is propagated in baseband or as part of a carrier wave, in which computer-readable program code is carried. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable signal medium may send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device . The program code contained on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: electric wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

The computer-readable medium may be included in the electronic device; or it may exist alone without being assembled into the electronic device. The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device is caused to: obtain the audio to be processed; determine whether the current device supports adding reverb to the audio to be processed; In order to determine that the current device supports adding reverb to the audio to be processed, the reverb algorithm is determined according to the reverb category selected by the user; according to the determined reverb algorithm, the audio to be processed is processed to obtain the processed audio.

Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, the programming languages including object-oriented programming languages such as Java, Smalltalk, C ++, and also including conventional Procedural programming language-such as "C" language or similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as an independent software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In situations involving remote computers, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (eg, through an Internet service provider Internet connection).

The flowchart and block diagrams in the drawings illustrate the possible implementation architecture, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or part of code that contains one or more logic functions Executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession can actually be executed in parallel, and sometimes they can also be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented with dedicated hardware-based systems that perform specified functions or operations Or, it can be realized by a combination of dedicated hardware and computer instructions.

The units described in the embodiments of the present disclosure may be implemented in software or hardware. In some cases, the name of the unit does not constitute a limitation on the unit itself. For example, the first acquiring unit may also be described as a “unit acquiring audio to be processed”.

The above description is only the preferred embodiment of the present disclosure and the explanation of the applied technical principles. Those skilled in the art should understand that the scope of the disclosure in this disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, but should also cover the above technical features or without departing from the above disclosed concepts. Other technical solutions formed by arbitrary combinations of equivalent features. For example, the above features and the technical features disclosed in this disclosure (but not limited to) having similar functions are replaced with each other to form a technical solution.

Claims

An audio processing method, including:

Obtain pending audio;

Determine whether the current device supports adding reverberation to the audio to be processed;

In response to determining that the current device supports adding reverberation to the audio to be processed, the reverberation algorithm is determined according to the reverberation category selected by the user;

According to the determined reverberation algorithm, the audio to be processed is processed to obtain processed audio.
The method of claim 1, wherein the method further comprises:

Play the processed audio.
The method according to claim 2, wherein the determining whether the current device supports adding reverberation to the audio to be processed includes:

Get device information collection;

According to the device information set, it is determined whether the current device supports adding reverberation to the audio to be processed.
The method according to claim 3, wherein, in response to determining that the current device supports adding reverberation to the audio to be processed, determining the reverberation algorithm according to the reverberation category selected by the user includes:

In response to determining that the current device supports adding reverberation to the audio to be processed, obtaining a list of algorithm categories that characterize the correspondence between device information and the type of reverberation algorithm;

Based on the algorithm category list, determine the reverberation algorithm category corresponding to the device information of the current device, where the reverberation algorithm category is used to characterize the category to which the reverberation algorithm belongs;

According to the reverb category selected by the user, the reverb algorithm is determined under the determined reverb algorithm category.
The method according to claim 3, wherein, in response to determining that the current device supports adding reverberation to the audio to be processed, determining the reverberation algorithm according to the reverberation category selected by the user includes:

In response to determining that the current device supports adding reverberation to the audio to be processed, performing audio characteristic analysis on the audio to be processed to obtain audio characteristic data;

Determine the reverberation algorithm according to the audio characteristic data and the reverberation category selected by the user.
The method according to claim 4, wherein the category to which the reverberation algorithm belongs is divided according to one of the following items:

The system overhead required for the reverberation algorithm architecture; and

The complexity of the reverb algorithm.
An audio processing device, including:

The first acquiring unit is configured to acquire audio to be processed;

The first determining unit is configured to determine whether the current device supports adding reverberation to the audio to be processed;

The second determining unit is configured to determine the reverberation algorithm according to the reverberation category selected by the user in response to determining that the current device supports adding reverberation to the audio to be processed;

The processing unit is configured to process the audio to be processed according to the determined reverberation algorithm to obtain processed audio.
The device according to claim 7, wherein the device further comprises:

The playing unit is configured to play the processed audio.
The apparatus according to claim 8, wherein the first determining unit is further configured to:

Get device information collection;

According to the device information set, it is determined whether the current device supports adding reverberation to the audio to be processed.
The apparatus according to claim 9, wherein the second determining unit is further configured to:

In response to determining that the current device supports adding reverberation to the audio to be processed, obtaining a list of algorithm categories that characterize the correspondence between device information and the type of reverberation algorithm;

Based on the algorithm category list, determine the reverberation algorithm category corresponding to the device information of the current device, where the reverberation algorithm category is used to characterize the category to which the reverberation algorithm belongs;

According to the reverb category selected by the user, the reverb algorithm is determined under the determined reverb algorithm category.
The apparatus according to any one of claims 9, wherein the second determining unit is further configured to:

In response to determining that the current device supports adding reverberation to the audio to be processed, performing audio characteristic analysis on the audio to be processed to obtain audio characteristic data;

Determine the reverberation algorithm according to the audio characteristic data and the reverberation category selected by the user.
The apparatus according to claim 10, wherein the category to which the reverberation algorithm belongs is divided according to one of the following items:

The system overhead required for the reverberation algorithm architecture; and

The complexity of the reverb algorithm.
A terminal device, including:

One or more processors;

A storage device on which one or more programs are stored,

When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1-6.
A computer-readable medium on which a computer program is stored, wherein the program is executed by a processor to implement the method according to any one of claims 1-6.