CN109448740B

CN109448740B - Voice sound effect processing method and device and voice system

Info

Publication number: CN109448740B
Application number: CN201811549257.7A
Authority: CN
Inventors: 罗树浩; 赵宇杰
Original assignee: Netease Hangzhou Network Co Ltd
Current assignee: Netease Hangzhou Network Co Ltd
Priority date: 2018-12-18
Filing date: 2018-12-18
Publication date: 2022-05-27
Anticipated expiration: 2038-12-18
Also published as: CN109448740A

Abstract

The application discloses a method and a device for processing voice sound effect and a voice system. The method comprises the following steps: acquiring an audio data set sent by a server corresponding to a target application; under the condition that the target plug-in is in an enabled state, sending the audio data set to the target plug-in; and acquiring a target data set to be played, which is sent by the target plug-in, wherein the target data set is generated by the target plug-in performing sound effect processing on the audio data set according to the service data of the target application. Through the application, the problem that the coupling between the voice system and the game in the related technology is too strong is solved.

Description

Voice sound effect processing method and device and voice system

Technical Field

The application relates to the technical field of game sound effect processing, in particular to a method and a device for processing voice sound effects and a voice system.

Background

The multi-user real-time voice system is a software system for performing remote online real-time voice communication by using computer equipment by a plurality of users. In a real-time voice system, a user A acquires own voice by means of a microphone and other acquisition equipment, the own voice is transmitted to other users of the same voice stream through a network, and the other users can hear the voice of the user A by playing the voice through speaker equipment. Meanwhile, the user A can also listen to the speech of other people. A typical application scene of multi-player real-time voice is an RPG game, and game users communicate through voice to achieve the purpose of mutual cooperation.

For game applications with complex scenes, in order to improve user experience, voice interaction needs to be combined with the scenes in the game to perform certain sound effect processing. For example, a voice attenuation effect based on a distance between game characters, an echo effect based on a game scene, and a sound change effect based on a demand of the game characters.

To achieve the real-time voice effect in the above example, the voice data needs to be processed, i.e. the required voice sound effect is added. In the prior art, because the voice effects of the same sound source at different playing terminals are different, the processing of the voice effect is not performed at the sound source terminal for collecting the voice but at the playing terminal for receiving the voice, and specifically, the processing method of the current real-time voice effect is as follows: and setting a data interface for data transmission for the voice system to receive service data provided by a service layer (such as game service), and further enabling the voice system to process the audio data according to the service data to generate audio data added with sound effect.

The above processing method can cause the technical problem that the coupling between the voice system and the game itself is too strong, and no effective solution has been proposed for the technical problem.

Disclosure of Invention

The present application mainly aims to provide a method, an apparatus and a voice system for processing voice sound effect, so as to solve the problem of too strong coupling between the voice system and the game itself in the related art.

In order to achieve the above object, according to one aspect of the present application, a method for processing voice sound effects is provided. The method comprises the following steps: acquiring an audio data set sent by a server corresponding to a target application; sending the audio data set to a target plug-in under the condition that the target plug-in is in an enabled state; and acquiring a target data set to be played, which is sent by the target plug-in, wherein the target data set is generated by the target plug-in performing sound effect processing on the audio data set according to the service data of the target application.

Optionally, the method further comprises: and under the condition that the target plug-in is in a deactivated state, determining the audio data set sent by the server as a data set to be played.

Optionally, the sending the audio data set to the target plug-in includes: storing the audio data set in a target memory for the target plug-in to read the audio data set from the target memory; the obtaining of the target data set to be played generated by the target plug-in includes: and reading the target data set from the target memory, wherein the target data set is a data set generated by the target plug-in according to the audio data set and stored in the target memory.

Optionally, said storing the set of audio data in a target memory comprises: acquiring the access authority of a writing area of the target memory; after the access authority of the writing area of the target memory is acquired, storing the audio data set in the writing area of the target memory, wherein the access authority of the writing area of the target memory grants a unique object at any time; the reading of the target data set generated by the target plug-in from the target storage comprises: acquiring the access authority of a reading area of the target memory every other preset time period; and after the access authority of the reading area of the target memory is acquired, reading a target data set from the reading area of the target memory, wherein the access authority of the reading area of the target memory grants a unique object at any time.

Optionally, after sending the set of audio data to the target plug-in, the method further comprises: determining the processing time length of each audio data in the audio data set by the target plug-in; determining whether target audio data with processing duration larger than a preset threshold exists according to the processing duration of each audio data; in the presence of the target audio data, determining to disable a target plug-in that processes the target audio data.

Optionally, the method further comprises: under the condition that the specified target plug-in is determined to be enabled, an enabling instruction is generated and the access right of a writing area of the target memory is obtained; after the access authority of the writing area of the target memory is acquired, storing the enabling instruction in the target memory, wherein the enabling instruction is used for enabling the appointed target plug-in to enter an enabling state when the access authority of the reading area of the target memory is acquired and the enabling instruction is read; under the condition that the specified target plug-in is determined to be deactivated, generating a deactivation instruction and acquiring the access authority of the writing area of the target memory; and after the access authority of the writing area of the target memory is acquired, storing the disabling instruction in the target memory, wherein the specified target plug-in enters a disabling state when the access authority of the reading area of the target memory is acquired and the disabling instruction is read.

In order to achieve the above object, according to one aspect of the present application, a method for processing voice sound effects is provided. The method comprises the following steps: the voice system acquires an audio data set sent by a server corresponding to a target application; under the condition that a target plug-in is in an enabled state, the voice system sends the audio data set to the target plug-in; the target plug-in receives the audio data set, performs sound effect processing on the received audio data set according to the service data of the target application to obtain a target data set and sends the target data set to the voice system; and the voice system receives the target data set and takes the target data set as a data set to be played.

Optionally, the sending, by the speech system, the audio data set to the target plug-in includes: the voice system acquires the access authority of a writing area of the target memory every other preset time period; after the voice system acquires the access authority of the writing area of the target memory, storing the audio data set in the writing area of the target memory; the target plug-in receiving the set of audio data comprises: the target plug-in obtains the access authority of the writing area of the target memory every a preset time period; after the target plug-in obtains the access right of the writing area of the target memory, reading the audio data set stored in the writing area of the target memory, wherein the access right of the writing area of the target memory grants a unique object at any time; the target plug-in sending the target data set to the voice system comprises: the target plug-in acquires the access authority of the reading area of the target memory every a preset time period; after the target plug-in obtains the access right of the reading area of the target memory, storing the target data set in the reading area of the target memory; the receiving, by the speech system, the target set of data includes: the voice system acquires the access authority of the reading area of the target memory every other preset time period; and after the voice system acquires the access authority of the reading area of the target memory, reading the target data set stored in the reading area of the target memory, wherein the access authority of the reading area of the target memory grants a unique object at any time.

Optionally, in a case that there are a plurality of target plug-ins, the method further includes: if the voice system sends an enabling instruction to a specified target plug-in, the specified target plug-in responds to the enabling instruction and enters an enabling state; if the voice system sends a stopping instruction to a specified target plug-in, the specified target plug-in responds to the stopping instruction and enters a stopping state; and under the condition that the target plug-in is in a disabled state, the voice system determines an audio data set sent by the server as a data set to be played.

To achieve the above object, according to another aspect of the present application, there is provided a speech system. The speech system includes: the first acquisition unit is used for acquiring an audio data set sent by a server corresponding to a target application; the sending unit is used for sending the audio data set to the target plug-in unit under the condition that the target plug-in unit is in an enabled state; and the second acquisition unit is used for acquiring a target data set to be played, which is sent by the target plug-in, wherein the target data set is generated by the target plug-in performing sound effect processing on the audio data set according to the service data of the target application.

In order to achieve the above object, according to another aspect of the present application, there is provided a processing apparatus for voice sound effects. The device includes: the voice system is used for acquiring an audio data set sent by a server corresponding to a target application, and storing the audio data set in a target memory under the condition that a target plug-in is in an enabled state so as to acquire a target data set to be played, which is generated by the target plug-in; and the target plug-in is used for reading the audio data set stored in the target memory, carrying out sound effect processing on the audio data set based on the service data of the target application to obtain a target data set, and sending the target data set to the voice system.

In order to achieve the above object, according to another aspect of the present application, there is provided a storage medium including a stored program, wherein the program executes the processing method of the voice sound effect described in any one of the above.

In order to achieve the above object, according to another aspect of the present application, there is provided a processor for executing a program, wherein the program executes the processing method of the voice sound effect according to any one of the above items.

Through the application, the following steps are adopted: acquiring an audio data set sent by a server corresponding to a target application; sending the audio data set to a target plug-in under the condition that the target plug-in is in an enabled state; and acquiring a target data set to be played, which is sent by the target plug-in, wherein the target data set is generated by the target plug-in performing sound effect processing on the audio data set according to the service data of the target application, so that the technical problem of over-strong coupling between a voice system and a game in the related technology is solved. And further achieves the technical effect of reducing the strong coupling between the voice system and the target application (such as game application) on the premise of realizing the sound effect processing on the audio data set.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the application and, together with the description, serve to explain the application and are not intended to limit the application. In the drawings:

FIG. 1 is a diagram illustrating a method for processing audio effects in the prior art;

FIG. 2 is a schematic flow chart illustrating a method for processing audio effects according to an embodiment of the present disclosure;

FIG. 3 is a flowchart illustrating another method for processing audio effects according to an embodiment of the present disclosure;

FIG. 4 is a flowchart illustrating another method for processing audio effects according to an embodiment of the present disclosure;

FIG. 5 is a flowchart illustrating another method for processing audio effects according to an embodiment of the present disclosure;

FIG. 6 is a flowchart illustrating another method for processing audio effects according to an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of a speech system provided in an embodiment of the present application; and

fig. 8 is a schematic structural diagram of a speech apparatus according to an embodiment of the present application.

Detailed Description

It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the application described herein may be used. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

In order to facilitate understanding of the technical problems solved by the present application, the following detailed analysis of the technical problems generated by the prior art is performed:

first, the real-time voice system works as a character of a subsystem in a game, and functions are relatively independent. At the beginning of game service establishment, a game service control voice system usually performs functions of collecting voice streams and playing the voice streams, so as to realize normal real-time voice functions in the game running process, i.e. the voice system does not have data of the game service therein, and does not process contents related to the game service. At this time, the voice system is different from the game service of fast iteration, and the function and performance of the voice system are stable.

In the subsequent development of the game industry, as shown in fig. 1, the voice sound effect is tightly combined with the game service scene. At this time, the voice system needs to expose an interface to the game service to allow the service to provide game data, and the voice system processes the game data and the voice data in combination. Similarly, when the game service needs to modify the implementation of the sound effect, for example, modifying the attenuation coefficient, the sound effect processing in the voice system needs to be modified correspondingly, and at this time, frequent modification of the voice system may cause the instability of the voice system, which is likely to cause abnormal situations such as downtime, and finally causes the instability of the whole game system.

Secondly, the real-time voice system is generally a system with strong versatility, high portability and plug and play, and the positioning is a special functional system. The basic functions of the voice system include sound collection, playing, sound mixing, recording, muting, collection control, voice shielding and the like, and the voice system can be used in most game systems at the beginning of game service establishment. The sound effect customized by the game service is strong in combination with the characteristics of the game and low in correlation with the basic function of the voice system. Therefore, the business content of the game is put in the voice system to be realized, the universality of the voice system is damaged, and the voice system is difficult to multiplex.

Finally, the game development work and the voice system development work are undertaken by different developers, so that the business content of the game is put in the voice system to be realized, which is not favorable for division of labor and cooperation, code authority control and the like. In addition, the real-time voice system of the game is not necessarily developed by the game development group, and may be accessed from a voice library provided by a third party. In this case, it becomes difficult to modify the implementation of the voice sound effect.

Based on the technical problems in the prior art, according to the embodiment of the application, a method for processing voice sound effect is provided.

FIG. 2 is a flowchart of a method for processing audio effects according to an embodiment of the present application. As shown in fig. 2, the method comprises the steps of:

and step S102, acquiring an audio data set sent by a server corresponding to the target application.

And step S104, sending the audio data set to the target plug-in under the condition that the target plug-in is in the enabled state.

And step S106, acquiring a target data set to be played, which is sent by the target plug-in, wherein the target data set is generated by the target plug-in performing sound effect processing on the audio data set according to the service data of the target application.

According to the processing method of the voice sound effect, the audio data set sent by the server corresponding to the target application is obtained; under the condition that the target plug-in is in an enabled state, sending the audio data set to the target plug-in; the method comprises the steps of obtaining a target data set to be played, sent by a target plug-in, wherein the target data set is generated by performing sound effect processing on an audio data set by the target plug-in according to service data of target application, and the technical problem that the coupling between a voice system and a game in the related technology is too strong is solved.

That is, the voice system does not perform sound effect processing on the audio data set according to the service data of the target application, but sends the audio data set to the independently set target plug-in unit under the condition that the target plug-in unit is in the enabled state, so as to obtain the target plug-in unit and perform sound effect processing on the audio data set according to the service data of the target application to generate the target data set. At this time, sound effect processing on the audio data set is realized, and meanwhile, the coupling between the voice system and the target application (such as a game application) is reduced.

Furthermore, when the technical personnel iterate the game service in the technical scheme provided by the application, the technical personnel do not need to iterate the voice system, and only the relevant data in the target plug-in is needed to be modified, so that the workload of the technical personnel is greatly reduced, and the stability and the universality of the voice system are improved.

It should also be noted that: in the processing method of the voice sound effect provided by the embodiment of the application, the method may further include: and under the condition that the target plug-in is in a deactivated state, determining the audio data set sent by the server as a data set to be played.

That is, according to the processing method for the voice sound effect provided by the embodiment of the application, under the condition that the target plug-in is in the enabled state, the audio data set is sent to the target plug-in, so that the target data set to be played and sent by the target plug-in can be obtained; and under the condition that the target plug-in is in a deactivated state, determining the audio data set sent by the server as a data set to be played. Namely, if the target plug-in is in the enabled state, the target plug-in performs sound effect processing on the audio data set to acquire the target data set to be played, and if the target plug-in is in the disabled state, the received audio data set is directly specified as the data set to be played, and at this time, sound effect processing is not performed on the audio data.

At this time, it is shown that in the processing method of the voice sound effect provided by the embodiment of the present application, the operation of the target plug-in and the operation of the voice system are independent and independent of each other. And under the condition that the target plug-in is in a stop state, the voice system can still independently operate, the function of normal real-time voice playing is realized, the universality of the voice system is ensured, and the technical effect that the voice system can still play real-time voice under the condition that the target plug-in is in the stop state is achieved.

First, the transmission and acquisition steps in the above steps S104 and S106 will be schematically described:

optionally, in the method for processing a voice sound effect provided in the embodiment of the present application, sending the audio data set to the target plug-in includes: storing the audio data set in a target memory for the target plug-in to read the audio data set from the target memory; the method for acquiring the target data set to be played generated by the target plug-in comprises the following steps: and reading a target data set from the target memory, wherein the target data set is a data set generated by the target plug-in according to the audio data set and stored in the target memory.

That is, data interaction between the voice system and the target plug-in may be achieved through the target storage. At this time, under the condition that the target plug-in is in the enabled state, the voice system stores the data which needs to be sent to the target plug-in the target memory, so that the target plug-in can read the data which needs to be sent to the target plug-in by the voice system from the target memory. Similarly, the target plug-in will also store the data to be sent to the voice system in the target memory so that the voice system can read the data from the target memory that the target plug-in needs to send to the voice system.

Further, in order to ensure normal data interaction between the voice system and the target plug-in, in the processing method of voice sound effect provided in the embodiment of the present application, storing the audio data set in the target memory includes: acquiring the access authority of a writing area of a target memory; after the access authority of the writing area of the target memory is acquired, storing the audio data set in the writing area of the target memory, wherein the access authority of the writing area of the target memory grants a unique object at any time; reading the target data set generated by the target plug-in from the target storage comprises: acquiring the access authority of a reading area of a target memory at intervals of a preset time period; and after the access authority of the reading area of the target memory is acquired, reading the target data set from the reading area of the target memory, wherein the access authority of the reading area of the target memory grants a unique object at any time.

Specifically, the situation that the data is abnormal due to the fact that the voice system and the target plug-in are simultaneously read and written is avoided, that is, the situation that the data message read by the target plug-in is abnormal due to the fact that the target plug-in simultaneously reads the data message when the voice system writes the data message in the target memory is avoided. In the method for processing the voice sound effect provided by the embodiment of the application, although the target memory can be subjected to reading and storing operations by the voice system and the target plug-in, the access right of the writing area/the storage area in the target memory is only granted to a unique object at any time, and the target plug-in and the voice system can perform storing or reading operations on the target memory only under the condition of acquiring the access right.

It should be noted that: in the processing method of the voice sound effect provided by the embodiment of the application, the voice system and the target plug-in carry out data interaction through the target memory, so that the following technical effects are achieved: 1. the target plug-in and the voice system carry out audio data transmission through a specified protocol format, so that the coupling is low, and the closure of the voice system is kept; 2. data transmission is carried out between the voice system and the target plug-in through a target memory, and resource access is limited by using a global system lock, so that the data transmission safety is improved.

The global system lock is an access right of a writing area/a storage area in the target memory and only grants a unique object at any time, and the target plug-in and the voice system can execute storage or reading operation on the target memory only under the condition of acquiring the access right.

In addition, in order to avoid the situation that the target plug-in goes down when the target plug-in performs sound effect processing on some audio data, in the method for processing voice sound effects provided in the embodiment of the present application, after sending the audio data set to the target plug-in, the method further includes: determining the processing time length of each audio data in the audio data set by the target plug-in; determining whether target audio data with processing duration larger than a preset threshold exists according to the processing duration of each audio data; in the presence of the target audio data, a target plug-in is determined that disables processing of the target audio data.

In yet another alternative example, prior to determining to deactivate the target plug-in processing the target audio data, the method further comprises: and restarting the target plug-in for processing the target audio data, and stopping the target plug-in for processing the target audio data if the target plug-in fails to restart.

Optionally, in the processing method of voice sound effects provided in the embodiment of the present application, the method further includes: under the condition that the specified target plug-in is determined to be enabled, an enabling instruction is generated and the access right of a writing area of the target memory is obtained; after the access authority of the writing area of the target memory is acquired, storing an enabling instruction in the target memory, wherein the enabling instruction is used for enabling a specified target plug-in to enter an enabling state when the access authority of the reading area of the target memory is acquired and the enabling instruction is read; under the condition that the specified target plug-in is determined to be deactivated, generating a deactivation instruction and acquiring the access right of a writing area of the target memory; and after the access authority of the writing area of the target memory is acquired, storing the stop instruction in the target memory, wherein the stop instruction is used for enabling a specified target plug-in to enter a stop state when the access authority of the reading area of the target memory is acquired and the stop instruction is read, and the number of the specified target plug-ins can be multiple.

It should be noted that: the above-mentioned determination of the target plug-in includes the following scenarios: the user sends an instruction for starting a specified target plug-in, and the target plug-in is restarted due to the fact that the duration of audio data processing of the target plug-in exceeds a preset threshold. The above-mentioned determining to deactivate the target plug-in includes a scenario in which the user sends an instruction to deactivate the specified target plug-in, and a scenario in which the target plug-in is deactivated/restarted because the length of time for which the target plug-in processes the audio data exceeds a preset threshold.

In an optional example, in a case that it is determined that the specified target plug-in is enabled, the voice system may further enable a sub-process, so that the enabled target plug-in is specified to run in the sub-process, thereby achieving a technical effect that the target plug-in runs independently in the voice system enabled sub-process, and does not occupy resources performed by the voice system.

It is also to be emphasized that: in the processing method of the voice sound effect provided by the embodiment of the application, the interaction of the stop/start instruction between the voice system and the target plug-in is still carried out through the target memory, so that the following technical effects are ensured: 1. the target plug-in and the voice system carry out audio data transmission through a specified protocol format, so that the coupling is low, and the closure of the voice system is kept; 2. data transmission is carried out between the voice system and the target plug-in unit in a target memory mode, and resource access is limited by using a global system lock, so that the data transmission safety is improved; 3. the voice system can simultaneously start a plurality of specified target plug-ins so as to have the possibility that the voice system selects a certain target plug-in to carry out sound effect processing on the audio data, and further improve the flexibility of the operation of the target plug-ins.

Furthermore, in the method for processing voice sound effects provided in the embodiment of the present application, as shown in fig. 3, when each piece of audio data in the set of audio data is a voice stream, sending the set of audio data to the target plug-in includes: and respectively sending each voice stream in the audio data set to a target plug-in specified by each voice stream for the target plug-in to independently perform sound effect processing on the received voice stream. Under the condition that a voice system receives a plurality of voice streams, each voice stream can be respectively distributed to different independent target plug-ins, so that the different target plug-ins can respectively and independently load the plurality of voice streams, wherein the target plug-ins are mutually independent, and therefore sound effect processing of the voice streams is mutually independent and does not influence each other.

Finally, it is to be noted that: in the method for processing the voice sound effect provided by the embodiment of the application, after the target data set to be played and sent by the target plug-in is acquired, the method further includes: and performing sound mixing processing on a plurality of target data in the acquired target data set, and playing the target data subjected to the sound mixing processing.

In addition, according to the embodiment of the application, a processing method of the voice sound effect is further provided.

FIG. 4 is a flowchart of a method for processing audio effects according to an embodiment of the present application. As shown in fig. 4, the method comprises the steps of:

step S202, the voice system acquires an audio data set sent by a server corresponding to the target application.

And step S204, under the condition that the target plug-in is in the enabled state, the voice system sends the audio data set to the target plug-in.

And S206, the target plug-in receives the audio data set, performs sound effect processing on the received audio data set according to the service data of the target application to obtain a target data set and sends the target data set to the voice system.

Step S208, the voice system receives the target data set and takes the target data set as a data set to be played.

According to the processing method of the voice sound effect, the voice system is used for acquiring the audio data set sent by the server corresponding to the target application; under the condition that the target plug-in is in an enabled state, the voice system sends the audio data set to the target plug-in; the target plug-in receives the audio data set, performs sound effect processing on the received audio data set according to the service data of the target application to obtain a target data set and sends the target data set to the voice system; the voice system receives the target data set and takes the target data set as a data set to be played, so that the technical problem that the coupling between the voice system and the game is too strong in the related technology is solved.

It should be noted that: in the method for processing a voice sound effect provided in the embodiment of the present application, before step S202, that is, before the voice system acquires the audio data set sent by the server corresponding to the target application, the server sending the audio data set for the voice system still needs to acquire the audio data set. The following schematically illustrates a server collecting an audio data set:

the target application corresponds to a plurality of clients, wherein the client starting the voice acquisition mode is a language sending client. At this time, the voice sending client collects audio data and performs encoding processing on the audio data to send to the server.

In an optional example, the voice sending client sends the audio data to the server, which may be implemented as follows:

step a, the voice sending client acquires an ip address and a port of the server by accessing an http interface and the like, and further establishes a connection link with the server, wherein after the connection link is established successfully, the voice sending client also sends identity verification information to the server, if the verification is successful, the connection state of the link is maintained, and if the verification is unsuccessful, the connection link is cut off.

And b, starting a voice acquisition function by an upper layer service of the voice sending client through the control module, and acquiring the voice of the user by the voice sending client by using hardware devices such as a microphone and the like so as to acquire audio data.

And c, the voice sending client performs filtering, coding and other processing on the collected audio data, wherein the common format of the audio data is PCM during sampling and filtering processing, and the common processing mode is to compress and code the PCM data into an audio format suitable for network transmission, such as AAC, OPUS and the like, during coding the PCM data.

And d, encapsulating the coded audio data by the voice sending client and sending the audio data to the server through the established connection link, wherein the audio data is encapsulated by taking user information such as a timestamp, uuid and the like as the head of the audio data, and further encapsulating the audio data into a network message frame to be sent to the server.

It should be noted that: under the condition that the voice acquisition function is started, the processes of acquisition, filtering, encoding, packaging, sending and the like are continuously and repeatedly carried out.

It should also be noted that: the server receives audio data sent by the voice sending clients, extracts a plurality of audio data to be sent to a target client where the voice system is located according to user information corresponding to the audio data, and combines the audio data into an audio data set to be sent to the target client.

For example, a plurality of users establish a voice channel and perform voice communication in the voice audio, at this time, the clients of the plurality of users respectively send audio data to the server, and the server receives the audio data sent by the plurality of clients and sends audio data corresponding to other clients to the voice receiving client (e.g., a target client).

Further, in the method for processing a voice sound effect provided in the embodiment of the present application, a specific step of the voice system acquiring the audio data set sent by the server corresponding to the target application in step S102 is schematically described:

in an optional example, the receiving, by the target client, the set of audio data sent by the server where the voice system is located may be implemented by:

and e, the target client acquires the ip address and the port of the server by accessing an http interface and the like, and further establishes a connection link of the server, wherein after the connection link is established successfully, the target client also sends identity verification information to the server, if the verification is successful, the link connection state is maintained, and if the verification is unsuccessful, the connection link is cut off.

And f, the target client receives a plurality of network message frames transmitted by the server through the network module, wherein after the plurality of network message frames are received, each network message frame needs to be decoded to obtain user information and audio data contained in each network message frame, and the audio data correspond to the user information one to one.

Further, when the voice system acquires an audio data set sent by a server corresponding to the target application and the target plug-in is in an enabled state, explaining data interaction between the voice system and the target plug-in:

under the condition that the target plug-in is in the enabled state, the voice system and the target plug-in perform audio data interaction through the target memory, which is specifically shown in the following four cases:

firstly, the step of sending the audio data set to the target plug-in unit by the voice system comprises the following steps: the voice system acquires the access authority of the writing area of the target memory every other preset time period; and after the voice system acquires the access right of the writing area of the target memory, storing the audio data set in the writing area of the target memory.

Secondly, the receiving of the audio data set by the target plug-in comprises the following steps: the target plug-in acquires the access authority of the writing area of the target memory every a preset time period; and after the target plug-in obtains the access right of the writing area of the target memory, reading the audio data set stored in the writing area of the target memory.

Thirdly, the target plug-in sends the target data set to the voice system, and the method comprises the following steps: the target plug-in obtains the access authority of the reading area of the target memory every a preset time period; and after the target plug-in obtains the access right of the reading area of the target memory, storing the target data set in the reading area of the target memory.

Fourthly, the receiving of the target data set by the voice system comprises the following steps: the voice system acquires the access authority of the reading area of the target memory every other preset time period; and after the voice system acquires the access right of the reading area of the target memory, reading the target data set stored in the reading area of the target memory.

It is to be emphasized that: the message format for communication between the voice system and the target plug-in may be as shown in FIG. 5, where cmd is the message type; size is the number of bytes of the current message body; the data is the content of the current message body, wherein the message type comprises two types of data message and control message, and the type of the audio data and the type of the target data message are data messages; the disable command and enable command message types are control messages.

In addition, the message format for communication between the voice system and the target plug-in is further divided into a header content (header) describing the ring storage information and a data content (data) describing the ring storage information, and as shown in fig. 6, the header content includes: a head part representing the starting position of the current ring memory, a size part representing the data byte size of the current ring memory, and a total part representing the maximum number of bytes which can be written in the ring memory; the data content (date) is the data itself which needs to be transmitted between the voice system and the target plug-in, wherein when the data which needs to be transmitted between the voice system and the target plug-in exceeds the tail part of the ring storage, the writing is continued from the head part of the ring storage.

It should be noted that: according to the technical scheme, the situation that the voice system and the target plug-in are read and written at the same time easily occurs, and data read and write are abnormal under the situation, namely, when the voice system writes data messages into the target memory, the target plug-in reads the data messages at the same time, and the data messages read by the target plug-in are abnormal messages at the moment.

In order to avoid the above situation, the access right of the writing area of the target memory is granted to the unique object at any time, and similarly, the access right of the reading area of the target memory is also granted to the unique object at any time. That is, a mutually exclusive global system lock is added in the programs of the sound effect system and the target plug-in for reading and writing in the writing area and the reading area of the target memory, and only one party who gets the access authority (lock) can access the writing area/the reading area of the target memory according to the access authority.

In addition, the interactive content between the target plug-in and the voice system further includes a stop instruction, that is, when there are a plurality of target plug-ins, the voice system and the target plug-in interact with each other through the target memory according to the stop instruction, which is specifically shown in the following two cases:

firstly, if the voice system sends an enabling instruction to the appointed target plug-in, the appointed target plug-in responds to the enabling instruction and enters an enabling state.

And secondly, if the voice system sends a shutdown instruction to the specified target plug-in, the specified target plug-in responds to the shutdown instruction and enters a shutdown state.

It should be noted that: and under the condition that the target plug-in is in a deactivated state, the voice system determines the audio data set sent by the server as the data set to be played.

It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.

The embodiment of the present application further provides a processing method for voice sound effects, and it should be noted that the voice system according to the embodiment of the present application can be used to execute the processing method for voice sound effects provided by the embodiment of the present application. The following describes a speech system provided in an embodiment of the present application.

FIG. 7 is a schematic diagram of a speech system according to an embodiment of the present application. As shown in fig. 7, the speech system includes: a first acquisition unit 71, a transmission unit 73, and a second acquisition unit 75.

A first obtaining unit 71, configured to obtain an audio data set sent by a server corresponding to a target application;

a sending unit 73, configured to send the audio data set to the target plug-in when the target plug-in is in an enabled state;

the second obtaining unit 75 is configured to obtain a target data set to be played, which is sent by the target plug-in, where the target data set is generated by performing sound effect processing on an audio data set by the target plug-in according to service data of the target application.

Optionally, in the speech system provided in the embodiment of the present application, the system further includes: the first determining unit is used for determining the audio data set sent by the server side as the data set to be played under the condition that the target plug-in is in a stop state.

Optionally, in the speech system provided in the embodiment of the present application, the sending unit includes: the storage module is used for storing the audio data set in the target storage and is used for the target plug-in to read the audio data set from the target storage; the second acquisition unit includes: and the reading module is used for reading the target data set from the target memory, wherein the target data set is a data set which is generated by the target plug-in according to the audio data set and is stored in the target memory.

Optionally, in the speech system provided in the embodiment of the present application, the storage module includes: the first acquisition submodule is used for acquiring the access authority of the writing area of the target memory; the storage submodule is used for storing the audio data set in the writing area of the target memory after the access authority of the writing area of the target memory is acquired, wherein the access authority of the writing area of the target memory grants a unique object at any time; the reading module includes: the second acquisition submodule is used for acquiring the access authority of the reading area of the target memory at intervals of a preset time period; and the reading submodule is used for reading the target data set from the reading area of the target memory after the access authority of the reading area of the target memory is acquired, wherein the access authority of the reading area of the target memory grants a unique object at any time.

Optionally, in the speech system provided in this embodiment of the present application, after sending the audio data set to the target plug-in, the speech system further includes: the second determining unit is used for determining the processing time of the target plug-in unit on each audio data in the audio data set; the third determining unit is used for determining whether target audio data with the processing time length larger than a preset threshold exists or not according to the processing time length of each audio data; a fourth determination unit configured to determine, in a case where the target audio data exists, a target plug-in that disables processing of the target audio data.

Optionally, in the speech system provided in the embodiment of the present application, the speech system further includes: the first generation unit is used for generating an enabling instruction and acquiring the access authority of the writing area of the target memory under the condition that the specified target plug-in is determined to be enabled; the first storage unit is used for storing the enabling instruction in the target memory after the access authority of the writing area of the target memory is acquired, and the first storage unit is used for enabling the appointed target plug-in to enter an enabling state when the access authority of the reading area of the target memory is acquired and the enabling instruction is read; a second generation unit configured to generate a shutdown instruction and acquire an access right of a write area of the target memory, in a case where it is determined to shutdown the specified target plug-in; and the second storage unit is used for storing the stop instruction in the target memory after the access authority of the writing area of the target memory is acquired, and is used for enabling the specified target plug-in to enter a stop state when the access authority of the reading area of the target memory is acquired and the stop instruction is read.

The voice system provided by the embodiment of the application is used for acquiring the audio data set sent by the server corresponding to the target application through the first acquisition unit; the sending unit is used for sending the audio data set to the target plug-in unit under the condition that the target plug-in unit is in the starting state; the second acquisition unit is used for acquiring a target data set to be played, which is sent by the target plug-in, wherein the target data set is generated by the target plug-in performing sound effect processing on the audio data set according to the service data of the target application, and the technical problem of over-strong coupling between a voice system and a game in the related art is solved.

The embodiment of the present application further provides a processing method for voice sound effect, and it should be noted that the processing device for voice sound effect of the embodiment of the present application can be used to execute the processing method for voice sound effect provided by the embodiment of the present application. The following describes a processing apparatus for audio sound effects provided in an embodiment of the present application.

FIG. 8 is a diagram of a processing apparatus for audio effects according to an embodiment of the present application. As shown in fig. 8, the processing device of the voice sound effect comprises: a voice system and a target plug-in.

The voice system is used for acquiring an audio data set sent by a server corresponding to the target application and storing the audio data set in the target memory under the condition that the target plug-in is in an enabled state so as to acquire a target data set to be played, which is generated by the target plug-in;

and the target plug-in is used for reading the audio data set stored in the target memory, carrying out sound effect processing on the audio data set based on the service data of the target application to obtain a target data set, and sending the target data set to the voice system.

The processing device for voice sound effect provided by the embodiment of the application is used for acquiring an audio data set sent by a server corresponding to a target application through a voice system, and storing the audio data set in a target memory under the condition that a target plug-in is in an enabled state so as to acquire a target data set to be played and generated by the target plug-in; the target plug-in is used for reading the audio data set stored in the target memory, performing sound effect processing on the audio data set based on the service data of the target application to obtain a target data set, and sending the target data set to the voice system, so that the technical problem of over-strong coupling between the voice system and the game in the related technology is solved.

Optionally, in the processing apparatus for voice sound effects provided in the embodiment of the present application, the voice system includes the following sub-units: the first acquisition subunit is used for acquiring the access authority of the writing area of the target memory every preset time period; and the first storage subunit is used for storing the audio data set in the writing area of the target memory after the voice system acquires the access right of the writing area of the target memory.

Optionally, in the processing apparatus for voice sound effects provided in the embodiment of the present application, the voice system includes the following sub-units: the second acquisition subunit is used for acquiring the access authority of the writing area of the target memory every preset time period; and the first reading subunit is used for reading the audio data set stored in the writing area of the target memory after the target plug-in obtains the access right of the writing area of the target memory.

In addition, in the processing apparatus for voice sound effect provided by the embodiment of the present application, the target plug-in further includes the following sub-units: the first acquisition subunit is used for acquiring the access authority of the writing area of the target memory every preset time period; and the second storage subunit is used for storing the target data set in the reading area of the target memory after the target plug-in obtains the access right of the reading area of the target memory.

In addition, in the processing apparatus for audio sound effect provided in the embodiment of the present application, the audio system further includes the following sub-units: the second acquisition subunit is used for acquiring the access authority of the writing area of the target memory every preset time period; a second reading subunit, configured to read the target data set stored in the reading area of the target memory after the voice system obtains the access right of the reading area of the target memory,

wherein, the access right of the writing area of the target memory is granted to the unique object at any time; the access right of the read area of the target memory is granted to the unique object at any time.

Optionally, in the processing apparatus for voice sound effects provided in the embodiment of the present application, if the voice system sends an enabling instruction to a specified target plug-in unit when there are a plurality of target plug-in units, the specified target plug-in unit responds to the enabling instruction and enters an enabling state; if the voice system sends a shutdown instruction to the specified target plug-in, the specified target plug-in responds to the shutdown instruction and enters a shutdown state.

Optionally, in the processing apparatus for voice sound effects provided in the embodiment of the present application, in a case that the target plug-in is in a deactivated state, the voice system is configured to determine the audio data set sent by the server as the data set to be played.

In addition, as shown in fig. 8, the speech system may further include the following modules: the network module is used for establishing a connection link with the server and transmitting audio data; the acquisition hardware is used for acquiring voice data of a user; the audio coding module is used for coding the collected language data; the audio decoding module is used for decoding the audio data transmitted by the server; the target plug-in management module is used for deactivating/activating the target plug-in and reading/writing data messages from the target memory so as to achieve the technical purpose of data interaction with the target plug-in; the audio mixing module is used for carrying out audio mixing processing on target data to be played; and the playing hardware is used for playing the data to be played.

The processing device of the voice sound effect comprises a processor and a memory, wherein the voice system, the target plug-in and the like are stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions.

The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. The kernel can be set to be one or more, and the technical problem of the prior art that the coupling of the voice system and the game is too strong is solved by adjusting the kernel parameters.

The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.

The embodiment of the invention provides a storage medium, wherein a program is stored on the storage medium, and the program can realize any one of the voice sound effect processing methods when being executed by a processor.

The embodiment of the invention provides a processor, which is used for running a program, wherein when the program runs, any one of the voice sound effect processing methods is executed.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A method for processing voice sound effect is characterized by comprising the following steps:

the voice system acquires an audio data set sent by a server corresponding to a target application;

under the condition that the specified target plug-in is determined to be enabled, an enabling instruction is generated and the access right of a writing area of the target memory is obtained; after the access authority of the writing area of the target memory is acquired, storing the enabling instruction in the target memory, wherein the enabling instruction is used for enabling the appointed target plug-in to enter an enabling state when the access authority of the reading area of the target memory is acquired and the enabling instruction is read;

under the condition that a target plug-in is in an enabled state, sending the audio data set to the target plug-in, wherein the operation of the target plug-in is independent of the operation of the voice system;

acquiring a target data set to be played, which is sent by the target plug-in, wherein the target data set is generated by the target plug-in performing sound effect processing on the audio data set according to the service data of the target application;

under the condition that the specified target plug-in is determined to be deactivated, generating a deactivation instruction and acquiring the access authority of the writing area of the target memory; and after the access authority of the writing area of the target memory is acquired, storing the disabling instruction in the target memory, wherein the specified target plug-in enters a disabling state when the access authority of the reading area of the target memory is acquired and the disabling instruction is read.

2. The method of claim 1, further comprising:

and under the condition that the target plug-in is in a deactivated state, determining the audio data set sent by the server as a data set to be played.

3. The method of claim 1,

the sending the set of audio data to the target plug-in comprises: storing the audio data set in a target memory for the target plug-in to read the audio data set from the target memory;

the obtaining of the target data set to be played generated by the target plug-in includes: and reading the target data set from the target memory, wherein the target data set is a data set generated by the target plug-in according to the audio data set and stored in the target memory.

4. The method of claim 3,

said storing the set of audio data in a target memory comprises: acquiring the access authority of a writing area of the target memory; after the access authority of the writing area of the target memory is obtained, storing the audio data set in the writing area of the target memory, wherein the access authority of the writing area of the target memory grants a unique object at any time;

the reading of the target data set generated by the target plug-in from the target storage comprises: acquiring the access authority of a reading area of the target memory every other preset time period; and after the access authority of the reading area of the target memory is acquired, reading a target data set from the reading area of the target memory, wherein the access authority of the reading area of the target memory grants a unique object at any time.

5. The method of claim 3, wherein after sending the set of audio data to the target plug-in, the method further comprises:

determining the processing time length of each audio data in the audio data set by the target plug-in;

determining whether target audio data with processing duration larger than a preset threshold exists according to the processing duration of each audio data;

in the presence of the target audio data, determining to disable a target plug-in that processes the target audio data.

6. A processing method of voice sound effect is characterized by comprising the following steps:

under the condition that the specified target plug-in is determined to be enabled, an enabling instruction is generated and the access right of a writing area of the target memory is obtained; after the access authority of the writing area of the target memory is acquired, storing the enabling instruction in the target memory;

the target plug-in obtains the access right of the reading area of the target memory, and enters a starting state when the access right of the reading area of the target memory is obtained and the starting instruction is read;

under the condition that a target plug-in is in an enabled state, the voice system sends the audio data set to the target plug-in, wherein the operation of the target plug-in is independent of the operation of the voice system;

the target plug-in receives the audio data set, performs sound effect processing on the received audio data set according to the service data of the target application to obtain a target data set and sends the target data set to the voice system;

the voice system receives the target data set and takes the target data set as a data set to be played;

in the case that the specified target plug-in is determined to be deactivated, the voice system generates a deactivation instruction and acquires the access right of the writing area of the target memory; after the access authority of the writing area of the target memory is acquired, storing the deactivation instruction in the target memory;

and the target plug-in acquires the access right of the reading area of the target memory and enters a deactivation state when the access right of the reading area of the target memory is acquired and the deactivation instruction is read.

7. The method of claim 6,

the sending, by the voice system, the set of audio data to the target plug-in includes: the voice system acquires the access authority of a writing area of the target memory every other preset time period; after the voice system acquires the access authority of the writing area of the target memory, storing the audio data set in the writing area of the target memory;

the target plug-in receiving the set of audio data comprises: the target plug-in obtains the access authority of the writing area of the target memory every a preset time period; after the target plug-in obtains the access right of the writing area of the target memory, reading the audio data set stored in the writing area of the target memory, wherein the access right of the writing area of the target memory grants a unique object at any time;

the target plug-in sending the target data set to the voice system comprises: the target plug-in acquires the access authority of the reading area of the target memory every a preset time period; after the target plug-in obtains the access right of the reading area of the target memory, storing the target data set in the reading area of the target memory;

the receiving, by the speech system, the target set of data includes: the voice system acquires the access authority of the reading area of the target memory every other preset time period; and after the voice system acquires the access right of the reading area of the target memory, reading the target data set stored in the reading area of the target memory, wherein the access right of the reading area of the target memory grants a unique object at any time.

8. The method of claim 6, wherein if there are a plurality of target plug-ins, the method further comprises:

and under the condition that the target plug-in is in a deactivated state, the voice system determines the audio data set sent by the server as the data set to be played.

9. A speech system, comprising:

the first acquisition unit is used for acquiring an audio data set sent by a server corresponding to a target application;

the first generation unit is used for generating an enabling instruction and acquiring the access authority of the writing area of the target memory under the condition that the specified target plug-in is determined to be enabled;

the first storage unit is used for storing the enabling instruction in the target memory after the access authority of the writing area of the target memory is acquired, and the first storage unit is used for enabling the appointed target plug-in to enter an enabling state when the access authority of the reading area of the target memory is acquired and the enabling instruction is read;

the sending unit is used for sending the audio data set to a target plug-in unit under the condition that the target plug-in unit is in an enabled state, wherein the operation of the target plug-in unit is independent from the operation of the voice system;

a second obtaining unit, configured to obtain a target data set to be played, where the target data set is generated by performing sound effect processing on the audio data set by the target plug-in according to the service data of the target application;

a second generation unit configured to generate a shutdown instruction and acquire an access right of a write area of the target memory, in a case where it is determined to shutdown the specified target plug-in;

and the second storage unit is used for storing the stop instruction in the target memory after the access authority of the writing area of the target memory is acquired, and is used for enabling the specified target plug-in to enter a stop state when the specified target plug-in acquires the access authority of the reading area of the target memory and reads the stop instruction.

10. A device for processing audio effects, comprising:

the voice system is used for acquiring an audio data set sent by a server corresponding to the target application; under the condition that the specified target plug-in is determined to be enabled, an enabling instruction is generated and the access right of a writing area of the target memory is obtained; after the access authority of the writing area of the target memory is acquired, storing the enabling instruction in the target memory; under the condition that the target plug-in is in an enabled state, storing the audio data set in a target memory to obtain a target data set to be played, which is generated by the target plug-in; and generating a shutdown instruction and acquiring the access right of the writing area of the target memory under the condition that the specified target plug-in is determined to be shutdown; after the access authority of the writing area of the target memory is acquired, storing the deactivation instruction in the target memory;

the target plug-in is used for entering an enabling state when the access right of the reading area of the target memory is obtained and the enabling instruction is read; reading an audio data set stored in a target memory, performing sound effect processing on the audio data set based on service data of a target application to obtain a target data set, and sending the target data set to the voice system; entering a deactivation state when the access authority of the reading area of the target memory is acquired and the deactivation instruction is read;

and the operation of the target plug-in is independent from the operation of the voice system.

11. A processor, characterized in that the processor is configured to run a program, wherein the program is configured to execute the processing method of the voice sound effect according to any one of claims 1 to 5 when running, or the program is configured to execute the processing method of the voice sound effect according to any one of claims 6 to 8 when running.

12. A storage medium characterized by comprising a stored program, wherein the program executes the method of processing the voice sound effects of any one of claims 1 to 5, or the program executes the method of processing the voice sound effects of any one of claims 6 to 8.