TW201331929A - System for generating interactive audio effect and method thereof - Google Patents

Abstract

Provided are a system for generating an interactive audio effect and a method thereof, adjusting a music signal generated by a performer to generate an interactive effect with an audience. Firstly, a sound information from the audience is received through a receiving unit, and the sound information is converted to a disposable digital audio. Further, the digital audio is subjected to feature detecting by a processing unit such that a detected value is obtained, and after the detected value is analyzed an audio effect parameter corresponding to the digital audio is generated. Finally, the music signal generated by the performer is adjusted by an output unit according to the audio effect parameter. Thereby, the interactive effect between the performer and the audience is improved.

Description

Interactive audio effect generation system and method thereof

The present invention relates to an interactive audio effect generation system and method thereof, and more particularly to an interactive audio effect generation system and method thereof for adjusting a music signal according to an emotional response of a listener, thereby enhancing interaction between a performer and a listener .

In general, the audio effect device can change the frequency or tone of the digital sound signal. For example, the audio effect device and the electric guitar, the electric bass or the DJ system are connected by the audio source line, and the performer can change the setting of the audio effect device. In turn, the sound produced by the instrument produces a change in sound.

In particular, audio effects are often used to adjust or modify the signal processing of audio. Applications include composition, recording, mixing, or signal processing. The physical audio effects can be divided into pedal and desktop. The pedal type is suitable for playing electric guitars and electric bass performers, so that the performers can use the foot to control the audio effects while playing the instrument while the desktop type can be divided into the machine used in the recording room. Rack and platform type commonly used in DJ systems. Musical instrument performers often choose to use the audio effects according to the effect of playing the music, so that the playing music changes, for example, the DJ uses the echo effect to make the music of the performance produce an echo effect, or when the performer wants to produce a broken sound effect. In this case, a distortion effect can be used, or an effect such as reverb or delay can be used to change or modify the tone.

However, the user of the conventional audio effect device is usually a musician or a performer in a performance, and the operation interface of the audio effect device is mostly a contact interface, for example, the performer adjusts the performance by a button, a knob or a touchpad. The sound effect of the music, in other words, the performer must dominate the sound of the music played. However, the use of conventional audio effects still has drawbacks. For example, an audio effect device needs to be controlled by a performer through an operation interface, and once the performer distracts the audio effect device, the effect of the performance may be affected. Moreover, the sound effects are dominated by the performers and cannot be guided by the live audience response, so that the listeners are always passive and reduce the audience's participation.

It can be seen from the above that the conventional technology can only control the sound effect of the music played by the performer through the audio effect device, so that the music can not change according to the emotional response of the live audience, thus reducing the interaction between the performer and the listener, and The existing audio effects still need to be controlled through the operation interface, which will have certain influence on the performance process and emotions of the performers. Therefore, how to overcome various problems of the prior art is an important issue.

In order to solve various problems of the above-mentioned prior art, the present invention proposes an interactive audio effect generation system for adjusting the music signal by judging the response of the listener, thereby enhancing the interaction between the performer and the listener.

Another object of the present invention is to automatically perform sound effect processing through the analysis and judgment of the interactive audio effect generation system, thereby reducing the inconvenience that the performer needs to operate the audio effect device by himself, thereby achieving a similar sound control effect.

In order to achieve the foregoing and other objects, the present invention provides an interactive audio effect generating system, and the interactive audio effect generating system receives sound information from the listener through a receiving unit, and is modulated by pulse code modulation (PCM). The sound information is converted into digital audio, and the detected value is generated by detecting the pitch of the digital audio through the processing unit, and the detected value is analyzed to obtain an audio effect parameter corresponding to the digital audio, and finally The output unit adjusts the music signal generated by the performer by using the audio effect parameter generated by the processing unit, and outputs the music signal.

In addition, the present invention also provides an interactive audio effect generating method for improving the interaction between a performer and a listener, and the interactive audio effect generating method includes: (1) capturing the voice information of the listener; and (2) Converting the sound information into digital audio; (3) performing feature detection of the pitch on the digital audio to generate a detected value, and then generating an audio effect parameter corresponding to the digital audio according to the detected value; and (4) transmitting the audio signal The effect parameter is sent to the audio effect device, and the audio effect is filtered by the audio effect device to adjust the music signal generated by the performer.

In summary, the interactive audio effect generating system and method thereof according to the present invention generate an appropriate musical effect by analyzing the sound of the listener, thereby improving the interaction between the performer and the listener, compared to the conventional technique, the performer There is no need to operate the audio effect device through the contact operation interface, which can reduce the inconvenience that the performer needs to distract the audio effect device during the performance, and the music effect is no longer dominated by the performer, but is accompanied by the emotion of the live audience. Therefore, the present invention produces an interactive effect similar to the voice control concept without the need for the performer to control the audio effect, so that the listener is more involved.

The other embodiments of the present invention will be readily understood by those skilled in the art from this disclosure.

It is to be understood that the description of the present invention is intended to be in the nature of the invention, and is not intended to limit the scope of the invention. Any modifications and adaptations of the drawings and the descriptions are intended to fall within the scope of the technical scope of the present invention without departing from the scope of the invention. In the meantime, the phrase used in the present specification is for convenience of description, and is not intended to limit the scope of the invention, and the modification or adjustment of the relative relationship is also considered to be category.

Please refer to FIG. 1 , which is a schematic diagram of the system of the interactive audio effect generation system of the present invention. As shown in FIG. 1 , the interactive audio effect generating system 1 is configured to adjust a music signal generated by a performer to enhance an interaction effect with a listener. The interactive audio effect generating system 1 includes: a receiving unit 10 and a processing unit. 12. Input unit 14 and audio effector 140.

The receiving unit 10 is configured to receive sound information from the listener and convert the sound information into digital audio. In order to enhance the audience's dominantness to the performer's music, the interactive audio effect generation system 1 will adjust the sound effect according to the audience reaction, that is, the receiving unit 10 will capture the sound information of the live listener, since the sound information is analogous signal, for convenience After the analysis processing, the receiving unit 10 further converts the sound information into digital audio.

In a specific implementation, the receiving unit 10 can be connected to a sound receiving device, such as a microphone, for receiving sound information, and transmitting sound information through a Pulse Code Modulation (PCM) method, for example, cheering and shouting the audience. Analog signals such as applause are converted into digital audio. Pulse coding modulation mainly divides, quantizes and encodes three-stage processing, thereby providing conversion between analog signals and digital signals. However, pulse coding is converted into commonly used analog digital conversion technology, so More details.

The processing unit 12 is configured to perform feature detection on the digital audio to generate a detection value, and analyze the detected value to generate an audio effect parameter corresponding to the digital audio. In detail, the processing unit 12 performs feature detection on the captured and converted digital audio. The feature detection refers to detecting the pitch of the digital audio and obtaining the detected value, and then analyzing the feature. The detected detection value is detected to analyze the current audience response, and the audio signal corresponding to the digital audio is obtained according to the detected value for subsequent sound adjustment.

In the specific implementation, the frequency range for detecting the pitch of the digital audio can be set at 50 to 1000 Hz, and the portion smaller than 50 Hz and greater than 1000 Hz (the segment of the non-human sound frequency) will be eliminated, and can be avoided. Unnecessary environmental noise, reducing the chances of analyzing and judging errors.

The output unit 14 adjusts the music signal played by the performer by using the audio effect parameter generated by the processing unit 12, and outputs the adjusted music signal. As can be seen from the above, the change of the music signal is no longer controlled only by the performer, but can be adjusted according to the response of the listener. For example, the high-pitched emotion of the listener can make the music louder or add the mix, so that the instant interaction with the listener can be achieved. Situation.

In addition, the output unit 14 further includes an audio effector 140 for adjusting the music signal generated by the performer. Specifically, the output unit 14 adjusts the audio effect parameter generated by the processing unit 12 through the audio effector 140 to filter the music signal generated by the performer, which may include the frequency, the timbre, or a combination thereof of the music signal. Therefore, after the analysis processing by the receiving unit 10, the processing unit 12, and the output unit 14, the audio effect parameter is transmitted to the audio effector 140 to perform sound adjustment, which is applicable not only to general performance occasions, such as concerts, concerts, or musicals. At the same time, by adjusting the sound effects of the music signal, the interaction between the listener and the performer can be enhanced and the audience's participation can be enhanced.

In addition, in the embodiment, the audio effector 140 is not limited to be disposed in the output unit 14, and the receiving unit 10, the processing unit 12, and the output unit 14 may be integrated into the interactive audio effect generating system 1, and the audio effector 140 Independent of the interactive audio effect generation system 1 outside. The receiving unit 10 receives the sound information, the processing unit 12 detects the analysis, and the output unit 14 transmits the audio effect parameter, and the audio effect parameter is transmitted to the external audio effector 140 to adjust the music signal, and then the audio effect is adjusted. The device 140 sends the adjusted music signal.

Please refer to FIG. 2, which is a schematic diagram of another embodiment of the interactive audio effect generating system of the present invention. In this embodiment, the receiving unit 20, the processing unit 22, the output unit 24, and the audio effector 240 of the interactive audio effect generating system 2 have the same functions as those described in FIG. 1 , and the difference lies in the interactive audio effect generating system of the embodiment. The second complex includes an input unit 28.

The receiving unit 20 receives the audio signal from the listener and converts it into digital audio. The processing unit 22 performs feature detection on the digital audio to generate a detected value, and analyzes the detected value to obtain a corresponding audio effect parameter. And transmitting the audio effect parameter to the output unit 24, and adjusting the music signal through the audio effector 240, wherein the input unit 28 will receive the music signal generated by the performer, for example, receiving the guitar, the piano or the jazz drum through the audio source line. The music signal is generated by the musical instrument, and then the music signal is transmitted to the output unit 24, so that the audio effector 240 in the output unit 24 processes the music signal according to the audio effect parameter generated by the processing unit 22, and the processed signal is processed. The music signal is output.

In addition, in FIG. 2, the audio effector 240 can also be obtained independently of the interactive audio effect generating system 2, that is, the receiving unit 20, the processing unit 22, and the output unit 24 receive, detect, and analyze. After the audio effect parameter corresponding to the voice message from the listener is received, the input unit 28 receives the music signal from the performer, and then transmits the music signal and the audio effect parameter to the audio effector 240 for sound adjustment and output. However, the audio effector 240 is provided inside or outside the interactive audio effect generating system 2, and its main function is to perform sound adjustment according to the audio effect parameter, so there is no need to limit the setting mode of the audio effector 240.

Next, please refer to FIG. 3, which is a flowchart of a method for generating an interactive audio effect according to the present invention, which is used to improve the interaction between a performer and a listener. As shown in the figure, in step S30, the voice information of the listener is captured. In order to improve the interaction between the performer and the listener, the sound adjustment is determined by the emotional response of the listener. Therefore, it is first necessary to draw the voice information from the audience. Then it proceeds to step S32.

In step S32, the sound information is converted into digital audio. Since the voice information from the listener is an analog signal, in order to facilitate subsequent analysis and processing, the sound information is converted into digital audio (ie, digital signal) in this step. In the specific implementation, the sound information can be converted into digital audio by pulse code modulation (PCM). Then it proceeds to step S34.

In step S34, the feature detection is performed on the digital audio to generate the detection value, and the audio effect parameter corresponding to the digital audio is generated according to the detected value. In order to know the emotional response of the listener, the feature detection is performed for the digital audio. Specifically, the sound can be detected for the pitch of the digital audio, and the corresponding audio effect parameters are obtained according to the detected values, and the audio effect parameters are obtained. Will be used for sound adjustment. Then it proceeds to step S36.

In step S36, the audio effect parameter is transmitted to an audio effect device to adjust the music signal generated by the performer by the audio effect device. That is to say, the audio effect device is used to adjust the music signal according to the audio effect parameter generated in the foregoing, and the audio effect device can adjust the frequency, the timbre or a combination of the music signal through the filtering method, thereby making the sound of the music signal more in line with the live audience. Emotional response.

In detail, in step S30, the receiving includes receiving the music signal generated by the performer, that is, in step S30, in addition to receiving the voice information of the listener, the music signal of the performer is also received, wherein the sound signal can be The music signal is received by a microphone-like device, and the music signal is directly obtained by connecting the sound source cable to the performer's musical instrument, and the music signal is used for sound adjustment in the subsequent step S36.

In addition, the method for generating the interactive audio effect comprises outputting the music signal adjusted by the audio effect device through an output device such as a speaker, so that the listener feels that the emotion can correspond to the outputted music.

Please refer to FIG. 4, which is a schematic diagram of the relationship between the performer, the listener and the interactive audio effect generation system of the present invention. The figure shows an interactive audio effect generation system in which the present invention is actually applied. Specifically, the music signal of the performer 40 is transmitted to the interactive audio effect generation system 4. At this time, the interactive audio effect generation system 4 simultaneously receives the live listener 42. Sound information, such as screams or applause, and the sound information is converted, detected, analyzed, and judged in the interactive audio effect generation system 4 to obtain an on-site listener 42 response, and then from the performer 40 through an audio effector. The music signal is adjusted so that the adjusted music signal is more in line with the mood of the live listener 42, thus increasing the interaction between the performer 40 and the listener 42.

As can be seen from the above, the interactive audio effect generation system adjusts the sound according to the response of the listener, so that it has the effect of driving the audio effect by the human voice. In other words, it is necessary to control the sound effect through the operation interface of the physical button or the knob. Differently, the sound effect control of the present invention is more similar to the voice control mode, so it is more convenient for the performer, and for the live audience, the interaction is more immediate and in line with the listener's mood.

In summary, the interactive audio effect generating system and method of the present invention analyzes the listener's voice to judge the emotional response of the listener, and adjusts the performance sound effect according to the emotional reaction of the listener, thereby making the listener feel the music effect more in line with the listener's emotion. Compared with the prior art, the implementation manner of the present invention is more similar to the voice-activated operation, not only instantaneously but also the performer does not need to manipulate the sound device by himself, which helps to improve the interaction between the live audience and the performers on the stage, and also makes the live audience more Have a sense of participation.

The above embodiments are merely illustrative of the effects of the present invention and are not intended to limit the present invention, and those skilled in the art can practice the above embodiments without departing from the spirit and scope of the present invention. Make modifications and changes. In addition, the number of elements in the above-described embodiments is merely illustrative and is not intended to limit the present invention. Therefore, the scope of protection of the present invention should be as set forth in the appended claims.

1, 2, 4. . . Interactive audio effect generation system

10, 20. . . Receiving unit

12, 22. . . Processing unit

14, 24. . . Output unit

140, 240. . . Audio effect

28. . . Input unit

40. . . actor actress

42. . . audience

S30 to S36. . . step

1 is a schematic diagram of a system of an interactive audio effect generation system of the present invention;

2 is a schematic diagram of another embodiment of the interactive audio effect generating system of the present invention;

Figure 3 is a flow chart of the method for generating an interactive audio effect of the present invention;

Figure 4 is a schematic diagram showing the relationship between the performer, the listener and the interactive audio effect generation system of the present invention.

1. . . Interactive audio effect generation system

10. . . Receiving unit

12. . . Processing unit

14. . . Output unit

140. . . Audio effect

Claims (12)

An interactive audio effect generation system for enhancing the interaction between a performer and a listener, comprising: a receiving unit for receiving sound information from the listener, and converting the sound information into digital audio; processing unit And performing feature detection on the digital audio to generate a detection value for generating an audio effect parameter corresponding to the digital audio after analyzing the detected value; and outputting the audio effect generated by the processing unit The parameter adjusts the music signal generated by the performer and outputs the adjusted music signal. The interactive audio effect generating system of claim 1, wherein the receiving unit converts the sound information into the digital audio through pulse code modulation (PCM). The interactive audio effect generating system of claim 1, further comprising an input unit for receiving a music signal generated by the performer to transmit the music signal to the output unit. The interactive audio effect generating system of claim 1, wherein the detecting of the feature by the processing unit refers to detecting the pitch of the digital audio. The interactive audio effect generating system of claim 1, wherein the output unit comprises an audio effect device for adjusting a frequency, a timbre or a combination of the music signals generated by the performer by filtering. . The interactive audio effect generating system according to claim 1, wherein the sound information is cheering, shouting, applause or a combination thereof. An interactive audio effect generation method for improving the interaction between a performer and a listener, including: (1) capturing the voice information of the listener; (2) converting the sound information into digital audio; (3) The digital audio performs feature detection to generate a detection value, and then generates an audio effect parameter corresponding to the digital audio according to the detected value; and (4) transmits the audio effect parameter to an audio effect device to enable the audio effect device Adjusting the music signal generated by the performer according to the audio effect parameter. The method for generating an interactive audio effect according to claim 7, wherein the step (2) converts the sound information into the digital audio through pulse code modulation (PCM). The method for generating an interactive audio effect according to claim 7, wherein the feature detection in the step (3) refers to detecting the pitch of the digital audio. The method for generating an interactive audio effect according to claim 7, wherein the audio effect adjusts the frequency, the timbre, or a combination thereof of the music signal through a filtering method. For example, in the method for generating an interactive audio effect described in claim 7, the step (1) includes receiving a music signal generated by the performer. The method for generating an interactive audio effect as described in claim 7 further includes the step (5) of outputting the adjusted music signal to the listener.