JP6657866B2 - Sound effect imparting device and sound effect imparting program - Google Patents

Description

  The present invention relates to a sound effect imparting device and a sound effect imparting program for imparting an acoustic effect to an input audio signal input to a microphone.

  Karaoke is performed to enjoy singing along with the performance of the music. A karaoke apparatus for performing karaoke mixes a musical performance and a singing voice of a user input from a microphone and emits the sound from a speaker. 2. Description of the Related Art There is known a karaoke apparatus having a sound effect imparting function of imparting sound effects such as echo and reverb to a singing voice in order to enhance a user's singing voice.

  Some karaoke apparatuses have a sound effect function of largely changing a singing voice of a user, in addition to a sound effect using a delay such as an echo or a reverb. Patent Document 1 discloses a voice musical instrument function for simulating a singing voice into a musical instrument such as a guitar or voice percussion as one of the sound effect imparting functions. Further, in Patent Document 1, when a voice instrument is specified, it is possible to identify that the user is playing the voice instrument by displaying image information indicating the voice instrument together with the reproduced video.

JP 2013-156543 A

  The voice instrument function disclosed in Patent Literature 1 is a function of converting a singing voice signal into a musical instrument sound such as a guitar or voice percussion by applying a predetermined sound effect to the singing voice. In the voice instrument function, it is preferable to eliminate as much as possible the characteristics of the singing voice, which is the original sound, so as to approximate the sound of the instrument to be simulated. Conventionally, in voice instrument functions, fixed values have been used for parameters used for sound effects. Therefore, depending on the portion of the singing voice, a characteristic that can be recognized as the singing voice may remain, and the sound quality may be insufficient for a simulated instrument sound.

  SUMMARY OF THE INVENTION It is an object of the present invention to provide a sound effect imparting device that simulates the sound of a musical instrument so as to approximate the sound of the musical instrument to be simulated. In particular, the present invention relates to a sound effect applying apparatus in which a target musical instrument to be simulated is a guitar.

Therefore, the acoustic effect imparting device according to the present invention is characterized by adopting the following configuration.
A sound effect imparting device that imparts an acoustic effect to an input audio signal input from a microphone,
A sound effect imparting process including at least a distortion process for distorting the input audio signal,
A detection process of detecting a voiced interval definitive input speech signal as the speech feature section,
An adjustment process for making the magnitude of the distortion of the distortion process different between the voice feature segment detected in the detection process and other segments.

Further, in the sound effect imparting device of the present invention,
In the adjusting process, the magnitude of the distortion in the distortion process may be changed according to the volume of the input audio signal.

Further, in the sound effect imparting device of the present invention,
The sound effect applying process includes a pitch changing process of changing a pitch of an input audio signal.

Further, in the sound effect imparting device of the present invention,
The pitch changing process is performed in synchronization with a performance process of playing performance information.

Further, the sound effect giving program in the present invention,
A sound effect giving program for giving a sound effect to an input audio signal input from a microphone,
A sound effect imparting process including at least a distortion process for distorting the input audio signal,
A detection process of detecting a voiced interval definitive input speech signal as the speech feature section,
The information processing apparatus is characterized by causing the information processing apparatus to execute an adjustment process for making the distortion processing distortion amount different between the voice feature section detected in the detection processing and the other sections.

  According to the sound effect imparting device and the sound effect imparting program according to the present invention, an audio characteristic section having a predetermined characteristic is detected in an input audio signal, and the magnitude of distortion of distortion processing is determined between the audio characteristic section and other sections. Is performed, it is possible to convert the input sound signal input to the microphone to be similar to the guitar sound to be simulated.

  Further, according to the present invention, it is possible to more effectively convert the sound characteristic section detected by the detection processing so as to resemble the guitar sound by setting the voice characteristic section in the input signal as the voiced sound section.

  Further, according to the present invention, by varying the magnitude of distortion in the distortion processing according to the magnitude of the input signal, the sound characteristics of the guitar sound are simulated, and the sound is more effectively converted to be similar to the guitar sound. It is possible to do.

  Further, according to the present invention, by performing a pitch change process of changing a pitch of an input voice signal, a pitch shift to a pitch different from that of the input voice signal, an octaver for converting to a sound of a different octave, or an input It is possible to add an effect peculiar to the guitar to be simulated, such as chording the audio signal.

Diagram showing the configuration of the karaoke system Diagram showing the configuration of the sound control unit Figure showing the song reservation confirmation screen FIG. 3A shows a data configuration of reservation information, and FIG. 3B shows a data configuration of music information. Flow chart showing music playback processing The figure which shows the structure of a sound effect provision part (when "voice guitar" is selected) Flow chart showing distortion amount adjustment processing Table showing the relationship between the characteristics of speech and the amount of distortion for the pronunciation section Diagram for explaining change in frequency characteristics due to distortion processing

  FIG. 1 is a diagram showing a configuration of a karaoke system according to an embodiment of the present invention. The karaoke system is provided with a karaoke device (also called a “commander”) 2 for playing music and a remote control device 1 for remotely controlling the karaoke device 2. The karaoke device 2 and the remote control device 1 are connected to form a network using the LAN 100 and the access point 110. In the present specification, an example in which a sound effect applying device is applied to a karaoke device 2 will be described. However, the present invention is not limited to the karaoke device 2 and various devices capable of applying a sound effect to voice. It is possible to apply to.

  The karaoke apparatus 2 includes an acoustic control unit 25 as a performance unit for performing a music piece. The sound control unit 25 captures the singing voice of the user input from the singing microphones 43 a and 43 b (microphones), mixes the singing voice with the performance sound, and emits the sound from the speaker 42.

  In addition, the karaoke apparatus 2 includes an operation unit 21 as input means including switches for receiving various inputs from the user. The karaoke apparatus 2 includes an operation processing unit 22 that interprets an input from the operation unit 21 and transmits the input to the CPU 30. Further, the karaoke apparatus 2 includes a hard disk 32 as karaoke apparatus-side storage means for storing various information. The karaoke apparatus 2 includes a LAN communication unit 24 for communication connection with the LAN 100 and joining the network.

  In addition, the karaoke apparatus 2 includes a video playback unit that displays a lyrics video and a background video on the monitor 41. The video playback means includes a video playback unit 29 for playing back a video based on video information, a video RAM 28 for temporarily storing the video to be played back, superimposition of lyrics telop on the played back video, addition of video effects, and the like. It comprises a video control unit 31 capable of executing processing.

  Further, in the karaoke apparatus 2, it is possible to display various information on the touch panel monitor 33 in addition to the monitor 41 connected to the outside. The touch panel monitor 33 is configured by superimposing a display unit 35 for displaying video information input from the video control unit 31 and a touch panel 34 for outputting the touched position to the operation processing unit 22. Various operations on the karaoke apparatus 2 can also be performed via an operation unit 21 provided on a front panel or the like of the karaoke apparatus 2.

  The touch panel monitor 33 of the present embodiment can also function as the same operation unit as the touch panel monitor 11 that is the operation unit of the remote control device 1. The user can use the same operation means function as the remote control device 1 such as selecting a music piece from the touch panel monitor 33 and making the karaoke device 2 make a reservation directly.

  Further, the karaoke apparatus 2 has a CPU 30 for executing various programs and a memory 27 for temporarily storing information necessary for executing the various programs, as control means for controlling the entire components. Be composed.

  With such a configuration, the karaoke apparatus 2 executes various processes. As a main function of the karaoke apparatus 2, music reservation processing and music reproduction processing can be executed. The music reservation processing is processing for reserving music based on an instruction from a user. The karaoke apparatus 2 registers the reservation information (FIG. 5A) formed by the reservation operation in a reservation table in the memory 27. The music reproduction process is a process of reproducing a reserved music, and is a process in which a performance process and a lyrics reproduction process are executed in synchronization.

  The performance process is a process of causing the acoustic control unit 25 to perform the performance information included in the music data. The music played by the acoustic control unit 25 is emitted from the speaker 42 together with the singing voice input from the singing microphones 43a and 43b. The lyrics reproduction process is a process of performing singing assistance by displaying the lyrics information included in the music data on the monitor 41. A background image display process may be performed to display a background image superimposed on the lyrics displayed in the lyrics reproduction process.

  The remote control device 1 transmits various instructions to the karaoke device 2 such as reservation information and receives various information from the karaoke device 2 or a server device 5 connected on the Internet. In the present embodiment, an operation unit 17 such as a button and a touch panel monitor 11 are provided as a user interface. The touch panel monitor 11 includes a display unit 11a and a touch panel 11b. The touch panel monitor 11 displays various interfaces on the display unit 11a and can receive a touch input from a user.

  Further, the remote control device 1 integrally controls the memory 14 as a remote control side storage unit for storing a database, various programs required for music search, and various information generated in accordance with the execution of the programs. And a remote control side control means. The remote controller side control means includes a control unit 15 composed of a CPU, a video control unit 13 for forming a video to be displayed on the display unit 11a, a video RAM 12 for temporarily storing video information to be displayed, and an operation unit 17. And an operation processing unit 18 for interpreting the input of the command and transmitting the result to the control unit 15.

  The remote controller 1 is wirelessly connected to the access point 110 by the wireless LAN communication unit 16 to be connected to a network constituted by the LAN 100. Each remote control device 1 is associated with a specific karaoke device 2 in advance. Various commands output from the remote control device 1 are received by the associated karaoke device 2.

  With such a configuration of the remote control device 1, the karaoke device 2 can receive various inputs from the user from the touch panel monitor 11 or the operation unit 17, and provide video information to the karaoke device 2 by providing various information by display on the touch panel monitor 11. Various instructions such as music reservation can be given to the user.

  FIG. 2 is a diagram illustrating a configuration of the sound control unit 25 that reproduces music in the karaoke apparatus 2 and applies a sound effect to the singing voice input to the singing microphones 43a and 43b. The sound control unit 25 of the present embodiment includes a music reproduction unit 251, sound effect imparting units 252 and 253, and an addition unit 254. The music reproduction unit 251 reproduces performance information included in the designated music information and outputs a performance sound. The sound effect applying units 252 and 253 can apply various sound effects to the singing voice. In the present embodiment, the sound effect imparting units 252 and 253 are provided for each of the singing microphones 43a and 43b, and it is possible to impart an acoustic effect to each singing voice input to each of the singing microphones 43a and 43b. It has become. The performance sound reproduced by the music reproduction unit 251 and the singing voice output from the sound effect applying units 252 and 253 are added by the addition unit 254 and output to the speaker 42.

  FIG. 3 is a diagram showing a music confirmation screen of the present embodiment. The karaoke system of the present embodiment allows a plurality of users to log in and use at the same time. By logging in, a user can receive various services using his / her user information. The services that the user can receive include a favorite song registered by the user, a history, a song search using a favorite artist (singer), a recommendation of a song according to the attribute of the user, and the like.

  Information on the user who has logged in to the karaoke system is displayed above the music confirmation screen shown in FIG. In the login user column 103, alternation images 103a to 103e of the user who has logged in to the karaoke system (face parts in this embodiment) are displayed. In the login user column 103, the user whose background is highlighted (white) at the right end is the active user 103e (Mr. A in this example), and a service for the active user 103e, that is, user information of the active user 103e. The service using is running. Switching of the active user can be performed by operating the user switching button 101. A user who has not registered as a user can operate the guest button 102 to use the karaoke system as a guest user.

  When a tune is selected as the active user, the user confirms the tune to be reserved by displaying details such as a tune name, a singer name, and a singing start on the tune confirmation screen.

  The karaoke apparatus 2 of the present embodiment can provide a user with a desired sound effect to singing voices input from the singing microphones 43a and 43b when playing back music. There are a plurality of types of this sound effect, and the user selects the type of the sound effect and which of the singing microphones 43a and 43b the sound effect is given by selecting the voice effect column 105. It is possible to The types of sound effects include vibrato, animation, zombie, young, gal, voice guitar, radio voice, techno voice, etc., and the user can select from these types using an interface (not shown). is there. Vibrato is a sound effect that fluctuates the pitch of a singing voice. Anime, zombies, young, gals, voice guitars, radio voices, and techno voices are sound effects imaged from their names, and are sound effects performed by performing one or more processes on singing voices. is there.

  The music confirmation screen shown in FIG. 3 shows a state in which “voice guitar” has been selected by the user. In the voice effect column 105, “voice guitar”, which is the name of the selected sound effect, and a sound effect target Microphone 2 (singing microphone 43b) is displayed.

  On the music confirmation screen, the user confirms that the music is to be sung and completes various settings, and operates the reservation button 106 to confirm the reservation of the music. When music is reserved using the remote control device 1, the reservation information is transmitted from the remote control device 1 to the karaoke device 2. FIG. 4A is a diagram showing a data structure of the reservation information. The reservation information includes a music ID for identifying the reserved music, and a user ID corresponding to the user who made the reservation (active user). Further, in the present embodiment, the voice effect designation information selected using the voice effect column 105 is included. The voice effect designation information includes a sound effect type and a designated microphone. When a reservation is made on the music confirmation screen in Fig. 3, "voice guitar" is specified as the sound effect type, and "microphone 2 (singing microphone 43b)" is specified as the designated microphone. The received reservation information is sequentially stored in a reservation table managed by the memory 27, and the music reproduction process is executed.

  FIG. 4B is a diagram showing a data configuration of music information to be subjected to music reproduction processing. The music information has meta information, which is various information related to the music information, and actual information for executing various processes such as displaying performances and lyrics. The meta information includes a song ID for identifying song information, a song name, a singer name, a lyricist name, and a composer name.

  The actual information of the music information includes performance information, chord information, and lyrics information. The performance information is control information for an electronic musical instrument based on the MIDI standard, or information for performing a karaoke accompaniment, including compressed audio information obtained by recording an actual performance. Chord information is information used when a singing voice is given a sound effect related to a chord. The chord information of the present embodiment corresponds to the progress of the music, and is information indicating which chord corresponds to which section. When a sound effect is given, it is possible to convert a single singing voice into a chord by referring to the chord information. Also, by referring to the chord information, it is possible to determine whether the current reproduction is a single tone section or a chord section. The lyrics information is information displayed in synchronization with the performance information to assist the singing, and the lyrics displayed in synchronization with the performance may be changed in color.

  FIG. 5 is a flowchart showing a music reproduction process performed by the karaoke apparatus 2. In the music reproduction process, the reservation table is checked (S101), and the presence or absence of the next music to be reproduced is determined (S102). If it is determined that there is a song to be reproduced next (S102: Yes), the user refers to the voice effect designation information in the reservation information of the song reserved by the user and designates the song from the voice effect column 105 when the song is reserved. Check whether the voice effect is specified. When the voice effect is specified (S103: Yes), the sound effect processing corresponding to the specified sound effect type is executed. In the present embodiment, since it is possible to specify which of the two singing microphones 43a, 43b is to be subjected to the voice effect, the sound effect imparting units 252, 253 corresponding to the specified singing microphones 43a, 43b have the sound effect. Execution of the assigning process is started (step S104). FIG. 3 shows a state where the microphone 2 (singing microphone 43b) is designated.

  At this time, when performing the sound effect applying process, it is determined whether or not the specified sound effect type is “voice guitar” (S105). In the present embodiment, when the sound effect type is "voice guitar" (S105), a distortion amount adjustment process (S106) is performed to bring the sound effect closer to the guitar, which is a musical instrument to be simulated. The distortion amount adjustment processing at the time of the voice guitar will be described in detail.

  FIG. 6 is a block diagram showing an internal process of the sound effect applying unit 253 when “voice guitar” is selected. Here, the sound effect applying unit 253 will be described, but the same applies to the sound effect applying unit 252. In addition, each of the sound effect applying units 252 and 253 functions independently, and can also apply different sound effects to the input singing voice. As illustrated in FIG. 3, when “voice guitar” is selected for the microphone 2 (singing microphone 43b), the sound effect applying unit 253 performs equalizer processing on the singing voice input from the singing microphone 43b. By sequentially executing 253a, compressor processing 253b, harmonizer processing 253c, and distortion processing 253d, the singing voice input to the singing microphone 43b is converted like a guitar tone.

  The equalizer process 253a is a process of giving a predetermined frequency characteristic (for example, raising a low frequency) to the input singing voice. The compressor process 253b is a process of adjusting the volume, for example, a process of suppressing the volume when the volume becomes equal to or higher than a certain volume.

  The harmonizer process 253c is a process for changing the pitch of the input signal, and is a process for adding the input signal and the signal of which the pitch has been changed to a harmonization (harmony). In the present embodiment, chord conversion is performed by using chord information output from the music reproduction unit 251 to perform chord conversion, thereby enabling chord conversion in accordance with the progress of music reproduction. The singing voice input from the singing microphone 43b is a single sound, but by performing the harmonizer processing 253c, it is possible to perform a chord performance in a guitar performance that is impossible with singing (single sound).

  The distortion processing 253d is processing for distorting an input signal. Note that the distortion processing 253d in this specification can adopt various forms as long as it is processing for distorting an input signal. For example, the distortion processing 253d is not limited to distortion in a guitar effector. , Overdrive, etc., as long as it is a process for obtaining a sound effect distorting the input signal. By performing the distortion processing 253d, it is possible to make the singing voice sound like a guitar sound. In particular, in the present embodiment, the characteristics of the singing voice are determined, and the magnitude of the distortion applied in the distortion processing 253d is changed according to the characteristics, thereby making the singing voice closer to the sound of the guitar. Therefore, the sound effect imparting unit 253 executes a volume detection process 253e, a characteristic section detection process 253f, and a distortion adjustment process 253g. The volume detection process 253e is a process of detecting the volume of the singing voice input to the singing microphone 43b. The characteristic section detection processing 253f is processing for detecting whether or not the singing voice is a voice characteristic section having a predetermined characteristic. In the present embodiment, as a predetermined feature, by performing voice recognition processing on the singing voice, it is detected whether the singing voice is a section of a muddy sound or a section other than that.

  The distortion amount adjustment processing 253g uses the volume detection result by the volume detection processing 253e, the section detection result by the characteristic section detection processing 253f, and chord information output from the music reproduction unit 251 in accordance with the progress of the music. , The amount of distortion used in the distortion processing 253d is determined. In determining the amount of distortion, at least a section detection result by the characteristic section detection processing 253f is sufficient, and the volume detection result by the volume detection processing 253e and the chord information output from the music reproduction unit 251 are not necessarily used. Good.

  FIG. 7 is a flowchart illustrating the distortion amount adjustment processing. In the distortion amount adjustment processing, it is determined whether the section is a voiced section or a non-voiced section based on the section detection result of the characteristic section detection processing 253f (S202). If it is a non-voiced sound section (S202: No), there is no distortion amount used in the distortion processing 253d, that is, a through state in which no distortion is applied in the distortion processing 253d. On the other hand, when it is determined that the section is a voiced sound section (S202: Yes), the size of the singing voice is determined based on the result of the volume detection by the volume detection process 253e (S203). If the volume of the singing voice is smaller than the threshold (S203: small), the distortion amount used in the distortion processing 253d is set to small. On the other hand, when the volume of the singing voice is equal to or higher than the threshold (S203: loud), the chord information is referred to, and it is determined whether the currently reproduced section of the music piece is a single-tone section or a chord section (S204). If it is a chord section (S204: chord), the distortion amount used in the distortion processing 253d is set to medium (S206).

  On the other hand, if it is a single sound section (S204: single sound), the distortion amount used in the distortion processing 253d is set to a large value (S207). In the chord section, the singing voice is converted into a chord by the above-described harmonizer processing 253c, and a plurality of singing voices are overlapped, so that the voice characteristics are not so conspicuous. Difficult to approach. In the present embodiment, by increasing the amount of distortion in a single sound section, the characteristics of the voice are suppressed, and the tone is closer to that of a guitar.

  FIG. 8 is a table showing the relationship between the characteristics of the voice and the distortion amount for the sounding section in the distortion amount adjustment processing of FIG. The setting of the distortion amount is not limited to the mode described here, and various settings can be made. In particular, in the present embodiment, the distortion amount is set to be zero in the non-voiced sound section, but it is also possible to set a small distortion amount smaller than “small” in the non-voiced sound section. Also, the distortion amount may be made different depending on the input voice and the sounding section even in the non-voiced section.

  The distortion amount determined in the distortion amount adjustment processing is used for the distortion amount given to the input signal of the distortion processing 253d. Here, the distortion imparting in the distortion processing 253d will be described. The distortion process 253d is a process of adding a harmonic to an input signal. FIG. 9 is an example showing a frequency change of the distortion processing 253d, and FIG. 9A is a diagram showing a frequency characteristic of a 500 Hz sine wave as an example of the original waveform. FIG. 9B shows frequency characteristics when the distortion processing 253d is performed on the sine wave. As can be seen from FIG. 9B, many harmonics with respect to 500 Hz are formed by performing the distortion processing. The magnitude of the distortion in the distortion processing 253d is defined by the number and level of the harmonics. The greater the number of harmonics or the higher the level of harmonics, the greater the amount of distortion. In the distortion processing 253d, various methods can be employed to form harmonics. For example, the input signal may be clipped at a predetermined level, or harmonics may be formed from the input signal and added.

  In the music reproduction process of FIG. 5, when the voice effect is specified, after the preparation is completed, the performance of the specified performance information is started (S107). In the present embodiment, since two singing microphones 43a and 43b are provided, for example, one sings with the singing microphone 43a and the other enjoys a simulated guitar performance with a voice guitar using the singing microphone 43b. It has become possible. In the music reproduction process, when it is determined that the performance has ended (S108: Yes), the program returns to the beginning of the music reproduction process and checks the reservation table to reproduce the next reserved music (S101).

  As described above, the sound effect imparting unit 253 (when “voice guitar” is selected) according to the present embodiment suppresses the characteristics of the sound by varying the magnitude of the distortion in accordance with the characteristics of the sound such as the voiced sound and the non-voiced sound, thereby singing. It is possible to bring the voice closer to the tone of a musical instrument (guitar). Further, in the present embodiment, more effective by adjusting the magnitude of the distortion according to the volume of the singing voice, or by changing and adjusting the magnitude of the distortion according to the progress of the music such as a single tone section and a chord section. In this configuration, the singing voice can be made closer to the tone of a musical instrument (guitar).

1: Remote control device 30: CPU
2: Karaoke device 31: Video control unit 5: Server device 32: Hard disk 11: Touch panel monitor 33: Touch panel monitor 11a: Display unit 34: Touch panel 11b: Touch panel 35: Display unit 12: Video RAM 41: Monitor 13: Video control unit 42: Speaker 14: Memory 43a, 43b: Singing microphone 15: Control unit 251: Music playback unit 16: Wireless LAN communication unit 252: Sound effect applying unit 17: Operation unit 253: Sound effect applying unit 18: Operation processing unit 253a : Equalizer processing 21: Operation unit 253b: Compressor processing 22: Operation processing unit 253c: Harmonizer processing 24: LAN communication unit 253d: Distortion processing 25: Sound control unit 253e: Volume detection processing 27: Memory 253f: Characteristic section detection processing 28: Video R M 253g: distortion amount adjustment process 29: the video playback unit 254: adding unit

Claims (5)

A sound effect imparting device that imparts an acoustic effect to an input audio signal input from a microphone,
A sound effect imparting process including at least a distortion process for distorting the input audio signal,
A detection process of detecting a voiced interval definitive input speech signal as the speech feature section,
An acoustic effect imparting device, comprising: performing an adjustment process for varying the magnitude of the distortion in the distortion process between the voice feature segment detected in the detection process and the other segments. The sound effect imparting device according to claim 1 , wherein the adjustment process varies a magnitude of distortion in the distortion process according to a volume of an input audio signal. The sound effect imparting processing, sound effect imparting apparatus according to claim 1 or claim 2, characterized in that it comprises a pitch changing process for changing the pitch of the input speech signal. The sound effect imparting device according to claim 3 , wherein the pitch change processing is executed in synchronization with a performance processing for playing performance information. A sound effect giving program for giving a sound effect to an input audio signal input from a microphone,
A sound effect imparting process including at least a distortion process for distorting the input audio signal,
A detection process of detecting a voiced interval definitive input speech signal as the speech feature section,
A sound effect providing program for causing an information processing apparatus to execute an adjustment process for making the distortion processing distortion amount different between a voice characteristic section detected in the detection processing and a section other than the voice characteristic section.