JP2009008934A - Music reproduction device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a music reproduction device, capable of providing a new interest. <P>SOLUTION: Pitch information is extracted from a voice input to a microphone designated for musical instrument performance. Substitution is performed to MIDI data having pitch information to substitute the pitch information thereof by the extracted pitch information, whereby new MIDI data is formed. A voice input to a general singing microphone, a general accompaniment sound, and a sound signal based on the new MIDI data are mixed and voice-output, whereby the voice input to the microphone can be used as a part of musical instrument sound. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a musical sound reproducing apparatus capable of providing a new interest.

Conventionally, musical tone reproduction apparatuses are widely known. The input voice and the song data of the music are mixed and output as a voice, and the singer can sing in synchronization with the reproduction of the music. In general, lyrics and video information are displayed on the display means. Some of these musical sound reproducing apparatuses can sing while playing a musical instrument. In the following Patent Document 1, a person who can play an instrument among a plurality of karaoke singers can perform karaoke singing and instrument playing by a plurality of singers when the karaoke singing proceeds while playing the instrument. Therefore, with respect to the type of musical sound corresponding to the musical instrument to be played, the designated MIDI data is deleted so that the sound source is not reproduced.
Japanese Patent Laid-Open No. 10-187175

  By the way, in the above musical tone reproducing apparatus, since any one of a plurality of karaoke singers performs, it is necessary to bring an instrument into a so-called karaoke BOX or the like. In addition, since the skill level of the musical instrument to be played becomes a problem, it is not a function that anyone who sings karaoke can easily use. Further, in order to connect an electric musical instrument to the musical sound reproducing device, the musical sound reproducing device as described above also requires a musical instrument connection board. When the board is built in the musical sound reproducing device, the device itself is also incorporated before It becomes larger compared.

  Therefore, the present invention solves the above-mentioned problems, and any of a plurality of karaoke singers does not bring an instrument into a karaoke BOX or the like, and regardless of the skill level of the instrument, An object of the present invention is to realize a karaoke apparatus that can easily perform karaoke singing and musical instrument performance by a plurality of singers by easily performing a desired musical instrument.

  In order to achieve the above object, the invention according to claim 1 is a musical sound reproducing apparatus comprising two sound input means (microphones), a control means, a music storage means, and a sound output means (speakers, etc.). Stores MIDI data including pitch information used for music reproduction, and the control means uses two voice input means (microphones) as first voice input means (instrument performance microphone) or second voice input means. Pitch information from the voice input to the voice input means determined as two voice input means (microphone for normal karaoke singing (hereinafter referred to as singing)) and determined as the first voice input means (microphone for musical instrument performance) The pitch information of MIDI data corresponding to a predetermined instrument is replaced with the extracted pitch information to create new MIDI data. 2. Mixing the voice input to the voice input means determined as the voice input means (ordinary singing microphone), the instrument sound based on the new MIDI data, and the performance sound stored in the music storage means The voice output means (speaker or the like) outputs the mixed signal as a voice.

  According to a second aspect of the present invention, in the musical sound reproducing apparatus according to the first aspect, the voice input to the first voice input means (the microphone for musical instrument performance) is corrected, and the pitch information extracted from the corrected voice is used. Based on this, a predetermined musical instrument sound is generated.

  According to a third aspect of the present invention, in the musical tone reproducing apparatus according to the first or second aspect, the control means further includes pitch information of the voice for each voice input to the two voice input means. Pattern matching with the pitch information of the guide melody is performed, and whether each voice input means is a first voice input means (a microphone for musical instrument performance) or not based on the result of the matching relationship of the pattern matching. Second voice input means It is characterized by determining whether it is (a microphone for normal singing).

  According to a fourth aspect of the present invention, in the musical sound reproducing device according to any one of the first to third aspects, the control means further includes the first voice input means at the timing when the guide melody starts. It is characterized in that it is determined whether it is a (musical instrument performance microphone) or a second voice input means (ordinary singing microphone).

  According to a fifth aspect of the present invention, in the musical sound reproducing device according to any one of the first to fourth aspects, when the preset number of simultaneous sounds that can be generated is exceeded, the parameter of the generated instrument sound among the tracks to be sound-outputted is used. The sound output of the nearest track is stopped.

  According to the first aspect of the invention, musical instrument performance can be realized without preparing a musical instrument or the like.

  According to the second aspect of the present invention, since the sound input to the musical instrument performance microphone is corrected and then converted into the instrument sound, an instrument sound close to the original pitch or the like can be generated.

  According to the invention of claim 3, it is discriminated whether it is the first voice input means (microphone for musical instrument performance) or the second voice input means (normal microphone for singing) by pattern matching with the guide melody. Therefore, it is not necessary for the user to set the microphone in advance.

  According to the invention of claim 4, since the voice input means is determined at the timing when the guide melody starts, the first voice input means (the microphone for musical instrument performance) and the second voice input means (before and after the interlude) Switching to a normal singing microphone) is possible.

  According to the fifth aspect of the present invention, when the number of simultaneously soundable sounds is exceeded during the performance, the output of the generated instrument sound is stopped in order to stop the sound output of the track closest to the parameter of the generated instrument sound. The performance can be continued without any problems.

[First Embodiment]
A musical sound reproducing apparatus according to the present invention will be described in detail with reference to the drawings based on a first embodiment embodied in a karaoke apparatus. In the following description, the terms pitch information and pitch data are used, but both terms are synonymous.

  FIG. 1 is a diagram illustrating an internal configuration of a control device according to a karaoke apparatus and peripheral devices thereof. The front panel 1 includes a power switch, a display, and a selection button. The power switch is a switch for turning on / off the power of the control device 100. For example, the music selection number is displayed on the display. Moreover, you may comprise so that various information may be displayed as needed. The singer can input a song number or the like using the selection button. The front panel 1 is controlled by a one-chip CPU09. Further, the operation of the front panel 1 may be realized by a remote controller (not shown). The front panel 1 is connected to the control device 100 by, for example, serial communication.

  The control device 100 is configured to be able to communicate with an external device. Specifically, it has a LAN interface 2 for enabling communication with another karaoke commander 20 via a LAN. It also has a modem 3 for enabling communication with the host PC 21 via a telephone line. The LAN interface 2 is connected to the main control unit 7. The modem 3 is connected to the main control unit 7. The communication between the karaoke commander 20 and the host PC 21 may be realized by another communication form or communication means.

  The control device 100 has a video input unit 4 for reading a DVD 24 storing video information. The video input unit 4 is connected to the main control unit 7.

  The control device 100 includes a microphone 22 and a microphone 23. In the following description, for convenience, the microphone 22 may be referred to as a microphone (1), and the microphone 23 may be referred to as a microphone (2). Signals input from these microphones are amplified by the microphone amplifier 5. The microphone amplifier 5 is connected to the A / D converter 111. The A / D converter 111 converts an analog input signal into a digital signal and inputs the digital signal to a digital audio processing unit 102 described later. Note that the microphone 22 and the microphone 23 may be configured to have an amplification function and / or an A / D conversion function. The singer sings using the microphone 22 and the microphone 23.

  The control device 100 includes an A / D converter 6 for A / D converting the music information stored in the DVD 24 described above. The A / D converter 6 is connected to a digital audio processing unit 102 described later.

  The control device 100 has a video output MPEG decoder 8. The video output MPEG decoder 8 is connected to the main control unit 7, receives the MPEG video signal, decodes the MPEG video signal, and outputs it to the monitor 25. If the video signal handled by the control device is not in the MPEG format, a module corresponding to the format of the video signal is provided.

  The HDD 10 and the HDD 11 mainly store video signals and / or audio signals. Such information may be obtained through a communication line, may be obtained through a predetermined storage medium, or may be stored in advance at the time of shipment. In addition to video and audio signals, various information may be stored. Further, MIDI data described later is also stored in the HDD 10 or the HDD 11.

  The voice control unit 101 functions as an interface between the main control unit 7 and the digital voice processing unit 102.

  The main control unit 7 is connected to various elements included in the control device 100, and controls various elements in order to realize the control device 100 as a music reproducing device.

  The voice effect unit 31 can add various effects (for example, echo, reverb, pitch, etc.) to the input audio signal.

  The D / A converter 115 and the D / A converter 116 convert the input digital signal into an analog signal.

  The preamplifier 117 is connected to the power amplifier 103. The power amplifier 103 amplifies the input signal.

  Details of the digital audio processing unit 102 will be described. FIG. 2 is a diagram showing a digital audio processing unit and its peripheral elements. The mute unit 41 and the mute unit 42 are connected to the microphone 22 and the microphone 23, respectively. By enabling each mute unit, the input of a signal to the voice effect unit 31 can be stopped.

  The pitch detection unit 43 and the pitch detection unit 44 are connected to the microphone 22 and the microphone 23, respectively. Each pitch detection unit extracts pitch information from the input audio signal. The extracted pitch information is compared with the guide melody, and the compared information is used for scoring, pitch correction, signal identification, and the like.

  The pitch correction unit 45 performs processing to correct the pitch information extracted by the pitch detection unit 43 and / or the pitch detection unit 44 to the pitch information of a predetermined instrument. The pitch correction unit 45 is connected to the pitch detection unit 43 and the pitch detection unit 44, and a signal to be corrected is determined by the main control unit 7.

  The key control unit 33 can control keys of audio signals from the DVD 24. The music effect unit 34 can add various effects to music information based on MIDI data.

  The sound control unit 47 outputs MIDI data for outputting sound to the MIDI sound source 32. Here, the MIDI data for outputting a sound is an input sound signal converted into a musical instrument sound or MIDI data read from the HDD. Note that the process of converting the input sound into an instrument sound will be described later.

  In addition, the external appearance of the karaoke apparatus in 1st Embodiment is not limited at all in this invention. Moreover, in this invention, you may provide the one part element shown as an internal structure of the karaoke apparatus mentioned above outside. That is, for example, a video output MPEG decoder or HDD can be realized as an externally connected device. It is also possible to realize the functions of some components by a server connected to a network.

  In the following description, the term plus 1 may be used. Here, plus 1 means that, apart from vocals, new MIDI data is generated using pitch information of the input sound, and the instrument sound signal based on the generated MIDI data is mixed, so that the input sound is This means that the sound is output as a part of the musical instrument sound constituting the MIDI music piece.

  In the following description, singing after being converted to an instrument sound is sometimes referred to as an instrument performance.

  The music reproduction data used in this embodiment includes pitch data, tone color data, timing data, and the like. As typical examples, MIDI data can be cited, but the present invention is not limited to MIDI data, and may be other data as long as the present invention can be implemented.

  Next, the flow of processing of the karaoke apparatus in the first embodiment will be described with reference to the drawings. FIG. 3 is a flowchart showing a main process of the karaoke apparatus in the first embodiment. First, in S1, when the plus 1 mode is selected by the remote controller, the process proceeds to the operation mode determination process in S2. In addition, you may comprise so that plus 1 mode may be selected by operation of the front panel 1, without using a remote control.

  Details of the operation mode determination processing in S2 will be described with reference to FIG. FIG. 3 is a flowchart of the operation mode determination process. First, in S11, an instrument for converting input sound is determined. The singer can be made to select the instrument.

  In S12, it is determined whether or not to delete the musical instrument to be converted from the music performance. This determination may be based on information input by the singer, or may be based on a signal from a preset control device. If it is determined that the music is to be deleted from the performance (S12: YES), the process proceeds to S13. On the other hand, if it is determined not to be deleted from the music performance (S12: NO), the process proceeds to S14.

  In S13, a flag indicating that the performance based on the music data of the musical instrument designated in S11 is invalidated is set. This flag information is used when the music is played.

  In S14, it is determined whether or not the pitch correction is performed on the voice input for the musical instrument performance. When it is determined that the pitch correction is to be performed (S14: YES), the process proceeds to S15. On the other hand, when it is determined not to perform the pitch correction (S14: NO), the operation mode determination process ends. In S5, a flag indicating that the pitch is to be corrected is set (validate the flag). The sound correction process will be described later. Further, this flag information is used at the time of music reproduction.

  Next, the microphone designation process in S3 of FIG. 3 will be described with reference to FIG. FIG. 5 is a flowchart of the microphone designation process. First, in S21, the control device 100 displays a message to that effect on the monitor to instruct the singer to input voice to the microphone that performs instrument conversion. In addition, you may comprise so that it alert | reports with an audio | voice etc. instead of alerting | reporting by a monitor.

  When notified to the singer, the singer inputs voice during S22.

  In S23, it is determined whether or not sound is input to the microphone (1). When it is determined that sound is input to the microphone (1) (S23: YES), the process proceeds to S24. If it is determined that no sound is input to the microphone (1), that is, it is input to the microphone (2) (S23: NO), the process proceeds to S26.

  In S24, the mute unit 41 is enabled. Thereby, the input to the voice effect part 31 of the audio | voice signal input into the microphone (1) is interrupted | blocked. In S25, the pitch detection data from the pitch detection unit 43 is designated as instrument conversion data.

  In S26, the mute unit 42 is enabled. Thereby, the input to the voice effect part 31 of the audio | voice signal input into the microphone (2) is interrupted | blocked. In step S27, the pitch information from the pitch detector 44 is designated as instrument conversion data.

  Returning to FIG. In S4, in order to play the music selected by the user, the music information of the music is prepared for playback from a predetermined storage means.

  In S5, it is determined whether or not the instrument invalid flag is set (the flag is valid). When the instrument invalid flag is set (S5: YES), the process proceeds to S6. On the other hand, if the instrument invalid flag is not set (S5: NO), the process proceeds to S7. In S6, the performance of the musical instrument designated from the performance data is set to be invalidated.

  In S7, a mixing process is performed. Details of the mixing process will be described with reference to FIG. FIG. 6 is a flowchart showing the mixing process. In S31, the data of the selected music is sent to the sound source and the performance is started.

  In S32, the sound control unit 47 acquires pitch information from the microphone for musical instrument performance. In S33, it is determined whether or not the pitch correction flag is valid. When the pitch correction flag is valid (S33: YES), the process proceeds to S35. When the pitch correction flag is invalid (S33: NO), the process proceeds to S34.

In S34, the data is converted into MIDI data of the designated instrument. Specifically, new MIDI data is created by replacing the information regarding the pitch information in the MIDI data of the musical instrument with the pitch information extracted in S32.
This process will be specifically described. A pitch frequency (for example, 300 Hz) is extracted by analyzing the input signal. Then, a note number corresponding to the extracted pitch frequency is calculated. Note that the note number is publicly known, so the description is omitted. Then, new MIDI data can be created by replacing the note number of the MIDI data of the musical instrument with the calculated note number.

In S35, a sound correction process is executed so as to approach the pitch information in the MIDI data of the designated instrument. In this sound correction process, for example, the pitch information of the sound input from the microphone is reset to the pitch information (new pitch information) of the reference sound having the closest pitch, so that the sound input from the microphone is This is a process for correcting the pitch information in the MIDI data of the musical instrument designated in the new pitch information so that various known techniques can be applied.
Here, “reset” means that if the pitch information of the input sound is closest to the pitch of the input sound, the pitch information of the input sound is reset to the pitch information of the reference sound whose pitch is the “de” sound. Meaning. The pitch information of the reference sound is prepared in advance for each pitch. For example, the pitch information of the reference sound corresponding to each of “do”, “re”, and “mi” is stored in the storage unit in advance.

  In S36, the converted MIDI data is transmitted to a predetermined port (eg, B port). As a result, a new acoustic signal is generated in the MIDI sound source 32.

  In S37, the sound signal based on the new MIDI data is mixed with the input sound signal and the music and output as a sound, so that the plus one function can be realized.

  In S38, it is determined whether or not the music has ended. If the song has not ended (S38: NO), the process returns to S32 and the above-described processing is repeated. When the music is finished, the mixing process is finished. The mixing process is repeatedly executed during the reproduction of music.

  Returning to FIG. In S8, it is determined whether or not to end the plus 1 mode. If it is determined that the plus 1 mode is to be terminated (S8: YES), the process is terminated. If it is determined not to end the plus 1 mode (S8: NO), the process returns to S2 and the above-described processing is repeated. That is, the next requested song is also played in the plus 1 mode.

  Next, regarding the processing described above, the temporal changes in the operations of the microphone (1), the microphone (2), the mute unit 41, the mute unit 42, the pitch detection unit 43, and the pitch detection unit 44 will be described with reference to FIG. explain.

  FIG. 7 is a timing chart showing temporal changes in the operation of the above elements. In this figure, the microphone (1) is designated as a normal singing microphone and the microphone (2) is designated as a performance performance microphone. In the figure, a performance is a section where a singer sings, that is, a section where lyrics are displayed. The performance section is also a section where a guide melody exists.

  When the plus 1 mode is turned on and the performance performance microphone is determined, the sound input to the microphone (2) at that time is controlled so that it can be converted into an instrument. In addition, when the microphone is selected, the pitch detection unit 43 is used for scoring. In addition, since there are various known techniques for the input voice scoring method, the description thereof is omitted here. Further, the pitch detection unit 43 is used for scoring until the music reproduction is finished. The pitch detector 44 is used for musical instrument conversion until the music reproduction is completed.

According to the karaoke apparatus according to the first embodiment described above, by changing the sound signal input to the designated microphone to a predetermined instrument sound and outputting the sound, the instrument performance can be achieved by a simple operation without bringing in the instrument. Can be realized. When two singers enjoy singing, one person can usually sing and the other person can perform a musical instrument performance. Thereby, the new interest in a musical tone reproduction apparatus can be improved.
In addition, a singer who performs a musical instrument according to the musical instrument performance outputs his / her voice from the singer's own mouth so as to match the performance of karaoke, and the act of playing a voice is performed. Therefore, a singer who performs a musical instrument performance can prevent a predetermined type of musical sound from being played based on MIDI data, and can also sing karaoke songs and musical instrument performances by other singers while playing a musical instrument by himself. It is possible to enjoy karaoke that can be easily performed.
Further, since the musical instrument connection board in the conventional music sound reproducing apparatus is not required to be built in, the apparatus itself is not enlarged.

  Note that the above-described flowchart is merely an example, and the process may be realized by another flowchart as long as it can obtain a result equivalent to the above-described process. In the above-described processing, the case where the number of microphones is two has been described, but the present invention can be similarly realized even when the number of microphones is three or more.

[Second Embodiment]
A musical sound reproducing apparatus according to the present invention will be described in detail with reference to the drawings based on a second embodiment embodied in a karaoke apparatus. In the first embodiment, the singer has set which microphone to use for the musical instrument performance. However, in the present embodiment, the control device 100 can automatically determine.

  A second embodiment will be described with reference to FIG. FIG. 8 is a flowchart of the main process of the second embodiment. Since the main process is substantially the same as the main process of the first embodiment, the description of the same process is omitted. In the second embodiment, two flags (X flag and Y flag) are used.

  When the plus 1 mode is selected in S41 and then the operation mode determination process in S42 is performed, the process proceeds to the music selection process in S43. Thereafter, processing based on the instrument invalid flag is performed (S44, S45), and the process proceeds to S46.

  In S46, the pitch information of the route of the microphone (1) and the microphone (2) is set in the instrument conversion data. Thereafter, the process proceeds to the mixing process of S47.

  The mixing process in the second embodiment will be described with reference to FIG. FIG. 9 is a flowchart of the mixing process in the present embodiment. In S51, the sound control unit 47 sends the MIDI data of the selected music to the MIDI sound source 32 and reproduces the music. In S52, the sound control unit 47 obtains pitch information of the input voice. In S53, it is determined whether or not the current reproduction position is the first measure of the first guide melody.

  If it is determined that the playback position is within the first measure of the first guide melody (S53: YES), the process proceeds to S54. In S54, a microphone automatic designation process is executed.

  Here, the microphone automatic designation processing will be described with reference to FIG. FIG. 10 is a flowchart of the microphone automatic designation process. In S61, pitch information for the first bar is acquired. Note that the interval from which pitch information is extracted is not limited to one measure but may be two or more measures. In S62, it is determined whether or not the pitch information of the microphone (1) matches the pitch information of the guide melody. If it is determined that they match (S62: YES), the process proceeds to S64, and the value of the X flag is set to 1. If it is determined that they do not match (S62: NO), the process proceeds to S63, and the value of the X flag is set to zero.

  In S65, it is determined whether or not the pitch information of the microphone (2) matches the pitch information of the guide melody. If it is determined that they match (S65: YES), the process proceeds to S67 and the value of the Y flag is set to 1. If it is determined that they do not match (S65: NO), the process proceeds to S66 and the value of the Y flag is set to zero.

  In S68, it is determined whether or not (X, Y) = (0, 0). That is, it is determined whether or not any microphone is used for musical instrument performance. When (X, Y) = (0, 0) (S68: YES), the process proceeds to S69. In S69, the pitch detection data of the microphone (1) and microphone (2) are set to be used as instrument conversion data.

  If (X, Y) = (0, 0) is not satisfied (S68: NO), the process proceeds to S70. In S70, it is determined whether (X, Y) = (1, 0). That is, it is determined whether the microphone (1) is for normal singing and the microphone (2) is for musical instrument performance. When (X, Y) = (1, 0) (S70: YES), the process proceeds to S71. In S71, the mute unit 42 is activated to mute the route of the microphone (2). In S72, the microphone (2) pitch data is set to be used as instrument conversion data. In this case, the pitch detection data of the microphone (1) is set to be used as scoring data.

  If (X, Y) = (1, 0) is not satisfied (S70: NO), the process proceeds to S73. In S73, it is determined whether or not (X, Y) = (0, 1). That is, it is determined whether the microphone (1) is for musical instrument performance and the microphone (2) is for normal singing. When (X, Y) = (0, 1) (S73: YES), the process proceeds to S74. In S74, the mute unit 41 is activated to mute the route of the microphone (1). In S75, the pitch data of the microphone (1) is set to be used as instrument conversion data. In this case, the pitch detection data of the microphone (2) is set to be used as scoring data.

When it is not (X, Y) = (0, 1) (S73: NO), the process proceeds to S76, and any microphone is controlled to be used for normal singing.
In the flowchart of FIG. 10, the processing when the number of microphones is two has been described, but the present invention is not limited to the case where there are two microphones. That is, even when the number of microphones is three or more, the present invention can be realized.
If the number of microphones is three or more, the pitch information obtained from the voice input for each microphone is compared with the pitch information of the guide melody, and the pitch information of the guide melody matches. Even if the number of microphones is three or more, the pitch information of the voice input from the microphone with the highest volume is used as the instrument conversion data, and the voice from other microphones is not converted to the instrument. The instrument conversion can be performed on the sound input from any one microphone.

  Regarding the processing described above, the relationship between the input audio signal and the output acoustic signal is tabulated as shown in FIG. That is, for each of the microphone (1) and the microphone (2), when the pitch of the input voice matches the pitch of the guide melody, it is configured to output as a normal vocal voice. Configured to output the sound of the instrument. Here, the coincidence between the pitch of the input voice and the pitch of the guide melody need not be exact and can be set as appropriate.

  Next, regarding the processing described above, the temporal changes in the operations of the microphone (1), the microphone (2), the mute unit 41, the mute unit 42, the pitch detection unit 43, and the pitch detection unit 44 will be described with reference to FIG. explain.

  FIG. 12 is a timing chart showing temporal changes in the operation of the above elements. In this figure, the microphone (2) is designated as a performance performance microphone. In the figure, a performance is a section where a singer sings, that is, a section where lyrics are displayed. The performance section is also a section where a guide melody exists.

  When the plus 1 mode is turned on and a music reproduction signal is detected, both the microphone (1) and the microphone (2) are in a state in which musical instrument sound can be converted. That is, the sound input to the microphone during this time is converted into instrument sound. Therefore, both the pitch data based on the microphone (1) and the pitch data based on the microphone (2) are set for musical instrument sound conversion.

  After that, at the timing when the guide melody starts playing, the microphone is used for either normal singing or instrument performance based on the match / mismatch of the pitch data based on the input sound to each microphone and the pitch data of the guide melody It is determined whether it is being used. In this example, since the microphone (1) is used for normal singing, the audio signal from the microphone (1) matches the pitch data of the guide melody.

  Thereby, the pitch data output from the pitch detection unit 43 is used for scoring. For a duet song, it is possible to determine whether the audio signal input from the microphone is for musical instrument performance using the male part guide melody and the female part guide melody.

  In the present embodiment, after the usage patterns of the microphone (1) and the microphone (2) are determined after the reproduction of the guide melody is started, the usage pattern is not changed. That is, what is determined for normal singing is for normal singing until the end of reproduction, and what is determined for musical instrument performance is for musical instrument performance until the end of reproduction.

  As described above, in the second embodiment, since the user can determine the use form of the microphone based on the comparison processing result with the pitch data of the guide melody without the user selecting the use form of the microphone. Musical instrument performance can be realized without imposing a burden on the user. Note that the above-described flowchart is merely an example, and the process may be realized by another flowchart as long as it can obtain a result equivalent to the above-described process.

[Third Embodiment]
Next, a third embodiment according to the present invention will be described. In the first and second embodiments, once determined, it cannot be changed until the end of the performance. However, in the third embodiment, the use form of the microphone can be changed even during the performance. it can.

  Since the main process of the third embodiment is the same as the main process of the second embodiment except for the mixing process, description thereof is omitted. In the present embodiment, two flags (X flag and Y flag) are used. The mixing process will be described with reference to the drawings. FIG. 13 is a flowchart of the mixing process.

  In S81, the sound control unit 47 sends the MIDI data of the selected music to the MIDI sound source 32 and reproduces the music. In S82, the sound control unit 47 obtains pitch information of the input voice. In S83, it is determined whether the reproduction position is the first measure of each guide melody. That is, it is determined whether the guide melody is played immediately after the prelude or immediately after the end of the interlude. If it is determined that the playback position is within the first measure of any guide melody (S83: YES), the process proceeds to S84. In S84, a microphone automatic designation process is executed.

  The microphone automatic designation process executed in S84 is the same as that in the second embodiment described above, and a description thereof will be omitted.

  Next, regarding the processing described above, the temporal changes in the operations of the microphone (1), the microphone (2), the mute unit 41, the mute unit 42, the pitch detection unit 43, and the pitch detection unit 44 will be described with reference to FIG. explain.

  FIG. 14 is a timing chart showing temporal changes in the operation of the above elements. In this figure, the microphone (2) is designated as a performance performance microphone. In the figure, a performance is a section where a singer sings, that is, a section where lyrics are displayed. The performance section is also a section where a guide melody exists.

  When the plus 1 mode is turned on and a music reproduction signal is detected, instrument sound conversion is possible for both the microphone (1) and the microphone (2). That is, the sound input to the microphone during this time is converted into instrument sound. Therefore, both the pitch data based on the microphone (1) and the pitch data based on the microphone (2) are set for musical instrument sound conversion.

  After that, at the timing when the guide melody starts playing, the microphone is used for either normal singing or instrument performance based on the match / mismatch of the pitch data based on the input sound to each microphone and the pitch data of the guide melody It is determined whether it is being used. In this example, since the microphone (1) is used for normal singing, since the audio signal from the microphone (1) matches the pitch data of the guide melody, the microphone (1) is determined for normal singing.

  Based on this, the pitch data output from the pitch detector 43 is used for scoring.

  Next, when the guide melody is started, the above-described processing is performed, and the microphone (1) is used for normal singing and the microphone (2) is used for musical instrument performance.

  As described above, in the third embodiment, the user can determine the microphone usage mode based on the result of the comparison with the pitch data of the guide melody without the user selecting the microphone usage mode. Performance performance can be realized without imposing a burden on the user. Moreover, since the use form of a microphone can be discriminate | determined for every performance area (lyric display area) divided | segmented by an interlude area, the new interest in karaoke can be improved. Note that the above-described flowchart is merely an example, and the process may be realized by another flowchart as long as it can obtain a result equivalent to the above-described process. In the above-described processing, the case where the number of microphones is two has been described, but the present invention can be similarly realized even when the number of microphones is three or more.

[Processing when the polyphony is exceeded]
In a musical sound reproducing device in which the number of simultaneous pronunciations is limited, the number of simultaneous pronunciations may be exceeded when the above-described plus 1 function is executed. In that case, if the plus one function is forcibly disabled, the interest of the user may be reduced. Therefore, even when the number of simultaneous pronunciations is exceeded, it is required to realize karaoke song reproduction without reducing the interest of the user.

  Processing that takes into account the restriction on the number of simultaneous pronunciations will be described with reference to the drawings. In the following, the process improved with respect to the above-described first embodiment will be described, but it goes without saying that the process can also be applied to the second embodiment and the third embodiment.

  FIG. 15 is a flowchart of processing that takes into consideration the restriction on the number of simultaneous pronunciations. Since the basic processing is the same as that of the first embodiment described above, description thereof is omitted. In S5, when the music invalid flag is not set (S5: NO), the music track check process in S101 is performed.

  The music track check process will be described with reference to the drawings. FIG. 16 is a flowchart of the music track check process. In S91, the track of the selected song data and the number of simultaneous sounds are checked. Thereby, the information regarding the number of musical instruments used in the selected music and the number of simultaneous pronunciations is acquired.

  In S92, the allowable simultaneous pronunciation number in the karaoke apparatus is acquired. In S93, it is checked whether or not the number of simultaneous pronunciations acquired in S91 is the same as the allowable number of simultaneous pronunciations acquired in S92. If the numbers are different (S93: NO), the music track check process is terminated. If the numbers are the same (S93: YES), the process proceeds to S94. Since the number of simultaneous pronunciations is increased by realizing the plus one function, if the number of simultaneous pronunciations is equal to the allowable number of simultaneous pronunciations, the maximum allowable number of simultaneous pronunciations of the karaoke device is exceeded during the reproduction of the music.

  In S94, it is determined whether or not there is the same track as the instrument selected as the instrument sound conversion target. If it is determined that there is the same track (S94: NO), the process proceeds to S96, and the track of the same instrument is set to be invalidated. On the other hand, if it is determined that there is no same track (S94: YES), the process proceeds to S95.

  In S95, a track similar to the frequency band of the musical instrument selected as the instrument sound conversion target is selected. Here, for the selection process, for example, a table shown in FIG. 17 can be used. When the table shown in this figure is used, if a guitar is selected as an instrument for musical instrument sound conversion, the track corresponding to the high range of the piano is set to be invalidated. When the process of S95 ends, the music track check process ends.

  By performing the above-mentioned processing, it is possible to cope with cases where the number of simultaneous pronunciations is exceeded, so even if there are restrictions on the device, performance performance can be performed, and the mixed acoustic signal as a whole has a little uncomfortable feeling It can be.

  In addition, this invention is not limited to the said Example, Of course, various improvement and deformation | transformation are possible within the range which does not deviate from the summary of this invention. For example, although the musical instrument to be converted into the musical instrument sound is determined in the operation mode determination process, it can also be determined at the start of reproduction of the guide melody. That is, it is possible to compare the pitch information of the input sound with the pitch information of each musical instrument sound of the music to be reproduced and convert it to the most similar musical instrument sound.

  The pitch detector may be configured to extract not only the pitch of the input voice but also the sound intensity, and may be configured to replace both the pitch data of the MIDI data and the sound intensity data. . Thereby, the converted musical instrument sound can more reflect the singing content of the singer performing the musical instrument performance.

  The present invention can also be realized as a musical sound reproduction method for executing the above-described processing. Furthermore, the present invention can be realized as a program for causing the musical sound reproduction method to be executed by a computer and a recording medium on which the program is recorded.

It is the figure which showed the internal structure of the control apparatus in the karaoke apparatus which concerns on 1st thru | or 3rd embodiment, and its peripheral device. It is the figure which showed the digital audio processing part and its peripheral element in the karaoke apparatus which concerns on 1st thru | or 3rd embodiment. It is a flowchart of the main process in the karaoke apparatus which concerns on 1st Embodiment. It is a flowchart of the operation mode determination process in the karaoke apparatus which concerns on 1st Embodiment. It is a flowchart of the microphone designation | designated process in the karaoke apparatus which concerns on 1st Embodiment. It is a flowchart of the mixing process in the karaoke apparatus which concerns on 1st Embodiment. It is the figure which showed the operation | movement timing of each element in the karaoke apparatus which concerns on 1st Embodiment. It is a flowchart of the main process in the karaoke apparatus which concerns on 2nd and 3rd embodiment. It is a flowchart of the mixing process in the karaoke apparatus which concerns on 2nd Embodiment. It is a flowchart of the microphone designation | designated process in the karaoke apparatus which concerns on 2nd Embodiment. It is the figure which showed the relationship between the input audio | voice and output acoustic signal in the karaoke apparatus which concerns on 2nd Embodiment. It is the figure which showed the operation | movement timing of each element in the karaoke apparatus which concerns on 2nd Embodiment. It is a flowchart of the mixing process in the karaoke apparatus which concerns on 3rd Embodiment. It is the figure which showed the operation | movement timing of each element in the karaoke apparatus which concerns on 3rd Embodiment. It is a flowchart of an example of the main process in case the restriction | limiting of the simultaneous pronunciation number is considered. It is a flowchart of the music track check process in the karaoke apparatus which concerns on one Embodiment of this invention. It is the figure which showed the corresponding relationship between the selected musical instrument and the musical instrument deleted in the karaoke apparatus which concerns on one Embodiment of this invention.

Explanation of symbols

22 microphone 23 microphone 32 MIDI sound source 43 pitch detection unit 44 pitch detection unit 46 sound correction unit 47 sound control unit

Claims (5)

In a musical sound reproducing apparatus comprising two voice input means, a control means, a music storage means, and a voice output means,
The storage means stores MIDI data including pitch information used for music reproduction,
The control means includes
Each of the two voice input means is determined as the first voice input means or the second voice input means,
Extracting pitch information from the voice input to the voice input means determined as the first voice input means,
Create new MIDI data by replacing the pitch information of the MIDI data corresponding to a predetermined instrument with the extracted pitch information,
Mixing the sound input to the sound input means determined as the second sound input means, the instrument sound based on the new MIDI data, and the performance sound stored in the music storage means,
The audio output means outputs the mixed signal as audio.
A musical sound reproducing apparatus characterized by the above. The control means further includes:
Correcting the pitch of the voice input to the first voice input means, and generating a musical instrument sound based on the pitch information extracted from the corrected pitch;
2. A musical sound reproducing apparatus according to claim 1, wherein The control means further includes:
For each voice input to the two voice input means, pattern matching between the pitch information of the voice and the pitch information of the guide melody is performed, and based on the comparison result of the matching relationship of the pattern matching, Determining whether the input means is the first voice input means or the second voice input means;
The musical tone reproduction apparatus according to claim 1 or 2, wherein The control means further includes:
Determining whether each of the voice input means is a first voice input means or a second voice input means at a timing when the guide melody starts;
The musical sound reproducing apparatus according to any one of claims 1 to 3, wherein The performance sound is composed of a plurality of tracks, and when the preset number of simultaneously soundable sounds is exceeded, the sound output of the track closest to the parameter of the generated instrument sound is stopped among the tracks to be sound output.
5. A musical sound reproducing apparatus according to claim 1, wherein

Images