JP6196571B2 - Performance device and program - Google Patents

Description

  The present invention relates to a performance device and a program for outputting a performance sound based on music data selected from a large number of music data, and in particular, for realizing an output of a performance sound that is easy to perform according to a user. Regarding improvements.

  2. Description of the Related Art A performance device that outputs a performance sound based on music data selected from a large number of music data and outputs a sound signal received from an input device is known. For example, a karaoke device used in a karaoke box or the like. According to such a karaoke apparatus, while outputting a performance sound based on the performance information included in the music data selected from a large number of music data (karaoke performance music) stored in the storage device in advance, the lyrics information of the music Can be displayed on the screen in synchronism with the output of the performance sound, so that karaoke performance of the desired music can be enjoyed.

  In the karaoke performance by the karaoke apparatus, the tempo of the performance becomes a problem. Therefore, a technique for controlling the tempo of karaoke performance in accordance with the user has been proposed. For example, a karaoke tempo control device described in Patent Document 1 is an example. According to this technology, by extracting the pitch of the singing voice captured from the microphone and controlling the tempo of the karaoke performance based on the pattern of the pitch change of the singing voice obtained by tracking the extraction result for a predetermined time, It is said that the karaoke tempo can follow the singer's singing speed.

JP-A-10-149180

  By the way, among the music played by the karaoke apparatus, there is a music in which there is a performance part to be uttered one sound at a time, for example, at the end of the performance. Such a performance part essentially corresponds to a part where the original artist performs singing at a unique timing or signal in live performances and the back band performs along with the singing. Here, the output timing defined in the music data does not necessarily coincide with the original artist's own timing, which makes it difficult to perform. Furthermore, it is conceivable that a capable singer wants to perform the performance part at a unique timing different from that of the original artist. However, according to the conventional technique, it is difficult to control the local change of the performance tempo corresponding to the performance part, and it is difficult to realize the output of the performance sound that is easy to perform according to the user. It was. Such a problem has been newly found in the process in which the present inventor continues intensive research with the intention of improving the performance of the performance device.

  The present invention has been made against the background of the above circumstances, and an object of the present invention is to provide a performance device and a program for realizing output of performance sound that is easy to perform according to the user.

  In order to achieve such an object, the gist of the first aspect of the present invention is to output a performance sound based on music data selected from a large number of music data and to receive a sound received from an input device. A performance apparatus for outputting a signal, comprising performance sound output control means for outputting the performance sound based on output timing information predetermined for the music data, the performance sound output control means comprising the music data Determining whether or not a sound signal has been received from the input device within the specified range, and if it is determined that a sound signal has been received, controlling the output timing information to output the performance sound. It is a feature.

  According to the first aspect of the invention, it is provided with performance sound output control means for outputting the performance sound based on output timing information predetermined for the music data, and the performance sound output control means is defined in the music data. In this range, it is determined whether or not a sound signal has been received from the input device, and when it is determined that a sound signal has been received, the performance sound is output by controlling the output timing information. Therefore, it is possible to realize the output of performance sound that each user performs at a unique timing in a performance portion or the like that should be uttered one by one while taking the so-called reason. That is, it is possible to provide a performance device that realizes output of performance sounds that are easy to perform according to the user.

  In the first invention, preferably, the performance device is a karaoke device connectable to the input device. If it does in this way, the karaoke apparatus which implement | achieves the output of the performance sound which is easy to perform according to a user can be provided.

  Preferably, the specified range has a time position at which a specified flag is defined in the music data as a start position and a time point when a sound signal is received from the input device as an end position. If it does in this way, the performance part which each user can perform at an original timing in the said music data can be suitably defined in a practical aspect.

  Preferably, the prescribed range is terminated when a prescribed time elapses from a time position where the prescribed flag is determined without receiving a sound signal from the input device. In this way, when the input of the sound signal from the input device is interrupted beyond what can be recognized as so-called, the performance portion where each user can perform at a unique timing is terminated. Furthermore, a more suitable performance can be realized.

  Preferably, the apparatus further comprises performance evaluation control means for evaluating a performance corresponding to the music data based on a sound signal received from the input device with the output of the performance sound by the performance sound output control means. The performance evaluation control means does not evaluate the timing of the sound signal received from the input device within a specified range in the music data. In this way, even if the performance timing deviates from the output timing defined in the music data in a performance portion or the like that should be uttered one note at a time while taking the so-called reason, the deduction is not made. Performance evaluation that matches your ability can be realized.

  Preferably, an effect output control means for outputting a specified effect is provided, and the effect output control means determines whether or not a sound signal is received from the input device within a specified range in the music data. When it is determined that a sound signal is received, the effect is output. In this way, it is possible to suitably suppress the deterioration of the atmosphere of the place due to the difference between the performance timing and the output timing of the effect in a performance portion or the like that should be uttered one by one while taking the so-called reason.

  In order to achieve the above object, the gist of the second invention is to output a performance sound based on music data selected from a large number of music data and to receive a sound signal received from an input device. Is a program for functioning as a performance sound output control means for outputting the performance sound based on output timing information predetermined for the music data, the performance sound output control means Determines whether or not a sound signal has been received from the input device within a specified range in the music data, and if it is determined that a sound signal has been received, controls the output timing information to output the performance sound It is a program characterized by performing. In this way, it is possible to realize the output of performance sound that each user performs at a unique timing in a performance portion or the like that should be uttered one by one while taking the so-called reason. That is, it is possible to provide a program that realizes output of performance sounds that are easy to perform according to the user.

It is a block diagram which illustrates the composition of the karaoke device which is a suitable example of the performance device of the present invention. It is a functional block diagram explaining the principal part of the control function with which CPU of the karaoke apparatus shown in FIG. 1 was equipped. It is a figure explaining an example of the performance sound output control by CPU of the karaoke apparatus shown in FIG. It is a flowchart explaining the principal part of an example of the music performance control of a present Example by CPU of the karaoke apparatus shown in FIG. It is a flowchart explaining the principal part of an example of the performance evaluation control of a present Example by CPU of the karaoke apparatus shown in FIG.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram illustrating the configuration of a karaoke apparatus 10 which is a preferred embodiment of the performance apparatus of the present invention. As shown in FIG. 1, a karaoke apparatus 10 according to this embodiment includes a CPU 12 that is a central processing unit, a ROM 14 that is a read-only memory, a RAM 16 that is a write / read memory as needed, and a hard disk 18 that is a storage device. And the video processing unit 20 such as a graphics chip (graphic board), the audio processing unit 22 such as a sound chip (sound board), the operation panel 24, the display control unit 26, and the input control unit 28. A touch panel display 30 connected to the CPU 12, a communication interface 36, a LAN interface 38, a wireless communication unit 40, and a display 44 which is a video display device connected to the video processing unit 20 via a video output terminal 42. , An input connected to the audio processing unit 22 via an audio input terminal 46 A microphone 48 as a device (sound input device), an amplifier 52 as a sound amplifying device connected to the sound processing unit 22 via an audio output terminal 50, and a speaker as a sound output device provided in the amplifier 52. 54 and a sound effector 74 connected to the sound processing unit 22 via an audio input terminal 72.

  The CPU 12 is a so-called microcomputer that processes and controls electronic information based on a predetermined program stored in advance in the ROM 14 using the temporary storage function of the RAM 16, and executes various controls in the karaoke apparatus 10. . That is, when a predetermined music piece (karaoke performance music piece) is selected and input by the operation panel 24, the touch panel display 30, or the electronic quick sample device 68, the reserved music provided in the RAM 16 or the like is input to the selected music piece. Music selection reservation control to be registered in the table, music data read control for reading performance information and lyrics information (music data) of the karaoke performance music selected from the hard disk 18 in accordance with the performance order of the reserved music table, music performance reading progress In response to the performance output control for transmitting performance information from the RAM 16 to the sound processing unit 22, a lyric character image is generated based on the lyric information developed in the RAM 16 during the performance output control, and sent to the video processing unit 20. The lyric character video output control to be transmitted, the video processing in the performance output control 20 is a background video output control that reproduces a predetermined background video, and inter-song information that outputs inter-song information such as new music information, music selection rankings, store advertisements, etc. while karaoke performance is not being performed. In addition to basic control such as output control, various controls such as music performance control and performance evaluation control according to this embodiment described later are executed. In this embodiment, the CPU 12 corresponds to the control device of the karaoke apparatus 10.

  The video processing unit 20 performs various controls related to drawing of a screen (video) displayed on the display 44. For example, based on the data supplied from the CPU 12, the data is written into the graphics memory, and the data is read out so that a predetermined screen is displayed on the display 44 through the video output terminal 42. Specifically, when the karaoke apparatus 10 outputs a musical performance (karaoke performance), a text image (telop) such as a lyric character image generated by the CPU 12 is output, or MPEG (stored in the hard disk 18) is stored. Based on background video information such as Moving Picture Experts Group) data, a predetermined background video is reproduced (decoded), the lyrics character video is synthesized on the front side of the background video and displayed on the display 44, Various display controls are performed such as displaying lyric text images in a color-changed manner as the music progresses.

  The sound processing unit 22 includes various sound sources such as an FM sound source and a PCM sound source, and performs various controls related to sound output by the karaoke apparatus 10. Preferably, a synthesizer that synthesizes sound by an electronic circuit and generates various timbres is provided. The synthesizer generates a music signal such as a musical instrument performance signal based on performance information of a karaoke performance song read from the hard disk 18 and sent. The synthesizer preferably includes a MIDI (Musical Instrument Digital Interface) terminal, and the performance information is, for example, data in the MIDI format. The music signal generated by the synthesizer based on the MIDI data is mixed with the singing voice of the user (performer) input from the microphone 48 via the audio input terminal 46, and via the audio output terminal 50. Is supplied to the amplifier 52, amplified by the amplifier 52, and output from the speaker 54. That is, in the present embodiment, the microphone 48 corresponds to an input device (voice input device) that can be connected to the karaoke device 10.

  The operation panel 24 selects a song that the user of the karaoke apparatus 10 wants to sing, adjusts the pitch related to the performance output of the song, adjusts the volume balance between the performance and the song, The input device includes operation buttons (switches) or knobs for performing various adjustments such as volume and tone. The touch panel display 30 is a device that displays an image (video) and inputs an operation to the karaoke device 10 according to a user's operation. The touch panel display 30 displays a predetermined image (video). And a touch panel 34 that performs input by touching the touch panel display 30 with a user's finger, an unillustrated pen, or the like. The display control unit 26 is a video processing unit that controls drawing of a screen (video) displayed on the display device 32 based on information supplied from the CPU 12. The input control unit 28 is an input processing unit that supplies operation input information input from the touch panel 34 to the CPU 12 and the like. With the above configuration, the touch panel display 30 functions as a second video display device separately from the display 44, and the user of the karaoke device 10 selects a song that the user wants to sing, It functions as an input device for adjusting the pitch related to the performance output, adjusting the volume balance between the performance and the song, and performing various adjustments such as echo, volume and tone.

  The karaoke apparatus 10 is connected to a communication line 60 via the communication interface 36 and the network connection terminal 56. Similarly, the karaoke apparatus 10 is connected to other devices connected to the communication line 60. Communication of information is possible through the network. The communication line 60 is a wide area information communication network connected to the Internet such as a WWW (World Wide Web) constituted by, for example, a public telephone line, an ADSL line, or an optical fiber line. The karaoke device 10 is preferably connected to a server (host device) (not shown) via the communication line 60, and from the server, music data (karaoke data), background video information, inter-song information, etc. It accepts distribution of digital contents. That is, the karaoke apparatus 10 is preferably a communication karaoke apparatus that is connected to a predetermined communication line and transmits / receives various information to / from the server, but is not connected to such a communication line. The present invention is also suitably applied to devices and the like.

  The LAN interface 38 is a connector for connecting the karaoke device 10 to a local area network (LAN) 64 via a LAN connection terminal 62, and thus connected to the LAN 64, the karaoke device 10 is also capable of transmitting / receiving information to / from other devices such as the electronic sample device 68 connected to the LAN 64. Further, when a plurality of karaoke apparatuses are provided in a store or the like where the karaoke apparatus 10 is installed, information can be transmitted and received between karaoke apparatuses connected to the LAN 64 in the same manner. For example, the music selection input from the electronic sample device 68 received via the access point 66 connected to the LAN 64 is received and stored in the reserved music table provided in the RAM 16, or via the access point 66. Mutual information exchange is performed between the karaoke device 10 and the electronic quick sample device 68 via radio waves, such as transmitting predetermined information from the karaoke device 10 to the electronic quick sample device 68.

  The wireless communication unit 40 performs wireless communication between the karaoke device 10 and an input device such as the electronic quick sample device 68. For example, it functions as a remote control receiving unit that receives a remote control signal transmitted from an input device such as the electronic quick sample device 68. The association (sticking) process between the karaoke apparatus 10 and the electronic quick sample apparatus 68 is preferably performed via the wireless communication unit 40 by such a remote control signal (infrared signal). That is, the electronic sample device 68 has an individual serial number, and in the association process, for example, a signal including the serial number (for example, the last four digits) and a predetermined connection code is notified of the connection. The electronic quick sample device 68 is associated with the karaoke device 10 that is transmitted to the karaoke device 10 and receives the connection signal by the wireless communication unit 40. The electronic quick sample device 68 thus associated with the karaoke device 10 functions as an input device (remote control device) of the karaoke device 10, and a signal transmitted from the electronic quick sample device 68 is the CPU 12. , The user of the karaoke apparatus 10 selects a song that the user wants to sing, adjusts the pitch related to the performance output of the song, adjusts the volume balance between the performance and the song, and so on. Input for making various adjustments such as volume, tone, etc. is accepted. After the association process is performed, communication between the electronic sample device 68 and the karaoke apparatus 10 is performed by LAN communication via the LAN 64, the access point 66, and the like. Further, in the present embodiment, the following description will be given on the assumption that the input device such as the electronic quick sample device 68 subjected to the association process with the karaoke device 10 also constitutes a part of the karaoke device 10.

  The sound effector 74 is connected to an electric instrument (electronic musical instrument) 76 such as an electric guitar or a bass guitar (electric bass guitar) as an external device, and a signal input from the electric instrument 76 is passed through the audio input terminal 72. A musical instrument input device to be supplied to the voice processing unit 22. Preferably, an external musical instrument 76 is connected via a shield or the like, and a signal (instrument performance signal corresponding to a performance sound corresponding to the performance) input from the electrical instrument 76 is input to the audio input terminal 72. To the audio processing unit 22. That is, in this embodiment, the electric musical instrument 76 corresponds to an input device that can be connected to the karaoke apparatus 10. The signal from the sound effector 74 may be input directly to the amplifier 52. Preferably, a plurality of sound effects corresponding to the electric musical instrument 76 are stored in advance in the sound effector 74 and settable, and a signal input from the electric musical instrument 76 is preliminarily set. A plurality of set sound effects are reflected and supplied to the sound processing unit 22. It is also possible to receive an input signal from the electric musical instrument 76 during karaoke performance based on the MIDI data. In this aspect, the music signal generated by the synthesizer based on the MIDI data is mixed with the performance sound of the electric instrument 76 input from the sound effector 74 via the audio input terminal 72, and the audio The signal is supplied to the amplifier 52 via the output terminal 50, amplified by the amplifier 52, and output from the speaker 54.

  As shown in FIG. 2, the hard disk 18 is provided with various databases including a music database 78 and a sound effect database 80. The music database 78 stores a large number (for example, tens of thousands of songs) of music data (karaoke data) for the performance output (karaoke performance) of the music by the karaoke apparatus 10. The music data stored in the music database 78 corresponding to each music output in the karaoke apparatus 10 includes, for example, metadata, MIDI data as performance information, and telop data as lyrics information. This metadata includes, for example, information such as song number (music selection number), song name, singer name, registration date and time as identification information of each song data. The telop data is information for performing lyric character video display control of each song via the video processing unit 20. For example, each of the lyrics of a song (performance song) corresponding to the song data is divided into a plurality of pieces. The block data corresponding to the section is included. The MIDI data is information for performing performance output control of each piece of music via the audio processing unit 22, and includes a plurality of tracks (channels) respectively corresponding to a plurality of types of musical instruments. The output timing of the performance sound is defined.

  In the MIDI data, a header (header chunk) is defined, and a conductor track, track 1, track 2, track 3,..., Track n (for example, n = 16) as the plurality of tracks (track chunks). Is stipulated. The header stores information such as data length, format, number of tracks, and time unit. This time unit indicates the length of a quarter note and corresponds to the resolution of the MIDI data. The conductor track has a tempo of the MIDI data. In each of the tracks 1 to 16, the type of musical instrument (performance sound) related to the performance output and the musical score information for determining the pitch and the length of the performance sound to be output are determined corresponding to each track. For example, the type of musical instrument (performance sound) corresponding to each track is determined such that the track 2 is “piano”, the track 3 is “electric guitar”, the track 4 is “bass guitar”,. As the musical score information of the instrument, information such as output timing (delta time), pitch, and volume is determined for each track.

  The sound effect database 80 stores a plurality of types (for example, several tens of types) of sound effect data corresponding to sound effects that can be output by the karaoke apparatus 10. The sound effect data is, for example, an AVI (Audio-Video Interleaved) format file, a WAVE sound file, and the like. Each cheer (voice) of a person who excites karaoke, a predetermined instrument such as a tambourine or a cymbal, applause, and clapping , And sound files (sound data) for outputting sound effects (sound effects) such as animal calls, and are identified by identification numbers (sound effect IDs) unique to each sound effect as the content ID. The sound effect data stored in the sound effect database 80 is used for selectively outputting a plurality of types of sound effects when performing karaoke performance by the karaoke apparatus 10. A sound effect selected from a plurality of types of sound effects corresponding to each sound effect data stored in the sound effect database 80 is read out by an input operation by the input device provided in the karaoke device 10 such as the present device 68. Then, it is reproduced and output from the speaker 54. The sound effect database 90 is preferably provided in the hard disk 18, but may be provided in the RAM 16.

  FIG. 2 is a functional block diagram for explaining the main part of the control function provided in the CPU 12 of the karaoke apparatus 10. In other words, the CPU 12 is caused to function as each control unit shown in FIG. 2 by the program according to the embodiment of the present invention. The music performance control means 82 shown in FIG. 2 controls the performance (playback) of music by the karaoke apparatus 10. Specifically, in the karaoke performance based on the music data stored in the music database 78, the reserved music stored in the reserved music table in order from the upper reserved music in the reserved music table such as the RAM 16 (in order of input). The music data corresponding to the music selection number of the music is read from the music database 78 of the hard disk 18, and the output of the performance music is controlled based on the performance information included in the music data. For example, based on MIDI data as performance information, a synthesizer provided in the sound processing unit 22 outputs performance sounds (music information) of musical instruments corresponding to each track as score information in the MIDI data, and the amplifier The sound is output from the speaker 54 via 52 or the like. Based on the lyric information included in the music data, the output of the lyric text image related to the performance music is controlled. That is, a lyric character image is generated based on the lyric information, and the lyric character image is displayed on the display 44 via the image processing unit 20. Further, as the karaoke performance progresses, the lyric character image displayed on the display 44 is switched and displayed, and the lyric character image is sequentially color-changed and displayed based on the lyric color change information.

  The music performance control means 82 includes performance sound output control means 84. The performance sound output control means 84 basically outputs the performance sound based on output timing information predetermined for the music data. That is, in the karaoke performance control based on the music data by the music performance control means 82, the output timing (delta time) corresponding to each note with respect to the notes defined for each musical instrument in the MIDI data included in the music data. ), A performance sound corresponding to the pitch and volume of the note is output. In other words, in this embodiment, the output timing corresponding to the notes determined for each instrument (each track) in the MIDI data corresponds to the output timing information predetermined for the music data.

  The sound signal input determination means 86 determines whether or not a sound signal is input (received) from the input device connected to the karaoke apparatus 10. Preferably, a singing voice signal of a user (singer) who performs karaoke performance using the karaoke device 10 is input from the microphone 48 as a voice input device connected to the karaoke device 10, or the electric It is determined whether or not a musical instrument performance sound signal of a user (performer) who plays the electric musical instrument 76 using the karaoke apparatus 10 is input from the musical instrument 76. Specifically, the sound pressure of a sound signal input from the microphone 48 or the electric musical instrument 76 via the audio input terminals 46, 72, etc. is detected and corresponds to a sound pressure equal to or higher than a predetermined value. The determination is affirmed when a sound signal is input from the microphone 48 or the electric musical instrument 76. That is, the sound signal input determination unit 86 preferably determines whether or not a sound signal corresponding to a sound pressure equal to or higher than a predetermined value is input (received) from the microphone 48 or the electric musical instrument 76.

  Whether the performance sound output control means 84 has received a sound signal from an input device such as the microphone 48 or the electric musical instrument 76 connected to the karaoke device 10 in a voice input standby section which is a prescribed range in the music data. If it is determined that the sound signal has been received, the performance sound is output by controlling the output timing information. That is, when the determination by the sound signal input determination means 86 is affirmative in the voice input standby section in the music data to be played by the music performance control means 82, the output timing information is controlled to control the performance sound. Is output. In other words, in the voice input standby section, the performance sound is not output until a sound signal is received from an input device such as the microphone 48 or the electric musical instrument 76.

  The voice input standby section preferably starts at a time position where a prescribed flag is set in the music data, and ends when a sound signal is received from an input device such as the microphone 48 or the electric musical instrument 76. It is what. FIG. 3 is a diagram for explaining an example of control by the performance sound output control means 84 of the present embodiment. In this FIG. 3, the score information defined in the master track of the MIDI data corresponding to the predetermined music is illustrated, and the specified flag that determines the start point of the voice input standby section as the specified range in the music data is “ “A” indicates a prescribed tempo, which is output timing information predetermined for MIDI, and “B”. In the example illustrated in FIG. 3, a mode in which a performance sound is output in response to an input of a sound signal (singing voice) from the microphone 48 as an input device is illustrated.

  As shown in FIG. 3, in this embodiment, for example, a flag “A” that determines the start point of the voice input standby section is inserted into the master track of the MIDI data in the music data subject to tempo control. The performance sound output control means 84 outputs the performance sound corresponding to each note based on the prescribed output timing information defined in the MIDI data for the part where the prescribed flag “A” is not set. When playing the portion where the specified flag “A” is set, the performance sound output control means 84 changes the tempo of the current playback portion in the master tempo from the specified tempo “B” defined in the MIDI data to “0”. Will be forcibly changed. At the tempo “0”, since the corresponding note is not output, the performance sound output is substantially put on standby at the position where the flag “A” is set. With the reception (input) of a sound signal from an input device such as the microphone 48 as a trigger, the prescribed flag “A” is released and tempo control is released at the same time. That is, the tempo of the performance sound whose output has been waiting is returned from “0” to “B”, and the performance sound is output. Since the performance sound output timing is triggered by the input of a sound signal from the microphone 48 or the like, the performance sound and the input sound signal are output from the speaker 54 at the same timing. That is, in this embodiment, in the voice input standby section in which the time position where the specified flag “A” is set in the music data is the start position and the time point when the sound signal is received from the input device is the end position. In the MIDI data, the specified output timing information determined corresponding to the note included in the section is ignored, and the performance corresponding to the note is triggered by the reception of the sound signal from the input device such as the microphone 48. Sound is output.

  In addition to the above processing, preferably, the performance sound in the performance section where the specified flag “A” is set is turned off by a control change signal for controlling note-off. For example, it is conceivable that a note corresponding to the tempo “0” is not output, but the performance sound of the note immediately before the tempo “0” continues to sound. Therefore, when the specified flag “A” is detected, the tempo is set to “0” in a state where the performance sound of the immediately preceding note is erased by the control change signal in order to erase the performance sound of the immediately preceding note. Control to turn on.

  In the present embodiment, preferably, in each piece of music data (MIDI data) stored in the music database 78, the prescribed flag “A” is inserted in advance at a predetermined location. For example, in the creation stage of the music data, a user (song) such as a performance part that should be uttered one by one while taking a so-called action at the end of the performance of the music, a performance part corresponding to the beginning of a song in a cappella, etc. A performance portion that is expected to be performed at a unique timing is selected, and the specified flag “A” is inserted in advance in the music data so that the portion is set as the voice input standby section. The Depending on the music, the specified flag “A” may be inserted so that all performance parts from the start to the end of the performance are set as the voice input standby section. Preferably, the specified flag “A” may be inserted on the user (user) side who performs karaoke performance using the karaoke apparatus 10. That is, on the side of a user who performs a karaoke performance using the karaoke apparatus 10, a performance portion that he / she desires to perform at his / her own timing by an input operation using the electronic quick sample apparatus 68 or the like is described as the sound. The specified flag “A” may be inserted (set) so as to be an input standby section.

  In the present embodiment, preferably, the specified range is such that a sound signal is not received from an input device such as the microphone 48 or the electric musical instrument 76, and a specified time from a time position where the specified flag “A” is set. It will be terminated when elapses. That is, in the voice input standby section starting from the time position where the specified flag “A” is set, reception of a sound signal from the input device such as the microphone 48 or the electric musical instrument 76 is performed for a specified time (for example, 10 It is terminated when it has not been performed for about a second). In other words, even when a sound signal is not received from an input device such as the microphone 48 or the electric musical instrument 76, each voice input standby section has a time position where the specified flag “A” is set. It ends when the specified time has passed.

  In the karaoke performance based on the music data, the music performance control means 82 is preferably changed by the performance sound output control means 84 for the lyrics character video display control of the music in the voice input standby section. Display control is performed based on the output timing information. That is, since the tempo is “0” in the voice input standby section, the performance tune is not played back, and the display of the lyrics character video and the color change display control are also stopped accordingly.

  The effect output control means 88 outputs a specified effect including a sound effect when the karaoke apparatus 10 performs the karaoke performance. For example, in a karaoke performance based on the music data by the music performance control means 82, any one of a plurality of types of sound effect data stored in the sound effect database 80 is read, and the sound effect data is supported. The sound effect is reproduced and output from the speaker 54. Preferably, the sound effect data selected by the user by an input operation using the electronic quick sample device 68 or the like is read from the sound effect database 80, and the sound effect corresponding to the sound effect data is reproduced to reproduce the speaker. 54 to output. The effect output by the effect output control means 88 may be a video effect (video effect) such as a video of fireworks or a video of a spectator surrounding the stage. That is, such a video effect may be reproduced by the video processing unit 20 or the like and displayed on the display 44 by being synthesized on the background side of the lyrics character video of the music.

  The effect output control means 88 preferably determines whether or not a sound signal is received from an input device such as the microphone 48 or the electric musical instrument 76 in the voice input standby section which is a prescribed range in the music data. If it is determined that a sound signal has been received, the effect is output. That is, in the voice input standby section, the specified effect is output with the reception of a sound signal from an input device such as the microphone 48 or the electric musical instrument 76 as a trigger. FIG. 3 also shows the effect output control of this embodiment in the voice input standby section. As shown in FIG. 3, the effect output control means 88 preferably performs an operation for outputting a specified effect (cheering SE) via the electronic quick sample device 68 or the like in the voice input standby section. Even when the operation is performed, the specified effect is not output when the operation is performed, and the sound signal is received from the input device such as the microphone 48 (triggering the reception of the sound signal). ) Output the specified effect. For example, at the same time as the tempo of the performance sound whose output has been waiting is returned from “0” to “B”, n sound effect data (cheering SE data) stored in the RAM 16 or the like are the same. It is reproduced and output at timing “C”. The effect output control means 88 may output a specified effect corresponding to, for example, booing when no audio signal is received for a specified time or more in the audio input standby section.

  The performance evaluation control means 90 performs the performance corresponding to the music data based on the sound signal received from the input device such as the microphone 48 or the electric musical instrument 76 in accordance with the performance output of the music data by the music performance control means 82. To evaluate. The performance evaluation control of the present embodiment is also preferably applied to performance evaluation corresponding to a sound signal input from the electric musical instrument 76 as an input device. In the following description, the performance evaluation control is performed as the input device. The performance evaluation control related to the sound signal (singing voice signal) input from the microphone 48 will be described in detail.

  The performance evaluation control means 90 basically compares the singing voice data input from the microphone 48 etc. with the model singing data related to the music data at the time of performance output based on the music data. Evaluate the song corresponding to the song audio signal. For example, when outputting a musical composition by the musical performance control means 82, the pitch, volume, and tempo of the musical composition corresponding to the voice input from the microphone 48 in parallel with the output of the musical composition by the voice processing unit 22 are as follows. An evaluation is performed using at least one of them as an evaluation criterion. Specifically, when outputting a predetermined performance song, the pitch (pitch) and tempo of the performance song output via the audio processing unit 22 and the pitch and tempo of the singing voice signal input by the microphone 48 are output. The performance of such a performance is evaluated. As the model singing data, data based on musical score information corresponding to a guide melody, that is, main melody in target performance information is preferably used. As an aspect of the performance evaluation, for example, scoring may be performed numerically, such as how many points out of 100, or a simple one such as determining which of 20 grades is applicable. It may be.

  The performance evaluation control unit 90 preferably does not evaluate the timing of the sound signal received from the input device within a specified range in the music data. That is, in the performance evaluation in the voice input standby section, the input timing (reception timing) of the sound signal from the input device such as the microphone 48 is not the target of performance evaluation corresponding to the music data. For example, even when the input timing of the sound signal from the input device such as the microphone 48 is deviated from the tempo of the performance song output via the audio processing unit 22 (the tempo of the model song data), Negative evaluation (for example, deductions etc.) is not performed for the deviation. In other words, when the timing, pitch, and volume of the sound signal are basically subject to performance evaluation, the performance evaluation control means 90 inputs the microphone 48 and the like for performance evaluation in the voice input standby section. Only the pitch and volume of the sound signal from the device are evaluated. On the other hand, when no sound signal is input from the input device such as the microphone 48 in the voice input standby section and the voice input standby section is terminated after a lapse of a specified time, the voice input standby section is entered. You may perform negative evaluation with respect to not having input the sound signal.

  FIG. 4 is a flowchart for explaining a main part of an example of the music performance control of the present embodiment by the CPU 12 of the karaoke apparatus 10 and is repeatedly executed at a predetermined cycle.

  First, in step (hereinafter, step is omitted) SA1, whether or not the karaoke performance corresponding to the predetermined music data is started in the order of performance of the reserved music table stored in the RAM 16 or the like. To be judged. If the determination at SA1 is negative, the routine is terminated. If the determination at SA1 is affirmative, the music data relating to the start of performance is read from the music database 78 at SA2. . Next, in SA3, performance output of the music corresponding to the music data (MIDI data) read in SA2 is started. Next, in SA4, it is determined whether or not a processing flag, that is, a specified flag “A” that defines the start point of the specified range has been passed. When the determination of SA4 is affirmed, the processing after SA7 is executed, but when the determination of SA4 is negative, the prescribed output defined for the music data (MIDI data) is determined at SA5. The performance sound is output (reproduced) based on the timing information. Next, in SA6, it is determined whether or not the performance corresponding to the music data is terminated, for example, by performing music data related to the performance to the end. If the determination at SA6 is negative, the processing after SA4 is executed again. If the determination at SA6 is affirmative, the routine is terminated.

  In SA7, for example, the tempo at the current playback location in the master tempo is forcibly changed from the prescribed tempo “B” defined in the MIDI data to “0”. Next, in SA8, it is determined whether or not a sound signal has been received (input) from the input device such as the microphone 48 or the like. When the determination of SA8 is affirmed, the processing after SA12 is executed. However, when the determination of SA8 is negative, a predetermined time after passing the specified flag “A” in SA9. It is determined whether or not elapses. When the determination at SA9 is negative, the processing after SA8 is executed again. However, when the determination at SA9 is affirmative, the tempo of the performance sound whose output has been waited for at SA10 is “ From “0” to “B”, the performance sound is output. Next, in SA11, it is determined whether or not the prescribed flag “A” has been passed. When the determination of SA11 is affirmed, the process after SA7 is executed again. However, when the determination of SA11 is negative, the process after SA5 is executed.

  In SA12, the tempo of the performance sound whose output has been waiting is returned from “0” to “B”, and the performance sound is output. Next, at SA13, it is determined whether or not sound effect data waiting for output (cheering SE data) is stored in the RAM 16 or the like. When the determination at SA13 is negative, the processing after SA5 is executed, but when the determination at SA13 is affirmative, the sound effect data waiting for output stored in the RAM 16 or the like at SA14. Is read out and output (reproduced), and then the processing from SA5 is executed. In the above control, it is desirable that the processing of SA8 to SA14 is executed within a very short time (substantially simultaneously).

  FIG. 5 is a flowchart for explaining a main part of an example of the performance evaluation control of the present embodiment by the CPU 12 of the karaoke apparatus 10, and is repeatedly executed at a predetermined cycle. The control shown in FIG. 5 described below is executed in parallel with the control shown in FIG. 4, for example, when performance evaluation is performed in the music performance control shown in FIG. 4 (performance evaluation mode). is there.

  First, at SB1, it is determined whether or not it is the voice input standby section. That is, after it is determined that the specified flag “A” has been passed in SA4 or the like of the control shown in FIG. 4, the reception of the sound signal from the input device (or the elapse of the specified time) has not been determined. It is determined whether or not. If the determination of SB1 is negative, in SB4, based on the input timing, pitch (pitch), and volume of the sound signal received from the input device such as the microphone 48, the input sound After the performance evaluation of the karaoke performance corresponding to the signal (note) is performed, this routine is terminated. When the determination of SB1 is affirmed, a sound signal is input from the input device such as the microphone 48 in SB2. It is determined whether or not there has been received (input). When the determination at SB2 is negative, the processing after SB1 is executed again. When the determination at SB2 is affirmative, the sound signal received from the input device such as the microphone 48 at SB3. After performing the performance evaluation of the karaoke performance corresponding to the input sound signal (note) based on the pitch (pitch) and the volume, which are elements other than the above timing, this routine is terminated. That is, in the performance evaluation in SB3, the input timing of the sound signal received from the input device is not subject to evaluation.

  In the above control, SA1 to SA3, SA5, and SA6 are the operations of the music performance control means 82, SA5, SA10, and SA12 are the operations of the performance sound output control means 84, and SA8 and SB2 are the sound signal inputs. SA14 corresponds to the operation of the determination means 86, SA14 corresponds to the operation of the effect output control means 88, and SB3 and SB4 correspond to the operation of the performance evaluation control means 90, respectively.

  According to the present embodiment, performance sound output control means 84 (SA5, SA10, and SA12) for outputting the performance sound based on output timing information predetermined for the music data is provided, and the performance sound output control is provided. The means 84 determines whether or not a sound signal is received from the microphone 48 or the electric musical instrument 76 as an input device within a specified range in the music data, and when it is determined that the sound signal is received, the output Since the performance sound is output by controlling the timing information, the performance sound output that each user performs at a unique timing in a performance portion that should be uttered one by one while taking the so-called reason. Can be realized. That is, it is possible to provide a performance device that realizes output of performance sounds that are easy to perform according to the user.

  Since the performance device is the karaoke device 10 that can be connected to an input device such as the microphone 48 or the electric musical instrument 76, it is possible to provide the karaoke device 10 that realizes an output of a performance sound that is easy to perform according to the user. it can.

  The specified range has a time position where a specified flag “A” is set in the music data as a start position, and a time point when a sound signal is received from an input device such as the microphone 48 or the electric musical instrument 76 as an end position. Therefore, in the music data, a performance portion where each user can perform at a unique timing can be suitably determined in a practical manner.

  The specified range is terminated when a sound signal is not received from the input device such as the microphone 48 or the electric musical instrument 76 and the specified time has elapsed from the time position where the specified flag “A” is set. Therefore, when the input of the sound signal from the input device such as the microphone 48 or the electric musical instrument 76 is interrupted beyond a level that can be recognized as so-called, performance that each user can perform at a unique timing. By ending the part, a more suitable performance can be realized.

  A performance evaluation control means 90 for evaluating a performance corresponding to the music data based on a sound signal received from an input device such as the microphone 48 or the electric musical instrument 76 in accordance with the output of the performance sound by the performance sound output control means 84. (SB3 and SB4), and the performance evaluation control means 90 does not evaluate the timing of the sound signal received from the input device such as the microphone 48 or the electric musical instrument 76 within the specified range in the music data. Therefore, in the performance portion that should be uttered one by one while taking the so-called reason, even if the performance timing deviates from the output timing defined in the music data, the player's ability The performance evaluation that suits can be realized.

  An effect output control means 88 (SA14) for outputting a specified effect is provided, and the effect output control means 88 receives a sound signal from an input device such as the microphone 48 or the electric musical instrument 76 within a specified range in the music data. If it is determined whether or not a sound signal has been received, the effect is output. Therefore, the performance timing and the effect It can suppress suitably that the atmosphere of a field worsens by having shifted with output timing.

  According to this embodiment, a performance sound is output based on music data selected from a large number of music data, and a sound signal received from an input device such as the microphone 48 or the electric musical instrument 76 is output. A program for causing a CPU 12 as a control device of the karaoke apparatus 10 to function as performance sound output control means 84 for outputting the performance sound based on output timing information predetermined for the music data, wherein the performance sound output The control means 84 determines whether or not a sound signal has been received from an input device such as the microphone 48 or the electric musical instrument 76 within a specified range in the music data, and if it is determined that a sound signal has been received, Since this program is characterized by controlling the output timing information and outputting the performance sound, it is a so-called purpose. In playing portion or the like to be uttered by one sound can be realized an output of the performance sound by each user performs a play in its own timing. That is, it is possible to provide a program that realizes output of performance sounds that are easy to perform according to the user.

  The preferred embodiments of the present invention have been described in detail with reference to the drawings. However, the present invention is not limited to these embodiments, and may be implemented in other modes.

  For example, in the above-described embodiment, as an example of a performance device connected to an input device such as the microphone 48 or the electric musical instrument 76, performance output of music data selected from a large number of music data is performed, and the music Although the example in which the present invention is applied to the karaoke device 10 that displays the lyric character image of the image on the video display device has been described, the present invention is not limited to this, and may be applied to other types of performance devices. . For example, the present invention is preferably applied to a musical instrument performance training apparatus used exclusively for practicing band performance, a home game machine or a personal computer that executes a game such as a so-called sound game. The present invention is also suitably applied to a case where a mobile phone such as a so-called smartphone or a tablet terminal is used as a performance device.

  In the above-described embodiment, the example in which the present invention is applied to the karaoke apparatus 10 as a performance apparatus to which input devices such as the microphone 48 and the electric musical instrument 76 are connected via the audio input terminal has been described. It may be built in the performance device. For example, when the present invention is applied to a smartphone as a performance device, a guitar string or a piano keyboard is displayed on the touch panel display of the smartphone, and a musical instrument performance is performed according to a touch input operation on the touch panel display. It is conceivable that a signal is input. In such an aspect, the present invention is suitably applied to music performance control and performance evaluation control for outputting a performance sound corresponding to a sound signal related to the input in response to an input operation by the smartphone. Further, in the karaoke apparatus 10, a musical instrument performance signal is input in response to a touch input operation on the touch panel display by displaying a guitar string or a piano keyboard on the touch panel display of the electronic quick sample apparatus 68. Embodiments are possible. In such an embodiment, the present invention provides a performance sound corresponding to a sound signal input via the touch panel display of the electronic quick sample device 68 in parallel with the performance output of the music based on the music data by the karaoke device 10. It is suitably applied to music performance control to be output and evaluation control of the performance.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

  10: performance device (karaoke device), 12: CPU (control device), 48: microphone (input device), 76: electric musical instrument (input device), 84: performance sound output control means, 88: effect output control means, 90 : Performance evaluation control means

Claims (7)

A performance device that outputs a performance sound based on music data selected from a large number of music data and outputs a sound signal received from an input device,
A performance sound output control means for outputting the performance sound based on output timing information predetermined for the music data,
The performance sound output control means determines whether or not a sound signal is received from the input device within a specified range in the music data, and controls the output timing information when it is determined that the sound signal is received. Then, the performance device outputs the performance sound. The performance device according to claim 1, wherein the performance device is a karaoke device that can be connected to the input device. The specified range is a time position where a specified flag is set in the music data as a start position, and a time point when a sound signal is received from the input device as an end position. Performance device. The performance device according to claim 3, wherein the prescribed range is terminated when a prescribed time elapses from a time position where the prescribed flag is determined without receiving a sound signal from the input device. Performance evaluation control means for evaluating a performance corresponding to the music data based on a sound signal received from the input device in accordance with the output of the performance sound by the performance sound output control means,
The performance according to any one of claims 1 to 4, wherein the performance evaluation control means does not evaluate the timing of the sound signal received from the input device within a specified range in the music data. apparatus. Equipped with effect output control means to output the specified effect,
The effect output control means determines whether or not a sound signal is received from the input device within a specified range in the music data, and outputs the effect when it is determined that the sound signal is received. The performance device according to any one of claims 1 to 5. A performance device controller that outputs a performance sound based on music data selected from a large number of music data and outputs a sound signal received from an input device is output in advance for the music data. A program that functions as a performance sound output control means for outputting the performance sound based on timing information,
The performance sound output control means determines whether or not a sound signal is received from the input device within a specified range in the music data, and controls the output timing information when it is determined that the sound signal is received. And a program for outputting the performance sound.

Images