JP6057079B2 - Karaoke device and karaoke program - Google Patents

Description

  The present invention relates to a karaoke apparatus in which a user can enjoy singing along with a performance, and a karaoke program that can be executed by various information apparatuses. In particular, the present invention relates to a karaoke apparatus capable of playing a main melody part and a chorus part, and a karaoke program.

  2. Description of the Related Art Conventionally, karaoke apparatuses that enjoy singing along with the performance of music are known. In a so-called communication karaoke apparatus using a communication line, the amount of data is reduced by using music information configured in the MIDI standard used for electronic musical instruments. With the recent development and introduction of high-speed communication lines and the advancement of voice compression technology, not only such music information but also the distribution of so-called live music information that records actual performance has been realized. .

  Music composed of multiple members' singing, such as a cappella music, is gaining popularity. Each member is in charge of a chorus part with a different pitch, so that a chorus sound with a thick sound is formed. Even in karaoke equipment, such music is provided, but because karaoke is often singing alone, the main melody is the singing part of the singer, and the other chorus parts are the live sound etc. Sometimes played.

JP 2010-2331070 A

  When singing such music in a karaoke device, where the main melody should be sung, users who are unfamiliar with singing may be sung by other chorus parts and sing chorus parts other than the main melody. .

In order to solve the above-described problems, the karaoke apparatus according to the present invention employs the following configuration.
A karaoke apparatus comprising a performance unit and a control unit,
The performance unit enables performance based on music information including reference part information and a plurality of chorus part information,
The control unit causes the performance unit to play music information, and a pitch of singing voice information input from a microphone is close to a pitch of any chorus part information among a plurality of chorus parts . If it is determined , the performance processing is executed to reduce or mute the volume of the chorus part information determined to be close .

Furthermore, in the karaoke apparatus according to the present invention,
If the pitch of the singing voice information continues for a predetermined period and is close to the pitch of any one chorus part information, the performance processing determines that the chorus part information is close to the pitch of the chorus part information, Gradually reduce the volume of.

The karaoke program according to the present invention is
A karaoke program that can be executed by an information processing apparatus having a performance section,
The performance unit enables performance based on music information including reference part information and a plurality of chorus part information,
When the musical piece information is played by the performance unit and the pitch of the singing voice information input from the microphone is determined to be close to the pitch of any chorus part information among the chorus parts of a plurality of pitches Then, a performance process is executed to reduce or mute the volume of the chorus part information determined to be close .

  According to the karaoke apparatus and the karaoke program according to the present invention, in the karaoke apparatus capable of playing music information including the reference part information and the chorus part information, the singer is restrained from being sung by the chorus part. It is possible to enjoy the singing of the standard part that should be sung originally.

The figure explaining the structure of the karaoke system which concerns on embodiment of this invention. The figure which shows the data structure of the music information which concerns on the past and embodiment of this invention The flowchart which shows the music performance process which concerns on embodiment of this invention The flowchart which shows the song determination processing which concerns on embodiment of this invention The schematic diagram for demonstrating the song determination processing which concerns on embodiment of this invention The schematic diagram for demonstrating the song determination processing which concerns on embodiment of this invention The figure which shows the data structure of the music information which concerns on other embodiment of this invention.

  FIG. 1 is a diagram showing a configuration of a karaoke system according to an embodiment of the present invention. The karaoke system in this embodiment includes a karaoke device 2 (commander) and a remote control device 1. In the example shown in FIG. 1, the remote controller 1 a, the remote controller 1 b, and the two remote controllers 1 are used for one karaoke apparatus 2. Since these remote control devices 1a and 1b have the same configuration, the remote control device 1 will be described. The karaoke device 2 and the remote control device 1 are connected so as to form a network using the LAN 100 and the access point 110.

  The karaoke apparatus 2 installed in a store such as a karaoke box includes an acoustic control unit 25 as a performance unit for playing music. Moreover, the karaoke apparatus 2 is provided with the operation part 21 as an input part by the side of the karaoke apparatus 2 comprised with the switch etc. which receive the various input from a user. The karaoke apparatus 2 includes an operation processing unit 22 that interprets an input from the operation unit 21 and transmits it to the CPU 30. The karaoke apparatus 2 includes an HDD 32 (hard disk) as karaoke apparatus side storage means for storing various information. The karaoke apparatus 2 includes a LAN communication unit 24 as a karaoke apparatus side communication unit for connecting to the LAN 100 and joining the network.

  Further, the karaoke apparatus 2 includes video reproduction means for displaying lyrics video and background video on the monitor 41. This video playback means includes a video playback unit 29 for playing back video based on video information, a video RAM 28 for temporarily storing the video to be played back, video for superimposing lyrics telop on the played back video, adding video effects, etc. A control unit 31 is provided.

  Further, in this karaoke apparatus 2, various information can be displayed on the touch panel monitor 33 in addition to the monitor 41 connected to the outside. The touch panel monitor 33 is configured by superimposing a display unit 35 that displays video information input from the video control unit 31 and a touch panel 34 that outputs a touch input position to the operation processing unit 22. The touch panel monitor 33 functions as an input unit, like the operation unit of the karaoke device 2 or the touch panel monitor 11 of the remote control device 1. The user can perform various operations on the karaoke device 2, such as selecting music from the touch panel monitor 33 and causing the karaoke device 2 to make a reservation directly.

  Furthermore, the karaoke apparatus 2 includes a CPU 30 for controlling each component in an integrated manner and a memory 27 for temporarily storing information necessary for executing various programs.

  With such a configuration, the karaoke apparatus 2 performs various processes, but as a main function of the karaoke apparatus 2, a music designation process, a music reproduction process, and the like can be performed. The music designation process is a process for designating and reserving music based on designation from the user, and is executed in cooperation with the remote control device 1. The reservation information designated by the input unit such as the remote control device 1 is registered in the reservation table in the memory 27 by a user operation. The music reproduction process is a process of reproducing a reserved music, and the music performance process and the lyrics reproduction process are executed in synchronization.

  The music performance process is a process for causing the acoustic control 25 to perform a performance based on the performance information included in the music information. The music played by the acoustic control unit 25 is emitted from the speaker 42 together with the singing voice input from the singing microphones 44a and 44b. The lyric reproduction process is a process of performing singing assistance by displaying the lyric information included in the music information on the monitor 41. A background video display process for superimposing a background video on the lyrics displayed in the lyrics reproduction process may be executed.

  On the other hand, the remote control device 1 transmits various instructions to the karaoke device 2 such as reservation information, and receives various information from the karaoke device 2 or the host device 5 connected on the Internet. In the present embodiment, an operation unit 17 such as a button and the touch panel monitor 11 are provided as user interfaces. The touch panel monitor 11 includes a display unit 11a and a touch panel 11b, displays various interfaces on the display unit 11a, and can accept a touch input from a user.

  Furthermore, the remote control device 1 controls the memory 14 as a remote control side storage unit that stores a database, various programs required for music search, and various types of information generated in accordance with the execution of the program, and controls these components. The remote control side control part for performing is comprised. The remote control side control unit interprets inputs from the CPU 15, the video control unit 13 that forms video to be displayed on the touch panel monitor 11, the video RAM 12 that temporarily stores video information to be displayed, the touch panel monitor 11, or the operation unit 17. Thus, an operation processing unit 18 for transmitting to the CPU 15 is included.

Further, the remote control device 1 is connected to a network constituted by the LAN 100 by being wirelessly connected to the access point 110 by the wireless LAN communication unit 16. Each remote control device 1 is associated with a specific karaoke device 2 in advance. Various commands output from the remote control device 1 are received by the associated karaoke device 2.

  With such a configuration of the remote control device 1, various inputs from the user are received from the touch panel monitor 11 or the operation unit 17, and video information is provided to the karaoke device 2 by displaying various information on the touch panel monitor 11. On the other hand, it is possible to give various instructions such as music reservation.

  FIG. 2 shows a data structure of music information according to the conventional and the embodiments of the present invention. FIG. 2A shows a data structure of music information that has been used conventionally, and FIG. 2B shows a data structure of music information according to the embodiment of the present invention. Both are data structures for chorus music having a chorus part. The music information includes information on lyrics and background video in addition to the information shown in the figure, but information on these videos is omitted here.

  As shown in FIG. 2A, the music information of the chorus music includes header information as metadata related to the music and actual information. The header information includes various pieces of information necessary for searching and specifying music information such as music identification information, music title, singer name, songwriter, composer, and the like. The actual data includes performance information and pitch information. The music information described here is information (also referred to as “live sound”) recorded from the actual performance, and it is possible to perform a more realistic performance than the music information formed by the instrument control information such as the MIDI standard. Information.

  The performance information includes accompaniment part information, reference part information, and chorus part information. Accompaniment part information is performance information that forms accompaniment sounds in karaoke. The reference part information is performance information corresponding to the part (main melody etc.) that the singer should sing, and when using the raw sound, it is possible to use the recording of the artist's singing voice as the reference part information. It is. The reference part information is performance information used in a so-called auxiliary mode, and it is possible to specify whether or not the performance can be performed by the user's selection. In the example of a cappella music, the chorus part is a part where members other than singing the reference part are sung, and the recording of the singing voice by the artist can be used as in the case of the reference part.

  In the form using such music information, the normal mode and the auxiliary mode can be selected. In the normal mode, the accompaniment part information and the chorus part information are played in the sound control unit 25, and the reference part information is not played. As described above, in the normal mode, it is possible to enjoy a performance close to an actual musical piece by performing the reference part by the user's own singing. On the other hand, in the auxiliary mode, the accompaniment part information, chorus part information, and reference part information are all played in the sound control unit 25. In the auxiliary mode, it is possible to assist the user's singing by playing the reference part. The performance volume of the reference part information may be set smaller than the performance volume of other part information, or the volume may be adjustable.

In conventional music information, actual information includes pitch information. This pitch information is information used when the karaoke apparatus 2 performs an evaluation process (scoring process). When the reference part information is composed of raw sound as in this embodiment, the pitch of the singing voice information input from the singing microphone 44 cannot be directly compared with the pitch of the reference part information configured as performance information. . Therefore, it is necessary to determine the pitch of the reference part by performing frequency analysis processing on the reference part information. Such a frequency analysis process leads to an increase in the load on the karaoke apparatus 2 and there is a possibility that the evaluation process cannot be executed quickly. For this reason, pitch information (reference part pitch information) corresponding to the reference part information of the performance information is included in the actual information. In the evaluation process, the pitch extracted from the singing voice information is compared with the pitch information, thereby reducing the load on the karaoke apparatus 2 and enabling a quick evaluation process.

  On the other hand, FIG. 2B shows a data structure of music information according to the embodiment of the present invention. The music information is configured to include header information and actual information as in the conventional music information described with reference to FIG. In addition, also about this music information, the information regarding a lyrics or a background image is abbreviate | omitted.

  The header information has a chorus flag in addition to the conventional music information. The chorus flag is information indicating that the music information is a chorus music. In the present embodiment, the chorus flag is used to determine that the music is a chorus music, and a specific process is performed when the chorus music is played. The actual information includes accompaniment part information, reference part information, and chorus part information, as in the case of conventional music information. However, when there are multiple pieces of chorus part information, the actual information includes performance information for each chorus part information. Are different. In the present embodiment, the chorus part information includes three parts including a reference part, and the chorus part information includes high-pitched chorus part information and low-pitched chorus part information.

  The conventional music information has pitch information (reference part pitch information) corresponding to the reference part information in order to execute the evaluation process, but the music information of the present embodiment has a song determination process to be described later. In order to execute, not only the reference part information but also pitch information (bass chorus part pitch information, treble chorus part pitch information) corresponding to bass chorus part information and treble chorus part information is provided. In the present embodiment, it is possible to determine which part the user is singing by comparing the singing voice information input from the singing microphone 44 with these pitch information.

  FIG. 3 is a flowchart showing music performance processing according to the embodiment of the present invention. When a music piece is designated using an input unit such as the remote control device 1 or the touch panel monitor 33 of the karaoke device 2, the music identification information of the designated music piece is registered in the reservation table. In the music performance process executed by the karaoke device 2, the reservation table is checked (S101) to determine the music to be played next. Next, when there is a song to be played (S102: Yes), whether or not the song is a chorus song is determined based on the chorus flag of the song information (S103). When it is not a chorus music, that is, when it is normal music information, the music control unit 25 starts playing the music information corresponding to the designated music (S107), and after the performance ends (S108: Yes), A reservation table check for performance (S101) is executed.

  On the other hand, when it is a chorus music (S103: Yes), the performance of the music information corresponding to the designated music is started (S104). In the case of FIG. 2B, accompaniment part information, treble chorus part information, and bass chorus part information in the performance information are played by the acoustic control unit 25. When the auxiliary mode is designated, the reference part information corresponding to the part to be sung may be played. In this embodiment, when reproducing a chorus music, a singing determination process (S200) that suppresses a singer from being sung by a chorus part can be executed. This singing determination process may be treated as an option that allows the user to select whether or not to execute the singing determination process. Prior to the start of the song determination process (S200), initialization of parameters used in the song determination process (l, m, n → 0) is performed (S105).

  FIG. 4 is a flowchart showing a song determination process according to the embodiment of the present invention. The singing determination process is a process of determining which part the singer is singing in the chorus music, and when it is determined that the chorus part other than the reference part to be sung is singing, the chorus part This is a process of reducing the volume of information or muting it. By performing such singing determination processing, it is possible to suppress singing by being choked by other chorus parts, and to assist the singing of the reference part that should be originally sung.

  In the present embodiment, the singing determination process for the music information described with reference to FIG. The music information in FIG. 2B is music having three pieces of singing part information: reference part information sung by a singer, treble chorus part information, and bass chorus part information. The number of chorus parts in the music information is not limited to two such as low tone, high tone, and may be singular or three or more.

  In the singing determination process, first, the pitch is acquired by performing frequency analysis on the singing voice information input from the singing microphone 44 (microphone) (S201). The pitch of the acquired singing voice information is compared with each pitch information (reference part pitch information, treble chorus part pitch information, bass chorus part pitch information) in the music information, and a pitch difference for each part is extracted (S202). ). In S203, the part with the smallest pitch difference is determined, and 1 is added to the parameter corresponding to the determined part (l for the reference part, m for the high-pitched chorus part, n for the low-pitched chorus part). (S206, S204, S208) The parameters of parts other than the part with the smallest pitch difference are initialized (S207, S205, S209).

  In the present embodiment, when the parameters (l, m, n) set for each part are equal to or greater than a threshold (here, 3), it is determined that the part that exceeds the threshold is being sung. That is, when the pitch of the singing voice information continues for a predetermined period and is close to the pitch of a certain part, it is determined that the song is singing close to the part.

  The schematic diagram for demonstrating the song determination process which concerns on embodiment of this invention is shown by FIG. 5, FIG. FIG. 5 shows the relationship between pitch and time for singing voice information (thick solid line), reference part (thin solid line), treble chorus part (dashed line), and bass chorus part (dashed line). Since the pitch of the music changes as the performance progresses, the pitch of each part changes in each section ae in the time axis direction. In the present embodiment, the high-pitched chorus part pitch information and the low-pitched chorus part pitch information are assumed to have a constant pitch difference with respect to the reference part pitch information, but the pitch difference of each chorus part is synchronized with the performance time. It may change.

  In normal evaluation processing (scoring processing), the evaluation (score) is determined by determining whether or not the pitch of the singing voice information is more than a threshold with respect to the reference part pitch information. In the form, the pitch of the singing voice information is close to any part by comparing the pitch of the singing voice information with the pitch of each part (reference part pitch information, treble chorus part pitch information, bass chorus part pitch information). It is different in the point of judging whether it is doing.

That is, in FIG. 5, A is the pitch difference between the pitch of the singing voice information and the high pitch chorus part pitch information, B is the pitch difference between the pitch of the singing voice information and the reference part pitch information, and C is the pitch of the singing voice information. And the pitch difference between the bass chorus part pitch information. In S230 of FIG. 4, the smallest pitch among the pitch differences of A, B, and C is detected. Moreover, it is supposed that the part in which the singer is singing will be determined on the condition that the same detection continued a predetermined number of times (three times in this embodiment). In the case of FIG. 5, the interval difference B is the smallest in the sections a and b, but the interval difference A is the smallest in the sections c to e. It is determined that they are singing in close proximity.

  FIG. 6 is a schematic diagram for explaining the singing determination process, and shows a standardized pitch based on the reference part pitch information. That is, as in FIG. 5, the horizontal axis is the time axis, but the vertical axis is a pitch difference. Further, similarly to FIG. 5, the singing voice information (thick solid line), the reference part (thin solid line), the high-pitched chorus part (broken line), and the low-pitched chorus part (dashed line) are shown.

  FIG. 6A shows a time transition of the pitch difference that the singer sings along the reference part. FIG. 6B shows a state in which singing is performed along the reference part, although it is slightly deviated from the reference part. FIG. 6C shows a state in which the pitch is shifted from the reference part to the high-pitched chorus part with the high-pitched chorus part. In the singing determination process of this embodiment, the pitch of the singing voice information is compared with each part (reference part pitch information, treble chorus part pitch information, bass chorus part pitch information), and the pitch of the singing voice information is a certain part. 6B, the singing form shown in FIG. 6C, that is, the singing performed by the chorus part, on the condition that the difference between the pitch and the minimum pitch is continued for a certain period. Can be determined.

  Returning to the flowchart of the singing determination process of FIG. 4, processing (S212 to S214) is performed to assist the singing according to the determination of the part that is singing because the minimum pitch difference continues for a predetermined period. Specifically, when it is determined that a chorus part other than the reference part is sung, the volume of the chorus part information being played is reduced (or silenced). In the present embodiment, the high-pitched chorus part information and the low-pitched chorus part information are separated in the performance information, so that the volume can be adjusted for each chorus part information.

  When the parameter m continues three times or more (S210: Yes), it is estimated that the singer is singing with the high-pitched chorus part, so the volume of the high-pitched chorus part information is included in the performance information being played. Is reduced (S211). On the other hand, when the parameter n continues three times or more (S212: Yes), it is estimated that the singer is singing along with the bass chorus part, so the volume of the bass chorus part information is reduced during the performance information. (S213). And when parameter l continues 3 times or more (S214: Yes), since it is estimated that the singer is singing along the reference part, the volume of either chorus part is reduced In step S215, the volume of the chorus part information is restored. Note that when changing the volume of the chorus part information, it is preferable to gradually change the chorus part information along with the passage of time in order to suppress a sense of discomfort in the sense of hearing.

  By continuously executing such a singing determination process, when the singer is sung by a chorus part, the volume of the chorus part information is reduced (or muted), so that the standard should be sung It becomes easy to sing a part. When reducing the volume of each chorus part (S211 and S213), in order to make it easier for the singer to sing the reference part, the performance information corresponding to the reference part information is played or already played. The volume may be increased. It becomes possible to encourage a singer singing along with another chorus part to sing along the reference part.

As described above, according to the karaoke apparatus employing the singing determination process of the present embodiment, in the chorus music in which the chorus part is played, the chorus part is restrained from being sung by the chorus part, and is compliant with the reference part that should be originally sung Can be sung. In the present embodiment, the music performance process executed by the karaoke apparatus 2 has been described. However, as a karaoke program for various information processing apparatuses such as a personal computer, a portable information terminal such as a smartphone, and a game apparatus. By providing (installing), various information processing apparatuses may be allowed to execute music performance processing including singing determination processing.

  The music information of FIG. 2 (B) used in the above-described embodiment is divided into high-pitched chorus part information and low-pitched chorus part information in the performance information. As described in the song determination process of FIG. The volume can be reduced (or silenced) for each piece of information. In the music information, instead of such a form, there is a form in which a plurality of chorus parts are mixedly recorded in the performance information. FIG. 7 shows a data structure of music information according to another embodiment of the present invention. The music information shown in FIG. 7 is recorded as performance information (high tone + bass chorus part information) including both a high tone chorus part and a low tone chorus part. In such a case, it is difficult to reduce (or mute) the volume for each of the high-pitched chorus part and the low-pitched chorus part, so the volume of the high-pitched / low-pitched chorus part information is adjusted. For example, when it is determined that a high tone chorus part is sung, the volume of the high tone + low tone chorus part is reduced (or silenced). In this case, the volume of the low-pitched chorus part is also reduced at the same time. However, by reducing the volume of the high-pitched chorus part, it is possible to correct the singing performed on the part.

  Note that the present invention is not limited to these embodiments, and embodiments configured by appropriately combining the configurations of the respective embodiments also fall within the scope of the present invention.

DESCRIPTION OF SYMBOLS 1a, 1b ... Remote control device, 11 ... Touch panel monitor, 11a ... Display part, 11b ... Touch panel, 12 ... Video RAM, 13 ... Video control part, 14 ... Memory, 15 ... CPU, 16 ... Wireless LAN communication part, 17 ... Operation , 18 ... operation processing unit, 19 ... infrared communication unit, 2 ... karaoke device (commander), 21 ... operation unit, 22 ... operation processing unit, 23 ... infrared communication unit, 24 ... LAN communication unit, 25 ... acoustic control unit 27 ... Memory, 28 ... Video RAM, 29 ... Video playback unit, 30 ... CPU, 31 ... Video control unit, 32 ... HDD (hard disk), 41 ... Monitor, 42 ... Speaker, 44a, 44b ... Singing microphone (microphone) ), 100 ... LAN, 110 ... access point, 120 ... router, 5 ... host device

Claims (3)

A karaoke apparatus comprising a performance unit and a control unit,
The performance unit enables performance based on music information including reference part information and a plurality of chorus part information,
The control unit causes the performance unit to play music information, and a pitch of singing voice information input from a microphone is close to a pitch of any chorus part information among a plurality of chorus parts . A karaoke device that performs performance processing to reduce or mute the volume of the chorus part information determined to be close when it is determined to be close . If the pitch of the singing voice information continues for a predetermined period and is close to the pitch of any one chorus part information, the performance processing determines that the chorus part information is close to the pitch of the chorus part information, The karaoke apparatus according to claim 1, wherein the volume of the karaoke is gradually reduced . A karaoke program that can be executed by an information processing apparatus having a performance section,
The performance unit enables performance based on music information including reference part information and a plurality of chorus part information,
When the musical piece information is played by the performance unit and the pitch of the singing voice information input from the microphone is determined to be close to the pitch of any chorus part information among the chorus parts of a plurality of pitches A program for karaoke that performs performance processing to reduce or mute the volume of chorus part information determined to be close .

Images