JP6184308B2 - Karaoke equipment - Google Patents

Description

  The present invention relates to a karaoke apparatus that can perform musical instrument performance together with karaoke singing.

  In recent years, karaoke devices with various functions have been introduced as electronic devices, etc. have become cheaper and higher in performance. Newly entertaining, improving service and improving user satisfaction. Is desired.

  Conventionally, as a karaoke apparatus to which various functions are added, not only singing along with the performance of karaoke music in a karaoke room, but also a way of enjoying playing an instrument such as an electric guitar has been widespread. For example, as described in Patent Literature 1, a chord score indicating a chord of a guitar played in accordance with a karaoke piece and a lyrics telop corresponding to the chord are displayed to support the guitar performance. . Such a guitar performance can be performed by a singer or a user other than a singer performing a backing performance in a singing section or a solo performance in a non-singing section (interlude part) or ending. is there.

  As another added function, as described in Patent Document 2, for example, as a technique for detecting the rising timing of a plurality of users (viewers) other than a singer, the viewer is imaged and a face is captured. Is determined by detecting the direction of the sound (facing the singer). On the other hand, from the viewpoint of the technology for determining the rising timing, it is also conceivable to install the microphone facing the viewer (so-called Gaya microphone), and to determine the rising level based on the audio signal collected by the microphone.

  Furthermore, as another added function, as a technique to change the performance time of karaoke music according to various factors, the performance time of the whole music is greatly reduced from a small change of changing the tempo according to the singer's preference. For example, as described in Patent Document 3, the remaining usage time of the karaoke room is compared with the scheduled performance time of reserved music, and the user sings all songs. The performance time of each piece of music is appropriately shortened so that the user can leave. On the other hand, a technique for extending a performance time by repeatedly reproducing a predetermined section of music is also known.

JP 2013-156542 A JP 2012-027340 A Japanese Patent Laid-Open No. 09-062822

  By the way, to increase the interest in the karaoke room using the above technique, the performance time of karaoke music is extended as a bonus based on the grading of singing and performance, and conversely, it is shortened as a penalty However, if you extend the time by repeatedly playing a predetermined section of the singing section, you can only sing the same lyrics repeatedly, and even if you extend the non-singing section, it can not be a bonus for the singer Not suitable for

  On the other hand, in the non-singing section, it is possible to evaluate the solo performance of the guitar by the user and extend the bonus, but even if the performance is evaluated, the solo performance of the guitar is basically an ad lib performance, It should be said that it is extremely difficult to properly evaluate based on reference data.

  Therefore, the present invention has been made in view of the above problems, and during the playback of karaoke music, evaluation of musical instrument performance is performed as a viewer without using reference data, thereby improving entertainment and improving user satisfaction. An object is to provide a karaoke device.

  In order to solve the above-mentioned problems, in the invention of claim 1, a karaoke performance sound is generated from karaoke performance data of karaoke music, a voice signal by a singer's singing and a musical sound signal by a player's musical instrument performance are input, A karaoke apparatus that emits a sound together with a performance sound, wherein a determination means for determining a degree of excitement of a viewer who is a user other than the singer and the player during music reproduction, and a predetermined section of the karaoke performance data are repeated. An extension means for reproducing, and a detecting means for detecting whether or not a musical sound signal is input by the musical instrument performance, and the input of the musical sound signal is detected by the detecting means in a predetermined section during the music reproduction, and When the determination means determines that the audience excitement is greater than or equal to a predetermined value, the extension means repeatedly reproduces the predetermined section. And it formed.

  According to a second aspect of the present invention, the karaoke performance data includes lyric data, and the predetermined section of repeated reproduction by the extension means is a non-singing section specified based on the lyric data.

  According to a third aspect of the present invention, there is provided an informing means for informing that the singing section being reproduced is repeatedly reproduced by the extension means.

  According to a fourth aspect of the present invention, there is provided an imaging unit that images the viewer side, and the determination unit is configured based on the imaging data from the imaging unit, based on the motion elements of each viewer in the imaging data. It is the structure which determines.

  The invention of claim 5 comprises sound collecting means directed to the viewer side, and the determining means is based on the sound signal from the sound collecting means, based on sound data of a predetermined frequency band in the sound signal. In this configuration, the degree of swell is determined.

  According to the present invention, during the music reproduction, the determination means indicates the degree of excitement of the viewer who is a user other than the singer and the player, for example, the operating element of each viewer in the imaging data obtained by imaging the viewer side or It is determined based on audio data of a predetermined frequency band in the audio signal collected by the viewer side, and the input of a music signal from a karaoke player is detected in a predetermined section during music playback, for example, a non-singing section In addition, when the determination means determines that the audience excitement is equal to or higher than a predetermined value, the extension means repeatedly reproduces the predetermined section, and appropriately repeats the replay so that the karaoke can be appropriately notified. Since the performance of the musical instrument is evaluated as a viewer while playing the music, it is possible to evaluate the performance according to the reaction of the viewer without using the reference data. Further boost the viewer prolonging Kanade section, improve motivation of the player, increase the entertainment brings the atmosphere of a live performance, but can be improved and thus the user satisfaction.

It is a block block diagram of the karaoke apparatus which concerns on this invention. It is explanatory drawing of the music selection by the remote input / output terminal of FIG. It is a flowchart of the section extension in the karaoke apparatus of this invention. It is explanatory drawing of the extension determination of FIG. It is explanatory drawing of the area extension and alerting | reporting of FIG. It is explanatory drawing of the other example in the area extension of the karaoke apparatus which concerns on this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram of a karaoke apparatus according to the present invention. In FIG. 1, a karaoke apparatus 11 is connected to a karaoke main body 12 as a main apparatus by wire or wirelessly, and includes a display unit 13, a mixing amplifier 14, a microphone 15, a speaker 16, a remote input / output terminal 17, a musical instrument. An amplifier 18 and an imaging unit 19 that is an imaging unit are connected.

  The display unit 13 displays a normal music selection display, a background image during karaoke performance, and the like. For example, a liquid crystal display (LCD), a plasma display (PDP), and other various displays can be employed. The mixing amplifier 14 mixes the audio signal from the microphone 15 with the music performance signal sent from the karaoke main body 12, and mixes and amplifies the musical sound signal sent from the instrument amplifier 18 to the speaker. 16 is output.

  The remote input / output terminal 17 transmits / receives data to / from the karaoke main body 12 using a wired system or a wireless system (such as an IR system or a Bluetooth (registered trademark) mechanism piconet connection system) by a terminal transmission / reception unit (not shown). Therefore, at least a music selection music registration means 17A is provided as appropriate. This music selection music registration means 17A is a program including a table for searching for music and selecting music, and the music selection is registered in a reservation queue (41) in the karaoke main body 12 to be described later. The music selection screen will be described with reference to FIG.

  The musical instrument amplifier 18 includes an input terminal for connecting various musical instruments, and outputs the musical tone signal of the input musical instrument to the mixing amplifier 14 and also outputs it to the detection means (29) of the karaoke main body 12 described later. Examples of musical instruments include electronic musical instruments such as electric guitars and keyboards, and in this embodiment, description will be made on electric guitars. The imaging unit 19 is a video camera or the like directed to a viewer side other than a singer and a player in the karaoke room, and the imaging data is output to an image recognition means (30) of the karaoke main body described later.

  The karaoke main body 12 includes a bus 20, a central control unit 21, a ROM 22, a RAM 23, a video display control unit 24, a music performance control unit 25, a sound source (synthesizer) 26, a transmission / reception unit 27, a determination unit 28, a detection unit 29, and image recognition. A means 30, an extension means 32, a storage unit 33, and a notification means 34 are provided as appropriate. The image recognition unit 30 includes an operation tempo specifying unit 31. A storage area for a reservation queue 41 is formed in the RAM 23, and a music DB 42 and a video DB 43 are stored in the storage unit 33. In addition, about each said structure, even if it is an element part which is not directly related to the summary of this invention, in order to show that most can be applied also in the conventional karaoke system, the whole component is demonstrated.

  The central control unit 21 is a physical CPU that performs overall processing control of the system, and performs algorithm processing based on a program stored in the ROM 22. The RAM 23 serves as a work area for developing and executing the various programs in addition to forming a storage area for the reservation queue 41. The RAM 23 is composed of, for example, a semiconductor memory and is virtually a hard disk. It is a concept including the case where it is built on.

  The video display control means 24 is a program or an electronic circuit that outputs the background video extracted from the video DB 43 and the lyrics data of the music extracted from the music DB 42 to the display unit 13 during performance. The music performance control unit 25 includes, for example, a sequence program, and drives a sound source (synthesizer) 26 in accordance with the note data extracted from the music DB 42 by a music code. The output of the sound source 26 is sent to the mixing amplifier 14 as a performance signal. Is output. In this case, if there is a musical instrument used for music performance, the musical note data of the track corresponding to the musical instrument is not reproduced. Alternatively, playback may be performed with the volume level of the track being lower than when no musical instrument is present. The transmission / reception unit 27 is used to exchange data with the remote input / output terminal 17 using a wired system or a wireless system (such as an IR system or a Bluetooth (registered trademark) mechanism piconet connection system). Electronic circuit and program.

  The determination means 28, which will be described in detail with reference to FIGS. 3 and 4, is a program for determining the degree of excitement of a viewer who is a user other than a singer and a player during music reproduction. The detecting means 29 is an electronic circuit and a program that have an A / D conversion function and detect the presence or absence of a musical tone signal input from the musical instrument amplifier 18. The image recognition means 30 has an A / D conversion function and recognizes each of the viewers with the capture motion function based on the imaging data input from the imaging unit 19, and will be described with reference to FIG. 4 as an example. The electronic circuit and program are provided with the program of the operation tempo specification unit 31 and specify the operation tempo as an operation element of each viewer and provide it to the determination means 28.

  The extension means 32, which will be described in detail with reference to FIGS. 3 and 5, is a program that repeatedly reproduces a predetermined section of karaoke performance data, and sends a command signal for instructing the music performance control unit 25 to repeatedly reproduce. .

  The music DB 42 stored in the storage unit 33 stores note data, lyrics data, performance tempo data, and the like for each music. Regarding the performance, specifically, a track of various musical instruments of a karaoke song in a predetermined data format having a song table in which a song ID, a song name, and an artist ID (artist name) are associated and managed by the song ID for each song. This is a database in which song codes are stored as file names for song data (files) composed of note data (for example, note data in MIDI (registered trademark) format) for each. The video DB 43 stored in the storage unit 33 is a database in which music code is stored as a file name for background video data corresponding to each music.

  The informing means 34, which will be described later with reference to FIG. 5, informs that the currently playing section is repeatedly reproduced, and displays video based on a command signal from the extending means 32 to the music performance control unit 25. This is a program for sending a notification video to the control means 24.

  Here, FIG. 2 shows an explanatory diagram of music selection by the remote input / output terminal of FIG. FIG. 2 (A) shows a screen for music selection of the remote input / output terminal 17, which allows key setting and tempo setting in addition to the song name, etc. The presence / absence of performance is set, the instrument type at that time, for example, guitar is set, and the transfer button is operated, and the result is sent to the karaoke main body 12.

  In the karaoke main body 12, the transmission / reception unit 27 receives the music selection signal from the remote input / output terminal 17, and sequentially stores them in the reservation queue 41 of the RAM 23 as shown in FIG. In this case, if there is a musical instrument performance, the flag is set and a musical instrument code of the musical instrument type (guitar) is attached. Note that settings such as tempo settings are also attached to the reservation queue 41, but are not shown here.

  Therefore, FIG. 3 shows a flowchart of section extension in the karaoke apparatus of the present invention, FIG. 4 shows an explanatory view of extension determination of FIG. 3, and FIG. 5 shows an explanatory view of section extension and notification of FIG. Here, a case where a musical piece with musical instrument performance is reproduced will be described. Moreover, as a music composition, as shown in FIG. 5 (A) as an example, a prelude part (non-singing section), a singing section, an interlude part (non-singing section), a singing section, a follower part (non-singing section) and To do.

  In FIG. 3, first, the performance of the music is started for the second of the reservation queue 41 of FIG. 2B (step (S) 1). At this time, it is assumed that an electric guitar 51 is connected to the musical instrument amplifier 18 of FIG. When the performance enters the singing section from the prelude section, the image recognition means 30 recognizes images of the singer and viewers other than the performer based on the image data from the image capturing section 19 at a predetermined timing. Then, the operation tempo specifying unit 31 specifies an operation tempo as an operation element of each viewer (S2). For example, three viewers as shown in the singing section of FIG. 4 (A) are image-recognized, and the motion of one of them is identified and determined as motion tempo information as shown in FIG. 4 (B). Sent to means 28.

  When the singing section is finished (S3) and the interlude section is entered, as described above, the track corresponding to the guitar in the note data is reproduced, and only the track corresponding to the performance of other instruments is reproduced without performing sound emission. Sounds out. At this time, the guitar player starts playing the guitar, and is emitted from the speaker 16 through the mixing amplifier 14 together with other musical instruments. Further, the determination means 28 specifies that it is an interlude part based on the lyrics data.

  In the interlude section, the image recognition means 30 recognizes each of the viewers from the interlude section based on the image data from the image capturing unit 19 at a predetermined timing. Then, the operation tempo specifying unit 31 specifies an operation tempo as an operation element of each viewer (S4). For example, three viewers as shown in the interlude section of FIG. 4 (A) are image-recognized, and the action of the three persons is specified as action tempo information as shown in FIG. 4 (B). Are sent sequentially.

  In the determination means 28, as shown in FIG. 4B, the motion tempo information of each viewer in the singing section up to the interlude section is acquired from the image recognition means 30, and the musical tone signal of the guitar performance in the interlude section. Is detected by the detecting means 29, the motion tempo information of each viewer from the interlude section is sequentially acquired, and the performance tempo information is acquired from the music performance controller 25 (S5). Therefore, the determination means 28 specifies the number of viewers whose tempo matches from the motion tempo information and performance tempo information of each viewer up to the interlude section, and the motion tempo information and performance tempo information of each viewer from the interlude section. The number of viewers whose tempos are more matched is specified, and these are compared to determine the degree of excitement (S6).

  That is, when the motion tempo of one of the viewers in the singing section of FIG. 4A matches the performance tempo, one of the viewers is playing on the song during the singing. When the motion tempo of the three viewers in the interlude section of 4 (A) matches the performance tempo, the three viewers are excited about the musical instrument performance.

  Here, the degree of excitement in the determination process of the determination unit 28 is determined based on whether or not the number of people engaged in singing or performing is greater than or equal to a predetermined value. In this case, the predetermined value is increased by one or more people, or The difference may be that one person increases to three persons, and any setting person may set as appropriate.

  When the degree of climax by the determination unit 28 is equal to or greater than a predetermined value (S7), the determination unit 28 sends a command signal for instructing the extension of the interlude section to the extension unit 32, and at the same time, the notification unit 34 A command signal for instructing display of extension start is sent (S8).

  As shown in FIG. 5 (A), the extension means 32 instructs the music performance control unit 25 to extend the same interlude part following the current interlude part to perform (S9). The music performance control unit 25 controls and reproduces the sound source 26 except for the guitar performance track based on the note data corresponding to the interlude unit. In addition, the notification unit 34 causes the display unit 13 to display the image display control unit 24 with a notification content such as “I entered the first extension” as shown in FIG. 5B, for example (S9).

  Therefore, when the current interlude section is finished and the section of the interlude section is played again (S10), the processing of S4 to S8 is repeated. If the degree of excitement continues, as shown in FIG. Furthermore, the performance of the same interlude part is repeated and extended. Further, every time the number of times the performance of the same interlude part is repeated (the number of times of extension) increases, a predetermined value for determining the degree of excitement in the determination means 28 is further increased, that is, the determination is made stricter. Good. Or you may provide a restriction | limiting in the frequency | count of extension.

  On the other hand, when it is determined in the interlude section that the degree of excitement by the determination means 28 is not equal to or greater than the predetermined value (S7), the performance of the next singing section is started as soon as the interlude section ends without being extended, If there is a next interlude section (S11), the processing of S2 to S10 is repeated, and if it does not exist (S11), the extension process ends.

  Next, FIG. 6 shows an explanatory diagram of another example in the section extension of the karaoke apparatus according to the present invention. The block diagram shown in FIG. 6A is a sound collecting means as an element for determining the degree of excitement in the determining means 28, instead of the imaging unit 19 and the image recognizing means 30 (operation tempo specifying means 31) in FIG. The sound collecting microphone 61 is connected to the karaoke main body 12 in a wired or wireless manner, and the karaoke main body 12 is provided with a level detecting means 62.

  The sound collecting microphone 61 is a so-called Gaya microphone directed to the viewer other than the singer and the performer, and the collected sound signal is input to the level detecting means 63. The level detection means 63 extracts audio data of a predetermined frequency band from the input audio signal, for example, a frequency band corresponding to a hand beat (may be applause) and detects the sound pressure level (average sound pressure level). To do.

  As shown in FIG. 6 (B), the level detection means 63 A / D converts the average sound pressure level in the singing section during the music performance and sends it to the determination means 28, and the average sound pressure level in the interlude section. Are A / D converted and sent to the determination means 28. For example, in the singing section of FIG. 6 (B), one of the viewers enjoys riding on a song as being detected as the average sound pressure level of the clapping for one viewer. As shown in FIG. 6B, the average sound pressure level of the clap for the three viewers in the interlude section is detected, and the three viewers are excited about the musical instrument performance. Become.

  The degree of excitement in the determination process of the determination means 28 compares the average sound pressure level of the singing section with the average sound pressure level of the interlude section, and the comparison result is equal to or greater than a level difference value as a predetermined value set as appropriate. It is determined that the viewer is excited, and the extension means 32 is instructed to repeatedly reproduce the interlude section. In the case where the level detection means 63 performs digital processing, the A / D conversion unit 62 may be provided to perform level detection processing.

  In this way, performance evaluation according to the reaction of the viewer can be performed for the musical instrument performance without using the reference data, and the viewer is further excited by extending the performance section accordingly. It is possible to improve the motivation, enhance the amusement by creating an atmosphere of live performance, and improve the satisfaction of the user.

  By the way, although the said embodiment demonstrated the musical instrument performance in the interlude part (non-singing area) specified based on the said lyric data as the especially effective object, the predetermined area of the repetition reproduction | regeneration by the extension means 32 was demonstrated. Musical instruments may be played with the non-singing section of the part or the follower part as an extension target.

  The karaoke apparatus of the present invention can be used in the industrial field of karaoke apparatuses having basic karaoke functions.

DESCRIPTION OF SYMBOLS 11 Karaoke apparatus 12 Karaoke main body 13 Display part 17 Remote input / output terminal 18 Musical instrument amplifier 19 Imaging part 21 Central control part 25 Music performance control part 28 Judgment means 29 Detection means 30 Image recognition means 31 Operation tempo specification part 32 Extension means 61 Sound collection Microphone 63 Level detection means

Claims (5)

A karaoke device that generates karaoke performance sound from karaoke performance data of a karaoke song, inputs a sound signal from a singer's singing and a musical sound signal from a performer's instrument performance, and emits the sound together with the karaoke performance sound,
A determination means for determining a degree of excitement of a viewer who is a user other than the singer and the player during music reproduction,
Extending means for repeatedly reproducing a predetermined section of the karaoke performance data;
Detecting means for detecting the presence or absence of input of a musical sound signal by the musical instrument performance;
Have
The extension means when the input of the musical tone signal is detected by the detection means and the degree of excitement of the viewer is determined to be greater than or equal to a predetermined value by the detection means in the predetermined section during the music reproduction. The karaoke apparatus characterized in that the predetermined section is repeatedly reproduced. The karaoke apparatus according to claim 1,
The karaoke performance data includes lyric data,
A karaoke apparatus characterized in that a predetermined section of repeated reproduction by the extension means is a non-singing section specified based on the lyrics data.   3. The karaoke apparatus according to claim 1, further comprising an informing unit that informs that the singing section being reproduced is repeatedly reproduced by the extension unit. 4. It is a karaoke apparatus in any one of Claims 1-3,
Comprising imaging means for imaging the viewer side;
The karaoke apparatus characterized in that the determination means determines the degree of excitement from an operation element of each viewer in the imaging data based on imaging data from the imaging means. It is a karaoke apparatus in any one of Claims 1-3,
Sound collecting means directed to the viewer side;
The karaoke apparatus characterized in that the determination means determines the degree of excitement from sound data in a predetermined frequency band in the sound signal based on the sound signal from the sound collecting means.

Images