JP7281386B2 - karaoke device - Google Patents

Description

The present invention relates to a karaoke machine.

Along with the karaoke performance by the karaoke device, a background image is displayed on the display device along with the lyrics telop. Some of the background images feature an artist who sings a song that is performed in karaoke. Specifically, a promotional video (PV) image (so-called PV image) produced at the release of a song or a live image of a concert performed by an artist may be used as a background image.

By the way, at a concert performed by an artist, the audience sometimes cheers, shouts, or applauds to liven up the venue.

Japanese Patent Laid-Open No. 2002-200003 discloses a technique that allows users to enjoy the atmosphere of watching live performances at a live venue by performing output operations for effects such as cheering and applause.

JP-A-10-78783

Here, there are standard shouts made by the audience at concerts and the like for each artist (hereafter, the shouts made by the audience accompanying the singing of a certain artist are referred to as "calls"). For example, in the case of an idol group, there are calls such as calling out the names of the members in the A melody of a song, and calling out specific shouts (hi, hey, oh, etc.) for each rest.

On the other hand, the effects provided by the technology described in Patent Document 1 are common regardless of artists. Therefore, even if the technique of Patent Document 1 is used when a live video is played as a background video of a karaoke performance, the same effect as the standard call for each artist will not be issued, so it will not be a problem for fans of the artist. There were times when I felt inadequate.

SUMMARY OF THE INVENTION An object of the present invention is to provide a karaoke apparatus capable of outputting a call sound suitable for an artist appearing in the live video when the live video is played as a background video.

The main invention for achieving the above object is accompaniment data for performing karaoke performance of a song, background image data corresponding to the background image displayed on the display means according to the karaoke performance of the song, and singing the song. A first storage section for storing associated artist identification information for identifying an artist, and call voice data for generating a call voice corresponding to a call made by the audience accompanying the artist's singing at the artist's concert. , a second storage unit that stores call identification information for identifying the call voice data and artist identification information of the artist in association with each other; a karaoke performance based on the accompaniment data; and a background based on the background video data. A karaoke control unit that displays an image, a determination unit that determines whether or not a background image corresponding to a certain reserved song is a live image of a concert performed by an artist, and the background image is a live image. and the karaoke control unit starts karaoke performance of the certain song, the call identification information linked to the artist identification information of the artist who sings the certain song is sent from the second storage unit a transmission processing unit that reads out and transmits to a mobile terminal owned by a user of a karaoke device; and call voice data based on the call identification information when the call identification information is received from the mobile terminal during the karaoke performance of the musical piece. from the second storage unit to generate a call voice, and output from the sound emitting means.
Other features of the present invention will be clarified by the description of the specification and drawings described later.

According to the present invention, when a live video is played as a background video, it is possible to output a call sound suitable for an artist appearing in the live video.

1 is a diagram showing a karaoke system according to an embodiment; FIG. It is a figure which shows the hardware constitutions of the karaoke apparatus which concerns on embodiment. It is a figure which shows the software configuration of the karaoke apparatus which concerns on embodiment. It is a figure which shows the table which the 1st memory|storage part which concerns on embodiment memorize|stores. It is a figure which shows the table which the 2nd memory|storage part which concerns on embodiment memorize|stores. It is a figure which shows the call selection screen displayed on the display of the mobile terminal which concerns on embodiment. It is a flow chart which shows processing of a karaoke device concerning an embodiment.

A karaoke apparatus according to an embodiment will be described with reference to FIGS. 1 to 7. FIG.

==Karaoke System==
A karaoke system includes a karaoke device and a plurality of mobile terminals. As shown in FIG. 1, the karaoke system 1 in this embodiment includes a karaoke machine K and mobile terminals M1 to M3.

The karaoke device K is a device for performing karaoke and for users to sing karaoke.

A mobile terminal is a smartphone or the like owned by a user. In the example of FIG. 1, mobile terminals M1 to M3 are owned by users U1 to U3, respectively. Dedicated application software (hereinafter referred to as a "karaoke application") for performing various operation inputs to the karaoke apparatus K is installed in the portable terminal of the present embodiment. The karaoke application provides the user with various menus that can be used in the karaoke system 1, such as music search and karaoke performance volume adjustment. The karaoke application can be obtained by downloading from a server device (not shown) or a website provided by the server device.

When the user activates the karaoke application on the portable terminal, pairing with the karaoke apparatus K is performed. The paired karaoke machine K and the portable terminal are connected to each other so as to be communicable via, for example, a LAN in the store where the karaoke machine K is installed.

==Karaoke Device==
As shown in FIG. 2, the karaoke machine K includes a karaoke main body 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50. As shown in FIG.

The speaker 20 is configured to emit various sounds. The speaker 20 is an example of "sound emitting means". The display device 30 is configured to display video and images on the screen based on the signal from the karaoke main body 10 . The display device 30 is an example of "display means". The microphone 40 is configured to convert the user's singing voice into an analog signal and input it to the karaoke main body 10 . The remote control device 50 is a device for performing various operations on the karaoke main body 10 . The user can use the remote control device 50 to select a desired song for karaoke singing. Icons and the like for inputting instructions for various operations are displayed on the display screen of the remote control device 50 .

The karaoke main body 10 performs various controls related to karaoke singing, such as karaoke performance control of music, display control of lyrics and background images, and processing of signals input through the microphone 40 . As shown in FIG. 2 , the karaoke main body 10 includes a control section 11 , a communication section 12 , a storage section 13 , a sound processing section 14 , a display processing section 15 and an operation section 16 . Each configuration is connected to bus B via an interface (not shown).

The control unit 11 includes a CPU 11a and a memory 11b. The CPU 11a realizes various control functions by executing operation programs stored in the memory 11b. The memory 11b is a storage device that stores programs to be executed by the CPU 11a and temporarily stores various types of information during execution of the programs.

The communication unit 12 provides an interface for connecting the karaoke main body 10 to a communication line via a router (not shown). The storage unit 13 is a large-capacity storage device that stores various data, such as a hard disk drive.

Under the control of the control unit 11 , the sound processing unit 14 performs control related to karaoke performance of music and processes signals based on singing voices input through the microphone 40 . The display processing unit 15 performs processing related to various displays on the display device 30 and the remote control device 50 under the control of the control unit 11 . For example, the display processing unit 15 controls the display device 30 to display a background image during a karaoke performance of a song. The operation unit 16 includes a panel switch, a remote control receiving circuit, and the like, and transmits operation signals such as a music selection signal and a performance stop signal to the control unit 11 according to the operation of the panel switch of the karaoke apparatus 1 or the remote control device 50 by the user. Output. The control unit 11 detects an operation signal from the operation unit 16 and executes corresponding processing.

As shown in FIG. 3, in this embodiment, the karaoke main body 10 includes a first storage unit 100, a second storage unit 200, a karaoke control unit 300, a determination unit 400, a transmission processing unit 500, and a generation unit 600. Prepare. The first storage section 100 and the second storage section 200 are part of the storage area of the storage section 13 . The karaoke control unit 300, the determination unit 400, the transmission processing unit 500, and the generation unit 600 are implemented by the CPU 11a executing a program stored in the memory 11b.

[First storage unit]
The first storage unit 100 stores accompaniment data, background video data, and artist identification information in association with each other.

The accompaniment data is data for karaoke performance of the music. The background image data is data corresponding to the background image. The background image is a moving image or a plurality of still images displayed on the display device 30 in time with the karaoke performance of the music. The artist identification information is unique information for identifying the artist who sings the song, such as an artist ID.

FIG. 4 shows a table stored in the first storage unit 100. As shown in FIG. Each song is associated with a song ID, which is unique information set for each song. For example, the artist ID "ID***A01" of artist A01 includes accompaniment data "AC***01" and background video data "BG***01" of song S01 (song ID "ID***S01"). ”, accompaniment data “AC***02” and background video data “BG***02” of music S02 (music ID “ID***S02”), and music S03 (music ID “ID***S03 ”) are associated with accompaniment data “AC***03” and background video data “BG***03”. In the following description, it is assumed that the first storage unit 100 stores the table shown in FIG.

Note that the first storage unit 100 may store reference data for scoring karaoke singing, lyrics telop data for displaying lyric telops on the display device 30 or the like in time with the karaoke performance of a song, and the like. good.

[Second storage unit]
The second storage unit 200 associates and stores call voice data, call identification information, and artist identification information.

Call voice data is data for generating call voice. A call sound is a sound corresponding to a call made by the audience accompanying the singing of the artist at the artist's concert. That is, the call voice is a pseudo-call issued from the karaoke machine K. FIG. The call identification information is unique information, such as call ID, for identifying each call voice data.

FIG. 5 shows a table stored in the second storage unit 200. As shown in FIG. For example, artist ID "ID***A01" of artist A01 contains call voice data "CV01" (call ID "ID***CV01") to call voice data "CV05" (call ID "ID***CV05"). ”) are associated with five call voice data and call IDs. As shown in FIG. 5, the second storage unit 200 may store a plurality of call voice data in association with one artist identification information. In the following description, it is assumed that the second storage unit 200 stores the table shown in FIG.

[Karaoke control part]
The karaoke control unit 300 performs karaoke performance based on the accompaniment data and displays a background image based on the background image data.

Specifically, the karaoke control unit 300 reads the accompaniment data associated with the music ID registered in the reservation queue from the first storage unit 100, controls the sound processing unit 14, A karaoke performance sound is emitted from 20. - 特許庁In addition, the karaoke control unit 300 reads from the first storage unit 100 the background video data associated with the music ID registered in the reservation queue, and controls the display processing unit 15 to perform karaoke. At the same time, the background image is displayed on the display device 30 .

[Determination part]
The determination unit 400 analyzes background video data corresponding to a certain reserved song, and determines whether or not the background video corresponding to the background video data is live video.

A live video is a video of a concert performed by an artist. A concert in this embodiment is an event in which an artist and an audience listening to the artist's singing are present, regardless of the scale, venue, holding time, or the like. That is, the live video shows the artist and the audience.

For example, among users U1 to U3 who use the karaoke machine K shown in FIG. The karaoke machine K reserves the song S01 by registering the song ID "ID***S01" of the song S01 selected by the user U1 in the reservation queue. In addition, when using the karaoke apparatus K, each user is assumed to have started a karaoke application on his/her mobile terminal.

The determination unit 400 reads from the first storage unit 100 the background video data “BG***01” linked to the music ID “ID***S01” registered in the reservation queue. The determination unit 400 determines whether or not the background video corresponding to the background video data is a live video by analyzing the background video data “BG***01”.

Background image data can be analyzed using a known technique described in, for example, Japanese Patent Application Laid-Open No. 10-234004. Specifically, the determination unit 400 extracts a plurality of still images from the background video corresponding to the background video data. The determination unit 400 classifies the extracted still image into shots each composed of an arbitrary number of images, and determines whether or not a face image of a person is captured for each shot. When determining that a face image of a person exists in the shot, the determining unit 400 determines whether the face image of the person has already been captured in another still image. The determination unit 400 classifies the facial images of the person into different facial images, and counts the number of appearances of each facial image in the background image. Then, the determining unit 400 creates a list of characters in the background image based on the classified face images and the counted number of appearances of each face image. Furthermore, the determination unit 400 checks whether the list of characters includes an artist who sings the song. If the list of characters includes a plurality of persons and the person includes an artist, the determining unit 400 determines that the background image corresponding to the background image data is the live image. The determination unit 400 outputs the determination result to the transmission processing unit 500 .

Note that the first storage unit 100 may store in advance the background video data in association with attribute information indicating whether the background video data is a live video. In this case, the determination unit 400 refers to the attribute information of the background image data corresponding to the reserved song, and determines whether the background image corresponding to the background image data is a live image of the artist's concert. determine what

[Transmission processing part]
When the background image is determined to be a live image and the karaoke performance of a certain song is started by the karaoke control unit 300, the transmission processing unit 500 is associated with the artist identification information of the artist who sings the song. The stored call identification information is read out from the second storage unit 200 and transmitted to the portable terminal owned by the user of the karaoke machine K.

The karaoke control unit 300 starts playing karaoke of a certain piece of music when the user gives an instruction to start playing a certain piece of music via the remote control device 50, or when a certain piece of music is at the top of the reservation queue. is.

For example, it is assumed that the song ID "ID***S01" of song S01 selected by user U1 is registered in the reservation queue. Here, when the karaoke performance of the music registered in the reservation queue before the music S01 is finished and the music S01 becomes the head of the reservation queue, the karaoke control unit 300 indicates that the karaoke performance is to be started. A signal is output to the transmission processing unit 500 .

The transmission processing unit 500 refers to the output result from the determination unit 400, and confirms whether or not the background image corresponding to the music S01 for which the karaoke performance starts is a live image.

Here, it is assumed that the determination unit 400 has determined that the background image corresponding to the song S01 is a live image.

In this case, the transmission processing unit 500 reads from the first storage unit 100 the artist ID “ID***A01” linked to the music ID “ID***S01” of the music piece S01.

Based on the read artist ID "ID***A01", the transmission processing unit 500 retrieves the call ID "ID***A01" linked to the artist identification information "ID***A01" from the second storage unit 200. ***CV01” to call ID “ID***CV05”.

The transmission processing unit 500 transmits the read five call IDs to all mobile terminals paired with the karaoke machine K (mobile terminals M1 to M3 in the example of FIG. 1).

If the determination unit 400 does not determine that the background image corresponding to the music piece S01 is a live image, the transmission processing unit 500 does not perform the above process.

[Generation part]
When the call identification information is received from the mobile terminal during the karaoke performance of a certain piece of music, the generation unit 600 reads the call sound data based on the call identification information from the second storage unit 200, generates the call sound, and broadcasts the call sound. Output from sound means. Further, when a plurality of call voice data are associated with one artist identification information, the generation unit 600 generates call voice based on one call identification information selected by the user via the mobile terminal. do.

For example, when the karaoke performance of the song S01 is started, the mobile terminal that has received the call ID causes the call selection screen created by the karaoke application to be displayed on the display.

For example, icons corresponding to call IDs are displayed on the call selection screen (see FIG. 6). The icons displayed on the call selection screen correspond to the classic shouts of artist A01. In FIG. 6, icons C01 to C05 corresponding to the five received call IDs are displayed. Icons C01 to C05 correspond to call IDs "ID***CV01" to call ID "ID***CV05", respectively.

The user U2 and the user U3 who listen to the karaoke singing of the user U1 select an arbitrary call icon in accordance with the karaoke singing of the user U1. The mobile terminal transmits the call ID corresponding to the selected icon to the karaoke machine K.

For example, assume that user U2 operates portable terminal M2 to select icon C01. The mobile terminal M2 transmits the call ID "ID***CV01" corresponding to the icon C01 to the karaoke machine K.

The generation unit 600 reads the call voice data "CV01" from the second storage unit 200 based on the call ID "ID***CV01" transmitted from the mobile terminal. The generation unit 600 generates a call voice based on the read call voice data and outputs it from the speaker 20 .

The generation unit 600 causes the speaker 20 to output a call voice based on the call ID received from the mobile terminal while the karaoke performance of the song S01 is being performed.

When the karaoke performance of the song S01 has ended, the transmission processing unit 500 transmits a signal indicating that the karaoke performance has ended to the portable terminal. The mobile terminal ends display of the call selection screen and displays a normal screen (for example, a menu selection screen).

==About the processing in the karaoke machine==
Next, a specific example of processing in the karaoke machine K according to this embodiment will be described with reference to FIG. FIG. 7 is a flow chart showing an example of processing in the karaoke machine K. As shown in FIG. In this example, it is assumed that the karaoke machine K is used by a plurality of users each owning a portable terminal. Also, it is assumed that a karaoke application is activated in each mobile terminal. Also, the first storage unit 100 stores accompaniment data, background video data, and artist identification information in association with each other. The second storage unit 200 associates and stores call voice data, call identification information, and artist identification information.

Assume that one user selects a certain piece of music. The karaoke machine K registers the song ID of a certain song selected by one user in the reservation queue (reservation of the song, step 10).

The determination unit 400 analyzes the background video data corresponding to the song reserved in step 10, and determines whether or not the background video corresponding to the background video data is a live video of an artist's concert. (determine whether or not the background image is a live image; step 11).

After that, the karaoke control section 300 outputs a signal indicating the start of the karaoke performance to the transmission processing section 500 (instructing the start of the karaoke performance; step 12).

Here, if it is determined in step 11 that the background video is a live video (Y in step 13), the transmission processing unit 500 makes a call associated with the artist identification information of the artist who sings a certain song. The identification information is read from the second storage unit 200 and transmitted to the portable terminal owned by the user of the karaoke machine K (the call identification information is transmitted to the portable terminal; step 14).

When call identification information is received from the mobile terminal during karaoke performance of a certain song (Y in step 15), the generation unit 600 generates call voice from the second storage unit 200 based on the received call identification information. A call voice is generated by reading the data and output from the sound emitting means (output of call voice; step 16).

The karaoke machine K repeats the processing of steps 15 and 16 until the karaoke performance of a certain piece of music is completed (in the case of Y in step 17).

As is clear from the above, the karaoke apparatus K according to the present embodiment includes accompaniment data for karaoke performance of a musical piece, and background image data corresponding to the background image to be displayed on the display device 30 in time with the karaoke performance of the musical piece. , and artist identification information for identifying the artist who sings the song in association with a first storage unit 100; a second storage unit 200 that associates and stores call voice data for generating a call voice data, call identification information for identifying the call voice data, and artist identification information for the artist; karaoke performance based on accompaniment data; and a karaoke control unit 300 that displays a background image based on the background image data, and a determination unit 400 that determines whether the background image corresponding to a certain reserved song is a live image of a concert performed by an artist. Then, when it is determined that the background image is a live image and the karaoke performance of the certain song is started by the karaoke control unit 300, the call identification linked to the artist identification information of the artist who sings the certain song. A transmission processing unit 500 that reads out information from the second storage unit 200 and transmits it to the mobile terminal owned by the user of the karaoke device K, and when call identification information is received from the mobile terminal during karaoke performance of a certain song, and a generation unit 600 that reads call voice data based on the call identification information from the second storage unit 200 to generate call voice and outputs the call voice from the speaker 20 .

According to such a karaoke device K, a user who listens to a certain artist's karaoke singing can select a call voice suitable for the certain artist. Then, the karaoke machine K can emit the call voice selected by the user in time with the karaoke singing. Also, the emitted call sound is the same sound as the actual call. Therefore, even if the user is a fan of a certain artist, the user will not feel unsatisfactory with the call voice. That is, according to the karaoke apparatus K according to this embodiment, when a live video is played as a background video, it is possible to output a call sound suitable for the artist appearing in the live video.

Further, the determination unit 400 analyzes the background image data corresponding to a certain reserved song, and determines whether or not the background image corresponding to the background image data is a live image of an artist's concert. may

Also, the second storage unit 200 stores a plurality of call voice data in association with one artist identification information, and the generation unit 600 stores one call identification information selected by the user via the portable terminal. may generate call audio based on Even for one artist, different calls may exist depending on the progress of the song or concert. Therefore, by linking a plurality of pieces of call voice data to one artist identification information, the user of the karaoke apparatus K can select a call voice that matches the music or the progress of the concert.

<Others>
In the above-described embodiment, when the karaoke performance of the song S01 ends, the portable terminal ends the display of the call selection screen and displays the normal screen. On the other hand, when ending the display of the call selection screen, the mobile terminal may display a normal effect selection screen. Ordinary effects are cheering, applause, and the like that can be used in common regardless of the artist, as described in Patent Document 1, for example.

A PV image is sometimes used as the background image. Since the artist also appears in the PV video, some users want to select the call voice even when the PV video is played.

Therefore, the determination unit 400 of the karaoke machine K may analyze the background video data and determine whether the background video corresponding to the background video data is a PV video. When the background image is determined to be a PV image and the karaoke performance of a certain song is started by the karaoke control unit 300, the transmission processing unit 500 associates it with the artist identification information of the artist who sings the song. The call identification information is read out from the second storage unit 200 and transmitted to the portable terminal owned by the user of the karaoke machine K.

It is also possible to emit different call sounds for the PV video and the live video. In this case, the second storage unit 200 stores call IDs and call audio data so that they can be distinguished for PV video and for live video. If the background image is a PV image, the determination unit 400 reads out only the call ID corresponding to the PV image from the second storage unit 200 . On the other hand, when the background image is a live image, the determination unit 400 reads out only the call ID corresponding to the live image from the second storage unit 200 . In this case, part of the call ID corresponding to the live video and the call ID corresponding to the PV video (that is, part of the call sound) may be common.

Further, in the above-described embodiment, the example in which the first storage unit 100 and the second storage unit 200 store predetermined tables in advance has been described. On the other hand, the karaoke machine K acquires the latest table information from the server device (not shown) at regular intervals (for example, every month or each time the user uses it), stores the first storage unit 100 and It may be stored in the second storage unit 200 . According to such a karaoke machine K, call identification information can always be provided to the user based on the latest information even when a new piece of music is distributed.

The above embodiments are presented as examples and are not intended to limit the scope of the invention. The above configurations can be implemented in combination as appropriate, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. The above-described embodiments and modifications thereof are included in the scope and spirit of the invention, as well as the scope of the invention described in the claims and equivalents thereof.

100 first storage unit 200 second storage unit 300 karaoke control unit 400 determination unit 500 transmission processing unit 600 generation unit K karaoke device M1 to M3 mobile terminal

Claims (3)

Accompaniment data for performing karaoke performance of a musical piece, background image data corresponding to a background image to be displayed on the display means in accordance with the karaoke performance of the musical piece, and artist identification information for identifying the artist who sings the musical piece. a first storage unit that is attached and stored;
Call audio data for generating call audio corresponding to calls made by the audience accompanying the artist's singing at the artist's concert, call identification information for identifying the call audio data, and artist identification information for the artist. a second storage unit that associates and stores
A karaoke control unit that performs karaoke performance based on the accompaniment data and displays a background image based on the background image data;
a determination unit that determines whether or not a background image corresponding to a certain reserved song is a live image of a concert performed by an artist;
When it is determined that the background image is a live image and the karaoke performance of the certain song is started by the karaoke control unit, the call identification information linked to the artist identification information of the artist who sings the certain song. A transmission processing unit that reads from the second storage unit and transmits to a mobile terminal owned by a user of the karaoke device;
When call identification information is received from the mobile terminal during karaoke performance of the certain song, call sound data based on the call identification information is read from the second storage unit to generate call sound, and the sound emitting means outputs the call sound. a generation unit to output;
A karaoke device having The determining unit analyzes background video data corresponding to a certain reserved song, and determines whether or not the background video corresponding to the background video data is a live video of a concert performed by an artist. 2. A karaoke apparatus according to claim 1. the second storage unit associates and stores a plurality of call voice data with one artist identification information;
3. The karaoke machine according to claim 1, wherein the generating unit generates a call voice based on one of the call identification information selected by the user via the portable terminal.

Images