JP7335175B2 - karaoke device - Google Patents

Description

The present invention relates to a karaoke machine.

Play your favorite video works (movies, documentaries, etc.) recorded on DVDs and BDs with a playback device (for example, a DVD/BD player) and display them on the TV screen as BGV, while enjoying the atmosphere of the video work with a mobile terminal or the like. The way of enjoyment of playing back a certain song has become widespread.

Also, in recent years, the number of karaoke rooms equipped with playback devices connected to karaoke machines is increasing. A user of the karaoke room can enjoy karaoke singing by reserving music that seems to match the atmosphere of the video work while displaying the video of the video work as a background video on the display device of the karaoke device.

Here, Patent Literature 1 discloses a technique for selecting music based on keywords extracted from video data.

Japanese Patent Application Laid-Open No. 2003-302971

By the way, a typical video work consists of various scenes such as an introduction and a climax. Therefore, even if a piece of music suitable for the atmosphere of the entire video work is selected using the technique disclosed in Patent Document 1, it may not be suitable depending on the scene.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a karaoke machine capable of playing karaoke songs suitable for each scene of a video work.

One invention for achieving the above object is a reproduction unit that reproduces data of a video work recorded on a medium, outputs a video signal, and displays the video on display means, and a plurality of images that constitute the video work. For each of the predetermined number of images, a first extraction unit that extracts an image keyword indicating the content of the image and associates it with the playback time at which the image starts to be played in the video work, and the singing history of the user. A second extraction unit that extracts a music keyword indicating the content of each song for a predetermined number of songs that are stored, and associates the second extraction unit with song identification information for identifying the song, and for each of the extracted image keywords, the extracted image keyword A related music keyword is determined from among the plurality of music keywords obtained, music identification information linked to the determined music keyword, and image keywords corresponding to the determined music keyword. and a processing unit that associates the playback time with the music data of the song indicated by the song identification information linked to the playback time when the playback time of the predetermined number of images arrives during playback of the video work. A karaoke device having a sound control unit for performing karaoke performance based on.
Other features of the present invention will be clarified by the description of the specification and drawings described later.

According to the present invention, it is possible to perform karaoke with songs suitable for each scene of a video work.

It is a figure which shows the karaoke apparatus which concerns on 1st Embodiment. It is a figure which shows the karaoke main body which concerns on 1st Embodiment. 4 is a table that links image keywords and playback times according to the first embodiment. 4 is a table in which music keywords and music identification information are associated with each other according to the first embodiment. 4 is a table showing music keywords related to image keywords according to the first embodiment; 4 is a table in which music identification information and playback times are associated with each other according to the first embodiment. It is a flow chart which shows processing of a karaoke device concerning a 1st embodiment. It is a figure which shows the karaoke main body which concerns on 2nd Embodiment. It is a flow chart which shows processing of a karaoke device concerning a 2nd embodiment. It is a flow chart which shows processing of a karaoke device concerning a 2nd embodiment.

<First embodiment>
A karaoke apparatus according to the first embodiment will be described with reference to FIGS. 1 to 7. FIG.

==Karaoke Device==
A karaoke device is a device for performing karaoke and for users to sing karaoke. A karaoke device is installed in a karaoke room of a karaoke store.

As shown in FIG. 1, the karaoke machine K according to this embodiment includes a karaoke main body 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50. As shown in FIG.

The speaker 20 is configured to emit various sounds. The display device 30 is configured to display video and images on the screen based on the signal from the karaoke main body 10 . The display device 30 is an example of "display means". The microphone 40 is configured to convert the user's singing voice into an analog signal and input it to the karaoke main body 10 . The remote control device 50 is a device for performing various operations on the karaoke main body 10 . The user can use the remote control device 50 to select a desired song for karaoke singing. Icons and the like for inputting instructions for various operations are displayed on the display screen of the remote control device 50 .

The karaoke main body 10 performs various controls related to karaoke singing, such as karaoke performance control of music, display control of lyrics and background images, and processing of signals input through the microphone 40 . As shown in FIG. 1, the karaoke main body 10 includes a control section 11, a communication section 12, a storage section 13, a sound processing section 14, a display processing section 15 and an operation section 16. FIG. Each configuration is connected to bus B via an interface (not shown).

The control unit 11 includes a CPU 11a and a memory 11b. The CPU 11a realizes various control functions by executing operation programs stored in the memory 11b. The memory 11b is a storage device that stores programs to be executed by the CPU 11a and temporarily stores various types of information during execution of the programs.

The communication unit 12 provides an interface for connecting the karaoke main body 10 to a communication line via a router (not shown).

The storage unit 13 is a large-capacity storage device that stores various data, such as a hard disk drive.

The storage unit 13 associates and stores music data for karaoke performance of music and music identification information. The music data includes accompaniment data, reference data, and the like. Accompaniment data is data that is the source of karaoke performance sounds. The reference data is data for scoring karaoke singing by the user. The song identification information is unique information set for each song, such as a song ID.

In addition, the storage unit 13 stores lyric telop data for displaying lyric telops on the display device 30 or the like in time with the karaoke performance of the music, background image data such as background images displayed on the display device 30 or the like during the karaoke performance, and the like. Store each song.

Under the control of the control unit 11 , the sound processing unit 14 performs control related to karaoke performance of music and processes signals based on singing voices input through the microphone 40 . The display processing unit 15 performs processing related to various displays on the display device 30 and the remote control device 50 under the control of the control unit 11 . For example, the display processing unit 15 controls the display device 30 to display an image in which lyric telops and various icons are superimposed on a background image during a karaoke performance of a song. Alternatively, the display processing unit 15 causes the display screen of the remote control device 50 to display various icons for operation input. The operation unit 16 includes a panel switch, a remote control receiving circuit, and the like, and transmits operation signals such as a music selection signal and a performance stop signal to the control unit 11 according to the operation of the panel switch of the karaoke apparatus 1 or the remote control device 50 by the user. Output. The control unit 11 detects an operation signal from the operation unit 16 and executes corresponding processing.

==Karaoke body==
As shown in FIG. 2, the karaoke main body 10 according to the present embodiment includes a reproduction section 100, a first extraction section 200, a second extraction section 300, a processing section 400, and a sound control section 500. The reproduction unit 100, the first extraction unit 200, the second extraction unit 300, the determination unit 400, and the sound control unit 500 are implemented by the CPU 11a executing a program stored in the memory 11b.

[Playback part]
The reproduction unit 100 reproduces the data of the video work recorded on the medium, outputs a video signal, and causes the display means to display the video.

Media are DVDs and BDs on which video works can be recorded. The data of the video work is composed of at least video data.

The video data is data corresponding to the video displayed on the display device 30 of the karaoke machine K. FIG. Video data is composed of a plurality of still image data.

For example, the user U enters a karaoke room and sets the media of the video work M on the karaoke machine K. After that, the user U instructs reproduction of the video work M via the remote control device 50 .

Based on the instruction, the reproducing unit 100 reproduces the data of the video work M recorded on the medium, outputs the video signal, and causes the display device 30 to display the video by continuously displaying a plurality of images. . The multiple images are images based on multiple still image data. Each image is associated with a playback time (time code) at which playback is started in the video work.

Some video works have chapters. In this case, a thumbnail image is set for each chapter. A thumbnail image corresponds to one of a plurality of images that constitute a video played within a chapter.

In the following description, the video work M is composed of 10 chapters (reproduction time per chapter is 10 minutes, total 60 minutes), and thumbnail images TN01 to TN10 are thumbnail images for each chapter. Assume it is set. It is also assumed that each thumbnail image corresponds to each image at playback time T01 to playback time T10.

[First extraction part]
The first extraction unit 200 extracts an image keyword for each of a predetermined number of images, and associates it with the reproduction time at which reproduction of the image is started in the video work.

The predetermined number of images are part of the plurality of images that make up the video work. A condition for specifying a predetermined number of images is set in advance. For example, the predetermined number of images can be thumbnail images. In the case of video work M, thumbnail images TN01 to TN10 correspond to predetermined images.

Alternatively, the predetermined number of images may be obtained by sampling a plurality of images included in the video work at predetermined time intervals. For example, when sampling a video work M with a playback time of 60 minutes at intervals of 6 minutes, 10 (after 2 minutes, 8 minutes, 14 minutes, 20 minutes, 26 minutes, 32 minutes, 38 minutes after the start of playback) minutes, 44 minutes, 50 minutes, and 56 minutes) are the predetermined number of images.

The image keyword indicates the content of the image (object name included in the image, atmosphere indicated by the image, etc.).

When the media of the video work M is set in the karaoke machine K by the user U, the first extraction unit 200 acquires the thumbnail images TN01 to TN10 from the plurality of images included in the video work M.

The first extraction unit 200 analyzes each acquired image and extracts image keywords.

A known method can be used to extract image keywords. For example, the first extraction unit 200 can analyze image data using Google Cloud Vision API and extract at least one keyword corresponding to an object, label, landmark, web entity, etc. included in the image. can.

The first extraction unit 200 associates the extracted image keyword with the playback time. For example, assume that the first extraction unit 200 analyzes the thumbnail images TN01 to TN10 and extracts one image keyword IK01 to IK10 for each thumbnail image. The first extraction unit 200 associates the image keywords IK01 to IK10 with the playback times T01 to T10 of the images corresponding to the thumbnail images TN01 to TN10 (see FIG. 3).

The first extraction unit 200 outputs information on the associated image keyword and reproduction time to the processing unit 400 .

[Second extraction part]
The second extraction unit 300 extracts song keywords from a predetermined number of songs included in the user's singing history, and associates them with song identification information for identifying the songs.

The singing history is a record of song titles, song IDs, singing dates and times, scoring results, etc. of songs sung by a certain user in the past. The singing history is stored, for example, in a server device (not shown). When a certain user performs a login operation, the karaoke apparatus K acquires the singing history of the certain user from the server device. It should be noted that the karaoke apparatus K may store the singing history in advance.

The predetermined number of songs is a part of all songs included in the singing history. A condition for specifying a predetermined number of songs is set in advance. For example, the predetermined number of songs is 50 songs in descending order of singing frequency, 40 songs in descending order of scoring results, or 30 songs at random. The song keyword indicates the content of each song (nouns included in the lyrics, atmosphere of the lyrics as a whole, etc.).

For example, it is assumed that user U's singing history includes 100 songs. It is also assumed that a condition of 50 songs is set in descending order of the number of songs sung.

In this case, the second extraction unit 300 selects 50 songs (songs S***01 to S***50) that have been sung many times from among the 100 songs.

The second extraction unit 300 extracts music keywords for each of the selected music.

A known technique can be used for extracting music keywords. For example, the second extraction unit 300 can use the AI learning function to extract at least one song keyword from each of the lyric data included in the correct answer data and the incorrect answer data (see Japanese Laid-Open Patent Publication No. 2018-2018 for details). 025949).

The second extraction unit 300 associates the extracted music keyword with the music ID. For example, assume that the second extraction unit 300 analyzes songs S***01 to S***50 and extracts one song keyword SK01 to song keyword SK50 for each song. The second extraction unit 300 associates the music keywords SK01 to SK50 with the music IDs of the music S***01 to S***50 (see FIG. 4).

The second extraction unit 300 outputs information on the associated music keyword and music ID to the processing unit 400 .

[Processing part]
For each of the extracted image keywords, the processing unit 400 determines a related music keyword from among the plurality of extracted music keywords, and collects music identification information linked to the determined music keyword and the determined music keyword. The playback time linked to the image keyword corresponding to the music keyword thus obtained is linked.

Specifically, the processing unit 400 compares each image keyword output from the first extraction unit 200 with the music keyword output from the second extraction unit 300, and compares each image keyword with the image keyword. Determine relevant song keywords.

A known method can be used to determine related music keywords. For example, the processing unit 400 compares image keywords and music keywords, and determines music keywords that completely or partially match one image keyword as "related music keywords." Alternatively, the processing unit 400 compares one image keyword with each of the plurality of extracted music keywords, and scores the relevance between the keywords. Then, the processing unit 400 determines the music keyword with the highest score as the "related music keyword". Relevance scoring is, for example, a technique for calculating the degree of relevance between a keyword extracted from content and a tag attached to an image (see Japanese Patent Laid-Open No. 2011-164865), and other known techniques that use AI learning functions. can be used.

Then, the processing unit 400 associates the music ID associated with the determined music keyword with the playback time associated with the image keyword corresponding to the determined music keyword.

For example, the first extraction unit 200 outputs image keywords IK01 to IK10 and information on reproduction times T10 to T10, and the second extraction unit 300 outputs music keywords SK01 to SK50 and music identification information ID***01 to Assume that the information of ID ***50 is output.

The processing unit 400 determines related music keywords from among the plurality of extracted music keywords SK01 to SK50 for each of the image keywords IK01 to IK10 (see FIG. 5). Then, the processing unit 400 associates the music ID associated with the determined music keyword with the playback time associated with the image keyword corresponding to the determined music keyword (see FIG. 6). .

Note that there is a possibility that a music keyword determined for one image keyword is also determined as a "related music keyword" for another image keyword. Therefore, for example, the processing unit 400 can determine related music keywords after excluding music keywords that have already been determined as "related music keywords" from comparison targets.

In addition, when the relevance score is used, there is a possibility that a plurality of music keywords having the same score will be generated for one image keyword. In this case, the processing unit 400 can determine, for example, the song keyword of the song that has been sung the most in the user's singing history or the song that has the highest scoring result as the song keyword related to the one image keyword.

On the other hand, the reproduction time of one chapter may be longer than the performance time of the music corresponding to the determined music keyword. In such a case, the processing unit 400 may determine multiple music keywords for one image keyword. That is, for one extracted image keyword, the processing unit 400 selects a plurality of related music keywords from among the plurality of extracted music keywords, which are a plurality of music keywords corresponding to the plurality of music keywords. A plurality of music keywords are determined such that the total playing time is less than the reproduction time of the chapter corresponding to the image keyword, a plurality of music identification information linked to the determined plurality of music keywords, The playback time associated with one image keyword corresponding to the determined music keyword may be associated.

[Sound control part]
The sound control section 500 performs various controls related to sound emission from the karaoke machine K. FIG. For example, the sound control unit 500 performs karaoke based on the music data of the reserved music. Specifically, the sound control unit 500 reads the music data associated with the music ID registered in the reservation queue from the storage unit 13 and controls the sound processing unit 14 to perform karaoke from the speaker 20 . Emit the performance sound.

Here, in the present embodiment, when the reproduction time of a predetermined number of images arrives during reproduction of a video work, the sound control unit 500 reproduces the music indicated by the music identification information linked to the reproduction time. A karaoke performance is performed based on the data.

For example, assume that the reproducing unit 100 reproduces the data of the video work M, outputs a video signal, and causes the display device 30 to continuously display a plurality of images to display the video.

When the playback time T01 of the image corresponding to the thumbnail image TN01 arrives, the sound control unit 500 plays the song S***10 indicated by the song ID ***10 (see FIG. 6) linked to the playback time T01. is read from the storage unit 13, and the sound processing unit 14 is controlled to output the karaoke performance sound of the song S***10 from the speaker 20. Similarly, when the playback times T02 to T10 of the images corresponding to the thumbnail images TN02 to TN10 arrive, the sound control unit 500 selects the music indicated by the song ID (see FIG. 6) associated with the playback times T02 to T10. are read out from the storage unit 13, and the sound processing unit 14 is controlled so that the karaoke performance sound of each piece of music is emitted from the speaker 20. - 特許庁

It should be noted that there is a possibility that the playback time for the next image may come during karaoke performance of one piece of music. In this case, the sound control unit 500 can fade out the current karaoke performance and start the karaoke performance of the song indicated by the song ID linked to the next reproduction time.

==About the processing in the karaoke machine==
Next, a specific example of processing in the karaoke machine K according to this embodiment will be described with reference to FIG. FIG. 7 is a flow chart showing an example of processing in the karaoke machine K. As shown in FIG. In this example, it is assumed that the user U uses the karaoke machine K to sing karaoke songs while watching the video work M.

The karaoke machine K performs login processing to the karaoke machine K of the user U based on the instruction input from the user U (login processing, step 10).

The karaoke machine K acquires the singing history of the user U from the server device (acquisition of singing history, step 11). A user U sets a medium in which a video work M is recorded in a karaoke machine K. - 特許庁

The first extraction unit 200 extracts an image keyword indicating the content of each of a predetermined number of images among a plurality of images constituting the video work M, and extracts an image keyword indicating the content of the image, and the reproduction time at which the image in the video work M is to be reproduced. (linking of image keyword and playback time; step 12).

In addition, the second extraction unit 300 extracts a music keyword indicating the contents of each music from a predetermined number of music included in the singing history of the user U, and associates it with a music ID for identifying the music ( Linking of music keywords and music IDs (step 13).

For each of the image keywords extracted in step 12, the processing unit 400 determines related music keywords from among the plurality of extracted music keywords (determination of related music keywords; step 14).

Then, the processing unit 400 associates the music ID associated with the music keyword determined in step 14 with the playback time associated with the image keyword corresponding to the determined music keyword (music ID and playback time (step 15).

After that, based on an instruction input from the user U, the reproducing unit 100 reproduces the data of the video work M recorded on the medium, outputs a video signal, and causes the display device 30 to display the video ( Start playing, step 16)

When the reproduction time of a predetermined number of images has arrived during the reproduction of the video work M (Y in step 17), the sound control unit 500 selects the music of the music indicated by the music ID linked to the reproduction time. Based on the data, a karaoke performance is performed (karaoke performance of music, step 18).

The karaoke machine K repeats the processing of steps 17 and 18 until the reproduction of the video work M is completed (in the case of Y in step 19).

As is clear from the above, the karaoke machine K according to the present embodiment reproduces the data of the video work recorded on the media, outputs the video signal, and displays the video on the display device 30. a first extraction unit 200 that extracts an image keyword indicating the content of each of a predetermined number of images among a plurality of images that constitute a work, and associates the image keyword with the reproduction time at which the image is started to be reproduced in the video work; A second extraction unit 300 that extracts a music keyword indicating the content of each song for a predetermined number of songs included in the user's singing history and associates it with song identification information for identifying the song, and For each of the image keywords obtained, a related music keyword is determined from among the plurality of extracted music keywords, and music identification information associated with the determined music keyword and information corresponding to the determined music keyword. A processing unit 400 that associates reproduction times associated with image keywords, and music identification information associated with the reproduction times when the reproduction times of a predetermined number of images come during reproduction of a video work. and a sound control unit 500 that performs karaoke performance based on the music data of the music indicated by .

According to such a karaoke machine K, each time a predetermined number of images forming a video work are displayed, a karaoke performance of music associated with the images can be performed. Therefore, the user can enjoy the video work and sing karaoke songs suitable for the scene being reproduced at present. That is, according to the karaoke apparatus K according to this embodiment, it is possible to perform karaoke with songs suitable for each scene of the video work. It should be noted that since the songs to be performed in karaoke are determined based on the singing history of the user himself/herself, it is impossible for the user to be unable to sing in karaoke.

Also, the predetermined number of images may be images corresponding to thumbnail images set for each chapter of the video work. By using the thumbnail images, the karaoke apparatus K can determine appropriate songs for each chapter.

<Second embodiment>
Next, a karaoke machine according to the second embodiment will be described with reference to FIGS. 8 to 9B. In the present embodiment, an example of recommending foods and drinks to a user according to images forming a video work will be described. Description of the same configuration as in the first embodiment is omitted.

==Karaoke body==
As shown in FIG. 8, the karaoke main body 10 according to the present embodiment includes a reproducing unit 100, a first extracting unit 200, a second extracting unit 300, a processing unit 400, a sound control unit 500, a list storage unit 600, a recommendation A unit 700 and a notification unit 800 are provided. The list storage section 600 corresponds to part of the storage area of the storage section 13 . The reproduction unit 100, the first extraction unit 200, the second extraction unit 300, the determination unit 400, the sound control unit 500, the recommendation unit 700, and the notification unit 800 are configured such that the CPU 11a executes a program stored in the memory 11b. It is realized by

[List memory]
The list storage unit 600 stores a list of foods and drinks that can be provided to users at a store where the karaoke machine K is installed.

The food and drink list includes food and drink names, identification IDs for identifying the food and drink, prices, images of the food and drink, calorie intake, and the like. The food and drink list varies from karaoke store to karaoke store. In the following description, it is assumed that the food list includes food FD01 to food FD30.

[Recommendation Department]
When the first extraction unit 200 extracts an image keyword indicating food and drink, the recommendation unit 700 recommends food and drink to the user based on the image keyword and the food and drink list.

Specifically, when the image keyword extracted by the first extraction unit 200 indicates food and drink, the recommendation unit 700 reads out the food and drink list from the list storage unit 600, compares it with the image keyword, Identify food and drink. Identification of related food and drink can be performed in the same manner as the processing in the processing unit 400 . That is, the recommendation unit 700 compares one image keyword with each food item included in the food item list, and scores the relevance between the keyword and the food item. Then, the processing unit 400 identifies the food with the highest score as the food related to the image keyword.

For example, it is assumed that an image keyword indicating food and drink "ramen" is extracted from the thumbnail image TN05 in the first embodiment. In this case, the recommendation unit 700 compares the food and drink included in the food and drink list with “ramen” and identifies the related food and drink (for example, char siu noodles).

The recommendation unit 700 makes a recommendation to the user by displaying the name or image of the specified food or drink or a message prompting an order on the display screen of the remote control device 50 . The user can use the remote control device 50 to order the recommended food and drink. Note that when a plurality of related foods and drinks are specified, the recommendation unit 700 may recommend the one with the highest score, or may recommend all the specified food and drinks.

[Notification part]
When the user orders the recommended food and drink, the notification unit 800 notifies the user of the food and drink based on the reproduction time associated with the image keyword used for recommending the food and drink. The provision timing is determined, and the decided provision timing of the food and drink is notified to the provider of the food and drink in the store.

The provision timing is the time at which food and drink are provided to the user while the video work is being reproduced. The provision timing is determined, for example, based on the playback time of a predetermined number of images.

For example, assume that the user U has ordered the “char siu noodles” recommended by the recommendation unit 700 . In this case, the notification unit 800 determines the timing of providing the pork noodles to the user U based on the reproduction time T05 associated with the image keyword (ramen) used when recommending the pork noodles. For example, the notification unit 800 determines the provision timing to be one minute before the reproduction time T05.

The notification unit 800 notifies the provider of the food and drink in the store of the determined provision timing. Specifically, the notification unit 800 transmits the identification ID of the food and drink to be ordered and the timing of provision to the mobile terminal owned by the provider or the management server installed in the store.

The provider identifies the food and drink to be provided based on the identification ID of the food and drink, and prepares the food and drink so that the food and drink can be provided in accordance with the provision timing.

The notification unit 800 can also notify the user of the provision timing by displaying the provision timing on the display screen of the remote control device 50 .

==About the processing in the karaoke machine==
Next, a specific example of processing in the karaoke machine K according to this embodiment will be described with reference to FIGS. 9A and 9B. 9A and 9B are flowcharts showing processing examples in the karaoke machine K. FIG. In this example, it is assumed that the user U uses the karaoke machine K to sing karaoke songs while watching the video work M. In addition, the list storage unit 600 stores a list of foods and drinks that can be provided to users at the store where the karaoke machine K is installed.

Steps 20-22 are similar to steps 10-12.

Here, when the first extraction unit 200 extracts an image keyword indicating food and drink (Y in step 23), the recommendation unit 700 performs , to recommend food and drink to the user (recommend food and drink; step 24).

When the user orders the recommended food and drink (Y in step 25), the notification unit 800 displays the food and drink based on the playback time associated with the image keyword used when recommending the food and drink. The timing for providing the product to the user is determined, and the determined timing for providing the food and drink is notified to the provider of the food and drink in the store (notification of the provision timing; step 26).

Steps 27-30 are similar to steps 13-16.

When the provision timing notified in step 26 arrives during the reproduction of the video work (Y in step 31), food and drink are provided by the provider (provide food and drink; step 32).

After that, when the playback time of a predetermined number of images has arrived (Y in step 33), the sound control unit 500 performs karaoke based on the song data of the song indicated by the song ID linked to the playback time. Performance is performed (karaoke performance of music, step 34).

The karaoke machine K repeats the processing from step 31 to step 34 until the reproduction of the video work M is completed (in the case of Y in step 35).

As is clear from the above, the karaoke machine K according to the present embodiment includes the list storage unit 600 that stores a list of foods and drinks that can be provided to the user at the store where the karaoke machine K is installed, and the first and a recommendation unit 700 that, when the extraction unit 200 extracts an image keyword indicating food and drink, recommends food and drink to the user based on the image keyword and the list of food and drink. According to such a karaoke machine K, it is possible to recommend food and drink suitable for the scene of the video work to the user.

In addition, when the user orders the recommended food and drink, the karaoke device K according to the present embodiment performs the processing based on the reproduction time associated with the image keyword used when the food and drink is recommended. It has a notification unit 800 that determines the timing of providing food and drink to the user and notifies the determined timing of providing food and drink to the provider of food and drink in the store. According to such a karaoke machine K, the user can eat and drink food suitable for the scene of the video work.

<Modification 1>
Many video works include audio. The data of such a video work consists of video data and audio data. The audio data is data corresponding to audio emitted from the karaoke machine K. FIG. Sounds include speech sounds, music sounds, sound effects (mechanical sounds, natural sounds, etc.), and the like.

When the video work includes sound, the reproducing unit 100 reproduces the data of the video work and outputs the audio signal together with the video signal. The sound control unit 500 controls the sound processing unit 14 to emit the sound of the video work from the speaker 20 .

Here, the sound control unit 500 can also output sound based on the sound signal when the karaoke performance is not performed.

For example, in the example of the first embodiment, assume that the sound control unit 500 emits the karaoke performance sound of the song S***10 when the playback time T01 of the thumbnail image TN1 arrives. Suppose that the karaoke performance of song S***10 is finished before proceeding to the next chapter. In this case, the sound control section 500 emits the sound of the video work M based on the audio data of the video work M until the next reproduction time T02 arrives.

By emitting the sound of the video work M in this way, it is possible to avoid a state in which only the video is displayed (a state in which no sound is emitted).

Note that the sound control unit 500 may change the volume of sound emitted between the sound of the video work and the sound of the karaoke performance.

In addition, in the example of the second embodiment, the sound control unit 500 emits the karaoke performance sound when the provision timing arrives (or when the reproduction time used for determining the provision timing arrives). It may be canceled and the sound of the video work may be emitted. In this case, it becomes easier for the user to stop singing karaoke and eat and drink.

<Modification 2>
When karaoke performance is performed based on the music data of the music indicated by the music identification information linked to one reproduction time, the reproduction unit 100 interrupts the reproduction of the data of the video work, and performs the karaoke performance. An image signal indicating an image extracted from the attached image keyword is output, the image is displayed as a still image on the display means, and reproduction of the data of the video work can be restarted after the karaoke performance is finished.

For example, in the example of the first embodiment, assume that the sound control unit 500 emits the karaoke performance sound of the song S***10 when the reproduction time T01 of the image corresponding to the thumbnail image TN01 arrives.

In this case, the reproduction unit 100 interrupts the reproduction of the data of the video work M, outputs an image signal representing the image corresponding to the thumbnail image TN01, and causes the display device 30 to display the image corresponding to the thumbnail image TN01. After that, when the karaoke performance of the song S***10 ends, the reproduction unit 100 resumes the reproduction of the data of the video work from where it was interrupted (that is, from the image following the image corresponding to the thumbnail image TN01). . There are various scenes even within a certain chapter. Therefore, by displaying an image corresponding to the thumbnail image TN01 used when determining the song S***10, the user sings karaoke while looking at the image most relevant to the song to be played karaoke. becomes possible.

<Others>
The above embodiments are presented as examples and are not intended to limit the scope of the invention. The above configurations can be implemented in combination as appropriate, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. The above-described embodiments and modifications thereof are included in the scope and spirit of the invention, as well as the scope of the invention described in the claims and equivalents thereof.

100 reproduction unit 200 first extraction unit 300 second extraction unit 400 processing unit 500 sound control unit 600 list storage unit 700 recommendation unit 800 notification unit K karaoke device

Claims (6)

a reproducing unit that reproduces the data of the video work recorded on the media, outputs a video signal, and displays the video on the display means;
a first extraction unit that extracts an image keyword indicating the content of each of a predetermined number of images among a plurality of images that make up a video work, and associates the image keyword with a playback time at which playback of the image is started in the video work; ,
A second extraction unit that extracts a song keyword indicating the content of each song for a predetermined number of songs included in the user's singing history and associates it with song identification information for identifying the song;
For each of the extracted image keywords, a related music keyword is determined from a plurality of extracted music keywords, music identification information linked to the determined music keyword, and the determined music keyword. a processing unit that associates the playback time associated with the image keyword corresponding to the
When the playback time of the predetermined number of images arrives during playback of the video work, the sound control unit performs karaoke performance based on the song data of the song indicated by the song identification information linked to the playback time. and,
A karaoke device having 2. The karaoke machine according to claim 1, wherein said predetermined number of images are images corresponding to thumbnail images set for each chapter of a video work. a list storage unit that stores a list of foods and drinks that can be provided to users in a store where a karaoke machine is installed;
a recommendation unit that, when the first extraction unit extracts an image keyword indicating food and drink, recommends food and drink to a user based on the image keyword and the food and drink list;
3. The karaoke apparatus according to claim 1, further comprising: When the user orders the recommended food and drink, the timing of providing the food and drink to the user is determined based on the playback time associated with the image keyword used when recommending the food and drink. and a notification unit that notifies the food and drink provider in the store of the determined food and drink provision timing;
4. The karaoke apparatus according to claim 3, further comprising: The reproducing unit reproduces data of a video work recorded on a medium and outputs an audio signal,
5. The karaoke apparatus according to any one of claims 1 to 4, wherein the sound control unit outputs sound based on the audio signal when the karaoke performance is not performed. When karaoke performance is performed based on the music data of the music indicated by the music identification information linked to one reproduction time, the reproduction unit interrupts the reproduction of the data of the video work, and at the one reproduction time An image signal representing an image extracted from the linked image keyword is output, the image is displayed as a still image on the display means, and reproduction of the data of the video work is resumed after the karaoke performance is finished. 6. A karaoke apparatus according to any one of claims 1 to 5.

Images