JP2008225379A - Music and video reproducer such that musical piece for viewing continued part of vide product is specified - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a music and video reproducer with which video and music can be enjoyed separately. <P>SOLUTION: The music and video reproducer includes: a video product database in which mapping among a product ID, a product entity, and an array of a plurality of musical piece IDs is stored; a musical piece database in which mapping among a musical piece ID, a product ID, music data, and a music name is stored; a means of extracting a product ID, corresponding to a specified musical piece ID and music data from the musical piece database; a means of extracting the product entity and musical piece ID array of the extracted product ID from the product database and determining a reproduction start position of the product entity, based on the order of the specified musical piece ID in the musical piece ID array; a reproduction output means for the extracted music data; a means of reproducing and outputting the product entity from the determined reproduction start position; a means of extracting a musical piece ID in the next place in the musical piece ID array and urging the music name and request input thereof, before the reproduction output of the music data ends; and a means of deciding the extracted next musical piece ID as an object to be reproduced, when request input is performed in response to the guidance. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a music video playback device that plays a user-designated musical piece such as a karaoke device and plays back a video work during the performance.

  A karaoke apparatus known as a music video playback apparatus plays a song specified by a user and superimposes lyrics subtitles on a moving image (background video) during the performance and displays and outputs it. The background video may be prepared one-on-one for one piece of music, or a large number of short-time videos (material videos) are prepared and a plurality of videos are sequentially played back during the performance of one piece of music. In some cases, they are stitched together.

  In either case, the background video is created so as to match the music atmosphere. The one-to-one video is created for each song and may be a video with a story that matches the atmosphere of the song, or a live video by the artist of the original song. The material video to be connected for each music and the script data designating the reproduction order are prepared and prepared, and the karaoke apparatus sequentially reproduces the material video during the music performance based on the script data. In this case as well, script data is created by selecting a material video that matches the music atmosphere. Japanese Patent No. 2975535 describes a karaoke apparatus in which a word is associated with a music and a material video, and when a certain music is requested, a material video matching the keyword of the music is automatically selected and edited. ing.

  By the way, people who aren't singing at the karaoke are just chatting with other companions or just looking at the background video of the lyrics, unless they sing along with the singer or take a rhythm. is there. In the method of stitching material videos, the same material video is used repeatedly, and therefore the same video may be played even when different music pieces are played. Even if you play one-on-one video for one song, if you always karaoke with the same friends, you are more likely to play the same song, and you will see the same video over and over, I get bored. Therefore, even though it is a “music video playback device”, video is often only an accessory element.

  Accordingly, the present inventors have come up with the idea that the user of the music video playback apparatus separates the video and music so that a person who enjoys the video itself and a person who enjoys the music coexist in a set of users. It was. Of course, as long as it is a music playback device, it is also necessary to have the music played continuously. In addition, there may be a case where it is desired to play a plurality of specific music pieces for the convenience of the manager of the music video reproduction apparatus, such as when it is desired to play more songs of the same singer by a campaign. Then, if it is assumed that a plurality of specific music pieces are played back, the user can play the plurality of music pieces so that an elaborate video can be seen only when the plurality of music pieces are played. In particular, it should be guided naturally. Or you should let the music play continuously in order to see an elaborate video. The present invention has been created with such considerations in mind.

The present invention is a video and music playback device specified by the following items (1) to (9).
(1) A music video playback device including a video work database, a music database, a control means, an input means, a video output means, and an audio output means. (2) A video work database is provided for each work. (3) The music database corresponds to the music ID, the work ID, the music data, and the music title for each music. (4) When the music ID is designated as a reproduction target, the control means performs the first to fifth processes. (5) The first process is a work corresponding to the designated music ID. Extracting the ID and music data from the music database (6) In the second process, the work entity and music ID array corresponding to the work ID extracted in the first process are extracted from the work database, and the music ID Determining the reproduction start position of the work entity based on the order of the designated music IDs in the column (7) The third process reproduces and outputs the music data extracted in the first process by the sound output means; The work entity extracted in the process is reproduced and output by the video output means from the reproduction start position determined in the second process. (8) The fourth process is performed before the music data reproduction process of the third process is completed. The music IDs in the next order of the music IDs specified in the music ID array extracted in the above are extracted, and the music titles are displayed to prompt the request input. (9) The fifth process is a request input in the fourth process. When received, the song ID corresponding to the displayed song name should be the next playback target.

  According to the music video reproduction apparatus of the present invention, it is possible to view all video works for a long time when a specific plurality of music pieces are sequentially played. Accordingly, a person who enjoys only video and a person who enjoys only music can coexist in a set of users who use the same music video playback device while continuing to perform music.

=== Basic Configuration and Normal Operation for Music Video Playback Device ===
As an embodiment of the music video reproduction apparatus of the present invention, a karaoke apparatus is cited. FIG. 1 shows a functional block configuration of the karaoke apparatus. The karaoke apparatus 1 has almost the same hardware configuration as a performance terminal of a known communication karaoke system. The central control unit 11 controls each peripheral component unit to control the karaoke apparatus 1, and the hard disk device 12 has a predetermined format (MIDI format, MP3) as the origin of accompaniment music for a large number of karaoke songs as a music database. Format), accompaniment music data, lyric rendering data that is the origin of the generation of lyric images, and various data including table of contents information such as song names and artist names are stored in association with music IDs. The hard disk device 12 has a large number of moving image data files in a predetermined format (such as MPEG2 format) corresponding to a large number of material images, and a processing sequence of moving image data files (moving image data files to be processed). Script data defining the identifier and the processing order is also included in the music database.

The karaoke device 1 is accompanied by a music selection device 30, and the music selection device 30 transfers the music ID of the karaoke music specified by the user to the karaoke device 1 to reserve performance. Specifically, the karaoke apparatus 1 is connected to the LAN 40 via the network interface 22, and the music selection apparatus 30 includes a wireless LAN interface and is configured to be connected to the LAN 40 via the wireless access point 50 connected to the LAN 40. Has been. Thereby, the central control unit 11 communicates with the music selection device 30 via the network interface 22. The main body of the karaoke apparatus 1 is provided with an operation panel 14 having keys for accepting user input, and the operation input information input to the operation panel 14 is centrally controlled via the operation control unit 13. Transferred to the unit 11.

  The music selection device 30 is a tablet computer having a user interface mainly composed of a touch panel, and stores an index database in which song names and artist names of karaoke songs are associated with song numbers. Then, a query input by a user is received to search for music, and the music number of the finally specified karaoke music is transferred to the karaoke apparatus 1 via the LAN 40.

  When the central control unit 11 receives a music number input to the music selection device 30 or the operation panel 14, the central control unit 11 stores the music number in an internal RAM and manages it in a performance processing queue. Then, the music numbers are sequentially extracted from the queue, the corresponding karaoke data is read from the hard disk device 12, and the accompaniment music data in the karaoke data is transferred to the audio signal generation unit 15. The audio signal generation unit 15 includes a synthesizer that generates musical sounds based on MIDI data, and has a decoding function for various encoded audio data (MP3 format, ADPCM format, etc.), and processes transferred accompaniment music data Then, an audio signal of accompaniment music is generated. Then, the mixing amplifier 19 mixes and amplifies the accompaniment music and the singing voice input to the microphone 21 and outputs the sound from the speaker 20.

  On the other hand, with regard to the lyric rendering data, the lyric image in which the portion to be sung is changed in color in synchronization with the accompaniment music is sequentially developed in the video RAM 16 as a bitmap. Further, a predetermined moving image data file is sequentially transferred to the video control unit 17 in a predetermined order based on the script data. The video controller 17 decodes the moving image data file into a moving image, superimposes the lyric image on the moving image as a background image, and displays the image on the display 18.

=== Video Works Database ===
In addition to the material video, the hard disk device 12 also stores a video data file of a video work in which video for a time longer than the performance time of one song is recorded. The part of the long-time video work is displayed as a background video, and after viewing a part of the video work displayed when the user plays a certain piece of music, if a specific piece of music is further played, It has a playback function that allows you to see the continuation of the video work. The hard disk device 12 stores a video work database for realizing a video product continued playback function.

  Fig. 2 shows the schematic structure of the video work database. In the video work database 100, a video data file (video work file) 102 as an entity of a video work and a music ID array 103 are associated with a work ID 101 as an identifier of each video work. In addition, if the arrangement | sequence of music ID in the video work of a certain work ID is matched, the said work ID is matched with each music ID contained in the arrangement | sequence in a music database.

=== Video work continued playback function ===
FIG. 3 shows the flow of information processing related to the video product continued playback function, and FIGS. 4A and 4B show the transition of the screen displayed on the display 18 during the startup of the playback function. In this embodiment, for the music (following video music) associated with the work ID, a background video based on the script data and a background video based on the work ID can be selected by user input when playing the music. I am doing so. Specifically, when the karaoke apparatus 1 takes out the music ID to be played from the queue and the work ID is associated with the music ID, the karaoke apparatus 1 continues the video work before starting the music performance. A guidance screen (FIG. 4A) that describes the playback function and an operation method for selecting whether or not to use the function is displayed on the display 18 (s1, s2 → s3). Then, when an operation for use is performed, the video product continued playback function is activated. If not used is selected, the normal music playing operation described above is performed (S4 → s21).

  Here, it is assumed that the use of the video product continued playback function is selected. When the central control unit 11 accepts the selection instruction, the central control unit 11 takes out the video work corresponding to the work ID associated with the music ID of the performance target music from the video work database (S4 → s5), and acquires the music ID array. At the same time (s6), the song ID of the performance target song specifies the order in the arrangement (s7). Then, when the video work is reproduced and output during music performance, the reproduction start position (t) is determined based on the order (s8 to s12). In this embodiment, the video recording time (total playback time) T of the video work file is acquired (s8). The elapsed playback time from the beginning of the total playback time T is set as a playback start position t, and the playback start position t is set to the number N of music IDs included in the music ID array, and the order k of the performance target music in the array. , Based on the total playback time T of the video work.

  FIG. 5 shows the relationship between the music ID array in a certain video work and the performance time (tk) and total performance time (t) of the music (Mk: k = 1, 2, 3...) Included in the array. FIGS. 6A to 6F show the relationship between the playback start position and the playback time of the video work when the video work shown in FIG. 5 is displayed by the video function and the playback function. This video work is associated with a music ID array including five music IDs. And the total performance time t of each music contained in the said arrangement | sequence and the performance time (tk: k = 1-5) of each music are set. In addition, the video work database is such that for each video work, the total performance time t of the music of each music ID included in the music ID array is always longer than the total playback time T of the video work (T ≦ t), and each music piece It is assumed that the performance time tk is always intended to be longer than T / N. That is, the video work 110 is set so that tk ≧ T / N = 3 minutes. Here, it is assumed that the third piece (k = 3) of the performance target music is the performance target music.

  First, the central control unit 11 stores the order in the music ID array (k = 3) or the music ID as the video work continued playback function start information (s9). Then, the video work file is examined, and the total reproduction time T is equally divided (T / N) by the number N of music IDs included in the music ID array (s10, s11). In this example, it is equally divided every 3 minutes, and the reproduction start time T1 (0 minutes) and each of the equal time points T2 (3 minutes), T3 (6 minutes), T4 (9 minutes), T5 (12 minutes) Either is the playback start position. The playback end position is T (15 minutes). Further, since the third music ID is the performance target music, T3 is the reproduction start position (FIG. 6A).

  The central control unit 11 starts the performance process of the musical piece to be played, transfers the video work file to the video control unit 17, decodes the video work file from the data position of T3, and superimposes the lyrics image on the decoded video. Pause processing is performed (s13). The performance time of the musical piece to be played is 5 minutes, and the video work is played from the position of T3, 2 minutes after T4, that is, 11 minutes after the playback start time T1 of the video work. End playback.

  When the central control unit 11 subsequently ends the music performance along with the reproduction of the video work, the central control unit 11 investigates whether or not the next music ID in the music ID array corresponds to the start start information. Also, it is investigated whether or not the next music ID exists. That is, it is investigated whether or not the music that has been played corresponds to the last music in the music ID array. Here, neither is true.

  Next, the central control unit 11 executes a process of displaying a guidance screen (FIG. 4B) including an operation method for continuing the video work and the reproduction function (s14 → s15, s16 → s18 → s19). In the screen, the next song ID of the song that has been completed in the previously obtained song ID array, the song name and artist name, the fact that the next song can be viewed when the next song is played, and the next song The operation method etc. for making a performance object music are included. When the user designates the music according to the music ID array as the music to be played in accordance with the operation on the screen, the central control unit 11 ignores the music ID in the queue and plays the fourth music in the music ID array. As the music, the video work file is played back by the video work followed by the playback function when the music is played (s20 → s12). If it is not instructed by the user input to continue the video work function, the routine shifts to a normal performance operation (s20 → s21). Here, it is assumed that the continuation function of the video work is instructed, and the central control unit 11 executes the process of playing the video work from T4, and the performance time of the fourth music in the music ID array is 4 minutes. A video work is displayed. That is, it is played back to a position after 13 minutes (FIG. 6C).

  Next, when playing the fifth music piece in the music ID array, reproduction of the video work is started from the position of T5. However, the performance time of this musical piece is 5 minutes, and the video work is played to the end during the performance. In this embodiment, when the playback end position T of the video work is reached during the performance as described above, the playback is resumed by returning to the top T1 of the video work (FIG. 6D). In this example, the music performance and the reproduction of the video work are finished when two minutes have elapsed from T1.

  Here, the last music in the music ID array is played, and when the central control unit 11 plays the last music in the array, the music ID at the head of the array is set as a performance processing target (s16 → s17). . Thereby, the music M1 is played and the video work is reproduced from T1 (FIG. 6E). Then, when the video work is played from T2, and the music M2 is played (FIG. 6F), since the next music M3 is stored as start-up information, the video work continued playback function is terminated when the music M2 finishes playing, The process shifts to a process for accepting a normal music performance operation and music performance reservation (s18 → s21).

=== Determination of Playback Start Position ===
The algorithm for determining the playback start position is not limited to the above-described embodiment. For example, the ratio of the performance time of each piece of music in the total performance time of the music included in the music ID array is determined for each playback start with respect to the total playback time of the video work. You may make it correspond to the time between positions. FIG. 7 shows a schematic diagram of the embodiment. When the video work 110 shown in FIG. 5 is reproduced, the total performance time t = 21 minutes and the total reproduction time T = 15 minutes. The performance time tk (k = 1 to 5) of each musical piece is t1 = 3 minutes, t2 = 4 minutes, t3 = 5 minutes, t4 = 4 minutes, and t5 = 5 minutes from the beginning of the array. Accordingly, when the time interval between the reproduction start position Tk of the video work during the performance of the music Mk and the reproduction start position T (k + 1) during the performance of M (k + 1) is ΔTk,
ΔTk = T × tk / t
The video work playback position Tk at the time of performance of each music Mk is
Tk = Tk + ΔT (k-1)
It becomes. In the case of k = 1, ΔT0 = 0 minutes. Of course, in the video work database, it may be possible to associate the reproduction start position with each music ID in the music ID array in advance.

=== Reproduction of video works ===
In the above example, when the video work is played to the end, the playback position returns to the beginning, but if it does not return to the top and the video work comes to the end even during the music performance, the playback ends. Alternatively, an appropriate material image may be displayed for the remaining performance time, or a message indicating that the video work has been played to the end may be displayed.

  In addition, when the video work continued playback function is started, a music other than the head of the music ID array is played, and when the video work continued playback function is continued and the last music in the array is played, You may display that the video work was played to the end without giving guidance. Of course, if the performance time of the music is long, the music being played when the last of the video work is reproduced is not necessarily the last music in the array. Even in such a case, it may be displayed that the video work has been reproduced to the end.

  The video work may always be played back from the beginning when the video work continued playback function is activated. For that purpose, it is only necessary to define only the context of music IDs in the music ID array. When the central control unit extracts a music ID from the queue, if the work ID is associated with the music ID, the central control unit sets the music ID to the head of the music ID array of the corresponding video work. For example, if the songs included in the song ID array are five songs A to E, and the order of the songs in the array is ABCDE, when the song C is first played, the song ID array is set in the order CDAEAB. change. As a result, the first time a video work is viewed, it is always played from the beginning.

=== Reproduction opportunities for the same video work ===
The same user may make a performance reservation for a plurality of times within the period of use from the start of use of the karaoke device to the end of use. In such a case, the video work that has been played once is played again. Corresponding to such a case, the same video work may not be reproduced within the usage period. For example, a clerk at a karaoke store performs a predetermined operation on the karaoke device, and inputs that a new user starts to use. The central control unit 11 sets the period of use until the same operation is accepted after receiving the operation for starting the use, and every time the video work is reproduced within the period of use, which music ID array of which work ID The number of music played and which video work was played from which playback start position is recorded as a work playback history. When the operation to start use is accepted, the work reproduction history so far is erased.

  The central control unit 11 compares the work playback history recorded at any time with the music to be played during the period of use, and for the video work that has been played back from the beginning to the end, the video work continues with the playback function. Do not play the work. Alternatively, when playing a musical piece to be played, a guidance screen may be displayed asking whether or not to replay the video work that has been played once by the video work continued playback function.

  Also, after starting the video work continued playback function and playing a video work according to the song ID array, the video work continued playback function is interrupted by user input and all the songs included in the music ID array are played continuously. If not, the video work may be included in the music ID array within the usage period, but the video work continued playback function may not be activated even if the music is a performance target. Or you may display the guidance screen which asks whether it starts.

=== About video works ===
The content of the video work may be anything as long as the user wants to see the continuation of the video work. As a result, while enjoying the performance of music, it is possible to enjoy images that are not directly related to the music being played. The video work may be a long-length video with a story, but if it is not played from the beginning of the video work, it will be difficult for the user to understand the story itself and know the ending first. It will end up becoming an amusement. However, if it is a work that enjoys visual beauty itself, such as “World Heritage,” storylines are not necessary.

  Or the content which contains an answer in a quiz may be sufficient. For example, a quiz answer sheet is placed at a karaoke store or the like, and a quiz question is given so that it cannot be answered unless one video work is viewed from the beginning to the end. When the user submits an answer sheet describing the correct answer to the front of the store, the prize is given. In this way, the user is motivated to watch the video work from the beginning to the end, regardless of the presence or absence of storylines. Then, the use of the music video playback device can be promoted.

  When one video work or a plurality of specific video works has been viewed, the quiz problem may be displayed on the display of the music video playback device, and the answer may be input by the music selection device. When the answer is correct, a bonus video is displayed, or a unique code that only the correct answerer can know is generated and displayed, and the code is given to the front of the store to give a prize. Such services can also be provided.

  If all the songs included in the song ID array of a video work are songs of a specific artist or songs recorded in a specific album, a CD for a specific artist or a promotional campaign for a specific CD album will be developed. You can also

=== About database of music and video works ===
The music database stores karaoke music, but normal music data such as vocals may be used, and the video can be viewed together with the music.

  In addition, although the above musical tone database and video work database are stored in the hard disk, they may be stored in a server device connected via a communication network and downloaded or streamed.

It is a functional block diagram of the karaoke apparatus which is one Embodiment of the music video reproduction apparatus concerning this invention. It is a schematic structure figure of the video work database memorize | stored in the said karaoke apparatus. It is a flowchart of the information processing regarding the video work continued function in the said karaoke apparatus. It is the screen schematic displayed on the display of the said karaoke apparatus during starting of the said image work continued function. It is the schematic about a certain video work in the said video work database. It is operation | movement explanatory drawing of the said video work continued function. It is explanatory drawing about the other operation example of the said video work continued function.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Karaoke apparatus 11 Central control part 12 Hard disk drive 15 Audio | voice signal production | generation part 17 Image | video control part 18 Display

Claims (1)

A music video playback device comprising a video work database, a music database, control means, input means, video output means, and sound output means,
The video work database stores a work ID, a work entity, and an array of a plurality of music IDs in association with each work,
The song database stores a song ID, a work ID, music data, and a song name in association with each song,
When the music ID is designated as the reproduction target, the control means performs the first to fifth processes,
The first process extracts the work ID and music data corresponding to the designated music ID from the music database,
In the second process, the work entity corresponding to the work ID extracted in the first process and the music ID array are extracted from the work database, and the reproduction of the work entity is started based on the order of the music IDs specified in the music ID array. Determine the position,
In the third process, the music data extracted in the first process is reproduced and output by the sound output unit, and the work entity extracted in the second process is reproduced and output from the reproduction start position determined in the second process by the video output unit.
In the fourth process, before the music data reproduction process of the third process ends, the music ID in the next order of the specified music ID in the music ID array extracted in the second process is extracted and the music name is displayed. Prompts for requests,
The fifth process is a music video playback apparatus in which, when a request input is received in the fourth process, the song ID corresponding to the displayed song name is the next playback target.

Images