JP4595791B2 - Karaoke practice device and program - Google Patents

Description

  The present invention relates to a karaoke practice device and a program for practicing karaoke while playing music data composed of compressed audio data supplied from the outside.

  2. Description of the Related Art Conventionally, a music data reproducing apparatus that reproduces music data composed of compressed audio data supplied from the outside is known.

  As such a music data reproducing apparatus, there is one in which lyrics data in, for example, JPEG (Joint Photographic Experts Group) format is displayed on a display unit while reproducing music data of a song.

  There is also a music data playback device that inputs text information according to user preferences and displays the text information according to the playback of music (see, for example, Patent Document 1).

Further, there is a karaoke reproducing apparatus that reproduces karaoke data composed of performance data supplied from the outside and can refer to the singing by reproducing a singing voice guide melody.
JP 2001-117543 A

  However, among the above-mentioned conventional playback devices, the first device is difficult to use the played music and lyrics for singing practice because the playback of the music data and the display of the lyrics data are not synchronized.

  Further, among the above conventional playback devices, the second device inputs all lyric information for one song, and it is not impossible to synchronize all the input lyric information with the song. Since the synchronization timing must be designated for each character or character string, work time and work contents become enormous.

  Furthermore, in the third device among the above conventional playback devices, although the karaoke playback and the lyrics display are synchronized, the singing is referred to by a voice synthesized sung voice guide melody that is not a real voice. I couldn't practice the complicated singing of the original song.

  This invention is made paying attention to this point, and it aims at providing the karaoke practice apparatus and program which can use the reproduced music and lyrics for singing practice.

In order to achieve the above object, the karaoke practice device according to claim 1 is at least one of music data composed of compressed audio data , performance data including a plurality of lyrics events , and a reproduction speed and a reproduction timing of the performance data. Storage means for storing offset information for adjusting the sound, generation means for generating a reproduction clock, and based on the reproduction clock generated by the generation means, the music data stored in the storage means are sequentially read and reproduced. a music reproducing means for, among the periods and playback timing before Symbol playback clock, at least one of them, the corrected based on the offset information stored in the storage means, based on the corrected reproduction clock, said storage Lyric reproducing means for sequentially reading out performance data stored in the means and reproducing lyrics And butterflies.

Preferably, a change setting means for changing and setting the offset information according to a user input, and a storage means for storing the offset information changed and set by the change setting means as offset information corresponding to the performance data. Yes, characterized in that.

  More preferably, designation means for designating any of the lyrics reproduced by the lyrics reproduction means, and music data corresponding to a lyrics event corresponding to the lyrics designated by the designation means among the plurality of lyrics events. It further has a calculation means for calculating a reproduction position, and the music reproduction means reproduces music data from the reproduction position calculated by the calculation means.

  In order to achieve the above object, the program according to claim 4 can be realized by the same technical idea as claim 1.

  According to the invention described in claim 1 or 4, since the music and the lyrics are reproduced synchronously, the reproduced music and the lyrics can be used for singing practice, and the practice when the user performs the karaoke practice Efficiency can be improved.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a schematic configuration of a server / client system including a karaoke practice apparatus according to an embodiment of the present invention.

  The server / client system in the illustrated example includes one server 100 and three clients, and the server 100 and the client are connected to each other via a communication network 110. The karaoke practice device 1 of the present embodiment is one of three clients, and assumes a mobile phone terminal. Therefore, the communication network 110 includes both a wired system and a wireless system. The communication network 110 and the karaoke practice apparatus 1 are wirelessly connected, and the communication network 110 and the server 100 are wired. Of course, this connection mode is merely an example, and the communication network 110 and the server 100 may be wirelessly connected.

  The server 100 communicates with a music database (DB) 101a that stores a plurality of music data, a lyrics database (DB) 101b that stores a plurality of performance data, a management database (DB) 101c that stores a plurality of offset information, A transmission / reception unit 102 that transmits / receives data to / from an apparatus on the network 110, a control unit 103 that controls the entire apparatus, and a storage unit 104 that includes a RAM and a ROM are included.

  The music DB 101a stores compressed audio music data as music data, and the lyrics DB 101b stores performance data including, for example, SMF (Standard MIDI File) format including a plurality of lyrics events as performance data. In the management DB 101c, two types of offset information are stored as offset information: music-specific offset information and terminal-specific offset information. Of course, the terminal device has different specifications and capabilities depending on the model, and using only the (standard) offset information unique to the song makes the music data playback timing match the performance data playback timing, The situation that it does not fit well with the model of can occur. Therefore, in the present embodiment, the occurrence of the above situation is prevented by using two types of offset information, that is, offset information specific to the music and offset information specific to the terminal.

  Each piece of music data is associated with one piece of performance data and offset information. The server 100 appropriately selects data stored in the music DB 101a, the lyrics DB 101b, and the management DB 101c in response to a request from the karaoke practice apparatus 1, and distributes the selected data to the karaoke practice apparatus 1.

  The karaoke practice device 1 includes a transmission / reception unit 11 that transmits / receives data to / from devices on the communication network 110, a control unit 12 that controls the entire device, a storage unit 13 that includes a RAM and a ROM, and a music playback codec (coder). -decoder), LCD (Liquid Crystal Display), and drawing engine, a playback / display unit 14 that plays back song data and displays lyrics events, and an operation input unit 15 that includes operation buttons, cursor keys, function buttons, and the like The data storage device 16 (for example, a flash memory or a power-backed RAM) that holds data distributed from the server 100 and various data is configured.

  FIG. 2 is a block diagram showing a detailed configuration of the playback / display unit 14.

  As shown in the figure, the reproduction / display unit 14 includes a reproduction clock generation unit 14a that generates a reproduction clock, and a music piece stored in the data storage device 16 based on the reproduction clock generated by the reproduction clock generation unit 14a. Based on the offset information and offset correction information held in the data storage device 16, the reproduction clock generated by the reproduction clock generation unit 14a (period) ) And a synchronous readout display unit 14d for reading out and playing performance data held in the data storage device 16 based on the reproduction clock corrected by the clock correction unit 14c and displaying lyrics. In the performance data indicated by the lyrics specification information Indexing the position of the lyric event is constituted by the reproduction position control unit 14e to reproduce the music data from the indexing position. As shown in FIG. 2, the playback / display unit 14 is divided into a plurality of functional blocks. However, it is not necessary to provide hardware corresponding to each block, and a part or all of each block may be provided. The function of each block can be appropriately realized by executing the program by the control unit 12, that is, by software.

  Here, when the reproduction clock generated by the reproduction clock generator 14a is used as it is for reading and reproducing the performance data, the reproduction of the music (because the music data and the performance data are originally uncorrelated data) The display of lyrics may become out of sync. Therefore, in the present embodiment, the playback speed of the performance data is adjusted by correcting the playback clock based on the offset information (and offset correction information), and the playback of the music and the display of the lyrics are synchronized. I am doing so.

  In the present embodiment, the music data playback start position can be specified by specifying the lyrics. FIG. 3 is a diagram showing an example of the data format of the performance data. As shown in FIG. 3, the performance data includes a header, event data (performance event data and lyrics event data), and playback timing of each event. It is composed of delta time (Δt) indicating a time difference (relative time) and end data. In this way, time information indicating a time difference between adjacent event data is added to each lyric event data. Therefore, when one lyric event data is specified by the user specifying the lyric, the performance is performed. The absolute time from the event data at the head of the data to the specified lyric event data (= reading start position of the music data) is calculated by adding all the time information (= delta time) between them. If the music data is reproduced from the calculated time position, the music data is reproduced from the position corresponding to the designated lyrics.

  A control process executed by the karaoke practice apparatus 1 configured as described above will be described in detail with reference to FIGS.

  The karaoke practice device 1 reads out a control program stored in the storage unit 104 or the data storage device 16 in accordance with an instruction from the user, and causes the control unit 12 to execute the read control program, thereby performing control processing. Do.

  FIG. 4 is a flowchart showing the procedure of the main routine executed by the karaoke practice apparatus 1.

This main routine mainly consists of
(1) Insufficient data acquisition process (step S3)
(2) Reproduction process (step S5)
(3) Feedback process (step S7)
Each process is performed.

  When the user selects a song (step S1), the karaoke practice device 1 checks whether all data corresponding to the selected song is stored in the data storage device 16 (step S2). Here, the data corresponding to the selected music is specifically the music data, performance data and offset information associated therewith. That is, when any one of these three types of data is not held in the data storage device 16, the karaoke practice device 1 proceeds to the above-described insufficient data acquisition process (1) and acquires the insufficient data. Request to be sent to the server 100. Here, the karaoke practice apparatus 1 also transmits the model information of the karaoke practice apparatus 1 together with the acquisition request for insufficient data. In the case where the deficient data is offset information, the offset information includes, as described above, offset information indicating basic offset setting for the music and the model of the terminal to which the music is provided, as described above. This is because there are two types of offset information representing the offset setting corresponding to, and when the server 100 provides the offset information to the terminal, it is necessary to provide both or a combination of these offset information. .

  When the server 100 distributes the shortage data in response to the acquisition request from the karaoke practice device 1, the karaoke practice device 1 receives the delivered shortage data via the transmission / reception unit 11 (step S3). The received insufficient data is held in the data storage device 16.

  FIG. 6 is a diagram illustrating an example of a display screen displayed on the reproduction / display unit 14 and a key arrangement of the operation input unit 15.

  FIG. 6A is a diagram illustrating an example of a display screen when playback is stopped, and a key layout is also illustrated. As shown in FIG. 6A, the keys SW1 to SW3 are function keys for selecting a function assigned in parentheses ([]) at the bottom of the screen. During playback, the up / down cursor key functions as a key for instructing to increase / decrease the volume, and the left / right cursor key functions as a key for instructing the next / previous page of the lyrics page. On the other hand, when a pull-down menu is displayed, the cursor key functions as a menu item selection key.

  When the user presses the key SW2 while playback is stopped, the pull-down menu shown in FIG. 6B is displayed, and the music data is registered and read out, and the offset information held in the karaoke practice apparatus 1 is uploaded to the server 100. You can set whether or not to do.

FIG. 6C is a diagram showing an example of a display screen during reproduction. In FIG. 6C, the key arrangement is not shown. During playback, the user presses the key SW2, it can be a pull-down menu shown in FIG. 6 (d) is displayed, to adjust the display timing of the lyrics. Further, when the user presses the key SW3 during reproduction, a pull-down menu shown in FIG. 6 ( e ) is displayed, and the reproduction speed of lyrics can be adjusted. The display timing and the playback speed adjusted in this way are held as offset information in the karaoke practice apparatus 1, for example, in the data storage device 16, and from the next time, the held contents are the default settings when the music is played back. It becomes.

  As shown in FIG. 6 (a), when the user presses the key SW1 in a state where all the data corresponding to the music selected by the user is complete and the reproduction is stopped, the karaoke practice apparatus 1 is instructed to reproduce by the user. If it is determined that the process has been made, the process proceeds to the reproduction process (2) (steps S4 to S5).

  FIG. 5 is a flowchart showing a detailed procedure of the reproduction process.

This playback process mainly consists of
(A) Reproduction speed changing process (step S13)
(B) Reproduction position control process (steps S14 to S16)
(C) Display timing change process (step S17)
(D) Other processing (step S18)
(E) Reproduction end processing (step S20)
Each process is performed.

  When the reproduction process is started, the control unit 12 reads the offset information corresponding to the selected music piece from the data storage device 16 and stores it in the temporary storage area secured in the storage unit 13. Based on the offset information, the playback speed and display timing of the performance data are controlled. Although illustration is omitted, reading, reproduction and display of music data and performance data are also executed simultaneously. However, the processing related to reading, reproduction and display of music data and performance data is not necessarily executed by the control unit 12, and the music reproduction CODEC and drawing engine provided in the reproduction / display unit 14 are controlled by the control unit 12. You may make it perform in parallel with the said control processing by the part 12. FIG. In this case, the control unit 12 responds to the reproduction / display unit 14 in accordance with instructions for reading music data or performance data in accordance with the operation of the key SW1, and for starting the reproduction, and operations of the key SW2, the key SW3, and the cursor key. Readout and designation of playback position are performed in a timely manner.

  As described with reference to FIG. 6C, when the key SW3 is pressed during reproduction, the karaoke practice apparatus 1 advances the process to the reproduction speed changing process of (a). (A) In the reproduction speed changing process, first, a pull-down menu shown in FIG. 6 (e) is displayed, and an instruction from the user is awaited. Next, when the user instructs to change the playback speed using the cursor key, the playback speed is changed according to the instruction. Specifically, to increase the reproduction speed (reproduction clock cycle) by, for example, 3 ms, the user moves the cursor to “+1 ms” in the pull-down menu of FIG. 6E and presses the key ENTR three times. . This increases the playback speed by 3 ms. The change value thus instructed is stored in a predetermined area of the data storage device 16, for example.

  Next, when the key SW2 is pressed during reproduction, the karaoke practice apparatus 1 advances the process to the display timing change process (c). (C) In the display timing change process, first, a pull-down menu shown in FIG. 6D is displayed, and an instruction from the user is awaited. Next, when the user instructs to change the display timing using the cursor key, the display timing is changed according to the instruction. Specifically, when the display timing is desired to be “slightly late”, for example, the user moves the cursor to “slightly late” in the pull-down menu of FIG. 6D and presses the key ENTR. Thereby, the display timing becomes “slightly late”. Here, “fast”, “slightly early”, “normal”, “slightly late”, and “slow” are specifically “−4 seconds”, “−2 seconds”, “0 seconds”, “ +2 seconds ”and“ +4 seconds ”. Of course, each second is merely an example. The change value instructed in this way is stored in a predetermined area of the data storage device 16, for example.

  Next, when the left / right cursor key is pressed during reproduction, the karaoke practice apparatus 1 advances the process to the reproduction position control process (b). (B) In the playback position control process, first, the playback position of the top music data of the page specified by the pressed cursor key is determined (step S14), and then the lyrics of the specified page are displayed. (Step S15) Further, the playback position is jumped to the determined position (Step S16). Since the method for determining the playback position has been described above, it will not be repeated.

  Next, when the key SW1 is pressed during reproduction, the karaoke practice apparatus 1 advances the process to the reproduction end process (e). (E) In the playback end process, the final playback speed and display timing are stored in the predetermined area of the data storage device 16 as described above as offset information of the song.

  In addition, in the other processing of (d), the operation event includes events other than events for instructing speed change, page selection, timing change, and generation end, respectively. When the event occurs, Since it only shows that the process is performed, (d) a detailed description of other processes is omitted.

  Next, when the key SW2 is pressed while the reproduction is stopped, the pull-down menu shown in FIG. 6B is displayed. Then, when the user operates the cursor key to instruct “feedback” and presses the key ENTR, the karaoke practice device 1 advances the process to the feedback process (3). (3) In the feedback process, the stored offset information is fed back to the server 100 side. The server 100 may correct or update the offset information stored in the management DB 101c based on the offset information fed back in this way.

  As described above, in this embodiment, the lyrics can be presented in a manner similar to the conventional karaoke content in synchronization with the reproduction of the music data, so that the practice efficiency when the user performs the karaoke practice can be improved.

  In addition, since the lyrics data is provided independently of the music data, the cost is lower than when the multimedia contents obtained by combining these are created and provided.

  Further, since each data has a conventional data capacity, there is no problem in terms of data capacity during data transfer.

  In addition, since the lyrics data can be provided only, the user can effectively use the already acquired music data.

  Furthermore, by using the time information possessed by the lyrics data, it is possible to jump to the target reproduction position based on the lyrics.

  In the present embodiment, the generation speed and the display timing are changed only during music playback. However, the present invention is not limited to this, and may be performed while playback is stopped.

  In this embodiment, the playback position is specified in units of pages. However, the present invention is not limited to this, and the playback position may be specified in units of lyrics. In this case, it is preferable to display the entire lyrics on the screen so that the lyrics to be the reproduction start position can be designated by cursor designation or the like. In this case, the method for determining the reproduction start position is the same as that described above.

  Alternatively, a range of lyrics may be specified, and music data within the specified range may be reproduced in a loop. In this case, the playback start position and the playback end position from the event time of the event data corresponding to the lyrics at the beginning of the range and the event data for the lyrics at the end of the range (or just before the event data corresponding to the next lyrics) Should be determined.

  Furthermore, in the present embodiment, all the various data (music data, performance data, and offset information) are downloaded from the server 100 and held in the karaoke practice device 1, but this is not limiting, and a playback request is made. Alternatively, the server 100 may be requested to perform stream delivery and the server 100 may play back the stream delivery in response to the request.

  Further, in the present embodiment, as shown in FIG. 3, the performance data includes event data (performance event data) for generating a musical sound signal. Since it is used only for displaying lyrics, it is sufficient that only the lyric event data (+ delta time) is included, and the event data for generating the musical sound signal need not be included.

  Further, in the present embodiment, as shown in FIG. 4, the offset information is fed back to the server 100 in response to the instruction of “feedback” in the playback stopped state. When “feedback” is instructed from the pull-down menu shown in FIG. 6B, the value of the flag indicating “perform / do not perform feedback” is inverted by toggle for each instruction. In step S6, the value of the flag may be determined, and feedback may be automatically performed at the end of the reproduction process according to the value of the flag.

  A program in which a storage medium storing software program codes for realizing the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus is stored in the storage medium. It goes without saying that the object of the present invention can also be achieved by reading and executing the code.

  In this case, the program code itself read from the storage medium realizes the novel function of the present invention, and the program code and the storage medium storing the program code constitute the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, hard disk, magneto-optical disk, CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW, magnetic A tape, a non-volatile memory card, a ROM, or the like can be used. Further, the program code may be supplied from a server computer via a communication network.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also the OS running on the computer based on the instruction of the program code performs the actual processing. It goes without saying that a case where the functions of the above-described embodiment are realized by performing part or all of the above and the processing thereof is included.

  Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

It is a block diagram which shows schematic structure of the server client system containing the karaoke practice apparatus which concerns on one embodiment of this invention. It is a block diagram which shows the detailed structure of the reproduction | regeneration / display part in FIG. It is a figure which shows an example of the data format of performance data. It is a flowchart which shows the procedure of the main routine which the karaoke practice apparatus in FIG. 1 performs. It is a flowchart which shows the detailed procedure of the reproduction | regeneration processing in FIG. It is a figure which shows an example of the keyboard layout of the display screen displayed on the reproduction | regeneration / display part in FIG. 1, and an operation input part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 12 ... Control part (change setting means, preservation | save means), 14 ... Reproduction | regeneration / display part (generation means, music reproduction means, lyrics reproduction means, calculation means), 15 ... Operation input part (change setting means, designation means), 16 ... Data storage devices (storage means)

Claims (4)

Storage means for storing music data composed of compressed audio data, performance data including a plurality of lyrics events , and offset information for adjusting at least one of the playback speed and playback timing of the performance data;
Generating means for generating a regenerated clock;
Music reproduction means for sequentially reading out and reproducing the music data stored in the storage means based on the reproduction clock generated by the generation means;
Of period and reproduction timing before Symbol playback clock, playing at least one, and corrected based on the offset information stored in the storage means, based on the corrected reproduction clock, which is stored in the storage means A karaoke practice device, comprising: lyrics reproduction means for sequentially reading out data and reproducing lyrics. Change setting means for changing and setting the offset information according to user input ;
Karaoke training device according to claim 1, characterized in that the offset information is changed and set by the changing setting means further have a <br/> and storage means for saving as the offset information corresponding to the performance data. Designating means for designating any of the lyrics reproduced by the lyrics reproducing means;
A calculation means for calculating a reproduction position of music data corresponding to the lyrics event corresponding to the lyrics designated by the designation means among the plurality of lyrics events;
The karaoke practice device according to claim 1 or 2, wherein the music reproducing means reproduces music data from the reproduction position calculated by the calculating means. A storage procedure for storing in the storage means music data composed of compressed audio data, performance data including a plurality of lyrics events , and offset information for adjusting at least one of the playback speed and playback timing of the performance data;
A generation procedure for generating a recovered clock; and
A music reproduction procedure for sequentially reading out and reproducing the music data stored in the storage means based on the reproduction clock generated by the generation procedure;
Of period and reproduction timing before Symbol playback clock, playing at least one, and corrected based on the offset information stored in the storage means, based on the corrected reproduction clock, which is stored in the storage means A program for causing a computer to execute a lyric reproduction procedure for sequentially reading data and reproducing lyrics.

Images