JP7129367B2 - Karaoke device, karaoke program and lyric information conversion program - Google Patents

Description

The present invention relates to a karaoke device for enjoying singing along with reproduced accompaniment sounds, a karaoke program, and a lyric information conversion program for converting lyric information used in karaoke.

Conventionally, karaoke, in which people enjoy singing along with accompaniment, is performed at parties, drinking parties, and other places where various people gather. A karaoke machine for performing karaoke usually has a basic function of displaying lyrics on a display device in synchronization with the performance. By singing while referring to the displayed lyrics, the user can sing with appropriate lyrics without memorizing the lyrics.

Patent Literature 1 discloses a karaoke system provided with a lyric enlargement function in order to assist visual recognition of amblyopia, presbyopia, or the like. By enlarging the lyrics to a character size that can be seen by the singer, it is possible to see the lyrics well and enjoy karaoke.

JP 2008-116864 A

Current karaoke machines generally transmit karaoke information to a display device via communication. Although many years have passed since communication-type karaoke machines became popular, there are still cases where karaoke information created at the beginning of the spread is still used. When communication-type karaoke machines were first popularized, the display devices (monitors) used were not as large as the current large-screen display devices, and the lyrics displayed using karaoke information were not commensurate with the size of the display devices. It was displayed in the form of character size, etc.

Currently, display devices used in karaoke boxes and the like generally use display devices with a large screen of 50 inches or more, such as large liquid crystal display devices. By using such a large-screen display device, it is possible to provide a powerful background image. On the other hand, as described above, since the lyrics display is created for the conventional display device, the lyrics are displayed larger than necessary, which may cause discomfort. In addition, the large lyrics hinder the visibility of the background image. In recent years, it has become common to display information other than lyrics, such as scoring results, on the screen while a song is being played. Visibility may be obstructed.

Therefore, the karaoke apparatus according to the present invention employs the following configuration.
Equipped with a control unit that performs playback based on karaoke information,
The karaoke information includes accompaniment information and lyric information,
The lyric information is lyric information created for the environment of a conventional karaoke device, and is configured including a plurality of line information,
The line information includes character information and accompanying information including a display position that defines a display line where the character information is displayed,
The control unit can execute accompaniment playback processing and combined display processing,
The accompaniment reproduction process reproduces the accompaniment information of the specified karaoke information,
In the combined display process, at a certain timing before combining , character information displayed on different adjacent display lines are combined into one, and the combined character information is displayed at a display position that defines a new display line.

Furthermore, in the karaoke device according to the present invention,
In the combining display process, when combining character information to be combined, among the character information displayed on different display lines adjacent to the character information to be combined, the character information displayed on the display line with a short width is combined. .

Furthermore, in the karaoke device according to the present invention,
The accompanying information includes the display position of the character information, the display start timing, and the display end timing,
The combined display process changes at least one of the display position, display start timing, and display end timing defined in the accompanying information.

Furthermore, in the karaoke device according to the present invention,
The combined display process displays the combined character information at the same timing as the display start timing included in the accompanying information, or ends the display at the same timing as the display end timing included in the accompanying information.

Furthermore, in the karaoke device according to the present invention,
In the combined display process, the combined character information is displayed at a timing different from the display start timing specified in the accompanying information, or the display ends at a timing different from the display end timing.

Furthermore, in the karaoke device according to the present invention,
The combined display process adjusts the display line so that the character information displayed is positioned at the bottom before the screen does not display the character information.

Furthermore, in the karaoke device according to the present invention,
In the combined display processing, the display lines on which the text information is displayed are switched so that the text information to be displayed becomes the lowest display line before the screen on which the text information is not displayed.

Furthermore, in the karaoke device according to the present invention,
The combined display process does not combine the character information so that the displayed character information is positioned at the bottom of the display line before the screen where the character information is not displayed.

Furthermore, in the karaoke device according to the present invention,
The control unit can switch between combined display processing and normal display processing, and
The normal display process displays character information on the display line specified by the accompanying information,
The combined display process displays the character information in a size smaller than the character size displayed in the normal display process.

Further, the karaoke program according to the present invention is
A karaoke program executed by an information processing device that reproduces based on karaoke information,
The karaoke information includes accompaniment information and lyric information,
The lyric information is lyric information created for the environment of a conventional karaoke device, and is configured including a plurality of line information,
The line information includes character information and accompanying information including a display position that defines a display line where the character information is displayed,
Accompaniment playback processing and combined display processing can be executed,
The accompaniment reproduction process reproduces the accompaniment information of the specified karaoke information,
In the combined display process, at a certain timing before combining , character information displayed on different adjacent display lines are combined into one, and the combined character information is displayed at a display position that defines a new display line.

Further, the lyric information conversion program according to the present invention is
A lyric information conversion program executed by an information processing device,
The lyric information is lyric information created for the environment of a conventional karaoke device, and is configured including a plurality of line information,
The line information includes character information and accompanying information including a display position that defines a display line where the character information is displayed,
At a certain timing before combining , character information displayed on different adjacent display lines are combined into one, and combining processing for assigning a display position defining a new display line to the combined character information can be executed.

According to the karaoke device and the karaoke program according to the present invention, it is possible to display lyrics in an appropriate form on a large-screen display device, etc., even if it is karaoke information created for a conventional display device. Become.

The figure which shows the structure of the karaoke system which concerns on this embodiment. A diagram showing the data structure of karaoke information and lyric information according to the present embodiment Flow diagram showing music playback processing of the present embodiment Diagrams showing display progress of lyric information before and after conversion in the present embodiment. A diagram showing conversion points in the present embodiment, and how lyrics are displayed after conversion. Flow chart showing lyric information conversion processing of the present embodiment A diagram for explaining the first combination rule of the lyric information conversion process of the present embodiment. A diagram for explaining the second combination rule of the lyric information conversion process of the present embodiment. A diagram for explaining the first correction process of the lyric information conversion process of the present embodiment. A diagram for explaining the first correction process of the lyric information conversion process of the present embodiment. A diagram for explaining the first correction process of the lyric information conversion process of the present embodiment. A diagram for explaining the second correction process of the lyric information conversion process of the present embodiment. A diagram for explaining the third correction process of the lyric information conversion process of the present embodiment.

FIG. 1 is a diagram showing the configuration of a karaoke system according to an embodiment of the present invention. The karaoke system 3 in this embodiment includes a karaoke device 2 (also called a “commander”) and a remote control device 1 . The karaoke machine 2 and the remote control device 1 are connected to form a network using a LAN 100 and an access point 110 .

A karaoke device 2 such as a karaoke box installed in a store includes an acoustic control section 25 as a playing means for playing music. The karaoke machine 2 also includes an operation unit 21 as input means on the karaoke machine 2 side, which is composed of switches for receiving various inputs from the user. The karaoke device 2 includes an operation processing section 22 that interprets an input from the operation section 21 and transmits it to the control section 30 . The karaoke machine 2 also includes an HDD 32 (hard disk) as storage means on the karaoke machine 2 side for storing various kinds of information. The karaoke machine 2 has a LAN communication section 24 as a karaoke machine side communication means for connecting to the LAN 100 and joining the network.

The karaoke machine 2 also includes image reproducing means for displaying images such as lyrics and background images on the monitor 41 . This video reproducing means includes a video reproducing section 29 for reproducing a background video based on background video information, a video RAM 28 for temporarily storing the background video to be reproduced, and a video control section 31 for superimposing lyrics on the reproduced background video. It has Note that the image control unit 31 may have a function of applying an image effect to the background image.

Furthermore, in this karaoke apparatus 2, various information can be displayed on the touch panel monitor 33 in addition to the monitor 41 connected to the outside. The touch panel monitor 33 includes a display section 33a for displaying video information input from the video control section 31, and a touch panel 33b for outputting the touch input position to the operation processing section 22, which are superimposed. Various operations on the karaoke device 2 can also be performed via an operation unit 21 provided on the front panel of the karaoke device 2 or the like.

The touch panel monitor 33 of this embodiment can also function as an operation means similar to the touch panel monitor 11 which is the operation means of the remote control device 1 . The user can select a piece of music from the touch panel monitor 33 and have the karaoke apparatus 2 directly make a reservation.

Further, the karaoke machine 2 has a control unit 30 composed of a CPU or the like as control means for controlling each component in an integrated manner, and a memory 27 for temporarily storing information necessary for executing various programs. I have.

With such a configuration, the karaoke device 2 executes various types of processing, and the main functions of the karaoke device 2 are music designation processing, music reproduction processing, and the like. The music designation processing is processing for designating and reserving music based on designation from the user, and is executed in cooperation with the remote control device 1 . The reservation information including the music ID for identifying the music transmitted from the remote control device 1 is registered in the reservation table stored in the memory 27. - 特許庁The music reproduction process is a process of reproducing music based on the reservation information registered in the reservation table, and is a process in which the performance process and the lyrics reproduction process are executed synchronously.

The performance process is a process of causing the acoustic control section 25 to perform the accompaniment information included in the karaoke information. The music played by the sound control unit 25 is emitted from the speaker 42 together with the singing voice input from the singing microphones 44a and 44b. The lyric reproduction process is a process of assisting singing by displaying the lyric on the monitor 41 based on the lyric information included in the karaoke information. A background image display process may be executed to superimpose a background image on the lyrics displayed in the lyrics reproduction process.

On the other hand, the remote control device 1 transmits various instructions such as reservation information to the karaoke device 2 and receives various information from the karaoke device 2 or a server device 5 connected to the Internet. In this embodiment, an operation unit 17 such as buttons and a touch panel monitor 11 are provided as a user interface. The touch panel monitor 11 includes a display section 11a and a touch panel 11b, and displays various interfaces on the display section 11a and can receive touch input from the user.

Furthermore, the remote control device 1 includes a database required for song searches, various programs, a memory 14 for storing various information generated in accordance with the execution of the programs, and a remote controller side control unit for collectively controlling these configurations. means. The remote control side control means includes a control section 15 composed of a CPU or the like, an image control section 13 for forming an image to be displayed on the display section 11a, a video RAM 12 for temporarily storing image information to be displayed, and an operation section 17. and an operation processing unit 18 that interprets the input of and transmits it to the control unit 15 .

The remote control device 1 is wirelessly connected to the access point 110 by the wireless LAN communication unit 16 , thereby being connected to the network formed by the LAN 100 . Each remote control device 1 is associated with a specific karaoke device 2 in advance. Various commands output from the remote control device 1 are received by the associated karaoke device 2 . The operation of the karaoke device 2 can also be performed using a portable terminal such as a smartphone owned by the user (customer). In that case, when the user comes to the store, the portable terminal possessed by the user is associated with the karaoke device 2 .

FIG. 2A is a diagram showing the data structure of karaoke information reproduced by the karaoke device 2. As shown in FIG. The karaoke information includes meta information added for selection of music and real information for displaying accompaniment and lyrics. The meta information includes music IDs for managing music, music titles, singer names, lyricist names, composer names, section identification information, and the like.

The actual information includes accompaniment information, lyric information, and background image information. When playing back a piece of music, it is possible to output accompaniment sounds as singing accompaniment from the speaker 42 by causing the acoustic control section 25 to play the accompaniment information. Also, when reproducing music, the video reproduction unit 29 reproduces the lyric information, and by outputting the video to the monitor 41, it is possible to assist the user in singing. At that time, by reproducing the background image information included in the karaoke information as the background image, it is possible to display an image that matches the atmosphere of the music. The background image information is not included in the karaoke information. For example, the background image information may be prepared for each genre of music and used according to the genre of the karaoke information.

FIG. 2B is a diagram showing the data configuration of lyrics information included in karaoke information. The lyric information of this embodiment is composed of a plurality of line information. The line information is information about one line of lyrics to be displayed on the screen, and is composed of accompanying information and character information. FIG. 2B shows the details of the line information 4 . The character information is information that defines characters to be displayed as lyrics, and is information defined by a character code (JIS code, etc.). The accompanying information is information related to character information in the progress of the performance. Specified display start timing, display end timing that specifies the timing at which the display of text information is erased, color change start timing that specifies the color change timing of text information, color change speed that specifies the speed of color change of text information is composed of

In the example of the line information 4 shown in FIG. 2(B), the lyric "uuuuuuuu" defined by the character information 4 is displayed to define the display line in which the character information included in the accompanying information is displayed. It is displayed on the screen of the monitor 41 at the position (X1, Y1 (Y1 corresponds to the first row)) at the display start timing t1. After that, at the color change start timing Dt, the color change is started at the color change speed v1. Then, when the display end timing t2 arrives, the display of the lyric "uuuuuuuu" is terminated (erased).

FIG. 3 shows a flow chart showing music reproduction processing executed by the karaoke device 2. As shown in FIG. The karaoke machine 2 refers to the reservation table (S101) and determines whether or not there is reservation information to be reproduced next (S102). If there is reservation information (S102: Yes), it is determined whether or not the song of the reservation information to be played next is a conversion target song (S103). Determination of conversion target music is performed, for example, by referring to a table that defines music IDs of conversion-prohibited music, with the music ID included in the reservation information to be reproduced. If the song ID to be played is listed in the table, it is determined that it is not a conversion target song (S103: No), and if the song ID to be played is not listed in the table, it is determined to be a conversion target song ( S103: Yes).

Here, examples of songs listed in the table defining conversion-prohibited songs include the following songs.
・Songs that include lyrics in the background video information ・Songs that prohibit displaying two lines of lyrics ・Songs that prohibit changing the display size of lyrics ・Songs that display 5 or more lines of lyric information simultaneously Music using a simultaneous color change event In the present embodiment, such music is not treated as a conversion target music, and the subsequent lyric information conversion processing (S104) is not executed.

On the other hand, the lyric information conversion process (S 200 ) is executed for the lyric information of the song to be converted. The lyric information conversion process (S 200 ) of the present embodiment is a process of converting original lyric information defined by four or three lines into two lines, or converting original lyric information defined by two lines into one line. is. At this time, by reducing the character size of the lyrics, the background image is not obstructed by the lyrics even on the large-screen monitor 41, and the visibility can be improved.

Next, the lyric information conversion process ( S200 ) will be described. FIG. 4A shows an example of the display progress of the lyrics information before conversion, and FIG. 4B shows the display progress of the lyrics information after conversion based on the new line information. is an example showing FIG. 4A shows the display progress of the lyrics displayed based on the lyrics information before conversion. In this embodiment, it is possible to allocate any one of the first to fourth rows as the Y coordinate at the display position (display row) included in the accompanying information. The character information 1 to 7 included in the line information are displayed at the coordinates based on the display position of each accompanying information associated with each character information according to the display start timing and the display end timing.

For example, for the line information 4 described with reference to FIG. It is displayed on the first line (line number 1) for the period of t2. FIG. 5(A) is a diagram showing the screen of the monitor 41 displayed by the lyric information before conversion, showing the situation at t1 shown in FIG. 4(A). At time t1, the first line (line number 1) displays the character information 4 "uuuuuuuuuu", the second line (row number 2) displays the character information 5 "eeeeeeeeee", and the third line Character information 2 "AAAAAAAAAA" is displayed on (line number 3), and character information 3 "I-I-II-II" is displayed on the fourth line (line number 4). In the character information 3 "Ii Ii Ii", the color change position C is indicated, indicating the singing timing.

FIG. 5(B) is a diagram showing the screen of the monitor 41 displayed by the lyric information after conversion, showing the situation at t1 in FIG. 4(B), that is, the situation at the same time as in FIG. It is After the conversion, the character information 4 on the first line before conversion and the character information 5 on the second line are combined, and the character information 4+5 "Uuuuuuueeeeeeeeeeee" is displayed on the new first line. . Also, the character information 2 on the 3rd line before conversion and the character information 3 on the 4th line are combined, and the character information 2+3 "Aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa" is displayed on the new second line. That is, after conversion (combination), the display position (display line), display start timing, and display end timing specified in the accompanying information related to the converted (combined) character information are changed, and temporarily stored in the memory 27, Character information is displayed based on the temporarily saved information. At that time, since the width of the character information may become longer due to the combination of the character information and may not be displayed, the lyric information after conversion is displayed in a smaller character size than the lyric information before conversion. These prevent the background image information from being obstructed by the lyric information.

Also, in the present embodiment shown in FIG. 5, a piano roll 41a and skill information 41b to 41d are displayed for song evaluation. Here, the piano roll 41a is a display for comparing the pitch of a model song and the pitch of a user's singing. It is displayed in a vertical bar shape. Also, the technique information 41b to 41d indicate the number of times the user's technique has occurred in singing.

In the state before conversion in FIG. 5A, the piano roll 41a and the technique information 41b to 41d are displayed above the monitor 41, whereas in the state after conversion in FIG. 5B, the monitor 41 The display position is changed to the lower position of . In addition, in the state before conversion in FIG. 5A, the technique information 41b to 41d are displayed on the piano roll 41a, whereas in the state after conversion in FIG. 5B, the piano roll 41a The technique information 41b to 41d are displayed below and the layout is changed. In particular, in this embodiment, since the character information after conversion is displayed on the upper part of the piano roll 41a, the piano roll 41a and the technical information 41b to 41d provide an easy-to-view layout that does not hinder the visibility of the lyrics. there is

Returning to the music reproduction process of FIG. 3, when the lyric information conversion process (S200) is completed, the reproduction of the accompaniment information included in the karaoke information is started (S104). In the present embodiment, when the scoring process is performed (S105: Yes) and the lyrics display mode is specified to be reduced (S106: reduced), the converted lyrics shown in FIG. The lyrics are displayed in a display form using information (S107). On the other hand, in other cases, that is, when the scoring process is not specified (S105: No), or when the normal display mode of the lyrics is specified even if the scoring process is specified (S106: normal ), and is displayed in a display form using the lyric information before conversion shown in FIG. 5A (S108). Note that the piano roll 41a and the technique information 41b to 41d are displayed on the monitor 41 during the scoring process, and the piano roll 41a and the technique information 41b to 41d are not displayed on the monitor 41 when the scoring process is not performed.

As described above, in this embodiment, depending on the specification of the size of the lyrics, the display of the piano roll 41a and the technique information 41b to 41d based on the scoring process, the lyrics information before conversion can be displayed in four to three lines, or , the display form is switched to a two-line display using the lyric information after conversion. It should be noted that the present invention is not limited to such an embodiment, and the lyrics display mode using the converted lyrics information may be used under appropriate setting conditions in the karaoke apparatus 2 .

In this embodiment, designation of the scoring process (S105) and determination of the display form of the lyrics (S106) are repeatedly executed during playback of the music, and it is possible to change the display form of the lyrics according to the situation. . At least one of the specification of the scoring process and the display form of the lyrics may be prohibited during the reproduction of the music. When the reproduction of the music is completed (S109: Yes), the process returns to the beginning of the music reproduction process, and the reservation table check (S101) is executed for the next music.

Next, the lyric information conversion processing (S200) of this embodiment will be described. FIG. 6 is a flowchart showing the lyric information conversion process (S200) of this embodiment. In the lyric information conversion process (S200), first, the lyric information of the music to be reproduced is read (S201). Then, the combining process is executed according to the first combining rule and the second combining rule (S202).

FIG. 7 is a diagram for explaining the first combination rule of the lyric information conversion process of this embodiment. As shown in FIG. 7(A), if the display state at a certain time before conversion is to display character information 1 to 4 on the 1st to 4th lines, after conversion, Character information 1 and character information 2 on the second line are combined and displayed on a new first line. Also, the character information 3 on the third line and the character information 4 on the fourth line are combined and displayed on a new second line. In this embodiment, by combining character information in the lyric information conversion process (S200), any one of the display position, display start timing, and display end timing in the accompanying information is changed, and a new display position, A display start timing and a display end timing are formed. The newly formed display position, display start timing, and display end timing are temporarily stored in the memory 27 . In this embodiment, the formed new display position, display start timing, and display end timing are discarded after the music playback process is completed. The timing may be stored in the lyric information or the like in the karaoke information so that it can be reused when the same song is specified again.

Further, as shown in FIGS. 7B and 7C, when the display state at a certain time before conversion is displaying character information 1 to 3 on the first to third lines, character The information 2 is connected to the short side of the character information displayed on the display line. For example, as shown in FIG. 7B, since the width of the character information 3 is shorter than the width of the character information 1, the character information 2 is combined with the character information 3 to create a new second line. will be displayed in On the other hand, as shown in FIG. 7C, since the width of the character information 1 is shorter than the width of the character information 3, the character information 2 is combined with the character information 1 to form a new first line. to be displayed. In this way, the first combination rule makes it possible to minimize the length of character information after conversion and to suppress the length difference between the new first and second lines.

FIG. 8 is a diagram for explaining the second combination rule of the lyric information conversion process of this embodiment. The second combination rule is a rule when the combined character information forms one line. For example, as shown in FIG. 8A, when the display state before conversion is character information 1 on the first line and character information 2 on the second line, and the combination after conversion results in one line, the combined The displayed character information 1 and 2 are displayed on the second line at the bottom. When the converted text is displayed on the first line, the character information is not displayed on the second line, so the singing user may expect something to be displayed on the second line. The user may be confused if nothing is displayed despite the user's expectations. In this embodiment, by giving priority to displaying the lower end side of the character information after conversion in this manner, it is possible to achieve a stable display in terms of the screen layout.

In this embodiment shown in FIG. 6, when the combining process (S202) according to the first combining rule and the second combining rule is completed, the combined character information is verified. In the merging process according to the first merging rule and the second merging rule, a plurality of pieces of character information after merging may be on the same line and may be displayed overlapping due to overlapping display timings. When the combined character information is displayed in an overlapping manner (S203: Yes), a first correction process (S204) is performed.

9 to 11 are diagrams for explaining the first correction process of the lyric information conversion process of this embodiment shown in FIG. 6, and show various forms of the first correction process. A to J of FIGS. 9 to 11 are diagrams for explaining each form, and the suffix "1" of each form A to J indicates before correction, and the suffix "2" indicates after correction. Further, the character information A to D are character information after performing the combining process, and indicate that they are sung in alphabetical order (A→B→C→D).

FIG. 9(A1) shows the state after the combining process has been performed. In this form, in the new second line (new line number 2), the end portion of the character information A and the beginning portion of the character information B Duplication is seen in Note that the new first line (new line number 1) is empty. In such a case, in the first correction process (S204), as shown in FIG. 9A2, correction is performed to move the character information B to a new empty first line to eliminate the duplication. there is

In FIG. 9(B1), the end portion of the character information B and the beginning portion of the character information C are overlapped in the new second line. In this case, the new first line (new line number 1) is not empty. In such a case, the character information B is moved to the new first line, the end of the character information A, that is, the display end timing of the character information A is brought forward, and the character information B and the character information are moved forward in the new first line. The duplication of C is eliminated. Singing is performed in the order of character information A, character information B, and character information C. Character information A and character information C are interposed between character information A and character information C. There will be time to sing. Therefore, as shown in FIG. 9B2, even if the display end timing of the character information A is moved forward, there is little possibility that a problem will occur.

In FIG. 9(C1), the end portion of the character information A and the beginning portion of the character information C are duplicated in the new second line. Since the character information A and the character information C have the character information B sandwiched between them, there is time between the character information A and the character information C being sung. Also, on the new first line, the character information B that is sung prior to the character information C is displayed. Therefore, in this case, as shown in FIG. 9C2, the display start timing of the character information C is postponed to eliminate the overlap between the character information A and the character information C. FIG.

In FIG. 9(D1), the end portion of the character information A and the beginning portion of the character information C overlap in the new first line. Also, in the new second line, the end portion of the character information B and the beginning portion of the character information D overlap. The character information B is sung during the period from when the character information A is sung until when the character information C is sung. Therefore, as shown in FIG. 9(D2), the display end timing of the character information A is brought forward to eliminate overlap with the character information C. FIG. Also, the character information C is sung during the period from when the character information B is sung until when the character information D is sung. Therefore, the display start timing of the character information D is postponed to eliminate overlap with the character information B. FIG.

FIG. 10(E1) shows a case where the character information B and the character information C overlap in the new second line. In this case, since the character information B is sung immediately after the character information A is sung, it is not preferable to move the display end position of the character information A and the display start position of the character information B. Here, since character information C is to be sung after character information B, character information C is moved to a new first line as shown in FIG. turn backwards. By correcting in this way, it is possible to sing appropriately in the order of the character information A, the character information B, and the character information C.

In FIG. 10(F1), the end portion of the character information A and the beginning portion of the character information C overlap in the new second line. In addition, character information B to be sung after character information A is displayed on the new first line. In this case, it is expected that there will be little trouble even if the character information A is erased early. Therefore, as shown in FIG. Duplication of information C is to be eliminated.

In FIG. 10 (G1), the end portion of the character information B and the beginning portion of the character information C overlap in the new first line. Note that character information A to be sung before character information B is displayed on the new second line. In this case, it is expected that there will be little trouble even if the character information A is quickly erased. Therefore, as shown in FIG. The overlap between the character information A and the character information C is eliminated by advancing the display end timing of the information A. FIG.

In FIG. 10(H1), the end portion of the character information B and the beginning portion of the character information C overlap in the new first line. Also, in the new second line, the end portion of the character information A and the beginning portion of the character information D overlap. In the new first line, character information C is sung immediately after character information B is sung. Therefore, if the display end timing of the character information B is advanced or the display start timing of the character information C is postponed, it is conceivable that there will be troubles in singing. In this form, as shown in FIG. 10(H2), after the display lines of the character information C and the character information D are exchanged, the display end timing of the character information A is brought forward, and the display start timing of the character information D is moved forward. We are planning to eliminate duplication by postponing.

In FIG. 11 (I1), the end portion of the character information B and the beginning portion of the character information D overlap in the new first line. Also, in the new second line, the end portion of the character information A and the beginning portion of the character information C overlap. In the new second line, the time from when the character information A is sung until the character information C is sung, and in the new first line, the time from when the character information B is sung to when the character information D is sung will be vacant. Therefore, in this form, it is possible to correct the display start timing and the display end timing without replacing the rows. As shown in FIG. 11 (I2), the display start timing of the character information D is postponed to eliminate overlap with the character information B. As shown in FIG. In addition, with respect to the character information A, overlap with the character information C is eliminated by bringing forward the display end timing thereof.

In FIG. 11(J1), the end portion of the character information A and the beginning portion of the character information D overlap in the new first line. Also, in the new second line, the end portion of the character information B and the beginning portion of the character information C overlap. In the new second line, character information C is sung immediately after character information B is sung. Therefore, if the display end timing of the character information B is advanced or the display start timing of the character information C is postponed, it is conceivable that there will be troubles in singing. In this form, as shown in FIG. 11 (J2), after the display lines of the character information C and the character information D are exchanged, the display end timing of the character information A is brought forward, and the display start timing of the character information D is moved forward. We plan to eliminate duplication by postponing.

The first correction process (S204) executed when duplication occurs in the same line after merging has been described above. By executing the first correction process (S204) in FIG. If the timing is advanced or the display start timing is delayed, the color change timing of the character information will not be in time. In spite of this, a situation may arise in which character information is not displayed.

In the lyric information conversion process (S200) of the present embodiment shown in FIG. 6, such a possibility is taken into consideration, and if there is a part where the color change timing is not in time after the first correction process (S204) (S205: Yes), the second correction process (S206) is to be executed.

FIG. 12 is a diagram for explaining the second correction process (S206) of the lyric information conversion process (S200) of this embodiment, and shows various forms of the second correction process. FIGS. 12A and 12B are diagrams for explaining each form. The suffix "1" of each form A to J is before correction by the first correction process (S204), and the suffix "2" is the first correction process. After correction by (S204), the suffix "3" indicates the state after correction by the second correction process (S206). Further, the character information A to D are character information after performing the combining process, and indicate that they are sung in alphabetical order (A→B→C→D).

In FIG. 12(A1), the end portion of the character information B and the beginning portion of the character information D overlap in the new second line. In this case, in the first correction process (S204), it is expected that there will be little trouble even if the character information D is displayed late. The duplication of the character information B and the character information D is eliminated by postponing. Here, Dt1 shown in FIGS. 12A1 to 12A3 is the color change start timing for the character information D. FIG. As shown in FIG. 12 (A2), by executing the first correction process (S204), when the color change start timing Dt1 for the character information D is not in time, that is, when the character information D is displayed, , the color change for the character information D has already started.

Therefore, in the second correction process (S206), as shown in FIG. By delaying the display end timing of , the situation where the color change of the character information D is not started in time is resolved. The correction in the second correction process (S206) can be performed within an appropriate range if it is before the color change start timing Dt1 of the character information D and after the color change end timing of the character information B. It is possible.

In FIG. 12B1, the end portion of the character information A and the beginning portion of the character information C overlap in the new first line. In this case, in the first correction process (S204), it is expected that there will be little trouble even if the character information A is erased early. The overlap between the character information A and the character information C is eliminated by moving forward. Here, Dt2 shown in FIGS. 12B1 to 12B3 is the color change end timing for the character information A. FIG. As shown in FIG. 12 (A2), by executing the first correction process (S204), the character information A is erased before the color change end timing for the character information A, and thus the song is suitable for singing. It is conceivable that a hindrance may occur.

Therefore, in the second correction process (S206), as shown in FIG. 12B3, the display end timing of the character information A is postponed so as to meet the color change end timing Dt2 of the character information A. Then, in order to avoid duplication of the character information A and the character information C, the display start timing of the character information C is postponed. Therefore, the situation in which the character information A is erased before the color change of the character information A is completed, which occurred in the first correction process (S204), is resolved. The correction in the second correction process (S206) can be performed within an appropriate range after the color change end timing At of the character information A and before the color change start timing of the character information C. It is possible.

Various forms of the second correction process (S206) of FIG. 6 have been described above. It is possible to solve the situation where the character information is not displayed or the character information is erased before the end timing of changing the color of the lyrics.

In the lyric information conversion process (S200) of FIG. 6, after executing the processes of S203 to S206, it is verified whether or not the converted lyric information has an unnatural arrangement (S207). FIG. 13A1 is a diagram for explaining an unnatural arrangement that occurs during conversion. FIG. 13A1 is an example showing the display progress of lyric information based on new line information for the lyric information for which the processes of S201 to S206 have been executed in the lyric information conversion process (S200). For example, it is conceivable that there will be a period during which the screen does not display any character information after the character information D is displayed until the next character information E is displayed. Such a situation occurs during an interlude, such as between the A melody and the B melody.

In the case of FIG. 13 (A1), after character information D is displayed on a new first line, a period in which singing is not required, such as an interlude, begins. It is conceivable that something is expected to be displayed in the portion indicated by A shown in A). If character information is not displayed despite the user's expectation, the user may be confused. In the present embodiment, such an arrangement of character information is regarded as an unnatural arrangement, and when an unnatural arrangement occurs (S207: Yes), a third correction process (S208) is executed to eliminate this. and

FIG. 13(A2) is an example showing the progress of display after the third correction process (S208) is performed on the lyric information of FIG. 13(A1). In this third correction process (S208), the display positions of the character information A and C and the character information B and D (one section from when the lyrics are not displayed to when the lyrics are not displayed again) are displayed. By exchanging the lines, the character information D displayed before the interlude is positioned on the new second line. Therefore, before the interlude, the character information is displayed on a new second line located below, and the user can confirm that the singing has finished. In this example, the unnatural arrangement of the character information displayed before the interlude has been described, but it is conceivable that the character information displayed immediately before the end of the music may also be similarly unnatural. . Even in such a case, by executing the third correction process (S208), it is possible to arrange lyrics that are easy to sing.

In the third correction process (S208), the rows of one section that are well delimited and can be replaced are replaced. It can also be canceled by canceling the coupling relationship, that is, by not coupling. FIG. 13(A3) shows a different form of solving the unnatural arrangement of FIG. 13(A1) from FIG. 13(A2). In FIG. 13A3, the connection relationship of the character information D that was in the connection relationship is released, and the character information D1 and the character information D2 are displayed on the first and second lines, respectively. By doing so, the character information D2 is displayed on the second line before entering a period in which singing is not required, and it is possible to eliminate the unnatural arrangement. It should be noted that the character information to be disconnected is not the character information located at the end as in this example, but it is possible to cancel the connection of character information appropriately within one section. For example, after combining, the horizontal width of the character information can be suppressed to an appropriate length by canceling (not combining) the combined relationship of the character information having the longest width.

In order to eliminate the unnatural arrangement, either the form of FIG. 13(A2) or the form of FIG. 13(A3) may be adopted. Alternatively, the form of FIG. 13(A2) and the form of FIG. 13(A3) may be used according to predetermined conditions. For example, if one segment is from when the lyrics are displayed to when the lyrics are not displayed on the screen, in that segment, the text information that is displayed first after being combined is the lowest line (in this embodiment, a new second line). line) and the number of character information per section is an even number, the form of FIG. 13 (A2) is adopted. On the other hand, if one segment is from when the lyrics are displayed to when the lyrics are not displayed on the screen, then in this segment, the character information that is displayed first after being combined is the second line from the bottom (in this embodiment, (new first line) and the number of pieces of character information per section is an odd number, it is conceivable to adopt the form of FIG. 13 (A3).

The lyric information conversion processing (S200) of the present embodiment has been described above. It is possible to adapt the lyric information to the environment of the current karaoke apparatus 2, especially the environment in which the monitor 41 is enlarged.

In this embodiment, the lyric information conversion process (S200) is executed before the karaoke device 2 designates (reserves) the song ID of the karaoke information and starts playing the lyric information. S200) can be performed as appropriate, or the execution timing can be appropriately determined. For example, instead of being executed by the karaoke device 2, the server device 5 may execute the conversion and distribute the converted lyric information or the karaoke information including the converted lyric information to the karaoke device 2. good. Alternatively, the lyric information conversion process (S200) may be started in the karaoke device 2 immediately after a song is specified (reserved) by the user.

Further, in this embodiment, the lyric information converted in the lyric information conversion process (S200) is not reused. It may be reused from time to time. In that case, the lyric information conversion process (S200) is not newly executed. Alternatively, the converted lyric information may be transmitted to the server device 5 . It is also possible to collect lyrics information converted by the server device 5 and distribute it to other karaoke devices 2 .

As described above, the karaoke machine 2 has been described as an example in the present embodiment, but the present invention is not limited to the karaoke machine 2. The present invention is also applicable to karaoke programs that can be executed by the server device 5 or various information processing devices. It belongs to the category of invention. Moreover, the karaoke device 2 may be not only a device dedicated to karaoke but also various information devices such as a PC, a game machine, and a smart phone. In that case, a karaoke program that can be executed by these information devices also belongs to the scope of the present invention.

1: remote control device 25: sound control section 2: karaoke device 27: memory 5: server device 28: video RAM
11: Touch panel monitor 29: Video reproduction unit 11a: Display unit 30: Control unit 11b: Touch panel 31: Video control unit 12: Video RAM 32: HDD
13: Video control unit 33: Touch panel monitor 14: Memory 33a: Display unit 15: Control unit 33b: Touch panel 16: Wireless LAN communication unit 41: Monitor 17: Operation unit 41a: Piano roll 18: Operation processing unit 41b to 41d: Technique Information 21: Operation unit 42: Speaker 22: Operation processing unit 44a, 44b: Singing microphone 24: LAN communication unit

Claims (11)

Equipped with a control unit that performs playback based on karaoke information,
The karaoke information includes accompaniment information and lyric information,
The lyric information is lyric information created for the environment of a conventional karaoke device, and is configured including a plurality of line information,
The line information includes character information and accompanying information including a display position that defines a display line where the character information is displayed,
The control unit can execute accompaniment playback processing and combined display processing,
The accompaniment reproduction process reproduces the accompaniment information of the specified karaoke information,
The combined display process combines character information displayed on different adjacent display lines into one at a certain timing before combining , and displays the combined character information at a display position that defines a new display line Karaoke device . In the combining display process, when combining character information to be combined, among the character information displayed on different display lines adjacent to the character information to be combined, the character information displayed on the display line with a short width is combined. The karaoke device according to claim 1. The accompanying information includes the display position of the character information, the display start timing, and the display end timing,
3. The karaoke machine according to claim 1, wherein the combined display processing changes at least one of the display position, display start timing, and display end timing defined in the accompanying information. 4. The combined display process displays the combined character information at the same timing as the display start timing included in the accompanying information, or ends the display at the same timing as the display end timing included in the accompanying information. karaoke device. In the combined display processing, the combined character information is displayed at a timing different from the display start timing specified in the accompanying information, or the display is finished at a timing different from the display end timing. The karaoke device described in 1. 6. The karaoke machine according to any one of claims 1 to 5, wherein the combined display processing adjusts the display line so that the character information to be displayed is positioned at the bottom before a screen in which the character information is not displayed. 7. The display line according to claim 6, wherein the combined display process replaces the display line in which the character information is displayed so that the displayed character information becomes the lowest display line before the screen does not display the character information. karaoke equipment. 7. The karaoke machine according to claim 6, wherein the combined display processing does not combine the character information so that the displayed character information is positioned at the bottom of the display line before a screen in which the character information is not displayed. The control unit can switch between combined display processing and normal display processing, and
The normal display process displays character information on the display line specified by the accompanying information,
9. The karaoke machine according to any one of claims 1 to 8, wherein the combined display process displays the character information in a size smaller than the character size displayed in the normal display process. A karaoke program executed by an information processing device that reproduces based on karaoke information,
The karaoke information includes accompaniment information and lyric information,
The lyric information is lyric information created for the environment of a conventional karaoke device, and is configured including a plurality of line information,
The line information includes character information and accompanying information including a display position that defines a display line where the character information is displayed,
Accompaniment playback processing and combined display processing can be executed,
The accompaniment reproduction process reproduces the accompaniment information of the specified karaoke information,
The combined display process combines character information displayed on different adjacent display lines into one at a certain timing before combining , and displays the combined character information at a display position that defines a new display line. program. A lyric information conversion program executed by an information processing device,
The lyric information is lyric information created for the environment of a conventional karaoke device, and is configured including a plurality of line information,
The line information includes character information and accompanying information including a display position that defines a display line where the character information is displayed,
At a certain timing before combining, it is possible to combine character information displayed on different adjacent display lines into one, and to execute a combining process of assigning a display position defining a new display line to the combined character information. Information conversion program.

Images