JP6691684B2 - Karaoke device and karaoke control program - Google Patents

Description

  The present invention relates to a karaoke device capable of easily displaying the correspondence between a lyrics telop and a piano roll.

  Conventionally, there is a karaoke device which displays a lyrics telop of a music piece and a piano roll representing a melody to be sung. In the karaoke apparatus described in Patent Document 1, in order to clarify the correspondence between the lyrics telop and the piano roll, each character of the lyrics telop is displayed in an overlapping manner on the display area of the piano roll. Also, in a general karaoke device, the lyrics telop and the piano roll are displayed in different areas, and the correspondence between the lyrics telop and the piano roll is the singing timing in the lyrics telop and the singing timing in the piano roll. It is represented by changing the color.

JP 2001-318683 A

  However, if the lyrics telop and the piano roll are displayed in different areas and the color change indicates the singing timing at which the song should be sung, the user visually follows the color change displayed in each area. There is a need. Furthermore, in order to continue singing correctly, the user must successively predict the correspondence between the lyrics telop before the color change and the pitch represented by the piano roll before the color change. In addition, the displayed piano roll may not represent one pitch for each character of the lyrics telop, but may represent a plurality of different pitches for each character. In this case, the utterance period from the beginning to the end of the utterance of one character of the lyrics telop does not match the pronunciation period from the change of multiple pitches represented by the piano roll to the next change, so the singing It is difficult for a person to continue singing once they make a mistake in the prediction.

  The present invention has been made to solve the above-mentioned problems, and even if a character image of lyrics and a pitch image are displayed in different areas, one character of the lyrics and at least one pitch are displayed. It is an object of the present invention to provide a karaoke device capable of easily displaying the correspondence.

  In order to achieve this object, the karaoke apparatus according to claim 1 stores a plurality of pieces of lyrics information indicating the lyrics of a song and pitch information indicating the pitch of a song to be sung in association with each song. Storage means, character image generating means for generating a character image representing lyrics characters according to the lyrics information, and pitch image generating a pitch image indicating a pitch to be sung and a vocalization period according to the pitch information. Generating means and correspondence determining means for determining the correspondence between one character of the lyrics and at least one pitch according to the time information that is included in the lyrics information and the pitch information and that represents the time of utterance; On the display screen of the display means, the display area determining means for determining the pitch display area for displaying the pitch image and the character display area for displaying the character image, and the display area determining means for determining Display control means for respectively displaying the character image and the pitch image in the displayed character display area and the pitch display area, and the pitch image includes a pitch figure representing each pitch. Each pitch figure of a plurality of pitch figures represents a pitch of a pitch by a display position in a predetermined direction in the pitch display area, and a vocalization period of the pitch by a length in a direction orthogonal to the predetermined direction. The pitch image generating means displays at least the color or shape of the pitch figure representing the pitch corresponding to one character of the lyrics in at least the character display area according to the correspondence determined by the correspondence determining means. It is determined to be different for each character of the lyrics to be performed, and the pitch image including the pitch figure of the determined color or shape is generated.

  The pitch image generating means according to claim 2, wherein when the correspondence determining means determines the correspondence relationship between one character of the lyrics and a plurality of pitches, a plurality of pitches respectively representing a plurality of pitches corresponding to one character of the lyrics. The color of the pitch figure is determined to be the same color, and the pitch image including the plurality of pitch figures is generated.

  4. The character image generation means according to claim 3, wherein the color of the character image representing one character of the lyrics corresponding to the pitch for which the color of the pitch figure is determined by the pitch image generation means is determined by the determined sound. It is characterized in that it is determined with the same color as the color of the high figure and the character image is generated.

  The pitch image generating means according to claim 4, wherein when the correspondence determining means determines a correspondence relationship between one character of the lyrics and a plurality of pitches, a plurality of pitches respectively representing a plurality of pitches corresponding to one character of the lyrics. Of the pitch figure are mutually connected by a connecting figure, and the pitch image including the plurality of pitch figures is generated.

  The karaoke control program according to claim 5, wherein the karaoke device includes a storage unit that stores a plurality of pieces of lyrics information indicating the lyrics of the song and pitch information indicating the pitch of the song to be sung in association with each other. And a pitch image for generating a pitch image representing a pitch to be sung and a vocalization period according to the pitch information. A generation step, and a correspondence determination step of determining a correspondence relationship between one character of the lyrics and at least one pitch according to the time information that is included in the lyrics information and the pitch information and represents the vocalization point, respectively. On the display screen of the display means, a display area determination unit that determines a pitch display area for displaying the pitch image and a character display area for displaying the character image, respectively. And a display control step of displaying the character image and the pitch image in the character display area and the pitch display area determined by the display area determining means, respectively. Includes a plurality of pitch figures representing each pitch, and each pitch figure of the plurality of pitch figures represents the pitch of the pitch by the display position of the pitch display area in a predetermined direction, and is orthogonal to the predetermined direction. The length of the pitch direction indicates the vocalization period of the sound, and the pitch image generating step represents the color of the pitch graphic representing the pitch corresponding to one character of the lyrics in accordance with the correspondence determined by the correspondence determining. Alternatively, the shape is determined to be different at least for each character of the lyrics displayed in the character display area, and the pitch image including the pitch figure of the determined color or shape is generated. That.

  According to the karaoke apparatus and the karaoke control program of claims 1 and 5, the pitch image generating means or the pitch image generating step includes one of the lyrics in accordance with the correspondence relationship determined by the correspondence determining means or the correspondence determining step. The color or shape of the pitch figure representing the pitch corresponding to the character is determined so as to be different at least for each character of the lyrics displayed in the character display area, and the sound including the pitch figure of the determined color or shape is determined. Produces high video. As a result, the pitch represented by the pitch figure and the vocalization period are displayed separately for each character of the lyrics by color or shape, and one character of the lyrics represented by the lyrics telop and at least one of the characters represented by the pitch figure are displayed. The correspondence with the pitch becomes easy for the user to understand.

  According to the karaoke apparatus of claim 2, when the correspondence determining means determines the correspondence between one character of the lyrics and a plurality of pitches, the pitch image generating means causes the plurality of sounds corresponding to one character of the lyrics. The colors of a plurality of pitch figures respectively representing pitches are determined to be the same color, and a pitch image including the plurality of pitch figures is generated. As a result, it becomes easy for the user to understand that a plurality of pitches are produced during the period in which one character of the lyrics is produced.

  According to the karaoke apparatus of claim 3, the character image generating means determines the color of the character image representing one character of the lyrics corresponding to the pitch for which the color of the pitch figure is determined by the pitch image generating means. A character image is generated by determining the same color as that of the generated pitch figure. This makes it easier for the user to understand which character of the lyrics is spoken at which pitch.

  According to the karaoke apparatus of claim 4, when the correspondence determining means determines the correspondence between one character of the lyrics and a plurality of pitches, the pitch image generating means causes the plurality of sounds corresponding to one character of the lyrics. A plurality of pitch figures representing pitches are connected to each other by connecting figures, and a pitch image including the plurality of pitch figures is generated. As a result, it becomes easy for the user to understand that a plurality of pitches are produced during the period in which one character of the lyrics is produced.

It is a block diagram showing the karaoke apparatus which concerns on one Embodiment of this invention. It is a flow chart showing display generation processing performed by a control part of a karaoke device. 6 is a first display example of a lyrics telop and a piano roll generated by the processing of the control unit in the present embodiment. 7 is a second display example of a lyrics telop and a piano roll generated by the processing of the control unit in the present embodiment. It is a 3rd example of a display of a lyrics telop and a piano roll produced by processing of a control part in this embodiment. It is a display example of a lyrics telop and a piano roll generated by the processing of the control unit in the first modified example.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[1. Configuration of karaoke device]
The karaoke apparatus of this embodiment will be described with reference to FIG. FIG. 1 shows a karaoke device. The karaoke device has a music reproducing device 1 and a remote control device 2 communicably associated with the music reproducing device 1.

  The music reproducing device 1 includes a control unit 10 that executes a process for providing karaoke including a display generation process described below. The control unit 10 is connected to the memory 20, the storage unit 30, the operation processing unit 41, the video control unit 51, and the sound control unit 61. The memory 20 has a ROM having a storage area for storing a program and a RAM having a storage area for temporarily storing information. The storage unit 30 stores a plurality of pieces of music information representing the sound of the music played in the karaoke device, pitch information representing the pitch to be sung, and lyrics information representing the lyrics of the music in association with each other. Further, the storage unit 30 stores video information representing a video including a background video to be displayed on the monitor 52 and a graphic user interface (hereinafter, referred to as GUI). The pitch information is composed of reference pitch information that represents the pitch to be sung by the music, and vocalization time of the pitch based on the performance start time of the musical composition, color change time, and vocalization time information that represents the vocalization period. This is the associated information. The lyrics information is information in which character information representing the lyrics is associated with lyrics time information representing the lyrics display time point and the color change time point based on the performance start time of the music. The vocalization time information and the lyrics time information are determined based on the cumulative time from the start of playing the music.

  The operation processing unit 41 is connected to the operation unit 42 for performing various operations on the music reproducing device 1. The operation unit 42 includes an operation knob arranged on the exterior panel of the music reproducing device 1 and a touch panel. When the user operates the operation unit 42, the content of the operation is sent to the operation processing unit 41. The operation processing unit 41 receives the content of the operation performed by the user, and sends an electric signal indicating the content of the operation to the control unit 10.

  The video control unit 51 is connected to the monitor 52 for displaying the video output by the music reproducing device 1. The monitor 52 displays an image sent from the image control unit 51 according to an instruction from the control unit 10. As an example, the monitor 52 is a liquid crystal panel and displays the lyrics telop, the piano roll, the background image, and the GUI output by the video control unit 51 to the monitor 52.

  3 to 5 show display examples displayed in the display area 520 of the monitor 52. 3 to 5 show first to third display examples at a certain point in time during music reproduction. The display area 520 is divided into a lyrics display area 521 and a piano roll display area 522 according to an instruction from the control unit 10. In the lyrics display area 521, a character image 523 representing lyrics is displayed. After the singing time, the color of the character image 523 is changed according to the color changing time included in the lyrics time information. The character image 523 whose color has been changed is the character image 523A.

  In the piano roll display area 522, a pitch axis F, a time axis T, a piano block 524 and a timing bar 525 are displayed. The pitch axis F defines the pitch of the pitch represented by the piano block 524, with the vertical direction being positive. The time axis T defines the vocalization start time and the vocalization end time represented by the piano block 524 by the time points determined by the elapsed time from the performance start time of the music with the right side in the horizontal direction as positive. The time axis T in the piano roll display area 522 is updated to a new time axis T when the display in the piano roll display area 522 is updated. The piano block 524 is displayed at a display position determined on the coordinate system of the pitch axis F and the time axis T according to the pitch information, so that the pitch to be uttered, the utterance start time, and the utterance end time are indicated. Represents. Further, after the singing time, the color of the piano block 524 is changed according to the color changing time included in the vocalization time information. The color-changed piano block 524 is a piano block 524A. Further, the timing bar 525 indicating the current time point on the time axis T moves from left to right in the piano roll display area 522 as time passes.

  The sound control unit 61 is connected to the singing microphone 62 and the speaker 63. The singing microphone 62 has a built-in analog-digital converter. The converter converts the sound input to the singing microphone 62 into digital information. The singing voice information which is the converted digital information is sent to the sound control unit 61. The sound control unit 61 synthesizes the singing voice information and the music information and sends them to the speaker 63. The speaker 63 generates a sound according to the sent information.

  The communication unit 71 is a wireless communication module that has a wireless communication function that complies with the well-known wireless LAN communication standard, and that enables the remote control device 2 (described later) and the music playback device 1 to communicate with each other. As an example, the communication unit 71 is configured by Wi-Fi (registered trademark), Bluetooth (registered trademark), a module for infrared communication, or the like. Further, the router 3 is provided so as to be communicable with the communication unit 71, and the music reproducing device 1 can be connected to the network 4 via the router 3.

  The remote control device 2 is a remote control device of the music reproducing device 1, and includes a karaoke navigation which is a karaoke dedicated terminal, a smartphone in which a remote control application is installed and which can be used as a remote control device, and a remote control device for karaoke. The karaoke device of the present embodiment includes any one or a plurality of these remote control devices 2. The remote control device 2 accepts a user operation and sends the content of the operation to the music reproducing device 1.

[2. Display generation processing]
The display generation processing according to this embodiment will be described with reference to FIG. The display generation process shown in FIG. 2 is executed by the control unit 10. The display generation process is executed before the reproduction of the music is started when the lyrics are designated to be displayed.

  In step S11, pitch information and lyrics information are acquired. Specifically, the pitch information and the lyrics information of the reproduced music are read from the storage unit 30. The read pitch information and lyrics information are stored in the memory 20. When the pitch information and the lyrics information are read out, the process proceeds to step S12.

  In step S12, the correspondence between the pitch information and the lyrics information is determined. Specifically, the vocalization time information included in the pitch information and the lyrics time information included in the lyrics information are compared. At this time, as an example, a pitch including the utterance start time of the pitch represented by the utterance time information is determined within a period from the color change start time of one character of the lyrics represented by the lyrics time information to the color change end time. .. As a result, the correspondence between the determined pitch and one character of the lyrics is stored in the memory 20. When the pitch corresponding to one character of the lyrics is determined, the process proceeds to step S13.

  In step S13, the shape of the piano block 524 is determined. Specifically, the shape of the piano block 524 is determined to be a rounded rectangle, a hexagon, or a rectangle, the shapes of which are shown in FIGS. 3 to 5 as an example. These shapes are determined according to display settings arbitrarily set by the user for each song. Further, in the case of being set at random, the shape is determined by the control unit 10 for each music. When the shape of the piano block 524 is determined according to the display setting, the process proceeds to step S14.

  In step S14, a piano block is generated. Specifically, the piano block 524 is determined and stored in the memory 20 in accordance with the correspondence between the one character of the lyrics and the pitch determined in step S12 and the shape of the piano block 425 determined in step S13. It In the present embodiment, a case where the shape of the piano block 524 is determined to be a rounded rectangle in step S13 will be described. The determination of the shape of the rounded rectangle will be described with reference to FIG.

  The piano block 524 displayed in the piano roll display area 522 shown in FIG. 3 includes a rounded rectangular piano block 524B, a left-sided piano block 524C obtained by dividing the rounded rectangular shape into left and right, and a rounded rectangular shape. It includes a right-sided piano block 524D divided into left and right and a rectangular piano block 524E. When it is determined in step S12 that the pitch corresponding to one character of the lyrics is one, the piano block 524B is determined. When it is determined in step S12 that the pitch corresponding to one character of the lyrics is two, the piano block 524C and the piano block 524D are determined. At this time, of the two pitches corresponding to one character of the lyrics, the shape is determined in order from the pitch at which the sounding start time comes first. First, the shape of the first pitch is determined by the piano block 524C, and the shape of the second pitch is determined by the piano block 524D. When it is determined in step S12 that the pitch corresponding to one character of the lyrics is three, the piano block 524C, the piano block 524D, and the piano block 524E are determined. At this time, of the three pitches corresponding to one character of the lyrics, the shape of the first pitch is determined by the piano block 524C in order from the pitch at which the pronunciation start time comes first, and the shape of the second pitch is determined. The pitch shape is determined by the piano block 524E, and the third pitch shape is determined by the piano block 524D. When it is determined in step S12 that the pitch corresponding to one character of the lyrics is three or more, the shape of the pitch that the sounding start time comes first is determined by the piano block 524C, and the sounding start time is the last. The shape of the incoming pitch is determined by the piano block 524D, and the shape of the remaining pitch is determined by the piano block 524E.

  Regarding the piano block 524 whose shape has been determined, the length in the horizontal direction is determined according to the time represented by the time axis T of the piano roll display area 522. As an example, when the period from the left end to the right end of the time axis T represents a period of 16 seconds from a predetermined time point, the length of the piano block 524 indicating that the vocalization is for 1 second is 16 in the piano roll display area 522. It is represented by a fraction of a length. The display position of the piano block 524 is determined in step S17 described below. When the length of each piano block 524 is determined, it is stored in the memory 20, and the process proceeds to step S15.

  In step S15, a character image is generated. Specifically, the character image 523 is generated according to the lyrics telop display size information and font information arbitrarily set by the user, and the lyrics information. As an example, the shape of the character image 523 shown in FIG. 3 is determined by the font information and the character information included in the lyrics information. For the lyrics image 523 whose shape has been determined, the size of the characters displayed in the lyrics display area 521 is determined according to the display size. The determined character image 523 is stored in the memory 20. When the character image is generated, the process proceeds to step S16.

  In step S16, it is determined whether or not the piano block in the treatment section and the generation of the character image are completed. Specifically, it is determined whether or not a piano block that can be displayed at one time has been generated in the piano roll display area 522. As an example, when the period from the left end to the right end of the time axis T represents a period of 16 seconds from a predetermined time point, it is determined whether the generation of the piano block 524 for 16 seconds is completed. If it is determined that the process is completed, the process of step S16 becomes YES and the process proceeds to step S17. If it is determined that the process is not completed, the process of step S16 becomes NO and the process proceeds to step S12.

  In step S17, the display position is determined. Regarding the piano block 524, the vertical display position in the piano roll display area 522 is determined according to the reference pitch information and the pitch axis F, and the horizontal direction in the piano roll display area 522 is determined according to the time information and the time axis T. The display position of is determined. Specifically, the display position is determined at the pitch position defined by the pitch axis F according to the reference pitch information indicating the pitch corresponding to each piano block 524. Furthermore, the display position is determined at a position where the utterance start time represented by the time information corresponding to each piano block 524 and the time defined by the time axis T match. When the display position of the piano block 524 is determined, the display position of the character image 523 is determined.

  The display position of the character image 523 is determined in the character image display area 521 according to the time information. As an example, the lyrics information includes information on the lyrics for each phrase, and the display position of the character image 523 is determined according to the time information and the phrases for each phrase. In other words, the display order and position are determined according to the time information and the division for each phrase. Further, depending on the width of the lyrics display area 521 and the size of the character image 523, the character image 523 is displayed in a plurality of stages. In FIG. 3, the character image 523 is displayed in order from the lyrics which the display time included in the lyrics time information comes first, at intervals so that the characters do not overlap from left to right, and the columns are changed for each phrase. The display position of the character image 523 is determined so that it is displayed.

  When the display positions of the character image 523 and the piano block 524 are determined, the process proceeds to step S18.

  In step S18, the display color and pattern are determined. Specifically, the colors for displaying the character image 523 and the piano block 524 are determined. As an example, the fill color and pattern are determined, as shown in FIG. As a result, the correspondence between one character of the lyrics and the pitch becomes clear. At this time, at least the displayed character image 523 and the adjacent character image 523 are determined so that their colors and patterns are not the same color and the same pattern. In addition, the color and pattern determined in step S18 are determined with colors and patterns different from those of the color-changed piano block 524A. As an example, in FIG. 5, a diagonal pattern 526A, a plain pattern 526B, and a lattice pattern 526C are sequentially determined for each character of the lyrics. As a result, a different pattern is determined for each adjacent character of the lyrics, so that the correspondence becomes clear. That is, the three colors and patterns are determined so that the piano block 524 and the character image 523 are displayed with the three colors and patterns except at least the color after the color change. When the color and pattern are determined, they are stored in the memory 20, and the process proceeds to step S19.

  In step S19, it is determined whether or not the generation of the piano blocks and the character images in all the sections is completed. The entire section is a section from the start of the performance of one music piece to the end of the performance and the end of the display of the character image. If all the sections have not ended, the process of step S19 becomes NO and the process proceeds to step S12. When all the sections have ended, the process of step S19 becomes YES and the display generation process ends.

  The display process is started when the display generation process is completed and the preparation for reproducing the music is completed. The display process is executed by the control unit 10.

  In step S20, the music information is sent to the sound control unit 61 and the reproduction of the music is started. When the reproduction of the music is started, the accumulated time from the start of the reproduction of the music is acquired. In accordance with the acquired accumulated time, the information of the character image 523 and the piano block 524 generated by the display generating process is read from the memory 20 in step S21. The read information of the character image 523 and the piano block 524 is sent to the image control unit 51 and displayed in a predetermined area of the monitor 52. The predetermined area is a display area determined by the display generation processing. Further, in step S21, the colors of the displayed character image 523 and the piano block 524 are changed according to the color change time points included in the vocalization time information and the lyrics time information.

  In step S22, it is determined whether or not the reproduction of the music has ended. Specifically, the performance end time included in the music information is compared with the acquired cumulative time. When it is determined that the playing end time and the cumulative time match, or if the cumulative time exceeds the playing end time, it is determined that the reproduction of the music has ended, and the display processing ends. If it is determined that the cumulative time has not reached the performance end time, the process proceeds to step S20.

[First Modification]
In the display generation processing of this embodiment, the piano block 524 has clarified the correspondence between one character of the lyrics and the pitch by the color and the pattern. However, in the first modification, a case will be described in which the correspondence between one character of the lyrics and the pitch is clarified by connecting the piano blocks 524. The first modification will be described with reference to FIG. In the process of determining the color and the pattern in step S18, a plurality of pitches corresponding to one lyrics character are combined. As shown in FIG. 6, a piano block 524F in which a plurality of piano blocks are combined is generated.

  The piano block 524C and the piano block 524D generated in step S14 are combined in step S18 to generate a piano block 524F. As an example, in FIG. 6, the right end representing the sounding end time of the piano block 524C and the left end representing the sounding start time of the piano block 524D are connected. At the right end of the piano block 524C, a line is drawn from the vertex farther from the piano block 524D to a near side above or below the piano block 524D. At this time, the angle formed by the pitch axis F and the line may be about 5 degrees. Similarly, at the left end of the piano block 524D, a line is extended from the vertex farther from the piano block 524C to a near side above or below the piano block 524C. At this time, the angle formed by the pitch axis F and the line may be about 5 degrees. Since the pitch to be actually sung is the pitch indicated by the piano block 524C and the piano block 524D, if the angle is too large, the user may misunderstand that the sound changes smoothly. Therefore, the angle formed by the pitch axis F and the line is set to about 5 degrees, but may be changed as appropriate within a range that does not cause misunderstanding by the user. The line may be a line other than a straight line, and may be a curved line, a wavy line, a broken line, or the like. Further, the piano block 524C, the area surrounded by the piano block 524D and two straight lines, the piano block 524C, and the piano block 524D may be determined with the same color.

  The case where the two piano blocks 524C and 524D are combined has been described as an example, but when there are a plurality of pitch figures to be combined, the same processing may be performed on the plurality of pitch figures. As an example, the piano block 524G shown in FIG. 6 will be described. The right end of the piano block 524C and the left end of the piano block 524E are connected by the above method, and the right end of the piano block 524E and the left end of the piano block 524D are connected by the above method, and the piano block 524G is generated. It Regarding the combination of the piano blocks 524, the case of a rectangle has been described as an example, but other shapes such as a rounded rectangle and a hexagon may be applied.

[Second Modification]
In the display generation processing of the present embodiment, in step S16, it is determined whether or not a piano block that can be displayed at once in the piano roll display area 522 has been generated. However, as in step S19, it may be determined whether or not piano blocks for all the sections have been generated. In that case, the processing of steps S17 and S18 is repeatedly executed, and the display content displayed in the piano roll display area 522 is continuously generated. In this way, it is possible to appropriately change the way of dividing the lyrics section in which the process is executed. Further, regarding step S15, step S13, and step S14, there is no problem even if the order of processing is interchanged. Furthermore, step S15, step S13, and step S14 may be simultaneously executed by multitask control. In this way, the order of processing can be changed appropriately.

[Third Modification]
In the present embodiment, the display process is executed after the display generation process is completed. However, the display process may be started when the information of the display content for the predetermined section is generated by the display generation process. In that case, as an example, when it is determined to be YES for the first time in step S16, the display process is started. When the display process is started, the display process and the display generation process are executed in parallel, so that the display process can be started without causing the user who is the user to wait.

[Fourth Modification]
The “one character of lyrics” described in the present embodiment may be one character of lyrics including kanji or one character of phonetic furigana expressed only in hiragana. In the case of a single hiragana hiragana character, the correspondence between pronunciation and the pitch at the time of pronunciation is clearer than in the case of kanji. Therefore, the display can be more easily understood.

  Furthermore, when the phonetic alphabet is displayed in Roman letters instead of in Hiragana, the correspondence is not determined for each character of the alphabet, but one or more alphabets that represent one Hiragana character when replaced with Hiragana are treated as one character. The display generation process and the display process must be executed. Specifically, when the phonetic alphabet in the Roman alphabet is “TSU”, it is expressed as “tsu” when it is replaced with hiragana. In this case, the alphabet is three characters "T, S, U", but the process of step S12 is executed as one character of "TSU" in the hiragana. Further, in the case of representing unvoiced sound in which only "S" is pronounced, there is no corresponding pitch in the alphabet representing unvoiced sound, so no pitch is associated in the process of step S12, or there is no pitch. Flags are associated.

[Fifth Modification]
In this embodiment, the shape of the piano block 524 is determined to be a rounded rectangle, a hexagon, or a rectangle in step S13. However, one type of shape may not be selected for one piece of music. As an example, in step S13, the shape is determined for each character in the order of rounded rectangle, hexagon, and rectangle. As a result, the shape of the piano block 524 displayed in the display processing is different from the shape of the adjacent piano block 524, so that the boundaries of the sounds to be pronounced can be displayed more easily. Further, the shape of the piano block may be determined by a flag indicating the type of effect, in accordance with the effect such as the tone of music or the background image.

[Correspondence between this embodiment and claims]
The storage unit 30 is an example of the storage means of the present invention. The control unit 10 that executes the processes of step S15, step S17, and step S18 is an example of the character image generating means of the present invention. The control unit 10 that executes the processes of step S13, step S14, step S17, and step S18 is an example of the pitch image generating means of the present invention. The control unit 10 that executes the process of step S12 is an example of the correspondence determining unit of the present invention. The control unit 10 that executes the process of step S21 is an example of the display area determining unit of the present invention. The control unit 10 that executes the process of step S21 is an example of the display control unit of the present invention. The control unit 10 and the memory 20 are an example of the computer of the present invention. The processing of step S15, step S17, and step S18 is an example of the character image generation step of the present invention. The processing of step S13, step S14, step S17, and step S18 is an example of the pitch image generating step of the present invention. The process of step S12 is an example of the correspondence determining step of the present invention. The process of step S21 is an example of the display area determining step of the present invention. The process of step S21 is an example of the display control step of the present invention. The lyrics information is an example of the lyrics information of the present invention. The pitch information is an example of the pitch information of the present invention. The piano block is an example of the pitch figure of the present invention.

1 music playback device 2 remote control device 3 router 4 network 10 control unit
20 memory
30 storage unit 41 operation processing unit 42 operation unit 51 video control unit 52 monitor 61 sound control unit 62 singing microphone 63 speaker
520 display area
521 Lyrics display area 522 Piano roll display area 523 Character image 524 Piano block 525 Timing bar

Claims (3)

A storage unit that stores a plurality of pieces of lyrics information that represents the lyrics of the song and pitch information that represents the pitch of the song to be sung in association with each other,
A character image generation means for generating a character image representing the characters of the lyrics in accordance with the lyrics information;
Pitch image generating means for generating a pitch image representing a pitch to be sung and a vocalization period according to the pitch information,
Correspondence deciding means for deciding the correspondence between one character of the lyrics and at least one pitch according to the time information which is included in the lyrics information and the pitch information and represents the time of utterance.
Display area determining means for determining a pitch display area for displaying the pitch image and a character display area for displaying the character image on the display screen of the display means,
Display control means for respectively displaying the character image and the pitch image in the character display area and the pitch display area determined by the display area determining means,
Equipped with
The pitch image includes a plurality of pitch figures representing each pitch,
Each pitch figure of the plurality of pitch figures represents the pitch of the sound by the display position in the predetermined direction in the pitch display area, and represents the vocalization period of the sound by the length in the direction orthogonal to the predetermined direction,
The pitch image generation means has the same color or pattern of a plurality of pitch figures respectively representing a plurality of pitches corresponding to one character of the lyrics according to the correspondence relation determined by the correspondence determination means, and at least the pitch graphics. Determining differently for each character of the lyrics displayed in the character display area, and generating the pitch image including the pitch figure of the determined color or pattern ,
The character image generating means determines the color or pattern of the character image representing one character of the lyrics corresponding to the pitch for which the color of the pitch figure is determined by the pitch image generating means, by the determined pitch figure. The karaoke device is characterized in that the character image is determined so as to have the same color or pattern . When the correspondence determining means determines the correspondence between one character of the lyrics and a plurality of pitches,
The pitch image generating means,
It is characterized in that a plurality of the pitch figures respectively representing a plurality of pitches corresponding to one character of the lyrics are connected to each other by a connecting figure, and the pitch image including the plurality of the pitch figures is generated. The karaoke device according to claim 1 . A computer of a karaoke device including a storage unit that stores a plurality of pieces of lyrics information that represents the lyrics of a song and pitch information that represents the pitch at which the song should be sung, in association with each other.
A character image generation step of generating a character image representing the characters of the lyrics according to the lyrics information;
A pitch image generating step of generating a pitch image representing a pitch to be sung and a vocalization period according to the pitch information;
A correspondence determining step of determining a correspondence relationship between one character of the lyrics and at least one pitch according to time information which is included in each of the lyrics information and the pitch information and represents a vocalization point;
A display area determining step of determining a pitch display area for displaying the pitch image and a character display area for displaying the character image on the display screen of the display means;
A display control step of respectively displaying the character image and the pitch image in the character display area and the pitch display area determined by the display area determining step ,
Run
The pitch image includes a plurality of pitch figures representing each pitch,
Each pitch figure of the plurality of pitch figures represents the pitch of the sound by the display position in the predetermined direction in the pitch display area, and represents the vocalization period of the sound by the length in the direction orthogonal to the predetermined direction,
In the pitch image generating step, according to the correspondence determined in the correspondence determining step, colors or patterns of the plurality of pitch figures respectively representing a plurality of pitches corresponding to one character of the lyrics are the same, and at least the pitch graphic is generated. Determining differently for each character of the lyrics displayed in the character display area, and generating the pitch image including the pitch figure of the determined color or pattern ,
In the character image generating step, the color or pattern of the character image representing one character of the lyrics corresponding to the pitch for which the color of the pitch figure is determined in the pitch image generating step is defined by the determined pitch figure. The karaoke control program , wherein the karaoke control program is characterized in that the character image is determined so as to have the same color or pattern .