JP2006189471A - Program, singing ability decision method, and decision system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a program etc., capable of appropriately displaying difference of singing voice and model voice while displaying a previous melody line. <P>SOLUTION: An image generation section 204 generates display image including a music score image, a decision line, and a keyboard image. A symbol display controller 205 arranges a note symbol based on model voice information in the corresponding position of the music note image and scrolls the note symbol in tune with the rhythm of the musical piece to be reproduced toward the decision line, etc. A scale display controller 207 makes the keyboard of the corresponding scale in the keyboard image emit light based on the musical interval of the received singing voice. A singing ability grading section 208 grades the singing ability including the musical interval based on the relationship between the position of the scrolled note symbol and the decision line etc., and the relationship between the arrangement of the note symbol on the music image and the position of the keyboard made to emit light. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a program, a singing ability determination method, and a determination apparatus.

Conventionally, commercial and household karaoke apparatuses have been widely used. A general-purpose personal computer or game device can also function as a karaoke device by executing predetermined karaoke performance software.
The user can enjoy karaoke at a shop or home by using these karaoke devices.

In general, such a karaoke apparatus plays music (karaoke music) including a melody line (melody part) serving as a main melody. Then, the user (singer) sings along the main melody of the music, depending on the melody line to be played (singing the displayed lyrics). In other words, this melody line has a role to guide the user to easily sing music.
Therefore, even when singing songs that are not used to singing or memorable songs, the user can sing the song to the end by singing the lyrics according to the pitch or rhythm of the melody line. it can.

  In addition, there are many types of karaoke devices that can score a user's singing ability. Such a karaoke apparatus performs comparison with model voices (pitch, volume, rhythm, etc.) that should be modeled when a user's singing voice is input along with the performance of karaoke music. And based on this comparison result, a user's singing ability is scored, for example, at the end of a performance, a scoring result is displayed by a numerical value etc.

As an example of this type of karaoke device, there is also disclosed a technology of a karaoke device that can appropriately output and control the singing voice of each user when the singing part is separated for each user (for example, a patent) Reference 1).
JP 2004-240065 A (page 6-11, FIG. 2)

As described above, in a conventional karaoke apparatus, it is common to display a user's singing ability with a numerical value or the like at the end of a song. Therefore, the user or the like cannot evaluate the singing ability while singing.
In other words, during the song, since the comparison result between the user's singing voice and the model voice is not notified at all, whether the voice currently being sung properly matches the model voice or how much it deviates from the model voice. There is a problem that the user cannot judge whether the user is present.

In addition, as described above, a melody line is played in a conventional karaoke apparatus, and the user sings the main melody using this melody line. For this reason, although it is possible to sing music that is not used to singing, some delay has occurred when the user matches (follows) the singing voice to the melody line.
That is, when the previous melody line cannot be grasped in the middle of the song, the user adjusts the pitch of the singing voice while actually listening to the melody line. As a result, the singing voice and the model voice are inevitably shifted (delayed), and the evaluation of the singing ability has been lowered.

  For these reasons, there has been a demand for a technique that can grasp the comparison status between the singing voice and the model voice in the middle of the song, and can grasp the previous melody line.

  The present invention has been made to solve such a problem, a program capable of appropriately displaying the difference between the singing voice and the model voice while displaying the previous melody line, a singing ability determination method, An object of the present invention is to provide a determination device.

  A program according to a first aspect of the present invention includes a computer (including a game device), a music storage unit, an image display unit, an accompaniment playback unit, a symbol display control unit, a voice input reception unit, a scale display control unit, and It is configured to function as a scoring unit.

  First, the music storage unit stores music information including accompaniment information that defines the accompaniment sound of the music and model voice information that defines voice information of the music to be modeled. The image display unit also includes a score area (for example, a score image) for arranging a pitch symbol (for example, a note symbol) representing the pitch of the model voice, and a determination area set in a predetermined area in the score area. An image including (for example, a determination line or a determination zone) and an input area (for example, a keyboard image) in which scale sections partitioned corresponding to the scale of the score area are displayed is displayed. Then, the accompaniment playback unit plays back the music based on the accompaniment information.

  On the other hand, the symbol display control unit arranges the pitch symbol at a corresponding position in the score area based on the model voice information, and scrolls the pitch symbol toward the determination area according to the rhythm of the music to be played. . The voice input reception unit receives input of singing voice sung by the user. The scale display control unit changes the display form of the corresponding scale section in the input area based on the accepted pitch of the singing voice (for example, emits light). The scoring unit is based on the relationship between the position of the scrolled pitch symbol and the determination area, and the relationship between the placement of the pitch symbol on the score area and the scale section where the display form is changed. And singing ability including pitch.

For example, if the pitch symbol has reached the judgment area, and the emitted scale section is equal to the scale of the pitch symbol, the scoring unit makes a positive evaluation because the timing of the utterance matches the pitch of the utterance. . On the other hand, even if the pitch symbol does not reach the determination area, the scoring unit makes a negative evaluation because the pitch of the utterance is shifted when the emitted scale section is different from the scale of the pitch symbol. In addition to this, even if the emitted scale section is equal to the scale of the pitch symbol, if the pitch symbol is before reaching the determination area, etc., the scoring unit is out of utterance timing, Negative evaluation.
In this way, it is possible to easily grasp the comparison situation between the current singing voice that the user is singing and the model voice. In addition, since the melody to be sung is displayed in the score area, it is possible to grasp the melody line in advance.
As a result, the difference between the singing voice and the model voice can be properly displayed while displaying the previous melody line.

The model voice information stored in the music storage unit includes volume information that defines the strength of the model voice,
The symbol display control unit may change the display form of the pitch symbol according to the strength of the model voice based on the volume information.

  The program may further cause the computer to function as an image display control unit that changes the display width in the scale direction of the image displayed on the image display unit based on the arrangement state of the pitch symbols in the score area.

The program includes a history information storage unit for storing history information indicating a pitch history of the received singing voice in association with the model voice information.
Based on the stored history information, a history symbol indicating a singing pitch is synthesized with the pitch symbol arranged by the symbol display control unit, and further functioned as a history symbol synthesis unit arranged in the score area. Also good.

  The program can be recorded on a computer-readable information recording medium such as a compact disk, a flexible disk, a hard disk, a magneto-optical disk, a digital video disk, a magnetic tape, and a semiconductor memory.

  The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed. The information recording medium can be distributed and sold independently of the computer.

  The singing ability determination method according to the second aspect of the present invention uses a music storage unit (stores music information including accompaniment information defining accompaniment sound of music and melody information defining music melody). A singing ability determination method comprising an image display step, an accompaniment reproduction step, a symbol display control step, a voice input reception step, a scale display control step, and a scoring step, and is configured as follows.

  First, in the image display step, a score area for placing a pitch symbol representing the pitch of the model voice, a determination area set as a predetermined area in the score area, and a section corresponding to the scale of the score area An image including an input area in which each musical scale section is arranged is displayed. In the accompaniment reproduction step, the music is reproduced based on the accompaniment information. In the symbol display control step, the pitch symbol is arranged at a corresponding position in the score area based on the model voice information, and is scrolled toward the determination area in accordance with the rhythm of the music to be reproduced.

  On the other hand, in the voice input receiving step, input of singing voice sung by the user is received. In the scale display control step, the display form of the corresponding scale section in the input area is changed based on the pitch of the received singing voice. Then, in the scoring step, based on the relationship between the position of the scrolled pitch symbol and the determination area, and the relationship between the placement of the pitch symbol on the score area and the scale section where the display form is changed. And singing ability including pitch.

In this way, it is possible to easily grasp the comparison situation between the current singing voice that the user is singing and the model voice. In addition, since the melody to be sung is displayed in the score area, it is possible to grasp the melody line in advance.
As a result, the difference between the singing voice and the model voice can be properly displayed while displaying the previous melody line.

  A determination device according to a third aspect of the present invention includes a music storage unit, an image display unit, an accompaniment playback unit, a symbol display control unit, a voice input reception unit, a scale display control unit, and a scoring unit as follows. Configure.

  First, the music storage unit stores music information including accompaniment information that defines the accompaniment sound of the music and model voice information that defines voice information of the music to be modeled. The image display unit also includes a score area (for example, a score image) for arranging a pitch symbol representing the pitch of the model voice, and a determination area (for example, a determination line or the like) set in a predetermined area in the score area. An image including a determination zone) and an input area (for example, a keyboard image) in which scale sections partitioned corresponding to the scale of the score area are respectively displayed is displayed. Then, the accompaniment playback unit plays back the music based on the accompaniment information.

  On the other hand, the symbol display control unit arranges the pitch symbol at a corresponding position in the score area based on the model voice information, and scrolls the pitch symbol toward the determination area according to the rhythm of the music to be played. . The voice input reception unit receives input of singing voice sung by the user. The scale display control unit changes the display form of the corresponding scale section in the input area based on the accepted pitch of the singing voice (for example, emits light). The scoring unit is based on the relationship between the position of the scrolled pitch symbol and the determination area, and the relationship between the placement of the pitch symbol on the score area and the scale section where the display form is changed. And singing ability including pitch.

In this way, it is possible to easily grasp the comparison situation between the current singing voice that the user is singing and the model voice. In addition, since the melody to be sung is displayed in the score area, it is possible to grasp the melody line in advance.
As a result, the difference between the singing voice and the model voice can be properly displayed while displaying the previous melody line.

  According to the present invention, it is possible to appropriately display the difference between the singing voice and the model voice while displaying the previous melody line.

  Embodiments of the present invention will be described below. In the following, for ease of understanding, an embodiment in which the present invention is applied to a game device will be described. However, the present invention is similarly applied to information processing devices such as various computers, PDAs, mobile phones, and dedicated karaoke devices. The invention can be applied. That is, the embodiment described below is for explanation, and does not limit the scope of the present invention. Therefore, those skilled in the art can employ embodiments in which each or all of these elements are replaced with equivalent ones, and these embodiments are also included in the scope of the present invention.

(Embodiment 1)
FIG. 1 is a schematic diagram showing a schematic configuration of a typical game device in which a karaoke device (determination device) according to an embodiment of the present invention is realized. Hereinafter, a description will be given with reference to FIG.

  The game apparatus 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an interface 104, a microphone 105, a controller 106, an external memory 107, and a DVD. A (Digital Versatile Disk) -ROM drive 108, an image processing unit 109, an audio processing unit 110, and a NIC (Network Interface Card) 111 are provided.

  Note that a DVD-ROM storing a game program and data is loaded into the DVD-ROM drive 108 and the game apparatus 100 is turned on to execute the program, thereby realizing the karaoke apparatus of the present embodiment. Is done.

  The CPU 101 controls the overall operation of the game apparatus 100 and is connected to each component to exchange control signals and data.

  The ROM 102 records an IPL (Initial Program Loader) that is executed immediately after the power is turned on, and when this is executed, the program recorded on the DVD-ROM is read out to the RAM 103 and execution by the CPU 101 is started. The The ROM 102 stores an operating system program and various data necessary for operation control of the entire game apparatus 100.

  The RAM 103 is for temporarily storing data and programs, and holds programs and data read from the DVD-ROM and other data necessary for game progress and chat communication.

  The microphone 105 connected via the interface 104 receives a voice (singing voice or the like) uttered by the user, converts the voice into a voice signal, and inputs the voice signal. When two microphones 105 are used by two users, each microphone 105 receives a singing voice from each user.

  The controller 106 connected via the interface 104 receives an operation input performed when the user executes the game.

  The external memory 107 detachably connected via the interface 104 stores data indicating the progress of the game, chat communication log (record) data, and the like in a rewritable manner. The user can record these data in the external memory 107 as appropriate by inputting an instruction via the controller 106.

  A DVD-ROM mounted on the DVD-ROM drive 108 stores a program for realizing the game and image data and audio data associated with the game. Under the control of the CPU 101, the DVD-ROM drive 108 performs a reading process on the DVD-ROM loaded therein, reads out necessary programs and data, and these are temporarily stored in the RAM 103 or the like.

  The image processing unit 109 processes the data read from the DVD-ROM by an image arithmetic processor (not shown) included in the CPU 101 or the image processing unit 109, and then processes the processed data in a frame memory ( (Not shown). The image information recorded in the frame memory is converted into a video signal at a predetermined synchronization timing and output to a monitor (not shown) connected to the image processing unit 109. Thereby, various image displays are possible.

The image calculation processor can execute a two-dimensional image overlay calculation, a transmission calculation such as α blending, and various saturation calculations at high speed.
In addition, the polygon information arranged in the virtual three-dimensional space and added with various texture information is rendered by the Z buffer method, and a rendering image obtained by overlooking the polygon arranged in the virtual three-dimensional space from a predetermined viewpoint position is obtained. High speed execution of the obtained operation is also possible.

  The audio processing unit 110 converts audio data read from the DVD-ROM into an analog audio signal and outputs the analog audio signal from a speaker (not shown) connected thereto. Further, under the control of the CPU 101, sound effects and music data to be generated during the progress of the game are generated, and sound corresponding to this is output from the speaker.

Furthermore, the audio processing unit 110 has a sound source such as a synthesizer, and, for example, sequentially synthesizes electronic sounds according to MIDI (Musical Instrument Digital Interface) data, and outputs music sounds from a speaker. Also, the singing voice input from each microphone 105 is sampled, and the sampled voice signal is synthesized with the music sound and output. That is, the singing voice from the microphone 105 is output together with the music sound.
Note that the sound processing unit 110 not only normally outputs the singing sound input from each microphone 105, but also controls the output volume of the singing sound corresponding to each microphone 105 under the control of the CPU 101.

  The NIC 111 is for connecting the game apparatus 100 to a computer communication network (not shown) such as the Internet, and conforms to the 10BASE-T / 100BASE-T standard used when configuring a LAN (Local Area Network). Therefore, analog modems for connecting to the Internet using telephone lines, ISDN (Integrated Services Digital Network) modems, ADSL (Asymmetric Digital Subscriber Line) modems, cables for connecting to the Internet using cable television lines A modem or the like, and an interface (not shown) that mediates between them and the CPU 101 are configured.

In addition, the game apparatus 100 uses a large-capacity external storage device such as a hard disk so that it performs the same function as the ROM 102, RAM 103, external memory 107, DVD-ROM attached to the DVD-ROM drive 108, and the like. It may be configured.
Further, it is possible to adopt a form in which a keyboard for accepting a character string editing input from a user, a mouse for accepting various position designations and selection inputs, and the like are connected. In addition, a general-purpose personal computer can be used instead of the game apparatus 100 of the present embodiment.

(Outline configuration of karaoke equipment)
FIG. 2 is a schematic diagram showing a schematic configuration of the karaoke apparatus according to the present embodiment. Hereinafter, a description will be given with reference to FIG.

  The karaoke apparatus 200 includes a music storage unit 201, a music playback unit 202, an image storage unit 203, an image generation unit 204, a symbol display control unit 205, a voice input reception unit 206, a scale display control unit 207, And a singing ability scoring unit 208.

  First, the music storage unit 201 stores a plurality of pieces of music information in advance. This music information includes, for example, MIDI data that defines karaoke music. Moreover, the music memory | storage part 201 has memorize | stored model audio | voice information which prescribes | regulates the singing voice (melody line) which a user (singer) should model for each music. This model voice information includes, for example, information such as pitch, volume, and rhythm.

In addition to such music information and model voice information, the music storage unit 201 stores lyrics information and the like corresponding to the music.
Note that the DVD-ROM mounted on the DVD-ROM drive 108 and the external memory 107 can function as such a music storage unit 201.

The music playback unit 202 reads music information (for example, MIDI data) to be played back from the music storage unit 201 and plays back the karaoke music. For example, the music reproducing unit 202 has a sound source, and sequentially synthesizes electronic sounds based on the read-out MIDI data, and outputs music sounds from a speaker. That is, the music reproducing unit 202 reproduces karaoke music that is accompanied by music sung by the user.
Note that the DVD-ROM drive 108 and the audio processing unit 110 can function as such a music reproducing unit 202.

The image storage unit 203 stores in advance image information used for the image generation unit 204 and the like. For example, the image storage unit 203 stores a score image, a keyboard image, and the like that form a display image generated by the image generation unit 204. Further, note symbols (becomes symbols indicating the pitch on the musical score image) used for the symbol display control unit 205 are also stored.
Note that the DVD-ROM mounted on the DVD-ROM drive 108 and the external memory 107 can function as such an image storage unit 203.

The image generation unit 204 generates a display image based on a score image, a keyboard image, and the like stored in the image storage unit 203.
For example, the image generation unit 204 generates a display image including a score image 211, a determination line 212, a determination zone 213, and a keyboard image 214 as shown in FIG.

A score image 211 in the figure is a staff for writing (arranging) note symbols to be described later.
The determination line 212 is a reference line for accurately determining the utterance timing as well as indicating the utterance timing of the note symbols arranged and scrolled on the score image 211 by the symbol display control unit 205, as will be described later.
The determination zone 213 is a reference range for generously determining the utterance timing of a note symbol.
The keyboard image 214 represents a keyboard (a black key and a white key) each indicating a musical scale, and, as will be described later, represents the pitch of the singing voice received by the voice input receiving unit 206 by light emission or the like.
Note that the image processing unit 109 can function as such an image generation unit 204.

Returning to FIG. 2, the symbol display control unit 205 generates a note symbol representing the pitch of the model voice (melody) to be a model, and arranges it at the corresponding position of the score image 211 described above. Then, the musical note symbols are scrolled in accordance with the rhythm of the karaoke music reproduced by the music reproducing unit 202.
That is, the symbol display control unit 205 reads an image of a note symbol from the image storage unit 203 and arranges it in the score image 211 based on the model voice information read from the music storage unit 201.
For example, the symbol display control unit 205 generates a note symbol 221 as shown in FIG. As an example, lyrics read from the music storage unit 201 are synthesized with the note symbol 221.
Then, the symbol display control unit 205 arranges the generated note symbols 221 at the corresponding positions (corresponding scales) of the score image 211 as shown in FIG.
Further, the symbol display control unit 205 scrolls the arranged note symbols 221 toward the determination line 212 (determination zone 213) as shown in FIG. 4C. This scroll is appropriately adjusted so as to match the rhythm of the karaoke music played back by the music playback unit 202.
Note that the image processing unit 109 can function as such a symbol display control unit 205.

Returning to FIG. 2, the voice input receiving unit 206 receives an input of singing voice sung by the user in accordance with the music sound reproduced by the music reproducing unit 202.
For example, the voice input reception unit 206 samples a singing voice (input voice) for which input has been received, and supplies a voice signal obtained by the sampling to the scale display control unit 207.
Note that the microphone 105 and the voice processing unit 110 can function as such a voice input receiving unit 206.

The scale display control unit 207 analyzes the pitch of the voice signal supplied from the voice input reception unit 206, and based on the analyzed pitch, the corresponding portion of the keyboard image 214 (any one corresponding to the pitch). ).
For example, the scale display control unit 207 changes the display color of the keyboard 222 according to the pitch of the singing voice, as shown in FIG.
Note that the image processing unit 109 can function as such a scale display control unit 207.

The singing ability scoring unit 208 determines the relationship between the position of the note symbol scrolled by the symbol display control unit 205 and the determination line, the arrangement of the note symbol on the score image, and the position of the emitted keyboard (musical scale). Based on the relationship, the singing ability including the pitch is scored.
For example, as shown in FIG. 6A, when the musical note symbol 221 has reached the determination line 212 and the scale of the emitted keyboard 222 is equal to the musical scale of the musical note symbol 221, the singing ability scoring unit 208 gives the highest positive rating. If the note symbol 221 is within the determination zone 213, a standard positive evaluation is made.
On the other hand, as shown in FIG. 6B, even if the note symbol 221 does not reach the determination line 212, when the scale of the emitted keyboard 222 and the note symbol 221 are different, the singing ability scoring unit 208 gives a negative rating. In addition to this, even if the scale of the emitted keyboard 222 and the scale of the note symbol 221 are equal, if the note symbol 221 does not reach the determination line 212 or the like, the singing ability scoring unit 208 Negative evaluation.
The CPU 101 can function as such a singing ability scoring unit 208.

(Outline of operation of karaoke equipment)
FIG. 7 is a flowchart showing the flow of the singing ability scoring process executed in the karaoke apparatus 200. Hereinafter, a description will be given with reference to FIG. This singing ability scoring process is started after, for example, an arbitrary piece of music to be reproduced (such as MIDI data and model voice information) is selected from the music storage unit 201.

First, the music playback unit 202 reads the music information from the music storage unit 201 and plays back the karaoke music (step S301).
Then, the image generation unit 204 generates a display image as shown in FIG.

The symbol display control unit 205 generates a note symbol, arranges it on the display image (score image), and scrolls it (step S302).
That is, the symbol display control unit 205 arranges the note symbol 221 in the musical score image 211 based on the model voice information read from the music storage unit 201 as shown in FIG. Then, the musical note symbol 221 is scrolled toward the determination line 212 (determination zone 213), as shown in FIG.

  When the user sings a song in such a state that the karaoke music is reproduced and the display image in which the note symbols scroll is displayed, the voice input receiving unit 206 receives the input of the user's singing voice (step S303). That is, the voice input reception unit 206 samples the singing voice (input voice) for which input has been received, and sequentially supplies the voice signal obtained by the sampling to the scale display control unit 207.

The scale display control unit 207 analyzes the pitch of the audio signal supplied from the audio input reception unit 206, and emits a corresponding portion of the keyboard image (any keyboard corresponding to the pitch) based on the analyzed pitch. (Step S304).
That is, the scale display control unit 207 changes the display color of the keyboard 222 according to the pitch of the singing voice, as shown in FIG. 5 described above.

The singing ability scoring unit 208 compares the scroll position of the note symbol and the scale of the note symbol with the scale of the light emission location of the keyboard image (step S305).
Then, the singing ability scoring unit 208 scores the singing ability based on these comparison results (step S306).
For example, as shown in FIG. 6A described above, when the note symbol 221 has reached the determination line 212 and the scale of the emitted keyboard 222 is equal to the scale of the note symbol 221, The scoring unit 208 gives the highest positive evaluation because the timing of the utterance and the pitch of the utterance match very accurately. If the note symbol 221 is within the determination zone 213, a standard positive evaluation is made.
On the other hand, as shown in FIG. 6B, even if the note symbol 221 reaches the determination line 212, the singing ability scoring is performed when the scale of the emitted keyboard 222 and the note symbol 221 are different. The unit 208 makes a negative evaluation because the pitch of the utterance is shifted. In addition to this, even if the scale of the emitted keyboard 222 and the scale of the note symbol 221 are equal, if the note symbol 221 does not reach the determination line 212 or the like, the singing ability scoring unit 208 Negative evaluation is given because the timing of utterance is off.

  The karaoke apparatus 200 determines whether or not the reproduction of the music has ended (step S307). If the reproduction has not ended (step S307; No), the process returns to step S301, and the above steps S301 to S307 are performed. Repeat the process. On the other hand, when reproduction | regeneration is complete | finished (step S307; Yes), the karaoke apparatus 200 complete | finishes a singing power scoring process.

Thus, the karaoke apparatus 200 can easily grasp the comparison status between the current singing voice and the model voice that the user is singing. In addition, since the melody to be sung is displayed on the score, it is possible to grasp the melody line in advance.
As a result, the difference between the singing voice and the model voice can be properly displayed while displaying the previous melody line.

(Other embodiments)
In the above-described embodiment, the case where a note symbol is arranged on a fixed musical score image has been described. However, based on the arrangement state of the note symbol, the width in the musical scale direction of the musical score image or the like may be changed as appropriate for easy viewing. Good.
Hereinafter, a karaoke apparatus 400 according to another embodiment of the present invention will be described with reference to FIG.

FIG. 8 is a schematic diagram showing a schematic configuration of a karaoke apparatus 400 according to another embodiment of the present invention.
The karaoke apparatus 400 further includes an image display control unit 401 in addition to the configuration of the karaoke apparatus 200 of FIG. 2 described above.

The image display control unit 401 changes the display width in the musical scale direction of the musical score image generated by the image generation unit 204 based on the arrangement state of the note symbols arranged in the musical score image by the symbol display control unit 205.
For example, the image display control unit 401 reads out the model voice information from the music storage unit 201 and specifies the arrangement state of the note symbols arranged in the symbol display control unit 205 in advance. In other words, the scale range necessary for the arrangement of the note symbols to be displayed is specified in advance.
Then, the image display control unit 401 changes the display width of the musical score image and the keyboard image in the musical scale direction based on the arrangement state of the note symbols (necessary musical scale range).
Specifically, when the note symbols are arranged in a wide range of the scale, the image display control unit 401 narrows the display width in the scale direction of the score image 211 and the keyboard image 214 as shown in FIG. Yes (shrink). On the other hand, when the note symbols are arranged in a narrow range of the scale, the image display control unit 401 widens the display width in the scale direction of the score image 211 and the keyboard image 214 as shown in FIG. Expanding).
In this way, by appropriately changing the display width in the musical scale direction of a musical score image or the like, it is possible to make it easier to see the arrangement and the like of the displayed note symbols.

In the above-described embodiment, the case where only the musical note symbol of the model voice is arranged on the score image has been described. However, the result of singing in the past may be displayed together.
Hereinafter, a karaoke apparatus 500 according to another embodiment of the present invention will be described with reference to FIG.

FIG. 10 is a schematic diagram showing a schematic configuration of a karaoke apparatus 500 according to another embodiment of the present invention.
The karaoke apparatus 500 further includes a history information storage unit 501 and a history synthesis unit 502 in addition to the configuration of the karaoke apparatus 200 of FIG. 2 described above.

The history information storage unit 501 stores history information indicating the pitch history of the singing voice received by the voice input receiving unit 206 in association with the model voice information.
That is, the history information of the user's singing pitch analyzed by the scale display control unit 207 is stored in association with the model voice information.

Based on the history information stored in the history information storage unit 501, the history synthesis unit 502 synthesizes a history symbol indicating a singing pitch with a note symbol arranged by the symbol display control unit 205.
For example, as shown in FIG. 11, the history synthesis unit 502 synthesizes a history symbol 521 based on history information with a note symbol 211 and arranges it in a score image 211.
At this time, it is assumed that the symbol display control unit 205 scrolls the history symbol 521 as well as the note symbol 211.

  Thus, since the history of the pitch at the time of singing in the past is also displayed, the user can easily grasp which part of the music has not been sung correctly.

In the above embodiment, note symbols having the same shape are displayed. However, the size of the note symbols may be appropriately changed according to the volume of the model voice.
For example, the symbol display control unit 205 reads volume information defining the strength of the model voice from the music storage unit 201 and changes the size of the note symbol based on the volume information.
Specifically, as shown in FIG. 12A, the symbol display control unit 205 generates and arranges a small note symbol 231 when the volume of the model voice is lower than the first specified value. Further, when the volume of the model voice is larger than the second specified value, a large note symbol 232 is generated and arranged. Then, when the volume of the model voice is between the first specified value and the second specified value, a note symbol 211 having a normal size is generated and arranged.
In addition to changing the size of these note symbols, the color or the like of the note symbols may be changed.
In this way, the display form of the note symbols changes as appropriate according to the volume of the model voice, so that the user can easily grasp how much to sing.

In the above embodiment, the case where the note symbol is represented by the shape of the note has been described, but the shape of the symbol for representing the pitch is arbitrary. Moreover, although the case where the pitch of the singing voice which a user sings is displayed by light emission of a keyboard image, etc., the pitch of a singing voice may be displayed by other than such a keyboard image.
For example, as shown in FIG. 12B, a rod-like pitch symbol 241 may be arranged. Then, instead of the keyboard image, the pitch of the singing voice may be displayed by the marker 242 that moves along the scale direction.

Further, after the singing, the pitch of the model voice and the pitch of the singing voice sung by the user may be displayed in a graph so that the comparison result with the model voice can be displayed in an easy-to-understand manner.
Further, based on the comparison result, a section that is particularly unsatisfactory (for example, a measure unit) may be repeatedly practiced.

  As described above, according to the present invention, it is possible to appropriately display the difference between the singing voice and the model voice while displaying the previous melody line.

It is a mimetic diagram showing an outline composition of a game device concerning an embodiment of the present invention. It is a mimetic diagram showing an outline composition of a karaoke device concerning an embodiment of the present invention. It is a schematic diagram which shows an example of the display image produced | generated by the image generation part. (A) is a schematic diagram showing an example of a note symbol, (b) is a schematic diagram showing an example of a note symbol arranged in a score image, and (c) is a diagram for explaining how a note symbol scrolls. FIG. It is a schematic diagram which shows an example of the keyboard image produced | generated by the image generation part. (A), (b) is a schematic diagram for demonstrating a mode that the keyboard in a keyboard image light-emits. It is a flowchart which shows the flow of the singing power scoring process performed in the said karaoke apparatus. It is a schematic diagram which shows schematic structure of the karaoke apparatus which concerns on other embodiment of this invention. (A), (b) is a schematic diagram for demonstrating a mode that the display width of a scale direction, such as a keyboard image, is changed. It is a schematic diagram which shows schematic structure of the karaoke apparatus which concerns on other embodiment of this invention. It is a schematic diagram for demonstrating a mode that the history symbol was synthesize | combined with the note symbol. (A), (b) is a schematic diagram which shows the example of a display of other symbols.

Explanation of symbols

100 game machine 101 CPU
102 ROM
103 RAM
104 Interface 105 Microphone 106 Controller 107 External memory 108 DVD-ROM drive 109 Image processing unit 110 Audio processing unit 111 NIC
DESCRIPTION OF SYMBOLS 200 Karaoke apparatus 201 Music storage part 202 Music reproduction part 203 Image storage part 204 Image generation part 205 Symbol display control part 206 Voice input reception part 207 Scale display control part 208 Singing ability scoring part 401 Image display control part 501 History information storage part 502 History synthesis unit

Claims (6)

Computer
A music storage unit that stores music information including accompaniment information that defines the accompaniment sound of the music and model voice information that defines voice information of the music to be modeled;
A musical score area for arranging a pitch symbol representing the pitch of the model voice, a determination area set in a predetermined area in the musical score area, and a musical scale section that is divided in accordance with the musical scale of the musical score area are arranged. An image display unit for displaying an image including the input area
Based on the accompaniment information, an accompaniment playback unit for playing back music,
A symbol display control unit that arranges the pitch symbol at a corresponding position in the score area based on the model voice information, and scrolls the pitch symbol toward the determination area according to the rhythm of the music to be played back,
A voice input reception unit that receives input of singing voice sung by the user,
A scale display control unit that changes the display form of the corresponding scale section in the input area based on the pitch of the received singing voice,
A singing including a pitch based on the relationship between the position of the scrolled pitch symbol and the determination area, and the relationship between the placement of the pitch symbol on the score area and the scale section where the display form has been changed. A scoring section that scores power
A program characterized by functioning as The program according to claim 1,
The model voice information stored in the music storage unit includes volume information that defines the strength of the model voice,
The symbol display control unit changes the display form of the pitch symbol according to the strength of the model voice based on the volume information.
It is characterized by that. The program according to claim 1 or 2,
Computer
Further functioning as an image display control unit for changing the display width of the scale direction of the image displayed on the image display unit based on the arrangement state of the pitch symbols in the score area.
It is characterized by that. A program according to any one of claims 1 to 3,
Computer
A history information storage unit that stores history information indicating the pitch history of the received singing voice in association with the model voice information,
Based on the stored history information, a history symbol indicating a singing pitch is synthesized with the pitch symbol arranged by the symbol display control unit, and further functioned as a history symbol synthesis unit arranged in the score area.
It is characterized by that. A singing ability determination method using a song storage unit, wherein the song storage unit includes song information including accompaniment information that defines an accompaniment sound of a song and model voice information that defines voice information of a song to be modeled Remember
A musical score area for arranging a pitch symbol representing the pitch of the model voice, a determination area set in a predetermined area in the musical score area, and a musical scale section that is divided in accordance with the musical scale of the musical score area are arranged. An image display process for displaying an image including the input area,
Based on the accompaniment information, an accompaniment playback step of playing back music,
A symbol display control step of arranging the pitch symbol at a corresponding position in the score area based on the model voice information, and scrolling to the determination area according to the rhythm of the music to be played;
A voice input acceptance process for accepting input of singing voice sung by the user;
A scale display control step of changing the display form of the corresponding scale section in the input area based on the pitch of the received singing voice;
A singing including a pitch based on the relationship between the position of the scrolled pitch symbol and the determination area, and the relationship between the placement of the pitch symbol on the score area and the scale section where the display form has been changed. A scoring process for scoring power,
A method characterized by that. A music storage unit that stores music information including accompaniment information that defines the accompaniment sound of the music and model voice information that defines voice information of the music to be modeled;
A musical score area for arranging a pitch symbol representing the pitch of the model voice, a determination area set in a predetermined area in the musical score area, and a musical scale section that is divided in accordance with the musical scale of the musical score area are arranged. An image display unit for displaying an image including the input area
Based on the accompaniment information, an accompaniment playback unit for playing back music,
A symbol display control unit that arranges the pitch symbol at a corresponding position in the score area based on the model voice information, and scrolls the pitch symbol toward the determination area according to the rhythm of the music to be played;
A voice input receiving unit that receives input of singing voice sung by the user;
A scale display control unit for changing the display form of the corresponding scale section in the input area based on the pitch of the received singing voice;
A singing including a pitch based on the relationship between the position of the scrolled pitch symbol and the determination area, and the relationship between the placement of the pitch symbol on the score area and the scale section where the display form has been changed. A scoring unit for scoring power,
A determination apparatus characterized by that.

Images