JP5291742B2 - Karaoke apparatus, range measurement method, and program - Google Patents

Description

  The present invention relates to a karaoke apparatus, a sound range measuring method, and a program that can appropriately measure a sound range that a singer can utter.

Conventionally, karaoke as entertainment has spread with the spread of commercial karaoke equipment. In recent years, it is also possible to cause a game device or the like to function as a karaoke device by causing a game device, a personal computer, or the like to execute predetermined software (such as a program for karaoke performance).
Therefore, even if a user uses a game device etc., he can enjoy karaoke casually at home.

Karaoke devices including such game devices and the like can generally score the singing ability of a singer (a user who sings at karaoke).
For example, a karaoke apparatus plays karaoke music sounds (accompaniment etc.) and inputs the voice of a singer from a microphone. This voice is sequentially compared with a reference model voice (pitch, volume, rhythm, etc.). And a karaoke apparatus scores a singer's singing power based on a series of comparison results at the end of a performance, and displays the singing power by a numerical value etc.

  The prior art of a karaoke device also discloses an invention of a karaoke device capable of scoring a singer's singing ability with emphasis on a section (rust section) that becomes a chorus of music (for example, Patent Document 1). reference).

JP 2007-108779 A (page 5-10, FIG. 2)

  By the way, in karaoke, there is a place where the singer cannot speak properly (cannot sing properly) due to the relationship between the range that the singer can utter (voice range) and the pitch of the main melody (melody part) in the song. May end up. In other words, in the main melody of the music, if there is a location with a pitch (high or low) that deviates from the singer's range, the singer cannot properly utter the location.

In order to solve this problem, it is also possible to measure the singer's range from the voice (singing voice) sung by the singer and propose a song in the singer's range.
However, in a scene where karaoke is actually performed, it is difficult to appropriately measure the singer's sound range because other users' shouts and sounds are also input from the microphone. Therefore, even if the song is proposed to be within the singer's range, there may be places where the singer cannot utter, and after starting karaoke, when singing that part, he / she realizes that he cannot utter There were many cases.

  For this reason, there has been a demand for the development of a karaoke apparatus that can appropriately measure the range in which a singer can utter.

  This invention is made | formed in view of the said actual condition, and it aims at providing the karaoke apparatus which can measure the sound range which a singer can utter appropriately, a sound range measurement method, and a program.

  The karaoke apparatus according to the first aspect of the present invention includes a reproduction unit, an input unit, an estimation unit, and a measurement unit.

  First, the reproducing unit reproduces the accompaniment sound of the music. The input unit accepts input sound. The estimator determines whether or not the input sound is a singing voice of a singer uttered in accordance with the accompaniment sound, based on the pitch of the input sound and the pitch of a melody (model voice, etc.) defined in the music. Infer. For example, if the difference between the pitch of the input sound and the pitch of the model voice is within a semitone, the estimation unit estimates that the singing voice is a singer, and otherwise estimates that it is not a singing voice. And a measurement part measures a singer's range based on the pitch of the said singing voice estimated to be a singing voice. For example, the measurement unit measures the range of the singer from the distribution of pitches of each singing voice that is estimated to be a singing voice, and the highest and lowest pitches.

Thus, it is estimated that the input sound having a pitch substantially equal to the pitch of the model voice is a singing voice. Then, by removing the input sound that deviates from the model voice as a noise sound that is input during karaoke, the singer's range can be appropriately measured from the input sound that is presumed to be a singing voice.
As a result, it is possible to appropriately measure the range in which the singer can speak.

The estimation unit estimates that an input sound within a predetermined pitch (for example, within a semitone) is a singing voice based on the pitch of a melody (model voice, etc.) among the input sounds,
The measurement unit may measure the singer's pitch based on the pitch distribution of the singing voice estimated in the music by the estimation unit.
In this case, the input noise sound can be effectively excluded, and the singer's range can be measured more appropriately.

The karaoke apparatus further includes a storage unit that stores information on the singer's range,
The measurement unit may update the information on the singer's range stored in the storage unit every time the singer's range is measured for each piece of music. For example, the stored information is overwritten so that the singer's widest range is maintained.
In this case, every time a singer sings, the singer's range is measured and the range information is updated. For example, when the singer sings a plurality of pieces of music (different pieces of music, etc.), accurate range information is obtained. Is accumulated in the storage unit.

The karaoke apparatus includes a determination unit that determines the appropriateness of singing by the singer based on the relationship between the distribution of the pitch of the melody defined in the music and the information on the singer's range stored in the storage unit. ,
You may further provide the display part which displays the music information regarding the music which a singer can select with the suitability of the song by a determination part.
For example, about the some music used as a music selection candidate, the determination part performs the adequacy (sound range check) of a song. When the display unit displays the music list (music selection image), the result of the sound range check is also displayed. In this case, before starting karaoke, it is possible to select a song while confirming whether it matches the singer's range (whether it can be sung or not).

The karaoke apparatus searches for music suitable for singing by the singer based on the relationship between the information about the singer's range stored in the storage unit and the distribution of melody pitches defined for each tune. And
You may further provide the display part which displays the information of the searched music.
For example, when searching for music that is a candidate for music selection, the search unit searches only for music that is suitable for singing by a singer. And a display part displays the music list (music selection image) of the searched music. In this case, before starting karaoke, only the music that matches the singer's range can be guided.

The karaoke apparatus further includes a display unit that sequentially displays the lyrics of the music being reproduced by the reproduction unit,
The display unit may change the display form of the lyrics in order to notify the lyrics of the pitch that is out of the singer's range measured by the measurement unit.
For example, the display unit displays the lyrics that are out of the range of the singer in reverse video, or changes the character color or size. In this case, it is possible to notify the singer of the location where the voice could not be heard (the location outside the range) during karaoke.

  A sound range measurement method according to a second aspect of the present invention is a sound range measurement method executed by a karaoke apparatus having a reproduction unit, an input unit, an estimation unit, and a measurement unit, and includes a reproduction step, an input step, an estimation step, And a measurement step.

  First, in the reproduction step, the accompaniment sound of the music is reproduced. In the input step, an input sound is received. In the estimation step, it is determined whether or not the input sound is a singing voice of a singer uttered in accordance with the accompaniment sound based on the pitch of the input sound and the pitch of a melody (model voice or the like) defined in the music. Infer. For example, in the estimation step, if the difference between the pitch of the input sound and the pitch of the model voice is within a semitone, the singing voice of the singer is estimated, and otherwise the singing voice is estimated. And in a measurement step, based on the pitch of the said singing voice estimated to be a singing voice, the range of a singer is measured. For example, in the measurement step, the singer's range is measured from the pitch distribution of each singing voice that is presumed to be a singing voice and from the highest and lowest pitches.

Thus, it is estimated that the input sound having a pitch substantially equal to the pitch of the model voice is a singing voice. Then, by removing the input sound that deviates from the model voice as a noise sound that is input during karaoke, the singer's range can be appropriately measured from the input sound that is presumed to be a singing voice.
As a result, it is possible to appropriately measure the range in which the singer can speak.

  The program according to the third aspect of the present invention is configured to cause a computer (including an electronic device) to function as the karaoke apparatus.

  This program can be recorded on a computer-readable information recording medium such as a compact disk, flexible disk, hard disk, magneto-optical disk, digital video disk, magnetic tape, and semiconductor memory.

  The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed. The information recording medium can be distributed and sold independently of the computer.

  According to the present invention, it is possible to appropriately measure a sound range that a singer can utter.

It is a mimetic diagram showing an outline composition of a typical game device with which a karaoke device concerning this embodiment is realized. It is a block diagram for demonstrating the schematic structure of the karaoke apparatus which concerns on 1st Embodiment. It is a schematic diagram for demonstrating an example of the image produced | generated by the image generation part. (A) is a schematic diagram for demonstrating the range of the semitone on the basis of the pitch of model voice, (b), (c) demonstrates the input sound which deviated 1 pitch or more from the pitch of model voice. It is a schematic diagram for. (A) is a schematic diagram which shows an example of distribution of the input sound presumed that it is a singing voice, and demonstrates a mode that the highest and minimum pitches are updated from the input sound presumed that (b) is a singing voice. It is a schematic diagram for doing. It is a schematic diagram which shows an example of a music selection image. It is a flowchart for demonstrating the karaoke control process which concerns on 1st Embodiment. It is a flowchart for demonstrating the detail of the sound range measurement process which is a subroutine. It is a block diagram for demonstrating the schematic structure of the karaoke apparatus which concerns on 2nd Embodiment. It is a flowchart for demonstrating the karaoke control process which concerns on 2nd Embodiment. It is a block diagram for demonstrating the schematic structure of the karaoke apparatus which concerns on 3rd Embodiment. (A)-(c) is a schematic diagram which shows an example of the lyric image which alert | reports all the places which remove | deviated from the singer's range. It is a flowchart for demonstrating the karaoke control process which concerns on 3rd Embodiment.

  Embodiments of the present invention will be described below. In the following, for ease of understanding, an embodiment in which the present invention is applied to a game device will be described. However, the present invention can be similarly applied to information processing devices such as various computers, PDAs, and mobile phones. it can. That is, the embodiment described below is for explanation, and does not limit the scope of the present invention. Therefore, those skilled in the art can employ embodiments in which each or all of these elements are replaced with equivalent ones, and these embodiments are also included in the scope of the present invention.

  FIG. 1 is a schematic diagram showing a schematic configuration of a typical game device in which a karaoke device according to an embodiment of the present invention is realized. Hereinafter, a description will be given with reference to FIG.

  The game apparatus 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an interface 104, a microphone 105, a controller 106, an external memory 107, a DVD ( Digital Versatile Disc) -ROM drive 108, image processing unit 109, audio processing unit 110, and NIC (Network Interface Card) 111.

  In this embodiment, a DVD-ROM storing a karaoke program (karaoke game or the like) and data is loaded in the DVD-ROM drive 108 and the game apparatus 100 is turned on. Karaoke equipment is realized.

  The CPU 101 controls the overall operation of the game apparatus 100 and is connected to each component to exchange control signals and data.

  The ROM 102 records an IPL (Initial Program Loader) that is executed immediately after the power is turned on, and when this is executed, the program recorded on the DVD-ROM is read out to the RAM 103 and execution by the CPU 101 is started. The The ROM 102 stores an operating system program and various data necessary for operation control of the entire game apparatus 100.

  The RAM 103 is for temporarily storing data and programs, and holds programs and data read from the DVD-ROM and other data necessary for the progress of karaoke.

  The microphone 105 connected via the interface 104 receives a voice (singing voice or the like) uttered by the user, converts the voice into a voice signal, and inputs the voice signal.

  The controller 106 connected via the interface 104 receives an operation input performed by the user when performing karaoke. For example, the controller 106 accepts input of a character string (message) or the like for music search according to the operation input.

  The external memory 107 detachably connected via the interface 104 stores data necessary for karaoke (singing history, singer's range, etc.) in a rewritable manner. The user can record these data in the external memory 107 as appropriate by inputting an instruction via the controller 106.

  The DVD-ROM mounted on the DVD-ROM drive 108 stores a karaoke program and image data and audio data necessary for karaoke. Under the control of the CPU 101, the DVD-ROM drive 108 performs a reading process on the DVD-ROM loaded therein, reads out necessary programs and data, and these are temporarily stored in the RAM 103 or the like.

  The image processing unit 109 processes the data read from the DVD-ROM by an image arithmetic processor (not shown) included in the CPU 101 or the image processing unit 109, and then processes the processed data in a frame memory ( (Not shown). The image information recorded in the frame memory is converted into a video signal (video signal) at a predetermined synchronization timing and output to a monitor connected to the image processing unit 109. Thereby, various image displays are possible.

The image calculation processor can execute a two-dimensional image overlay calculation, a transmission calculation such as α blending, and various saturation calculations at high speed.
In addition, the polygon information arranged in the virtual three-dimensional space and added with various kinds of texture information is rendered by the Z buffer method, and a rendered image is obtained by overlooking the polygon arranged in the virtual three-dimensional space from a predetermined viewpoint position. High speed execution of the obtained operation is also possible.

  Further, the CPU 101 and the image arithmetic processor operate in a coordinated manner, so that a character string can be drawn as a two-dimensional image in a frame memory or drawn on the surface of each polygon according to font information that defines the character shape. is there. The font information is recorded in the ROM 102, but it is also possible to use dedicated font information recorded in the DVD-ROM.

The audio processing unit 110 converts audio data read from the DVD-ROM into an analog audio signal and supplies the analog audio signal to an external speaker to output the audio. For example, the sound processing unit 110 generates an accompaniment sound from music data used for karaoke under the control of the CPU 101, and outputs the accompaniment sound from a speaker.
The audio processing unit 110 also performs analysis of audio input from the microphone 105 and the like.

  The NIC 111 is for connecting the game apparatus 100 to a computer communication network (not shown) such as the Internet, and conforms to the 10BASE-T / 100BASE-T standard used when configuring a LAN (Local Area Network). Analog modems for connecting to the Internet using telephone lines, ISDN (Integrated Services Digital Network) modems, ADSL (Asymmetric Digital Subscriber Line) modems, cable modems for connecting to the Internet using cable television lines And an interface (not shown) that mediates between these and the CPU 101.

In addition, the game apparatus 100 uses a large-capacity external storage device such as a hard disk so that it performs the same function as the ROM 102, RAM 103, external memory 107, DVD-ROM attached to the DVD-ROM drive 108, and the like. It may be configured.
Further, it is possible to adopt a form in which a keyboard for accepting a character string editing input from a user, a mouse for accepting various position designations and selection inputs, and the like are connected.

  Further, instead of the game apparatus 100 of this embodiment, a general computer (general-purpose personal computer or the like) can also be used as a karaoke apparatus. For example, a general computer includes a CPU, a RAM, a ROM, a DVD-ROM drive, and a NIC, and an image processing unit that has a simpler function than that of the game apparatus 100, as with the game apparatus 100. In addition to having a hard disk as a storage device, flexible disks, magneto-optical disks, magnetic tapes, and the like can be used. In addition, a keyboard, a mouse or the like is used as an input device instead of a controller. When the karaoke program is installed and then executed, the karaoke apparatus functions.

(Outline of karaoke equipment)
FIG. 2 is a block diagram showing a schematic configuration of the karaoke apparatus 200 according to the first embodiment of the present invention. The karaoke apparatus 200 is characterized by appropriately measuring the sound range (voice range) that the singer can utter while grasping the voice (singing voice) of the singer excluding noise sound (noise) and the like. Hereinafter, a description will be given with reference to FIG.

  The karaoke apparatus 200 includes a music information storage unit 201, an image generation unit 202, a display unit 203, a reproduction unit 204, an input reception unit 205, an estimation unit 206, a measurement unit 207, and a storage unit 208. Part 209.

First, the music information storage unit 201 stores a plurality of pieces of music information in advance. This music information includes, for example, MIDI data that defines karaoke music. Note that the music information includes a melody part that is the main melody.
In addition, the music information storage unit 201 stores model voice information that defines a singing voice that the user (singer) should use as a model for each music piece. This model voice information includes, for example, information such as pitch (pitch), volume, and rhythm.
In addition to such music information and model audio information, the music information storage unit 201 stores lyrics information, background images, and the like corresponding to the music.
Note that the above-described DVD-ROM mounted on the DVD-ROM drive 108, the external memory 107, and the like can function as such a music information storage unit 201.

The image generation unit 202 generates various images necessary for karaoke. For example, the image generation unit 202 generates a lyrics image and a background image corresponding to a karaoke piece to be played.
That is, the image generation unit 202 reads out lyric information corresponding to the music reproduced by the reproducing unit 204 described later, a background image, and the like from the music information storage unit 201, and displays the lyric image and the like according to the progress (reproduction) of the music. A background image is sequentially generated.
Specifically, the image generation unit 202 generates a lyrics image KG and a background image HG as shown in FIG. The lyrics image KG has a function (guide function) for guiding not only the contents of the lyrics but also the timing of singing the lyrics. Therefore, the image generation unit 202 generates a lyrics image KG in which the display form is changed according to the progress of the music.
In the lyrics image KG in FIG. 3, the timing of singing is guided by inverting the lyrics, but this is an example, and the display form used for the guide function is arbitrary. For example, the timing of singing may be guided by changing the character color of the lyrics or changing the size of the characters.
Further, the background image HG is, for example, a moving image or the like, and is generated such that the display content changes as the music progresses.
In addition to this, the image generation unit 202 also generates a music selection image for selecting music before starting karaoke. Details of the music selection image will be described later together with the description of the determination unit 209.
Note that the above-described image processing unit 109 and the like can function as such an image generation unit 202.

Returning to FIG. 2, the display unit 203 displays the image generated by the image generation unit 202. That is, with the start of karaoke, the above-described lyrics image KG, background image HG, etc. as shown in FIG. 3 are displayed. Prior to that, a music selection image for selecting music is also displayed.
Note that a monitor or the like connected to the image processing unit 109 described above can function as such a display unit 203.

The reproduction unit 204 reads out music information (for example, MIDI data) to be reproduced from the music information storage unit 201 and reproduces music sound based on the music information. For example, the playback unit 204 has a sound source (electronic sound source of each musical instrument), and sequentially synthesizes the music sound produced by the musical instrument defined in the read MIDI data at a specified pitch or volume, The music sound is output from a speaker or the like. The music sound includes a melody sound along the melody part (main melody), and the singer can sing along the melody sound (with the main melody).
Note that the above-described audio processing unit 110 and the like can function as such a reproduction unit 204.

The input receiving unit 205 receives an input sound (singer's voice or the like) input during karaoke. That is, the singing voice input by the singer is received in accordance with the music sound reproduced by the reproducing unit 204. Note that the input reception unit 205 inputs not only the singing voice but also a noise sound generated in the surroundings (for example, a voice or a sound of another user).
Then, the input reception unit 205 samples the received input sound and supplies the sampled input signal data to the estimation unit 206.
Note that the microphone 105 and the voice processing unit 110 described above can function as such an input receiving unit 205.

The estimation unit 206 estimates whether or not the received input sound is a singer's singing voice. As described above, since the input reception unit 205 inputs not only the singing voice but also a noise sound generated in the surroundings, the estimation unit 206 performs the sound of the input signal data (input sound) supplied from the input reception unit 205. By comparing the pitch with the pitch of the model voice (main melody) in the music, it is estimated whether the input voice is the singing voice of the singer. As an example, the estimation unit 206 estimates that the input sound is a singing voice if the difference between the pitch of the input sound and the pitch of the model voice is within a predetermined range.
Specifically, as shown in FIG. 4A, when the pitches T1 to T4 of the model voice are defined, the pitches of the received input sounds are based on the pitches T1 to T4. If it is in the range of the semitones h1-h4, the estimation part 206 will estimate that the input sound is a singer's singing voice. As for the semitone, the semitone h1 will be described as an example. The range of the semitone h1 is from a semitone above the pitch T1 (#: sharp) to a semitone below the pitch T1 (♭: flat). The same applies to the semitones h2 to h4 for the other sounds T2 to T4.
Therefore, as shown in FIG. 4B, when the pitch of the input sound N1 corresponding to the pitch T1 of the model voice is lower than the pitch T1 by one tone or more (out of the range of the semitone h1), The estimation unit 206 estimates that the input sound N1 is not a singer's singing voice (is a noise sound). Similarly, as shown in FIG. 4C, when the pitch of the input sound N4 corresponding to the pitch T4 of the model voice is one or more higher than the pitch T4 (outside the range of the semitone h4). Moreover, the estimation unit 206 estimates that the input sound N4 is not the singing voice of the singer.
Then, the estimation unit 206 supplies information (pitch, etc.) of the input sound to the measurement unit 207 when it is estimated that the input sound is a singer's singing voice on the basis of the model sound.
Note that the CPU 101, the voice processing unit 110, and the like described above can function as such an estimation unit 206.

Returning to FIG. 2, the measurement unit 207 measures the singer's range (voice range) from the pitch of the input sound estimated to be a singing voice. That is, the range of the singer is measured based on the pitch of the input sound that is estimated to be a singing voice by the estimation unit 206.
Specifically, as shown in FIG. 5A, the measurement unit 207 accumulates the pitches of the input sounds N estimated to be singing voices from the start to the end of the music, and the sound of all the input sounds N The singer's range is measured based on the high distribution. In addition to this, as shown in FIG. 5B, the measurement unit 207 obtains the highest pitch (input sound NH) and the lowest sound in the music from each input sound N that is sequentially estimated to be a singing voice. The pitch (input sound NL) may be updated, and the singer's range may be measured from the highest pitch (input tone NH) and the lowest pitch (input tone NL) at the end of the song.
Note that the CPU 101 and the like described above can function as such a measurement unit 207.

Returning to FIG. 2, the storage unit 208 stores information related to the singer's range measured by the measurement unit 207. In the storage unit 208, for example, whenever the karaoke song ends, the measurement unit 207 appropriately updates the information related to the singer's range. That is, the information in the storage unit 208 is updated so that the singer's widest range is maintained.
Note that the RAM 103, the external memory 107, and the like described above can function as such a storage unit 208.

The determination unit 209 determines the suitability of the singing by the singer based on the relationship between each pitch in the music (main melody) and the singer's range stored in the storage unit 208. For example, when a singer selects a song for karaoke, it is determined whether the pitch distribution of each song (such as a list of songs) is within the singer's range.
When this determination result is supplied to the image generation unit 202, the image generation unit 202 generates, as an example, a music selection image including a range check (adequacy of singing) for each piece of music as shown in FIG.
Note that the CPU 101 and the like described above can function as such a determination unit 209.

(Outline of operation of karaoke equipment)
Hereinafter, the operation of the karaoke apparatus 200 having such a configuration will be described with reference to the drawings. FIG. 7 is a flowchart showing a flow of karaoke control processing executed by the karaoke apparatus 200. FIG. 8 is a flowchart showing details of the sound range measurement process in the karaoke control process.
First, the karaoke control process of FIG. 7 will be described. This karaoke control process starts from a point where the singer can select a song.

First, the karaoke apparatus 200 searches for a plurality of music pieces (step S301).
For example, a song recommended for a singer such as a hit song or a new score is appropriately searched. Note that the search target music may be searched based on the history of music selected in the past.

The karaoke apparatus 200 performs a sound range check for each searched music piece (step S302).
That is, the determination unit 209 determines the suitability of the singing by the singer based on the relationship between each pitch of the searched music (main melody) and the singer's range stored in the storage unit 208. That is, it is determined whether the pitch distribution in the music is within the singer's range.

The karaoke apparatus 200 displays a music list including a check result for the range check (step S303).
That is, the image generation unit 202 generates a music selection image including a sound range check as shown in FIG. 6 and displays it on the display unit 203.

The karaoke apparatus 200 determines whether or not the song has been determined by the singer (step S304).
For example, it is determined whether any music is selected from the music selection screen as shown in FIG. The karaoke apparatus 200 returns a process to step S301, and repeatedly performs the process of step S301-S304, when a music piece is not determined (step S304; No). That is, the music list is searched again, and the music list (music selection image) subjected to the range check is displayed again.

On the other hand, when the music is determined (step S304; Yes), the karaoke apparatus 200 reproduces the music and generates an image (step S305).
That is, the playback unit 204 reads the target music information from the music information storage unit 201 to play back the music sound, and the image playback unit 202 reads the target lyrics information, the background image, and the like from the music information storage unit 201. To generate a display image.
That is, the karaoke music sound (accompaniment etc.) is reproduced, and the lyrics image KG and the background image HG as shown in FIG. 3 are generated and displayed on the display unit 203.

Karaoke apparatus 200 accepts an input sound (step S306).
That is, the input reception part 205 receives the singing voice etc. which are input by the singer according to the music sound to be reproduced. As described above, the input receiving unit 205 inputs not only the singing voice but also a noise sound generated in the surroundings.

The karaoke apparatus 200 performs a sound range measurement process (step S307). In other words, the sound range that can be uttered by the singer is measured while excluding noise sound (noise) and the like.
Details of the sound range measurement process will be described later.

The karaoke apparatus 200 compares the input voice and the model voice, and calculates a score (step S308).
For example, the pitch, volume, rhythm, etc. of the input voice are analyzed and compared with the pitch, volume, rhythm, etc. of the model voice, and a score corresponding to the degree of similarity is calculated. At this time, the score becomes higher as the input voice is closer to the model voice.

The karaoke apparatus 200 determines whether or not the reproduction of the music has ended (step S309).
That is, the reproducing unit 204 determines whether or not the reproduction of the karaoke music has been completed. If it is determined that the reproduction of the music has not ended (step S309; No), the karaoke apparatus 200 returns the process to step S305 and repeatedly executes the processes of steps S305 to S309 described above.

  On the other hand, when it is determined that the reproduction of the music has ended (step S309; Yes), the karaoke apparatus 200 counts the scores and displays the singing ability and the like (step S310). That is, the level and evaluation value indicating the singing ability of the singer are specified from the total score, and the level is displayed.

  Next, the details of the sound range measurement process in step S307 described above will be described with reference to FIG.

First, the karaoke apparatus 200 samples the input sound (step S401).
That is, the input reception unit 205 samples the received input sound and supplies the sampled input signal data to the estimation unit 206.

Karaoke apparatus 200 determines whether or not the input sound is assumed to be a singing voice (step S402).
That is, the estimation unit 206 determines whether or not the input sound received by the input reception unit 205 is estimated to be a singer's singing voice. That is, when the pitch of the input sound is substantially equal to the pitch of the model voice (main melody) in the music, the estimation unit 206 sings the input sound that is tuned to the music sound (accompaniment) to be played back. I guess it is the voice of the singer.
Specifically, as shown in FIG. 4A described above, the pitch of the received input sound is within a range of semitones (h1 to h4) with reference to the corresponding model voice (pitch T1 to T4). If there is, the estimation unit 206 estimates that the input sound is the singing voice of the singer. On the other hand, as shown in FIGS. 4B and 4C, the pitches of the input sounds (N1, N4) are out of the range of the semitones (h1, h4) based on the model voices (pitch T1, T4) corresponding to the corresponding pitches. Then, the estimation part 206 estimates that the input sound is not a singer's singing voice (it is a noise sound).
And if it is estimated that it is not a singing voice (step S402; No), the karaoke apparatus 200 will pass through a sound range measurement process as it is, and will return a process to the karaoke control method of FIG.

On the other hand, when it is estimated that it is a singing voice (step S402; Yes), the karaoke apparatus 200 supplies the information of an input sound to the measurement part 207 (step S403).
That is, the estimation unit 206 supplies information (pitch, etc.) of the input sound that is estimated to be the singer's singing voice based on the model voice to the measurement unit 207.

The karaoke apparatus 200 measures the singer's range (step S404).
That is, the measuring unit 207 measures the singer's range (voice range) from the pitch of the input sound that is estimated to be a singing voice. That is, the singer's range is measured from the information of each input sound supplied in step S403 described above.
Specifically, as shown in FIG. 5A described above, the measurement unit 207 measures the singer's range based on the distribution of the sounds of each input sound N that is estimated and supplied as a singing voice. In addition to this, as shown in FIG. 5B, the highest pitch (input tone NH) and the lowest pitch (input tone NL) in the music are updated from each input tone N that is sequentially supplied. The singer's range may be measured from the input sounds NH and NL at the end of the music.

The karaoke apparatus 200 updates the storage unit 208 according to the measurement result (step S405).
That is, the measurement unit 207 updates the information in the storage unit 208 based on the information related to the measured sound range. That is, the information in the storage unit 208 is updated so that the singer's widest range is maintained.
Then, when the sound range measurement process is finished, the karaoke apparatus 200 returns the process to the karaoke control method of FIG.

In such a sound range measurement process, an input sound that is substantially equal to the model voice is estimated to be a singing voice. Then, by removing the input sound that deviates from the model voice as a noise sound that is input during karaoke, it is possible to accurately measure the sound range that the singer can utter from the appropriate input sound.
Further, since the singer's range is measured each time the singer sings, for example, when the singer sings a plurality of songs (different songs, etc.), accurate range information is accumulated in the storage unit 208. Will go.
Then, based on the information stored in the storage unit 208, the musical range of the music selection candidate is checked, and the result is displayed. In other words, whether or not it matches the singer's range (whether or not it can be sung) is presented at the time of music selection, so an appropriate music can be selected.

  As a result, it is possible to appropriately measure the range in which the singer can speak. In addition, at the time of music selection, it is possible to select a music by checking the musical range.

(Second Embodiment)
In said 1st Embodiment, in the music selection image, although the result of the range check by the determination part 209 was shown to the singer and the case where a selection of a singer was assisted was demonstrated, it corresponds with a singer's range. Only the music that is present may be presented.
Hereinafter, a karaoke apparatus 500 that presents music that matches the singer's range when selecting a music will be described with reference to FIG. 9. FIG. 9 is a block diagram showing a schematic configuration of a karaoke apparatus 500 according to the second embodiment of the present invention.

As shown in FIG. 9, the karaoke apparatus 500 includes a music information storage unit 201, an image generation unit 202, a display unit 203, a playback unit 204, an input reception unit 205, an estimation unit 206, and a measurement unit 207. And a storage unit 208 and a search unit 501.
Note that the music information storage unit 201 to storage unit 208 have the same configuration as that of the karaoke apparatus 200 of FIG. 2 described above. The karaoke device 500 includes a search unit 501 instead of the determination unit 209 of the karaoke device 200.

The search unit 501 searches for music suitable for the singer based on the relationship between the information related to the vocal range of the singer stored in the storage unit 208 and the pitch distribution in each musical piece (main melody).
Specifically, when the singer selects karaoke music, the search unit 501 selects only the music that falls within the singer's range based on the singer's information stored in the storage unit 208. Search from the information storage unit 201. The search unit 501 supplies the searched music information to the image generation unit 202.

  The image generation unit 202 generates a music selection image (music list, etc.) based on the music information supplied from the search unit 501. That is, the image generation unit 202 presents only the music that matches the singer's range in the music selection image (music list, etc.).

The operation of the karaoke apparatus 500 having such a configuration will be described with reference to FIG. FIG. 10 is a flowchart showing a flow of karaoke control processing executed by the karaoke apparatus 500.
Steps S305 to S310 in FIG. 10 have the same contents as the karaoke control process in FIG. 7 described above, and are denoted by the same reference numerals.
Therefore, steps S305 to S310 will be briefly described, and steps S601 to S604 that are characteristic processing contents of the karaoke apparatus 500 will be described in detail.

  First, the karaoke apparatus 500 acquires singer information from the storage unit 208 (step S601). That is, the search unit 501 acquires information about the singer's range from the storage unit 208.

The karaoke apparatus 500 searches for a predetermined number of songs that match the singer's range (step S602).
That is, the search unit 501 searches the music information storage unit 201 for a predetermined number of songs that are within the singer's range. Specifically, searching for music that falls within the singer's range while comparing the information about the singer's range acquired from the storage unit 208 and the pitch distribution of each tune in the song information storage unit 201. To do.

  The karaoke apparatus 500 displays a music list of the searched music (step S603). That is, the image generation unit 202 generates a music selection image of only the music that matches the singer's range and displays it on the display unit 203.

Karaoke apparatus 500 determines whether or not the song has been determined by the singer (step S604).
When the tune is not determined (step S604; No), the karaoke apparatus 500 returns the process to step S602 and repeatedly executes the processes of steps S602 to S604. That is, the music that matches the singer's range is searched again, and the music list (music selection image) is displayed again.

  On the other hand, when the music is determined (step S604; Yes), the karaoke apparatus 500 advances the process to step S305, and executes the processes of steps S305 to S310 as in the karaoke control process of FIG.

That is, the karaoke apparatus 500 reproduces music and generates an image, receives an input sound, performs a sound range measurement process, compares the input sound and the model sound, and calculates a score (steps S305 to S308).
The karaoke apparatus 700 repeats the processes of steps S305 to S308 while reproducing the music, and when the reproduction of the music is finished, the score is totaled and the singing ability is displayed (steps S309 to S310).

  Thus, in the karaoke apparatus 500 which concerns on 2nd Embodiment, before starting a karaoke, only the music suitable for a song can be shown to a singer. Moreover, the karaoke apparatus 500 can measure appropriately the sound range which a singer can utter similarly to the karaoke apparatus 200 which concerns on 1st Embodiment.

(Third embodiment)
In the above-described embodiment, a case has been described in which a musical piece that matches the vocal range of the singer is presented by, for example, displaying the result of the musical range check in a selected image. Nevertheless, it may happen that a song that deviates from the singer's range is selected at the request of the singer. When such a musical piece is selected and karaoke is started, a location outside the singer's range may be notified.
Hereinafter, a karaoke apparatus 700 for notifying a location outside the singer's range during karaoke will be described with reference to FIG. FIG. 11 is a block diagram showing a schematic configuration of a karaoke apparatus 700 according to the third embodiment of the present invention.

As shown in FIG. 11, the karaoke apparatus 700 includes a music information storage unit 201, an image generation unit 202, a display unit 203, a playback unit 204, an input reception unit 205, an estimation unit 206, and a measurement unit 207. A storage unit 208, a determination unit 209, and a notification unit 701.
Note that the music information storage unit 201 to the determination unit 209 have the same configuration as that of the karaoke apparatus 200 of FIG. The karaoke apparatus 700 includes a notification unit 701 in addition to the configuration of the karaoke apparatus 200.

The notification unit 701 notifies the location of a song that is out of the singer's range during karaoke.
For example, the notification unit 701 sequentially reads out the pitches of the selected music piece (main melody) from the music information storage unit 201 and compares the ranges of the singers measured by the measurement unit 207. If there is a pitch outside the singer's range, the portion is supplied to the image generation unit 202.

Then, the image generation unit 202 generates a lyrics image in which the display form of the lyrics is changed based on the information supplied from the notification unit 701.
For example, as illustrated in FIG. 12A, the image generation unit 202 generates a lyrics image KG in which the display form of the lyrics DP having a pitch outside the singer's range is changed. In addition, although this lyric DP shows an example of reverse display, in addition to this, it may be informed that the singing is out of the singer's range by changing the character color or size of the lyric DP. .
Further, as shown in FIG. 12B, the image generation unit 202 may generate a lyrics image KG obtained by synthesizing a mark MK <b> 1 indicating that it is out of the singer's range. In addition to this, in order to indicate how far it is, even if a lyrics image KG is generated by synthesizing the mark MK2 (in this case, the upper limit) indicating the range of the musical note and the note N indicating the pitch of the music Good.

The operation of the karaoke apparatus 700 having such a configuration will be described with reference to FIG. FIG. 13 is a flowchart showing a flow of karaoke control processing executed by the karaoke apparatus 700.
In addition, the karaoke control process of FIG. 13 becomes the content which added step S801-S802 to the karaoke control process of FIG. That is, steps S301 to S310 (steps S301 to S308 and steps S309 to S310) in FIG. 13 are the same as the processing contents of the karaoke control process of FIG. 7 described above, and are denoted by the same reference numerals.
Therefore, steps S801 to S802, which are characteristic processing contents of the karaoke apparatus 700, will be described in detail, and steps S301 to S310 will be described briefly.

The karaoke apparatus 700 selects a plurality of music pieces, performs a sound range chuck for each music piece, and displays a music list including check results (steps S301 to S303).
When the music is selected, the karaoke apparatus 700 reproduces the music, generates an image, and receives an input sound (steps S304 to S306).
Then, the karaoke apparatus 700 performs a sound range measurement process, compares the input voice with the model voice, and calculates a score (steps S307 to S308).

Here, the karaoke apparatus 700 determines whether or not the pitch is outside the range (step S801).
That is, the notification unit 701 determines whether or not the pitch of the imitation voice is a pitch that is out of the range of the singer.
If the karaoke apparatus 700 determines that the pitch is not out of the range (step S801; No), the process proceeds to step S309.

On the other hand, when it is determined that the pitch is out of the range (step S801; Yes), the karaoke apparatus 700 notifies the pitch that is out of the range (step S802).
In other words, the notifying unit 701 supplies the portion of the pitch outside the singer's range to the image generating unit 202, and the image generating unit 202 generates a lyrics image in which the display form of the lyrics is changed.
For example, as illustrated in FIG. 12A described above, the image generation unit 202 generates a lyrics image KG in which the display form of the lyrics DP having a pitch outside the singer's range is changed. In addition, as shown in FIG. 12B described above, the image generation unit 202 may generate a lyrics image KG obtained by synthesizing a mark MK1 indicating that it is out of the singer's range.

The karaoke apparatus 700 determines whether or not the reproduction of the music has ended (step S309).
If it is determined that the reproduction of the music has not ended (step S309; No), the karaoke apparatus 700 returns the process to step S305, and repeatedly executes the processes of steps S305 to S308, S801 to S802, and S309.
On the other hand, when it is determined that the reproduction of the music has ended (step S309; Yes), the karaoke apparatus 700 counts the scores and displays the singing ability and the like (step S310).

  As described above, in the karaoke apparatus 700 according to the third embodiment, it is possible to notify the singer of the location where the voice cannot be produced during the karaoke. Moreover, the karaoke apparatus 700 can measure appropriately the sound range which a singer can utter similarly to the karaoke apparatus 200 which concerns on 1st Embodiment.

  As described above, according to the present invention, it is possible to provide a karaoke apparatus, a sound range measuring method, and a program that can appropriately measure a sound range that a singer can utter.

100 game machine 101 CPU
102 ROM
103 RAM
104 Interface 105 Microphone 106 Controller 107 External memory 108 DVD-ROM drive 109 Image processing unit 110 Audio processing unit 111 NIC
200, 500, 700 Karaoke device 201 Music information storage unit 202 Image generation unit 203 Display unit 204 Playback unit 205 Input reception unit 206 Estimation unit 207 Measurement unit 208 Storage unit 209 Determination unit 501 Search unit 701 Notification unit

Claims (7)

A playback unit for playing back the accompaniment sound of the music;
An input unit for receiving input sound;
An estimation unit that estimates whether the input sound is a singing voice of a singer uttered in accordance with the accompaniment sound from the pitch of the input sound and the pitch of a melody defined in the music; ,
Based on the pitch of the singing voice estimated to be the singing voice, a measuring unit that measures the range of the singer ,
A display unit that sequentially displays the lyrics of the music that the playback unit is playing,
The display unit changes the display form of the lyrics in order to notify the lyrics of the pitch that is out of the range of the singer measured by the measurement unit,
A karaoke apparatus characterized by that. The karaoke apparatus according to claim 1,
The estimation unit estimates an input sound within a predetermined pitch based on a pitch of the melody among the input sounds as the singing voice,
The measurement unit measures the range of the singer based on the pitch distribution of the singing voice estimated in the music by the estimation unit.
A karaoke apparatus characterized by that. The karaoke apparatus according to claim 1 or 2,
A storage unit for storing information on the singer's range;
The measurement unit updates the singer's range information stored in the storage unit each time the singer's range is measured for each song.
A karaoke apparatus characterized by that. The karaoke apparatus according to claim 3,
A determination unit that determines the suitability of the singing by the singer based on the relationship between the distribution of the pitch of the melody defined in the song and the information about the singer's range stored in the storage unit ;
The display unit displays music information on music that can be selected by the singer along with appropriateness of singing by the determination unit .
A karaoke apparatus characterized by that. The karaoke apparatus according to claim 3,
Information about the singer of range stored in the storage unit, based on the relationship between the pitch of the distribution of the melody to be defined in each song, the search unit for searching the music suitable for singing by the singer, a further Prepared,
The display unit displays information of the searched music .
A karaoke apparatus characterized by that. A sound range measurement method in a karaoke device having a reproduction unit, an input unit, an estimation unit , a measurement unit, and a display unit ,
The playback unit plays back the accompaniment sound of the music;
An input step in which the input unit receives an input sound;
Whether the estimation unit is a singing voice of a singer uttered in accordance with the accompaniment sound from the pitch of the input sound and the pitch of the melody defined in the music. A guess step to guess;
The measurement unit measures the range of the singer based on the pitch of the singing voice that is estimated to be the singing voice;
The display unit includes a display step of sequentially displaying lyrics of the music being played back by the playback unit;
In the display step, in order to notify the lyrics of the pitch outside the range of the singer measured in the measurement step, the display form of the lyrics is changed,
Range measurement wherein a call. Computer
A playback unit that plays the accompaniment sound of a song,
An input unit that accepts input sound,
An estimation unit that estimates whether the input sound is a singing voice of a singer uttered in accordance with the accompaniment sound from the pitch of the input sound and the pitch of the melody defined in the music;
A measurement unit that measures the range of the singer based on the pitch of the singing voice that is estimated to be the singing voice ;
The playback unit functions as a display unit that sequentially displays the lyrics of the music being played back,
The display unit changes the display form of the lyrics in order to notify the lyrics of the pitch that is out of the range of the singer measured by the measurement unit,
Program for causing to function as.

Images