JPH0720885A - Karaoke device - Google Patents

Abstract

PURPOSE:To extract modulation parameters of music from the music information of KARAOKE information (music information, text information, background image, etc.) and generate and display graphic data which change by the modulation parameters. CONSTITUTION:The KARAOKE device is equipped with a reader 3 which reads data out of a recording medium 2, a signal mixing amplifier 5 which mixes the music information outputted by the reader 3 with a voice signal inputted from a microphone 9 and drives a speaker 10, a music modulation extraction part 6 which extracts features (modualtion information) of the pitch and intensity of the music information, a modulation image generation part 7 which generates the graphic data corresponding to the value of the output signal of the music modulation extraction part 6, and a video output device 8 which sends the output of the modulation image generation part 7 to a display device 11.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an audio device for reproducing music information or a so-called karaoke device for displaying a synthetic image in which lyrics information is superimposed on a background image in synchronization with the music information.

[0002]

2. Description of the Related Art A conventional karaoke apparatus simply reproduces music information or, in recent years, superimposes and displays lyrics information corresponding to the progress of a song on a background image. It was intended to provide users with information such as how to start singing and how fast to sing.

[0003]

However, in the conventional karaoke apparatus, the lyrics displayed in accordance with the music information to be played, or in the case where the lyrics information is displayed on the display device, displays the lyrics displayed in accordance with the progress of the performance. It was used to chase while singing, but such a method did not provide information for singing with the intonation, which is an important element for singing.

Further, in the conventional karaoke apparatus which merely reproduces the recorded data, it is impossible for the user to set the usage environment and give a unique effect.

Further, it was impossible to specifically confirm what the relationship between the user's own song and the accompaniment or the unique singing style of the singer was.

Therefore, the present invention is directed to a karaoke apparatus which extracts an intonation parameter of music from music information of karaoke information (music information, lyrics information, background image, etc.) and generates and displays graphics data which changes according to the intonation parameter. For the purpose of provision.

[0007]

In order to solve such a problem, the present invention has the following constitution.

A karaoke apparatus according to the present invention comprises a signal mixing / amplifying unit for mixing and amplifying music information and a microphone input, and a music intonation / extraction unit for extracting from the music information so-called intonation, which is a characteristic of high / low / strong of a song. The size, shape, or color of the graphics data or the size or size of the graphics data corresponding to the intonation parameter output by the music intonation extraction unit
And an intonation image generation unit that changes the shape and color in combination.

Further, in a karaoke apparatus which reproduces mainstream music information, lyrics information and a background image in synchronization with each other in recent years, a music intonation extraction section for extracting intonation of music information being reproduced and an output of the music intonation extraction section are parameters. As a result, an intonation image generation unit that changes graphics data, and an image synthesis unit that superimposes the intonation image data generated by the intonation image generation unit in addition to the lyrics information on the background image.

In addition, an input device for editing intonation image data, a CPU for executing an editing program and controlling an internal device, and further, a human voice signal is extracted from the music information and the input signal from the microphone. It consists of a voice filter for.

[0011]

According to the intonation parameter extracted from the music information, the graphics processor, for example, raises the brightness of the graphics data when the intonation is high, makes the graphics data red, or enlarges the display size. By generating graphics data that appeals to the emotions of the user, it becomes possible to display intonation information on the display in synchronization with music information.

Further, the program of the CPU controls the input device and the input signal processing unit to allow the user to edit the intonation image data and generate the user's own use environment and effect screen. By storing the intonation data in the memory and displaying it during or after the performance, or both, the user can compare the intonation of the performance and the user's song.

Further, when reproducing the music information in which the singer's song is recorded, a voice filter for passing the singer's singing voice is provided in front of the music intonation extraction unit, and the intonation is extracted from the data passed through this voice filter. By doing so, it is possible to visually recognize the intonation peculiar to the singer and further compare it with the intonation of the user himself, so that it is possible to realize an extremely effective karaoke device for practicing songs.

[0014]

【Example】

(Embodiment 1) Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 shows an example of a block diagram of a karaoke apparatus according to the present invention. In the karaoke device according to the present invention, when the recording medium 50 is inserted into the karaoke device main body 1 and the performance is started, the reading device 52 reads the data from the recording medium 50 and transfers the data to the signal mixing amplifier 5 and the music intonation extraction section 6. . The signal mixing amplifier 5 is a microphone 9
The audio signal input from the device and the music information transferred from the reading device 52 are mixed and amplified, and the speaker 10 is driven to reproduce the music information. On the other hand, the music intonation extraction unit 6 generates intonation parameters based on the level and strength of the music information transferred from the reading device 52, and the intonation image generation unit 7 produces graphics data corresponding to these intonation parameters. The video output unit 51 outputs graphics data to the display device 11. Hereinafter, a case where data is reproduced from a laser disk (hereinafter referred to as LD) will be described in more detail with reference to FIGS. 2 to 6 as an example.

FIG. 2 shows an example of a conceptual block diagram of a karaoke apparatus which reproduces data from an LD in this embodiment, and FIG. 3 shows an example of an intonation image generation section and a video synthesizing section of the karaoke apparatus of this embodiment.

In the karaoke apparatus shown in FIG. 2, the reading device 3 reads a digital signal from the LD 2,
The signal separation unit 4 separates this data into music information and video information (lyric information, background video). The signal mixing amplifier 5 mixes the music information output from the signal separating unit 4 and the input from the microphone 9 and outputs a signal to the speaker 10. The music intonation extraction unit 6 receives the same music information as that of the signal mixing amplifier 5 and extracts intonation parameters from the pitch and strength of the sound, and the intonation image generation unit 7 draws the graphic data (intonation) corresponding to the variation of this intonation parameter. Image data). The video synthesizing unit 8 synthesizes lyrics information, background information, and intonation image data, and outputs a video signal to the display 11.

Next, with reference to FIG. 3, description will be made on the processing from the generation of the intonation image to the image synthesis in the karaoke apparatus of the present invention. The signal separation unit 4 separates music information, lyrics information, and background video from the data read from the LD 2, and outputs the lyrics information and background video to the video synthesis unit 8. In the video synthesis unit 8, the writing control unit 17 Writing to VRAM (video random access memory) 15 and 16 is performed. On the other hand, the music intonation extraction unit 6 that has received the music information
The intonation parameter extracted from the high / low / strong of the music information is sent to the intonation image generation unit 7. The intonation image generation unit 7
A memory 13 in which a basic pattern of an intonation image is recorded,
Graphics processor 12 for generating graphics data based on intonation parameters and data in memory 13
Compose by. As shown in FIG. 3A, the inside of the video synthesizing unit 8 includes a write control unit 17, VRAMs 14, 15, and 1.
6. The writing control unit 1 including the video synthesizing device 18.
Reference numeral 7 separately writes the intonation image, the lyrics information, and the background video in the VRAMs 14, 15, and 16. The image synthesizer 18 selects the data to be output according to the display position of the display by the configuration shown in FIG. 3b. FIG. 3b shows a logical configuration for displaying three types of data in the order of lyrics information, intonation image, and background information from the front side. The writing control unit 17 writes data that serves as a mark (“0” in FIG. 3b) at a place where there is no data when writing lyrics information and intonation image data in the memory.
Write). The comparators 52 and 53 set the output to "0" when detecting such data as a mark, and set the output to "1" in the other parts. Therefore, in the video synthesizer 18, if the lyrics information exists at the display position, the data buffer is opened to output the data, and the image information is when the image information exists at the display position and the lyrics information does not exist. Output and background information are output only in places where lyrics information and image information do not exist.

FIGS. 4, 5 and 6 show examples of representations of synthetic video and intonation information. FIG. 4 shows a case where only the size of the intonation image is changed in accordance with the intonation parameter. In the example of the figure, the inflection image is enlarged in accordance with the increase in the intonation of the music, and on the contrary, the part where the person is calm and sings quietly The inflection image is displayed small.

FIG. 5 shows a case in which the color of the intonation image is changed in accordance with the intonation parameter. For example, in accordance with the human sense, the part where the intonation is increased is red, the quiet part is blue, and the tones parameter is changed. This is an example in which the intonation image is displayed by changing the mixing ratio of the two colors.

FIG. 6 shows a mixture of the above two methods.
That is, when both the size and the color of the intonation image are changed according to the intonation parameter, a large red intonation image is displayed as the intonation increases, and a small blue intonation image is displayed in the quiet and calm part. Has become.

(Embodiment 2) FIG. 7 shows an example of a block diagram for reproducing an LD in the karaoke apparatus according to the third aspect. In FIG. 7, components having the same functions as those in FIGS. 1 and 2 are designated by the same reference numerals, and detailed description thereof will be omitted. The input signal processing unit 20 of FIG. 7 operates as an interface for transmitting signals input from the input devices 22 (light pen), 23 (mouse), and 24 (numeric key controller) to the CPU 19, and the CPU 19 causes the intonation image data. Each part is controlled according to the editing program.

FIG. 8 shows an example of a screen when the user edits an intonation image. In FIG. 8, an image editing window 30 is an area for drawing an intonation image, and buttons 31, 32, 33 and 34 are used to specify the direction in which the edited image is changed by the intonation parameter. That is, when changing directions are set to the buttons 31, 32, 33, 34, the karaoke performance graphics processor 12 enlarges / reduces the image data in that direction in accordance with the intonation parameter. Buttons 36 to 40 are buttons for setting a command for editing. The “description” button of the button 36 is a button for executing a command for displaying an explanation screen of the editing procedure. The “select cell” button of the button 37 is a button for executing the “select cell” command. If a box in the image edit window 30 is clicked after executing this command, that part is colored with the currently selected color. . The "erase" button of the button 38 is a button for executing a command for clearing the color setting of the colored cell, and the cell clicked after the "erase" command is executed is not displayed as intonation image data. The “color” button of the button 39 is a button for executing a command to change the color of the square to be colored, and the CPU 19 instructs the graphics processor 12 each time the “color” button is clicked, and the button 39 The color of is changed, and the cells selected thereafter are colored in the same color as the current "color" button. The “record” button of the button 40 is clicked when all the settings are completed, and when this button is clicked, the editing information input by the CPU 19 is recorded in the memory 21.

The internal operation when the editing program is executed will be described with reference to the flowchart of FIG.

First, a song is selected in S901, and the user waits for an input as to whether or not to edit the intonation image (S902).
In step S902, when not editing, the CPU 19 causes the graphics processor 12 to store the memory 13 in the intonation image.
Make settings to use the data of (1) and start playing (route 1: S901-S902-S919-S92)
0). When editing in S902, the graphics processor 12 is controlled to display the screen of FIG. 8 on the display. Here, as an example, a case of creating an image as shown in FIG. 8 will be described.

First, in order to determine the color for coloring the square in the image editing window 30, the "color" button is clicked to determine the color (Route 2: S903-S904-S9).
05-S906-S907-S908-S909-S9
10-S911-S913). Next, the command is set to "select cell" to color the clicked cell to the current color (route 3: S903-S904-S905-S9).
06-S907-S908-S909-S915). When a square in the image edit window 30 is clicked in this state, the square is colored in the same color as the "color" button (Route 4: S903-S904-S905-S9).
06-S922). Therefore, when the operation of coloring the cells in the same color is performed, after going through (Route 2-3), Route 4 is repeated. If you want to clear the colored part, click the button 38 and set the command to "Erase" (Route 5: S903-
S904-S905-S906-S907-S908-
S909-S910-S914), and then click the square you want to delete (Route 6: S903-S904-S)
905-S906-S923). The above operation is the procedure for drawing the intonation image in the image editing window 30. If you click buttons 31-34 CPU
19 determines which of the four buttons, and makes settings for changing the intonation image in the direction corresponding to the button (Route 7: S903-S904-S905-S).
906-S907-S908-S909-S910-S
911-S912).

Such an editing procedure is the same for the color setting of the color bar window 35. When the image editing is completed by repeating the above operations, the button 40 is finally clicked (S907). Then, CPU19
Records the data of the edited image shape, color, direction of change, etc. in the memory 21 (S917) and programs the graphics processor 12 to use the data of the memory 21 for the intonation image and starts playing.

Thereafter, the internal operation during karaoke performance is exactly the same except that the basic pattern of the intonation image is read from the memory 21, not from the memory 13.

(Embodiment 3) FIG. 10 shows an example of a block configuration diagram when an LD is reproduced in the karaoke apparatus according to claim 4. In the figure, Examples 1 and 2
Those having the same functions as those shown in FIG. The karaoke device shown in FIG. 10 is provided with a voice intonation detection device 25 for extracting intonation parameters from the input from the microphone 9, and in the example of the drawing, in particular, for explaining the contents described in claim 8. In addition, it is provided with memories 26 and 27 for recording the intonation parameter of music information and the intonation parameter of microphone input. The operation will be described below with reference to the flowchart of FIG. 11 and the example of the use mode setting screen of FIG.

When the music selection is completed, the CPU 19 controls the graphics processor 12 to display the use mode setting screen shown in FIG. 12 on the display 11 (S11).
01). The CPU 19 controls the graphic processor 12 so as to move the display position of the cursor 48 according to the input signals from the input devices 22, 23 and 24. On this usage mode setting screen, the information displayed during the performance and the information displayed on the confirmation screen after the performance is determined (S1105).
S1113). When the user finishes the setting, he / she clicks the performance start button (S1104). Play start button 47
When is clicked, the CPU 19 controls the switches 28 and 29 and the graphics processor 12 according to the set information. That is, when reproducing the intonation information on the confirmation screen after the performance, the switches 28 and 29 are switched so that the intonation parameter can be stored in the memory, and the graphics processor 12 acquires the intonation parameter from the memory during the performance. To set. During the performance, the CPU 19 controls processing such as displaying the inflection image of the music information and the inflection image of the performer at different positions.

FIG. 15 shows an example in which an intonation image of music information and an intonation image of a user are displayed in synchronization with lyrics information on the confirmation screen. In the figure, the alphabet indicates the lyrics, the line 62 in the window 60 represents the intonation image of music information, and the line 63 represents the intonation image of the user.
The line 61 represents the correspondence to the current position of the lyrics.

Therefore, the user can recognize the difference between the intonation of his / her song and the intonation of the performance in what part of the song by using such information.

(Embodiment 4) FIG. 13 shows an example of a block configuration diagram when an LD is reproduced in the karaoke apparatus according to claim 6. In particular, FIG. 13 is a configuration diagram in the case where the intonation parameter can be recorded and then displayed on the display as described in the third embodiment, that is, the case where the feature shown in claim 8 is provided, and in the same FIG. Those having the same functions as those shown in FIG. The karaoke device shown in FIG.
A voice filter 48 for passing a voice signal is provided in the preceding stage of a music intonation extraction unit for extracting intonation from the music information read from the.

The operation will be described below with reference to FIG. First, the voice filter 48 is set to a frequency band suitable for passing a human voice as an initial setting. Therefore, the music information passed through the voice filter 48 mainly includes the data of the singing voice of the singer. Then, by extracting intonation parameters for this data, it becomes possible to extract a unique intonation when the singer originally sings the song, unlike pure music information. If the pass band of the voice filter 48 can be changed, the input device can be used when it is necessary to change the pass band due to differences in singers. 14
Shows a flowchart of the processing of the CPU 19,
Here, after the music selection is completed (1401), the presence or absence of a singer's song is confirmed (1402), and if there is, the CPU 19 sets the music information to pass through the voice filter 48. In the flowchart of FIG.
The processes from S1417 to S1417 are the same as those described in the third embodiment. The music information that has passed through the voice filter 48 includes a lot of singing voice information of the singer, which makes it possible to visualize the intonation peculiar to the singer.

It should be noted that in FIG. 3a of the present embodiment, the intonation image data, the lyrics information, and the background image are independently VR.
Although the method of storing in the AM is shown, the write control unit 17 is provided with a signal selection function for setting the display priority as lyrics information, intonation image data, and background image table as shown in FIG. It becomes possible to put together in a place.

An example has been described in which the write control unit 17 writes data that serves as a mark when writing intonation image data and lyrics information in order to select display data from intonation image data, lyrics information, and background video. It is also possible to provide a memory for recording the display priority.

Further, not only the intonation information can be converted into graphics data, but also the brightness and color of the whole composite video can be changed, or the color and brightness of the room lighting can be controlled by the intonation parameter. is there.

In order to realize the voice filter shown in the fourth embodiment, in addition to the method of using an analog circuit, D
It is also possible to configure by SP (Digital Signal Processor).

Further, in the example of FIG. 15, the music information intonation image and the voice intonation image are displayed as a graph, but as another method, a method of displaying two intonation parameters as numerical values and a difference between the two are displayed. Methods etc. are also possible.

An example of reproducing the LD on the recording medium has been described, but the present recording medium for karaoke information includes a compact disc, a video cassette, etc., and the present invention does not exclude the configuration other than the above-mentioned embodiment.

[0041]

According to the present invention, the intonation information, which is an important element of a song, can be displayed on the display as image data, and the intonation of the song which cannot be expressed by the conventional karaoke apparatus can be presented to the user. When dealing with a recording medium that can be visually transmitted and also video information in addition to music information, it can be displayed on the display together with the lyrics information in synchronization with the music information.
It is possible to provide information for singing a song well on one display.

Since the intonation information is extracted from the music information, a large amount of software (CD
-G, LD, etc.) can be used as is.

Since the inflection image can be edited by the user, the user can edit the usage environment uniquely, and each person can enjoy a unique and unique human interface. A karaoke device provided can be realized. It is possible to visually recognize the difference between the song of the user and the intonation of the song, including the specific part.

Furthermore, when the software in which the song by the singer is recorded is played back, it is possible to visually grasp the unique expression method of the professional singer, which is not in the music information just for playing the score. It is possible to provide a karaoke device that visually recognizes such data and allows the singer's song to be compared with the user's own song and provides excellent information for practicing the song.

[Brief description of drawings]

FIG. 1 is a block configuration diagram of a karaoke apparatus according to claim 1.

FIG. 2 is a block configuration diagram when an LD is used as a recording medium in the karaoke apparatus according to claim 2.

FIG. 3 is a detailed diagram of an intonation extraction unit and a video composition unit.

FIG. 4 is a diagram showing a display example in which intonation images are combined.

FIG. 5 is a diagram showing a display example in which intonation images are combined.

FIG. 6 is a diagram showing a display example in which intonation images are combined.

FIG. 7 is a block configuration diagram when an LD is used as a recording medium in the karaoke apparatus according to claim 3.

FIG. 8 is a diagram showing an example of an intonation image editing screen.

FIG. 9 is a flowchart of the CPU in the second embodiment.

FIG. 10 is a block configuration diagram of a third invention when an LD is used as a recording medium.

FIG. 11 is a flowchart of the CPU in the third embodiment.

FIG. 12 is a diagram showing an example of a usage mode setting screen.

FIG. 13 is a block configuration diagram of a fourth invention when an LD is used as a recording medium.

FIG. 14 is a flowchart of the CPU in the fourth embodiment.

FIG. 15 is a diagram showing an example of an intonation information confirmation screen.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Karaoke device 5 Music intonation extraction unit 7 Intonation image generation unit 51 Video output device 52 Reading device

Claims (8)

[Claims] 1. A reading device for reading data from a recording medium, a signal mixing amplifier for driving a speaker by mixing music information output by the reading device and an audio signal input from a microphone, and a high / low level of the music information. A music intonation extraction unit that extracts intensity features (hereinafter referred to as intonation information) and outputs an intonation parameter; an intonation image generation unit that produces intonation image data corresponding to the value of the intonation parameter; And a video output device for outputting the output of the unit to a display device. 2. A reading device for reading data from a recording medium on which video information (lyric information / background video) is recorded in addition to the music information, and data read by the reading device is separated into music information and video information. A signal separation unit, a function of displaying the video information in synchronization with the reproduction of the music information, and a video composition unit that superimposes intonation image data extracted from the music information on the video information. Karaoke device according to 1. 3. An image editing program for editing the intonation image data, a CPU (central processing unit) for controlling the intonation image generating unit in correspondence with the image editing program, and when executing the image editing program. At least one input device that generates an electrical or other physical signal change for inputting data; an input signal processing unit that operates as an interface between the input signal of the input device and the CPU; 3. The karaoke device according to claim 1, further comprising a memory for recording the program of claim 1 and the editing information input by the input device. 4. A voice intonation extraction unit that extracts intonation of a voice signal input from a microphone, and an intonation that produces intonation image data using two intonation parameters output from the music intonation extraction unit and the voice intonation extraction unit. An image generating unit;
3. The karaoke device according to any one of 3. 5. The karaoke apparatus according to claim 1, further comprising a voice filter for extracting a voice signal between the reading device and the music intonation extraction section. 6. The karaoke device according to claim 2, further comprising a voice filter for extracting a voice signal between the signal separation device and the music intonation extraction unit. 7. The karaoke apparatus according to claim 1, wherein size / shape / color information of the intonation image is changed in response to a change in the intonation parameter. 8. A memory for recording intonation parameters output by the voice intonation extraction unit, and means for displaying intonation image data generated from the intonation parameters stored in the memory.
The karaoke device according to any one of 3 and 6.