JPH08254984A - Signal processor - Google Patents

Abstract

PURPOSE: To provide a signal processor for supplying an accompaniment at a speed required by a user and for displaying characters to the accompaniment. CONSTITUTION: An accompaniment signal and a character signal are parallelly stored in a ring memory 12 and a VSC 18 controls the readout speed of the accompaniment signal and the character signal from the ring memory 12 by the speed change request of an accompaniment. Moreover, the VSC 18 applies a speech-speed transformation processing to a read accompaniment signal to prolong or shorten the output time of the signal without changing its musical interval. The accompaniment signal applied with the speech-speed transformation is supplied to a reproducing part 16 and then the accompaniment sound having the speed corresponding to the request is reproduced to be outputted. Besides, read character signals are superimposed on a video signal to be displayed on a display part 28 as prescribed pictures, Thus, characters (a text) are displayed matching with the speed of the accompaniment.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a signal processing device used in a karaoke apparatus or the like for displaying an accompaniment sound and an image at a speed according to a user's request.

[0002]

2. Description of the Related Art Currently, accompaniment sounds stored in advance are reproduced,
A so-called karaoke device in which a user enjoys a song accompanied by this is widely used. This karaoke device uses a laser disk (LD) or the like as a recording medium, and reproduces a video signal containing a voice signal (accompaniment signal) recorded in the LD and a character signal such as lyrics for each song. Thus, the accompaniment sound is output from the speaker, and the lyrics and the background image are displayed on the monitor. In addition, in order to make it easier to sing, there are various ways to change the color of the displayed lyrics according to the progress of the accompaniment, or to display a beautiful background image with the lyrics to create a mood. Has been done.

In such a karaoke apparatus, it is known that the accompaniment influences the singer's ease of singing. Therefore, the pitch adjustment means for freely adjusting the pitch of the accompaniment according to the request of the singer or the like is provided to provide the accompaniment of the pitch that is easy to sing, thereby improving the ease of singing.

[0004]

Originally, a song is a means for expressing the personality, emotions, etc. of the singer. For example, in the case of live performance, an accompaniment is provided at the speed required by the singer.
Therefore, in the case of live performance, even the same phrase part of the same song can be expressed quite differently depending on the singer. Therefore, even when the karaoke device provides the accompaniment, it is preferable to respect the individuality of the singer as much as possible and provide the accompaniment according to the request of the singer.

However, in the conventional karaoke device,
Only the means for adjusting the pitch of the accompaniment is provided,
It was not possible to arbitrarily change the tempo of the song, that is, the accompaniment speed, which is an important means of expressing the song. Therefore, the singer must always sing along with the accompaniment of a predetermined speed, and cannot provide the accompaniment sound at a speed according to the singer's idea.

Therefore, the applicant of the present application has proposed a technique for manually or automatically changing the accompaniment speed in accordance with the singing speed of the singer when the accompaniment sound and the speed of the song deviate from each other. This allows the singer to sing the song at any speed.

However, with respect to the image displayed on the monitor, the accompaniment sound and the image are deviated in time by changing the accompaniment speed. Since the background image displayed on the monitor expresses a scene or the like that matches the music, a time difference of 2 to 3 seconds from the accompaniment sound is not a problem. However, if text information such as lyrics is displayed at the same time as this background image, the lyrics information indicates the progress of the song, so if there is a time lag between the accompaniment sound and the lyrics display, the lyrics are displayed. There is a problem that you cannot sing unless you memorize it, and a means to eliminate this time lag was required.

The present invention has been made in order to solve the above-mentioned problems, and it is a signal processing which supplies an accompaniment sound at a speed required by a user and displays characters such as lyrics in accordance with the accompaniment sound. The purpose is to provide a device.

[0009]

In order to achieve the above object, the signal processing apparatus according to the present invention has the following features.

A signal processing device for processing an input accompaniment signal and a character signal, wherein the accompaniment signal and the character signal are sequentially stored in place of old signals to store a predetermined time, and an accompaniment speed. In response to the change request signal,
A read control unit that controls the read speed of the accompaniment signal and the character signal from the storage unit, and compression or decompression processing is performed on the accompaniment signal read from the storage unit without changing the pitch, and the output time An accompaniment signal output control unit for shortening or extending the length, and an image signal output unit for synthesizing and outputting character information according to the character signal read from the storage unit with an input video signal. Characterize.

Further, the input accompaniment signal, character signal and video signal are signals obtained by independently reading out signals recorded on a recording medium.

Further, the character information is separated from the video signal containing the character information recorded on the recording medium, and the character information is supplied to the storage section as the input character signal, and the character signal is separated. And a video complementing unit for complementing the character information portion of the video signal from which the information has been separated and outputting the complemented video signal as the input video signal.

A signal processing device for processing a video signal including an accompaniment signal and a character signal read from a recording medium by an audio pickup and a video pickup, which are provided independently, The accompaniment signal is replaced with an old signal, and is sequentially stored for a predetermined time, and a read control unit that controls the read speed of the accompaniment signal from the storage unit according to the accompaniment speed change request signal. And an accompaniment signal output control unit for performing compression or expansion processing on the accompaniment signal read from the storage unit without changing the pitch, thereby shortening or extending the output time, or extending the output time for the accompaniment signal or A read position control unit for generating a control signal for controlling the read position of the video signal recorded on the recording medium in accordance with the shortening process. And butterflies.

[0014]

In the signal processing device of the present invention, the accompaniment signal and the character signal read from the recording medium and input are sequentially stored in the same storage section. Then, the read speed of the accompaniment signal and the character signal from the storage unit is controlled according to the accompaniment speed change request signal. Then, the read accompaniment signal is compressed or expanded without changing the pitch to shorten or extend the output time of the accompaniment signal. On the other hand, the read character signal is displayed on a display unit such as a monitor as predetermined character information. As a result, the speed of the accompaniment, that is, the tempo of the song becomes an arbitrary speed according to the intention of the user, and the singer does not sing along with the accompaniment but can adjust the accompaniment to the progress of his / her song. Further, since the characters are displayed on the display unit in accordance with the accompaniment, it is possible to sing while watching the lyrics even if the accompaniment speed is changed.

When the input video signal includes character information, the character information is separated from the video signal,
The character signal is stored in the storage unit in parallel with the accompaniment signal. Then, the accompaniment signal output control unit performs a predetermined process according to the accompaniment speed change request signal as described above. On the other hand, for the video signal from which the character information is separated, the character information portion is complemented and characters are erased from the video signal. Further, the image signal output unit synthesizes the character signal read from the storage unit at a predetermined speed with the video signal from which characters have been deleted to form an image signal. As a result, the accompaniment is reproduced at the requested speed, and the characters are displayed in accordance with the accompaniment.

If a video signal is stored in a state in which a character signal is included in a predetermined recording medium and the video signal and the accompaniment signal are read by the video pickup and the audio pickup, respectively, the audio pickup is used. For the accompaniment signals that are individually read and input, the output time is shortened or extended according to the accompaniment speed change request signal. Then, by controlling the read position of the video signal of the video pickup on the recording medium so as to match the output accompaniment, an image is displayed in accordance with the accompaniment.

[0017]

【Example】

(Embodiment 1) Hereinafter, Embodiment 1 of the present invention will be described with reference to the drawings.

[Schematic Configuration of Apparatus] FIG. 1 is a schematic block diagram of a signal processing apparatus according to a first embodiment.

In FIG. 1, a recording medium 30 such as an LD has a voice signal (hereinafter referred to as an accompaniment signal), which is an accompaniment of a song, a character signal indicating lyrics, and a video signal representing a background image, which are different from each other. It is stored as a signal.

The accompaniment signal, the character signal, and the video signal are read out by the signal pickup (PU) 32 and separated as separate signals in the signal separation unit 20.

The separated analog accompaniment signal is supplied to an analog / digital converter (ADC) 10 for converting the accompaniment signal into predetermined digital data. AD
The C10 samples the input analog accompaniment signal at a predetermined sampling frequency, converts it into a digital accompaniment signal having a predetermined quantization bit number, and supplies this digital accompaniment signal to the ring memory 12 connected to the ADC 10.

The character signals such as lyrics separated by the signal separation unit 20 are also supplied to the ring memory 12.

The ring memory 12 is a memory for sequentially storing incoming accompaniment signals and character signals in place of old signals before a predetermined time, and always stores accompaniment signals and character signals for a predetermined time according to the storage capacity. I remember. The accompaniment signal and the character signal are stored in the ring memory 12 in parallel at a predetermined bit rate.

A voice speed conversion processing unit (VSC) 18 is connected to the ring memory 12. And VSC18
In response to the request signal for changing the accompaniment speed, the ring memory 1
The read speed of the accompaniment signal and the character signal from 2 is controlled, and the time axis expansion processing or compression processing is performed on the read accompaniment signal without changing the pitch, and the output time is extended or shortened. Performs speed conversion processing (speech speed conversion processing).

The digital accompaniment signal subjected to the speech speed conversion process is read out by the digital-analog converter (DAC) 14 connected to the VSC 18 and converted into an analog accompaniment signal. Is supplied to the reproducing unit 16 such as a speaker and reproduced and output as a predetermined accompaniment sound.

The character signal stored in parallel with the accompaniment signal in the ring memory 12 is read out at the same speed as the accompaniment signal by the read control of the VSC 18, and the read character signal is connected to the ring memory 12. It is supplied to the character decoder 22 and decoded. Then, the character information obtained by decoding is output to the synthesizing unit 24.

The synthesizing unit 24, which is an image signal output unit, synthesizes the input video signal and the character information from the character decoder 22 to form a predetermined image signal, and the formed image signal is processed by a CRT or the like. It is supplied to the display unit 28. This allows
Characters (lyrics) are displayed on the display unit 28 along with the background image in accordance with the accompaniment speed.

[Method of changing accompaniment speed] As shown in FIG. 2, when writing an accompaniment signal and a character signal to the ring memory 12, the writing position precedes the reading position by a predetermined time (for example, 2 to 3 seconds). It is carried out sequentially.

When the character signal is stored in the LD in the same format as the CDG, the sampling frequency FS is 44.1.
and the character signal is 44.1 kbps (= 6bi).
The information is about t × 7350 bps). Therefore, when the accompaniment signal and the character signal are sequentially stored in the ring memory 12 with 16 bits, the character signal can be stored in the ring memory 12 in parallel with the accompaniment signal by allocating the lower 1 bit of the accompaniment signal to the character signal. The bit rate of the accompaniment signal and the character signal is not limited to this, and may be, for example, every 8 bits.

When singing at standard speed, the VSC of FIG.
Reference numeral 18 controls reading so that the reading position of the ring memory 12 becomes a standard reading position that is apart from the writing position by a fixed distance (2 to 3 seconds in time). The accompaniment signal read from the ring memory 12 is V
DA without changing the speech speed in SC18
It is output to C14. On the other hand, the character signal read at the same time as the reading of the accompaniment signal is decoded by the character decoder 22, is combined with the video signal by the combining unit 24, and a predetermined image is displayed on the display unit 28.

Next, an accompaniment speed change request signal is generated by automatically detecting the manual request of the singer or the time difference between the melody of the song and the melody of the accompaniment, and C (not shown) is generated.
The PU or the like gives the VSC 18 an instruction as to whether to increase or decrease the accompaniment speed.

For example, if the singer demands to slow down the accompaniment when he wants to sing slowly at the climax part of the song or when the song is delayed relative to the accompaniment, C
Based on the instruction from the PU, the VSC 18 makes the ring memory 1
The read timing (reading speed) of the accompaniment signal and the character signal from 2 is delayed by a predetermined period and a predetermined ratio.
As a result, the read position in FIG. 2 moves away from the write position. The ring memory 1 is the limit to delay the accompaniment.
It is determined according to the capacity of 2.

When the player wants to sing fast, the VSC 18 makes the accompaniment signal and the character signal read from the ring memory 12 faster by a predetermined period and at a predetermined ratio, as opposed to delaying the accompaniment. . As a result, the read position shown in FIG. 2 approaches the write position.

In this way, the character signal read out at a predetermined timing in response to the accompaniment speed change request signal is decoded by the character decoder 22, read out frame by frame, and progressed by the synthesizing section 24 at a normal speed. A predetermined image signal is obtained by synthesizing the image signal with the current image signal. For example, when it is requested to delay the accompaniment, a character signal delayed by a predetermined time with respect to the video signal is synthesized, and the character corresponding to the accompaniment delayed by the predetermined time is displayed on the display unit 28. .

The frequency of the accompaniment signal read at a timing different from the normal read timing changes, and the pitch of the accompaniment sound changes if reproduced as it is. Therefore, the VSC 18 performs a speech speed conversion process for changing the speed (time conversion) without changing the pitch of the read accompaniment signal, and extends or shortens the output time of the accompaniment signal output to the DAC 14.

In the speech speed conversion processing, first, the read accompaniment signal is divided into frames for each predetermined period, a repetitive waveform from each of the divided frames is detected, and a pitch cycle which is a repetitive unit of the waveform is detected. Then, this repetitive waveform is divided for each pitch period. Furthermore, this repetitive waveform portion is omitted or added in pitch units.

When the repeated waveform portion is omitted, the output time of the accompaniment signal to be output is shortened, and when added, the output time is extended.

For example, when the accompaniment signal and the character signal for 2.5 seconds are delayed by 20% due to the accompaniment change request, the accompaniment signal is output as an accompaniment for 3 seconds without changing its pitch.

As described above, in this embodiment, the accompaniment speed is changed in response to the request, and the characters are displayed in accordance with the accompaniment speed. Therefore, the accompaniment can be provided at a speed suitable for the singer's song, and the lyrics can be displayed in accordance with the accompaniment, which greatly improves the singing ease.

(Second Embodiment) An LD which has been conventionally used as a recording medium stores a video signal containing character information and an accompaniment signal. In the second embodiment, the character information is separated from the video signal including the character information read from such a recording medium and the signal processing is performed. In addition, LD
As a recording format of CA, one frame of the video signal is recorded around the track and reproduced at a constant rotation speed.
V (Constant Angular Velocity) method and CLV (Constant Angular Velocity) method where the length of one frame on the track is constant and the playback speed is different on the inner and outer circumferences of the LD.
Although there is a linear velocity method, both the CAV method and the CLV method can be applied in the case of the second embodiment.

The signal processing apparatus according to the second embodiment will be described below with reference to FIG. It should be noted that the same parts as those of the drawings already described are designated by the same reference numerals and the description thereof will be omitted.

The video signal read from the recording medium and input is first supplied to the character signal separating section 40. The character signal separation unit 40 separates character information from the video signal,
This character information is supplied as a character signal to the buffer memory 42 as a digital signal for each frame. The separated character signal is information for 20 horizontal lines on the display screen × 400 dots, and one dot is represented by 1 or 2 bits. In the karaoke device, since the lyrics are often displayed at the same position at the bottom of the screen, the character signal separating unit 40
For example, the character signal is discriminated and separated by comparing the brightness of the portion corresponding to the lower part of the screen in the video signal with the same portion of another frame.

The video signal from which the character signal has been separated by the character signal separating section 40 is supplied to the character erasing section 46, where the character signal section is complemented so as to have the same color and brightness as the surrounding video signal. , Characters are deleted from the video signal.

On the other hand, the character signal separated and stored in the buffer memory 42 is parallel to the accompaniment signal read out from the recording medium and input, at a predetermined bit rate and of the accompaniment signal to the ring memory 12. The data is sequentially stored in the ring memory 12 at the writing frequency FS (for example, 10 kHz).

When an accompaniment speed change request signal is generated, VS
C18 accordingly responds to the ring memory 1 as in the first embodiment.
The read speed of the accompaniment signal and the character signal from 2 is controlled, and the voice speed conversion process is performed on the read accompaniment signal.

In addition, the ring memory 1 by the VSC 18
The character signal read from No. 2 is written in the buffer memory 44.

Then, the synthesizing unit 48, based on the vertical / horizontal synchronizing signal of the video signal supplied from the character erasing unit 46,
A character signal is read from the buffer memory 44, and the character signal read from the buffer memory 44 is combined as a character information with a video signal in which characters are erased to create a predetermined image signal. The image signal is supplied to the display unit 28, and the display unit 28 displays character information such as lyrics in accordance with the accompaniment speed.

The bit ratio between the accompaniment signal and the character signal stored in the ring memory 12 is, for example, 24 or 12 bits for the accompaniment signal and 20 or 40 bits for the character signal when the storage capacity of the ring memory 12 is 64 k × 52 bits = 4 Mbits. Can be Here, regarding the character signal, the vertical 20 dots on the display screen are handled collectively, and these 20 dots (20 or 40 bits) are handled as a ring memory 1.
If the parallel processing with the accompaniment signal is performed on the memory 2, the ring memory 12 can be easily accessed.

The number of addresses in the ring memory 12 is
For example, 400 points × 25 times × 6 seconds (± 3 seconds of memory) = 60 k. By thus setting the number of addresses of the ring memory 12 to be an integral multiple of the number of points (dots in the horizontal line direction) of the character information, the position of the character signal on the screen can be ascertained by the address of the ring memory 12 Is easy to handle.

In the ring memory 12, if a character signal of 20 bits (or 40 bits) is processed in parallel,
A character signal for one frame is output to the buffer memory 44 by reading 400 times from the ring memory 12. Therefore, the read frequency from the buffer memory 44 is about 10 kHz (standard read frequency in the ring memory 12) / 400 = 25 Hz.

(Third Embodiment) In the third embodiment, when a video signal including character information and an accompaniment signal are recorded on a recording medium such as an LD as in the second embodiment, the video signal and the accompaniment signal are recorded. Are read by separate pickups, and the reading of the video signal from the recording medium is controlled according to the accompaniment speed.

The LD used as the recording medium is a CAV type recording format LD. This CAV system L
In D, since one frame of the video signal is recorded in one track, a still image can be easily displayed by performing a track jump.

Further, in this embodiment, as described above, the CAV
Since the LD of the type is used as a recording medium, the traveling speed of the image to be displayed can be controlled by the track jump of the video PU. On the other hand, when the accompaniment signal is digitally recorded (or FM recorded) in the CD format, skipping occurs when a track jump is performed. Therefore, the LD is configured to rotate at a standard speed, and the accompaniment signals are sequentially picked up without performing track jumps.

The third embodiment will be described below with reference to FIG. It should be noted that the same parts as those of the drawings already described are designated by the same reference numerals and the description thereof will be omitted.

The accompaniment signal read from the recording medium 30 by the audio PU 34 and input to the signal processing device is first supplied to the ADC 10, converted into a digital signal by the ADC 10, and written to the ring memory 12 at a predetermined writing frequency. Are written in sequence. At the same time, the ring memory 12 stores, together with the accompaniment signal, a frame number assigned to each frame corresponding to the accompaniment signal.

When an accompaniment speed change request is made automatically or manually, the VSC 18 controls the reading of the accompaniment signal from the ring memory 12, and, in the same manner as in the first and second embodiments, the VSC 18 responds to the read accompaniment signal. To convert the speech speed,
The output time of the accompaniment signal is extended or shortened and this is set to DAC1.
Supply to 4.

The microcomputer 23 generates a predetermined control signal so that the position of the video PU 36 is equal to the current position of the audio PU 34 + the read delay amount in the ring memory 12 + the delay amount in the VSC 18, and the PU servo is performed. Give a command to 50. In response to this command, the PU servo 50 responds to the video PU 3
By controlling the position of 6, the video PU 36 jumps to the track having the frame number corresponding to the accompaniment signal to be reproduced. As a result, the video signal of the track delayed by an amount corresponding to the delay of the accompaniment signal with respect to the position of the audio PU 34 is picked up.

The current position of the audio PU 34 is determined from the frame number attached to the accompaniment signal. The read delay in the ring memory 12 is a delay according to the distance between the write position and the read position of the ring memory 12, and is detected from the access state to the ring memory 12. Furthermore, the delay in VSC18 is V
SC18 is the time required for the speech speed conversion process, which is a fixed delay.

In this way, the video signal read from the storage medium 30 in response to the accompaniment delay is output to the display unit 28 via the predetermined path and is output from the accompaniment sound reproducing unit 16. An image corresponding to the sound progress is displayed. Therefore, it is possible to display the lyrics suitable for the accompaniment.

[0060]

As described above, according to the configuration of the signal processing apparatus of the present invention, the accompaniment speed is changed in accordance with the accompaniment speed change request signal without changing the pitch, and the lyrics are adjusted in accordance with the accompaniment. Characters such as can be displayed. Therefore, instead of the singer singing along with the accompaniment, the singer can sing along with the accompaniment. At the same time,
Since the lyrics indicating the progress of the accompaniment are displayed along with the accompaniment, it is possible to sing while watching this display even if the lyrics are not memorized.

Furthermore, when a signal is read from a recording medium recorded in an existing recording format, the video signal input to the signal processing device may include character information. Therefore, in the present invention, a character signal separator is provided to separate character information from the video signal. Then, the character information separated according to the accompaniment speed is processed as a character signal, and the character can be displayed in accordance with the accompaniment. Therefore, without changing the recording format of the recording medium,
The accompaniment speed and the character display speed can be arbitrarily changed.

Further, even if the read position of the video signal stored in the recording medium is controlled in accordance with the requested accompaniment speed, the accompaniment speed can be arbitrarily changed without changing the recording format on the recording medium. In addition to being changeable, the display speed of the characters and the background image can be changed according to the accompaniment speed.

[Brief description of drawings]

FIG. 1 is a schematic block diagram of a main part of a signal processing device as a first embodiment of the present invention.

FIG. 2 is a diagram showing a relationship between a write position and a read position of the ring memory 12 of FIG.

FIG. 3 is a schematic block diagram of a main part of a signal processing device as a second embodiment of the present invention.

FIG. 4 is a schematic block diagram of a main part of a signal processing device as a third embodiment of the present invention.

[Explanation of symbols]

10 ADC, 12 ring memory, 14 DAC, 1
6 playback unit, 18 VSC, 22 character decoder, 2
4, 48 composition section, 28 display section, 30 recording medium, 3
2 signal PU, 34 audio PU, 36 video PU,
40 character signal separation unit, 42, 44 buffer memory,
46 character eraser, 50 PU servo.

Claims (4)

[Claims] 1. A signal processing device for processing an input accompaniment signal and a character signal, the storage unit storing the accompaniment signal and the character signal for a predetermined time by sequentially storing old signals. A read control unit that controls a read speed of the accompaniment signal and the character signal from the storage unit in response to an accompaniment speed change request signal, without changing the pitch of the accompaniment signal read from the storage unit. An accompaniment signal output control unit that performs compression or decompression processing to shorten or extend the output time, and an image that is output by combining character information according to the character signal read from the storage unit with an input video signal. A signal processing device comprising: a signal output unit. 2. The signal processing device according to claim 1, wherein the input accompaniment signal, character signal, and video signal are signals obtained by independently reading signals recorded on a recording medium. Signal processing device. 3. The signal processing apparatus according to claim 1, further comprising separating character information from a video signal containing character information recorded on a recording medium, and storing the character information as the input character signal. And a video signal complementation unit that complements the textual information part of the video signal from which the textual information is separated and outputs the complemented video signal as the input video signal. A signal processing device characterized by: 4. A signal processing device for processing a video signal including an accompaniment signal and a character signal read from a recording medium by an audio pickup and a video pickup, which are provided independently, And a read control unit for controlling the read speed of the accompaniment signal from the storage unit according to the accompaniment speed change request signal And an accompaniment signal output control unit for performing compression or expansion processing on the accompaniment signal read from the storage unit without changing the pitch, thereby shortening or extending the output time, or extending the output time for the accompaniment signal or And a read position control unit that generates a control signal for controlling the read position of the video signal recorded on the recording medium according to the shortening process. Signal processing apparatus according to.