JPH10319980A - Karaoke sing-along machine - Google Patents

Abstract

PROBLEM TO BE SOLVED: To print his or her own singing figure of a singer with ease even if the singer does not care about lighting and a shutter by driving an illumination device toward the singer and sampling the synthesized images combining the singer's videos and background images of this time. SOLUTION: While the videos taken by a video camera 26 are inputted as video signals to a video control section 21, the background image data read out of a hard disk device 12 is bit map developed on a video RAM 20 via a central control section 11. The video control section 21 fits the video of the video camera 26 into the bit map image to synthesize the images, forms the video signal thereof and outputs the signal to a display 23. When a sampling command is given, the video displayed on the display 23 is fixed and displayed and the 5 image is printed by a video printer 22. At this time, a stroboscope is automatically lighted toward the singer in synchronization with the sampling command.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention reproduces karaoke data as appropriate to output accompaniment music and lyric images of karaoke music in synchronism with a speaker and a display, and also outputs a singer's voice signal together with the karaoke accompaniment music. Regarding the karaoke device outputting to the speaker, in particular,
The present invention relates to a karaoke apparatus to which a system for photographing and printing a singing person is added.

[0002]

2. Description of the Related Art A karaoke apparatus reproduces karaoke data such as an accompaniment music and a lyric image of an appropriate karaoke tune in response to a user's selection of a tune, and synchronizes the accompaniment music with the lyric image and outputs it to a speaker and display. I do.

In addition to the functions of these conventional karaoke devices,
2. Description of the Related Art There is a karaoke apparatus having a karaoke print function of printing a figure of a singer by a video printer. This is because, by adding a video camera, a video printer, and an image synthesizing means to the configuration of the conventional karaoke apparatus, the image of the singer photographed by the video camera is combined with the background image stored in the data storage unit. Make an image. The background image includes a decorative pattern called a frame pattern. Then, the synthesized image is displayed on a display, and is sampled and printed by a video printer.

[0004]

In a conventional karaoke apparatus having a karaoke print function, it was necessary to manually turn on a light for illumination and take a shutter with a remote controller or the like when taking a picture of a face. Therefore, even if you think that the shutter was released when you took a good pose and a good expression, looking at the printed one, the overall brightness was not enough or the lighting direction was bad, and the user was disappointed. There was something.

[0005] In addition, the lighting conditions at the time of photographing, such as the type, direction, brightness, and color of the light, are usually fixed, so that the illumination changes little with respect to the facial expression and the movement of a person, which is interesting. Did not. Furthermore, under various lighting conditions, it was difficult to catch the appearance of singing at the swelling portion of the singing song with good timing and release the shutter. In other words, in the rust part of the song that the singer seems to have a good expression, the lighting appropriate for the place is applied to the singer, and the image showing the singer's expression at that time is sampled and printed with good timing There was very little that could be done.

Accordingly, the present invention has been made in view of such a conventional problem, and an object of the present invention is to allow a singer to easily print his or her singing figure without having to worry about lights and shutters. In a place where the expression of the singer becomes rich, such as the rust portion of the song, the lighting conditions are appropriately changed, the singer is photographed with a video camera, and a synthesized image obtained by synthesizing the video and an appropriate background image is obtained. It is to provide a karaoke apparatus that can print.

[0007]

In order to achieve the above object, according to the present invention, the accompaniment music and the lyric image are reproduced by appropriately reproducing karaoke data including the accompaniment music of the karaoke music and the lyric image. In a karaoke apparatus that outputs to a speaker and a voice signal of a singer along with the accompaniment music in synchronization with outputting to a speaker and a display in synchronization, a video camera for photographing the singer, and a plurality of light sources at different positions. A lighting device capable of independently controlling the driving thereof, a lighting control means for controlling the lighting device, a data storage unit storing a background image, and the background image read from the data storage unit. An image is synthesized by combining images captured by a video camera, and the synthesized image is displayed on the display or another system. An image synthesizing unit that displays the image in a ray, and a video printer that samples and prints the synthesized image displayed on the display, wherein the accompaniment music information included in the karaoke data samples the synthesized image. Lighting control information for controlling the lighting device in various modes is added together with the timing information for giving an instruction, and when a sampling instruction is given based on the timing information, the timing is based on the lighting control information at that time. The lighting device is driven toward the singer under the lighting condition, and the video printer samples a combined image obtained by combining the singer's video at that time and the background image.

Here, the video printer sequentially samples and stores a combined image obtained by combining the video taken by the video camera and the background image under different lighting conditions, and It is desirable to have a means for arranging and printing the stored images on one sheet of print paper.

[0009] The background image includes a decoration pattern created to be added to the portrait image, and the decoration pattern is timely transmitted from the host device when the karaoke device is connected to the host device via a communication line. It is desirable to be done.

[0010]

FIG. 1 shows an embodiment of a karaoke apparatus according to the present invention. Central control unit 1
Reference numeral 1 denotes a computer including a CPU, ROM, and RAM therein, and controls and controls each peripheral component of the karaoke apparatus 1. The central control unit 11 is connected to the communication line network 30 via the modem 27 and receives distribution of karaoke data such as accompaniment music of karaoke music and lyrics data synchronized therewith from the host device 31. The delivered karaoke data is stored in the hard disk device 12. In addition, the hard disk device 12 stores a background image including a decorative design, which is a decorative illustration designed to frame the periphery of a person image. This background image is also distributed from the host device 31 in a timely manner. The video CD changer 24 stores a plurality of video CDs. Each video CD contains moving image information such as an image video. Further, a remote control receiving unit 15 for receiving transmission signals from the operation panel 14 and the remote control transmitter 13 is coupled to the central control unit 11 via an operation control unit 16.

Next, the operation of reproducing karaoke data will be described. When the central control unit 11 receives a user's music selection input from the remote control transmitter 13 or the operation panel 14 via the operation control unit 16, the central control unit 11 reads karaoke data of the selected karaoke music from the hard disk device 12. At the same time, the video CD changer 24 is controlled so as to reproduce a video CD containing an appropriate image and video. On the other hand, the accompaniment music data is reproduced by the synthesizer 17 into a music signal. Then, the voice signal of the singer input from the microphone 25 and the music signal reproduced by the mixing amplifier 18 are synthesized and output from the speaker 19. The lyrics data is transferred to the video RAM 20 as text data, and the video control unit 21 superimposes the text data in the video RAM 20 on an image output from the video CD and outputs it to the display 23.

The karaoke apparatus 1 has a video control unit 21 and a display 2 which display the contents displayed on the display 23 together with the basic functions of reproducing the karaoke music described above.
3 also has a video print function for printing by the video printer 22 inserted in the signal path. This video print function is operated by the following command system under the control of the central control unit 11. That is, when a sampling command is issued from the central control unit 11 to the video printer 22, the video printer 22 synchronizes with the video signal output from the video control unit 21 and Capture the image into an image memory such as a memory. At this time, the sampled image information is displayed on the display 23 as a still image. Then, by appropriately processing the stored image information, the display screen of the display 23 is hard-copied on the print sheet. Further, a multi-sampling mode is provided in which a plurality of different images are printed side by side on one print sheet by sequentially storing input video signals in an image memory. Of course, a multi-print mode is also provided in which one image is selected from the sampled images and printed on one print sheet, or a plurality of the same images are arranged and printed on one print sheet.

Here, the karaoke apparatus 1 displays a composite image obtained by combining a video of a video camera 26 equipped for photographing a singer and an appropriate background image on a display 23.
And displays the displayed image on the video printer 2.
2 has the function of printing. That is, the video image captured by the video camera 26 is converted into a video signal by the video
The background image data read from the hard disk device 12 is developed into a bitmap in the video RAM 20 via the central control unit 11. Then, the video control unit 21 adds the video camera 2 to the bitmap image.
6 is inserted and synthesized, a video signal is generated and output to the display 23. Then, when a sampling command is given, the image displayed on the display 23 is fixedly displayed, and the image is displayed on the video printer 22.
Printed with

Further, the karaoke apparatus 1 can control the direction and the position of the lighting directed to the singer and the dimming pattern so as to keep pace with the atmosphere of the karaoke song. It has a lighting system that turns on the strobe automatically for the singer in synchronization. This lighting system also has a function of constantly turning on the light from the start to the end of the performance of the karaoke song and changing the lighting conditions for the singer in real time in accordance with the progress of the song. Therefore, the configuration of the lighting system and the operation of each component will be described.

The illumination system includes an illumination device 40 including an input / output control unit 42, a dimming control unit 43, a dimming device 44, and a light source 45, and an illumination direction for changing the illumination direction and the illumination position of the illumination device 40. -It is comprised with the lighting position control apparatus 41. The lighting system is controlled based on lighting control information added to the accompaniment music information of the karaoke data.

Here, the illumination control information includes the direction (azimuth / elevation angle) of the illumination device toward the subject, illumination direction / position data relating to the position of the illumination device, and the type of illumination (spotlight, strobe, etc.). And dimming pattern data that describes dimming patterns such as the color and luminous intensity of illumination. These data are added to the karaoke data at appropriate times as control data similar to sound source designation information described in encoded music information such as the MIDI standard, together with timing information for giving a sampling command. . In this embodiment, according to the state of the accompaniment music,
It is assumed that timing information and illumination control information are appropriately added to a climax part of the music such as a so-called rust part.

By analyzing the contents of the melody and lyrics of each karaoke song, it is possible to predict that the singer will have such an expression in this part, so that a good shooting timing can be determined in advance. It is.
In other words, by analyzing changes in the pitch (frequency), tempo, and rhythm of the song, and by analyzing the meaning contained in the lyrics, it is possible to predict the excitement of each karaoke song and open the mouth of the singer. Not only the condition, but also the posture and movement of the body when the microphone is held can be predicted to some extent. Therefore, the shooting timing and the lighting conditions at that time may be determined in consideration of these points comprehensively.

The illumination direction / illumination position control device 41 is a device for changing the direction and position of the illumination device 40 toward the subject. The configuration of this device mainly uses a servomotor used to convert a control signal of a servo mechanism into torque or force and apply rotation or displacement to a load. That is, a servo head in which two pulse motors of an elevation / elevation angle servo motor and an azimuth angle servo motor are incorporated and a means for moving the servo head are provided. Attach.
Here, the servo head can rotate the two pulse motors incorporated therein appropriately according to a control signal from a servo control drive unit in the control device 41, so that the direction of the illumination device 40 can be changed in the vertical and horizontal directions. It can be changed freely. Then, it receives the illumination direction / illumination position data and controls the direction / position of the illumination device 40.

On the other hand, when the input / output control unit 42 receives the dimming pattern data, the dimming control unit 43 sequentially decodes the message described in the data and controls the dimming device 44 according to the message. Conditions such as the type, luminous intensity, and color of the light source 45 are set, and the light source 45 is turned on or emits light. Here, as the light source 45, there are a spotlight, a strobe, a fluorescent lamp, and the like. It is desirable that the plurality of light sources are arranged at different positions and can be independently driven and controlled. A configuration including a light source may be employed. Further, it is desirable to use a fluorescent lamp or the like having a good color rendering property to enable illumination to excite the field.

Next, a function of photographing and printing a person using the above-described lighting system will be described. First, prior to the start of performance of a music piece, the user operates the remote control transmitter 13 or the operation panel 14 to select one of the genres of the decorative pattern when selecting a decorative pattern to be added to the person image. Then, a plurality of decorative design samples are displayed on the display 23. If there is no desired screen, a sample of the next screen is displayed. When the desired decorative design is determined, the number assigned to the image is input from the remote control transmitter 13 or the operation panel 14.

Next, it is selected whether the sampling timing of the synthesized image is automatic or manual. When automatic is selected, the timing to release the shutter of the camera, that is, the timing at which the above-mentioned sampling command is issued and the lighting conditions at that time are automatically set. A singer's figure is photographed and a print with a decorative pattern is created.

In the case of manual operation, a synthesized image is always displayed on the display 23, and a singer or accompanying person inputs an instruction from the remote control transmitter 13 or the operation panel 14 at a sampling position (shutter opportunity). The composite image is stored in the image memory of the video printer 22. Here, description will be made assuming that automatic sampling is selected.

When the performance of the music starts, the central controller 11
Monitors the transmission of timing information together with the normal playback control of karaoke music. Then, when the timing information is received during the performance, the lighting direction and position of the lighting device 40 and the type, color and luminous intensity of the light source 45 are set based on the lighting control information at that time, and the lighting is directed toward the singer. The camera is turned on and the camera shutter is released. Then, it instructs the video control unit 21 to combine the video captured by the video camera with the selected decorative pattern, and at the appropriate time interval, instructs the video printer 22 to capture the image in the multi-sampling mode. Command. It is assumed that the time interval is set so that, for example, nine shots are continuously taken from the start to the end of the rust of the music. Further, in the multi-sampling mode, each time the shutter is pressed, the lighting device 4 is operated under different lighting conditions.
It is assumed that the lighting control information is set in advance so that 0 lights up.

This composite image is displayed as a still image on the display 23 in the order of sampling. When the sampling period ends, all the sampled images are divided into frames and displayed on the display 23. When the user wants to print this composite image, he or she can use the remote control transmitter 13 or the operation panel 14 to set the multi-print mode or
The user selects whether to print sheets and gives a print execution instruction. If printing is not to be performed, an operation for canceling is performed, and the display is returned to the normal image display state again.

In the automatic sampling mode, the timing information and the lighting control information at that time are set once each for the start, end, and chorus portions of the music (a total of nine times for a music having up to 3 music pieces). The singer is shot under the conditions,
After the performance, it is also possible to automatically print a composite image with the selected decorative design by, for example, dividing into 3 × 3 frames. The display 23 is operated by the user.
In such a case, a composite image of the singer and the decorative pattern may be always displayed. Further, two systems of a display for displaying a normal music reproduction video and a display for displaying a composite image for printing may be prepared, and the video control unit 21 may be provided with two systems of video output corresponding to the two displays. .

Alternatively, only the image may be sampled during the reproduction of the music, and after the reproduction is completed, the sampled image may be selected again and printed in a desired print mode. Further, in this embodiment, the manual mode and the automatic mode are set in advance before performing the karaoke, but the shutter is released in the automatic mode, and the mode is appropriately switched to the manual mode according to the singer's preference, and manually. The shutter may be released.

[0027]

According to the present invention, it is possible for a singer to easily print his or her singing figure without worrying about the light and the timing of releasing the shutter, and the lighting conditions are poor. Finish print failures are greatly reduced.

Then, under the lighting conditions suitable for the atmosphere of the music, it is possible to create a print with a background image in which a person singing with a natural expression is projected. In other words, the start and end of the performance as well as the strength of the beat, the start of the chorus, the start and end of the chorus, the start and end of the climax,
In various scenes such as ending, the strobe is automatically turned on and the camera shutter is released toward the singer under lighting appropriate for the scene. Therefore, people who sing and sing around can concentrate on singing without worrying about a photo opportunity, and the atmosphere of the excitement does not point to the water.

Further, in various scenes of such a song, a photograph taken in a situation where the lighting conditions and facial expressions are completely different can be printed on a single print sheet made of a plurality of small stickers in a continuous shooting mode. Therefore, it is possible to print a variety of really interesting videos.

Further, by using various decorative patterns as the background image, a favorite face photograph print can be created. In addition, since the decorative design can be supplied in a timely manner through a communication line, a new decorative design can always be used, and the regular customers are not bored.

As described above, according to the present invention, the entertainment of karaoke can be greatly improved.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of an example of an embodiment of a karaoke apparatus according to the present invention.

[Explanation of symbols]

 Reference Signs List 1 Karaoke device 11 Central control unit 12 Hard disk device 21 Video control unit 22 Video printer 23 Display 26 Video camera 40 Illumination device 41 Illumination direction / illumination position control device 42 Input / output control unit 43 Dimming control unit 44 Dimming device 45 Light source

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁶ Identification code FI H04N 5/765 H04N 5/781 510G 5/781

Claims (3)

[Claims] The present invention relates to a method for synchronizing the accompaniment music and the lyrics image to a speaker and a display by appropriately reproducing karaoke data including the accompaniment music of the karaoke music and the lyrics image. In a karaoke device that outputs to the speaker together with the accompaniment music, a video camera for photographing the singer, a plurality of light sources at different positions, and a lighting device that can be independently driven and controlled, An illumination control unit for controlling the illumination device; a data storage unit storing a background image; and an image obtained by combining the background image read from the data storage unit with a video taken by the video camera, and combining the images. Image synthesizing means for displaying on the display or another type of display, and displaying on the display And a video printer that samples and prints the synthesized image that has been obtained. The lighting device is provided in various modes together with timing information for giving an instruction to sample the synthesized image in the accompaniment music information included in the karaoke data. Lighting control information for controlling the lighting device is added, and when a sampling instruction is given based on the timing information, the lighting device is driven toward a singer under lighting conditions based on the lighting control information at that time. A karaoke apparatus, wherein the video printer samples a combined image obtained by combining the image of the singer at that time and the background image. 2. The means according to claim 1, wherein the video printer sequentially samples and stores a combined image obtained by combining a video taken by the video camera and the background image under different lighting conditions; Means for arranging and printing the images stored by said storage means on one sheet of print paper. 3. The image according to claim 1, wherein the background image includes a decorative pattern created to be added to the portrait image.
A karaoke apparatus, wherein the decoration design is distributed from the host apparatus in a timely manner when the karaoke apparatus is connected to the host apparatus via a communication line.