JP2006071712A - Karaoke system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a karaoke system which is constituted so as to output pictures which are easy to see of picture contents with picture contents, such as motion pictures, drama and to output mixed voices in which the sound output of the picture contents and voices of play words of the user are mixed, by utilizing the functions of the contentional karake system effectively, and with which the user can experience pictures and sounds in which the user oneself participates, and which have presence, and also the user can perform the vocal training of the lines of a character of the motion picture or the drama, by allowing the lines to efficiently assist the user. <P>SOLUTION: The karaoke system consists essentially of a karaoke playing device (1) which is equipped with a display means (D) and a osteo conducting means (B), and has picture contents in which the characters having play words are included, and which outputs sounds, by eliminating all of the picture contents or the voices of play words of a prescribed character, and also which is equipped with mixing and voice outputting means (13) which mixes the sound output and the voices of the play words of the user and outputs the mixed voices. The karaoke system is constructed, by being equipped with an output control means (18) for performing control so as to output the pictures of the picture content to the display means (D) and so as to output voices of the eliminated play words of the osteo conduction to the osteo conduction means (B) by making it synchronize with the outputting of the pictures of the picture content having a prescribed preceding of time. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a karaoke system mainly composed of a karaoke performance device provided with bone conduction means and capable of mixing a video output of video content, a sound output of the video content, and a user's speech.

  In recent years, karaoke has become popular regardless of age or gender, but recently, so-called “karaoke boxes”, which have many karaoke rooms with karaoke performance devices installed in private rooms, have become widespread. The karaoke room is designed so that almost no sound is leaked to the outside by the soundproofing function even when music is played with high sound in the room or singing with high output.

  Furthermore, recently, the display device attached to the karaoke performance device has become thinner and larger due to the development of liquid crystal technology and plasma technology, and combined with this conventional soundproofing function, video content other than karaoke in the karaoke room, specifically Has become available for watching movies and dramas. With regard to such a service, for example, Patent Document 1 discloses a karaoke system in which each device attached to a karaoke performance device can be used together to watch a movie.

  By the way, as a way to use video content such as movies and dramas, for example, people who want to imitate voice actors of animation and Western movies and those who are serious about voice actors do so-called “after-recording”. As it is, the environmental sound (natural sounds and sound effects other than speech sound) is left from the video content, and the speech of the character is erased and output by audible output. You can practice speaking while watching the language, or people who want to learn a language can practice speaking foreign languages in the same way.

  In order to practice speech utterance using such video content, it is necessary to erase the speech of the characters that are the subject of speech practice, but this is not particularly difficult with current acoustic processing technology. Absent. For example, Patent Document 1 also discloses a system capable of separately processing a video signal and an audio signal constituting a movie, and adding or erasing audio to a video by performing separate processing on the video signal and the audio signal. You can. Moreover, at present, in addition to environmental sounds, a plurality of audio signals are superimposed for each character, or audio signals in a specific audio frequency band are extracted from all audio signal data. By separately processing the signals, for example, it is possible to erase the speech of all the characters while leaving the environmental sound, and it is also possible to erase the speech of only a predetermined character.

In addition, in order to practice speech utterance, the user generally needs a script, but the video content is superimposed on the background video of karaoke, for example, in order to appreciate the video content. Even if a caption telop that assists the dialogue is inserted like a lyric telop, it is not preferable because the video becomes difficult to see. Therefore, it is preferable to use a method that assists speech by voice without inserting a caption telop. In the conventional karaoke singing service, a technique has been conceived in which lyrics are transmitted to the user by means of a lyrics assist voice called “exemplary vocal” instead of the lyrics telop. For example, in Patent Document 2, a technique for controlling the output of the lyrics assist voice so as to convey the lyrics to be sung next to the singer prior to the progress of the karaoke performance, regardless of the lyrics telop displayed on the TV monitor or the like. Is disclosed. Further, in Patent Document 3, reading condition data including reading time conditions and voice quality conditions is added to the lyrics data so that a driver who cannot see the lyrics telop can check the lyrics without looking at the character display. A technique for generating synthesized speech of lyrics (lyric assist sound) according to conditions is disclosed.
JP-A-8-292780 Japanese Patent Laid-Open No. 11-133898 JP-A-11-167392

  However, it is difficult to apply such conventional technology to speech utterance practice using video content. In other words, when singing karaoke, there is karaoke accompaniment music, so even if you can hear some model vocals etc., there is no accompaniment music in movie contents such as movies and dramas, and speech to assist dialogue is emitted. If it is done, the atmosphere will collapse. In response to such problems, for example, speech assist sound is emitted from a dedicated head-mounted type (headphone type or earphone type) sound pressure type speaker and used by the user for other purposes. A method of making the dialogue assist voice inaudible to the user is also conceivable. However, it is not preferable that the user himself / herself has difficulty in listening to the dialogue of other characters when wearing headphones that block the user's ears.

  Therefore, the present invention effectively utilizes the function of the conventional karaoke system, and with video content such as movies and dramas, video output of video content that is easy to see, and its audio output and user's speech are mixed and output. It is an object of the present invention to provide a karaoke system that allows users to experience the realistic video and sound that they participate in, can assist the user in the dialogue, and can efficiently practice the speech of the characters.

  In view of the above problems, the present inventors are provided with display means and bone conduction means, and when outputting video content, erase the speech of the character desired by the user, and output the sound and the user's speech. In addition to outputting audio mixed with audio, the display means outputs video without subtitle telop, etc., and synchronizes with the video output of the video content for a predetermined time in advance, and the erased dialogue is transmitted by the bone conduction means. It has been found that the above-mentioned problems can be solved by constructing a karaoke system for controlling the bone conduction output, and the karaoke system of the present invention has been conceived.

That is, the karaoke system of the present invention includes display means and bone conduction means, has video content including a character with dialogue, and erases all of the video content or speech of the predetermined character. A karaoke performance apparatus having a mixing sound output means for mixing the sound output with the user's speech and outputting the sound.
The display means outputs the video content as video,
The bone conduction means is synchronized with the video output of the video content for a predetermined time in advance, and the erased speech is bone conduction output.
It is characterized by having an output control means for controlling as described above.

  According to the karaoke system of the present invention, the speech of the character desired by the user is erased and output as sound, the speech of the user and the user's speech are mixed, and the video content is output to the display means. However, by outputting the erased dialogue to the bone conduction means with bone conduction means, it is possible to experience the realistic video and sound that the user himself participated in, and his speech speech and speech assist speech are not misleading, Each of them can be heard clearly, and other users can hear only the speech of the user, and the speech utterance practice using the video content can be efficiently performed.

  Hereinafter, the karaoke system of the present invention will be described with reference to an optimum embodiment. First, the block configuration diagram of the karaoke performance apparatus constituting the karaoke system of the present invention shown in FIG. 1 and the video content shown in FIG. Based on the schematic configuration diagram of data, the conceptual diagram of the method of synchronizing the video output and the bone conduction output of the dialogue voice shown in FIG. 3, and the external perspective view of the bone conduction means shown in FIG. The configuration will be described.

  The karaoke performance device (1) constituting the karaoke system of the present embodiment is composed of a central control means (2) for controlling the operation of the entire device and various devices connected thereto, and this central control means (2). Includes a hard disk (3), a RAM (4), a sound source (synthesizer: 5), a mixer (6), a PCM decoder (9), an MPEG decoder (10), a synthesis circuit (11), a remote control device (R), and the like. It is connected. In particular, on the hard disk (3), performance data (21), background video data (22), and lyrics telop linked to a music code (20) for specifying individual karaoke music as singing content data (C1). Data (23) and the like are recorded. On the other hand, as video content data (C2), video data (25), audio data (26) and the like associated with video code (24) specifying individual video content are recorded. It is recorded.

  Here, each functional means will be described briefly. The communication control means (12) connects to a karaoke host device (not shown) using a VPN (Virtual Private Network) managed by a karaoke company on the Internet via an ADSL line, an ISDN line, a general telephone line, or the like. Control for. From this karaoke host device, various data relating to singing content data (C1) and video content data (C2) are distributed to individual karaoke performance devices (1).

  In the case of singing content data (C1), the sound source (5) forms a musical sound signal according to the performance data input by the music sequencer (15) executed by the central control means (2). The formed musical sound signal is input to a mixer (6), which mixes a plurality of musical sound signals generated by the sound source (5), a karaoke microphone (M), and an A / D converter (8). The input user's singing voice signal is mixed with an appropriate balance. The mixed digital audio signal is input to the sound system (SS: 7). This sound system (7) includes a power amplifier, converts an input digital signal into an analog signal, amplifies it, and emits a musical sound and a singing sound from the speaker (S). The singing voice signal converted into a digital signal by the A / D converter (8) is also input to a vocal adapter (not shown), and the singing power is automatically scored based on the singing frequency of the singing voice signal collected from the vocal adapter. Etc. are performed.

  On the other hand, in the case of video content data (C2), the mixing audio output means (13) extracts the acoustic data (26) recorded in the PCM (Pulse Code Modulation) format, and this is extracted by the PCM decoder (9). It reproduces and outputs sound, and controls to input this to the mixer (6). As in the case of the singing content, the mixer (6) mixes the user's speech input from the karaoke microphone (M) via the A / D converter (8) with an appropriate balance, and is mixed. The digital audio signal is input to the sound system (7). As in the singing content data (C1), the speech audio signal converted into a digital signal by the A / D converter (8) is also input to the vocal adapter (not shown), and is collected from this vocal adapter. Depending on the speech frequency of the dialogue speech signal, for example, if it can be used for automatic scoring of speech speech in a foreign language, it can also be effectively used for practicing speech in a foreign language.

  Both the background video data (22) of the singing content data (C1) recorded in the hard disk (3) and the video data (25) of the video content data (C2) are recorded in the MPEG (Moving Picture Experts) format. The output control means (18) reads this out and inputs it to the MPEG decoder (10) for playback processing. In the case of singing content data (C1), the MPEG decoder (10) converts the input MPEG data into an NTSC video signal and inputs it to the synthesis circuit (11). The synthesis circuit (11) On the video RAM), the lyrics telop is OSD synthesized on the video signal, and the video signal is displayed on the display means (D).

  The synthesizing circuit (11) also has a fade function. When a lyrics telop is faded in or faded out, or when a plurality of lyrics telops are displayed, only a part of the lines is faded in or faded out. You can also. In the case of video content data (C2), the output control means (18) displays the video data (25) after the compressed data is expanded by the MPEG decoder (10) and converted into a composite video signal. Control is performed so that video is output to the means (D), but at this time, synthesis of dialogue caption telop data and the like is not performed.

  The remote control device (R) includes a user interface, a remote control signal transmission circuit, and the like, and inputs an operation signal corresponding to a user operation to the central control means (2). The central control means (2) detects the operation signal by the operation input processing means (19) and performs corresponding processing. For example, when a music code is input by the remote control device (R), the operation input processing means (19) detects this and transmits it to the sequencer (14) as a request for karaoke music. When the code is input, it is transmitted to the sequencer (14) as a request for video content. In response to this, the sequencer (14) reads performance data (21), video data (25) and the like identified by the music code (20) and video code (24) from the hard disk (3).

  The sequencer (14) mainly includes a music sequencer (15) and a character sequencer (16). The music sequencer (15) reads track data such as performance data tracks and guide melody tracks in the performance data. The karaoke piece is played by controlling the sound source (5) with this data. On the other hand, the character sequencer (16) is provided with a character pattern creation means (17), creates an image pattern of the lyrics telop data (23) in the singing content data (C1), and generates the image pattern as described above. Output to.

  Then, the output control means (18) causes the erased speech to be bone conduction output by the bone conduction means (B). Specifically, the speech data of the character designated by the user is extracted from the acoustic data (26) recorded in the PCM format, and this data is expanded by the PCM decoder (9). It is converted into a conduction signal, and the bone conduction means (B) outputs bone conduction. The bone conduction means in the present invention may be a currently known means, which conducts vibration waves such as voice and musical sound through a human bone and transmits information to the brain. Some are also attached to the phone. Usually, information is transmitted through bones such as the skull and mandible, but recently, performance has been improved to the extent that information can be transmitted from the back of the hand.

  As shown in FIG. 2, the video content data (C2) of the present embodiment is identified by adding a video code (24) for each video content. The configuration mainly consists of video data (25) and audio data (26). In addition to the environmental sound data (26x), the acoustic data (26) includes dialogue voice data (26a) associated with “person code a” to “person code d” for identifying the characters A to D having dialogue. It consists of (26b), (26c), and (26d), and each speech audio data is recorded independently so that it can be processed individually. By selecting the desired character, the user deletes the speech audio data (26a), (26b), (26c), and (26d) of all the characters while leaving the environmental sound data (26x). Of course, it is also possible to delete the dialogue of only a predetermined character, acoustic data excluding the erased dialogue voice data is acoustically output, and the erased dialogue voice is output as bone conduction.

  As shown in FIG. 3, the video data is accompanied by time code data accompanying the progress of the video output, and characters A to C are synchronized with the video output of the video content based on the time code data. The bone conduction output timing of the speech is set for each D. At this time, in the present invention, synchronization is established with a predetermined time in advance. For example, in this embodiment, by synchronizing the time code data 5 seconds ahead of time, the speech sound is bone conduction output from 5 seconds before the character actually utters the speech. This is for informing the user of the dialogue in advance to assist the dialogue, and the preceding time can be arbitrarily set. More preferably, the bone conduction output speed of the speech sound is made faster than the normal speech sound speed so that the bone conduction output and the next speech sound do not overlap.

  As described above, bone conduction is to transmit sound as bone conduction sound through the skull or mandible, and is usually used in a state where the bone conduction speaker is in close contact with the peripheral portion of the ear. FIG. 4 (a) is an external view of the finger-fitting type bone conduction means (B), and the whole is obtained by putting about 2 to 3 fingers between the holding arm (B1) and the bone conduction speaker (B2). Can be listened to while listening to the temple or lower jaw of the user's head. For example, the user has a microphone in one hand and utters speech with the bone conduction means in one hand. FIG. 4B is an external view of the head-mounted bone conduction means (B), and the user's head between the holding arm (B1) and the left and right bone conduction speakers (B2). Attach so that the temple part of the part is inserted. This configuration does not require the user to have bone conduction means in their hands. In this embodiment, the speech is transmitted from the karaoke performance apparatus main body via the wired communication line (B3). However, the present invention is not limited to this, and a wireless communication system may be used.

  5 is a system flow diagram of the karaoke system of the present invention shown in FIG. 5, an external perspective view of the karaoke remote control apparatus shown in FIG. 6, and the use of the karaoke remote control apparatus shown in FIGS. The processing procedure in this system will be described in detail based on the person interface display screen.

  First, as shown in FIG. 5, the user designates video content by a video code (S1). The video content is specified by using the karaoke remote control device (R) shown in FIG. 6. Here, the karaoke remote control device (R) will be described briefly. The karaoke remote control device (R) has a liquid crystal display (Ra) and a touch sensor (Rb) stacked on the front, and the touch sensor (Rb) provides a GUI (Graphical User Interface) environment to the user. A user interface is formed and instructions from the user are transmitted to the karaoke performance device.

  The display screen (Ra1) in FIG. 7 shows a user interface when the user designates video content, and this display screen (Ra1) displays “Song content or video content”. A “karaoke content” icon (30) and a “cinema content” icon (31) are provided, and when the user selects the latter, the screen is switched to the display screen (Ra2). On this display screen (Ra2), the user inputs the video code of the desired video content into the video code input field (34) using the numeric keypad (33), as in the case of specifying the karaoke music piece. After input, when the “transfer” icon (35) is selected, the video content is formally designated.

  If the video content is formally designated, then, as shown in FIG. 5, the user designates the desired character by the person code (S2). Here, the display screen (Ra3) of FIG. 8 is a user interface display screen for designating a character. In this display screen (Ra3), there is a character designation field (36) in which the name or nickname that is the ID of the character is posted together with a face photo (or animation) of the character with the dialogue, and each appearance A “designation” icon (36a) for designating a person is provided. When a user designates a desired character and selects a “transfer” icon (35), the character is formally designated. In the present invention, all of the characters may be specified in a predetermined manner, or a single character or a plurality of characters may be specified in a predetermined case.

  When the character is formally designated, next, as shown in FIG. 5, for the audio output of the video content, sound data other than the speech data of the designated character is extracted (S3), and this extracted sound data Is output (S4). At this time, video data is output from the display means in synchronism with each other (S5), and the bone conduction means synchronizes with the video output of the video content for a predetermined time in advance, and the speech of the designated character is received. The bone conduction is output (S6). When the user utters speech while listening to the bone conduction output of the speech during video output of the video content, it is mixed with the acoustic output and output as speech (S7).

  As described above in detail, according to the karaoke system of the present invention, the dialogue voice of the character desired by the user is erased and outputted as sound, and this and the user's dialogue voice are output as mixing voice and displayed. By outputting video content to the means and outputting the erased dialogue with the bone conduction means, you can experience the realistic video and sound that the user has participated in, The dialogue assist voice is not confusing, each can be heard clearly, and other users can only hear the dialogue voice of the user, and the speech utterance practice using the video content can be performed efficiently. .

The block block diagram of the karaoke performance apparatus which comprises the karaoke system of this invention. The schematic block diagram of video content data. The conceptual diagram of the synchronizing method of an image output and the bone conduction output of a speech sound. The external appearance perspective view of a bone conduction means. The system flow figure of the karaoke system of this invention. The external appearance perspective view of a karaoke remote control device. User interface display screen of karaoke remote control device. User interface display screen of karaoke remote control device.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Karaoke performance apparatus 2 Central control means 3 Hard disk 6 Mixer 9 PCM decoder 10 MPEG decoder 11 Synthesis circuit 13 Mixing sound output means 18 Output control means 24 Video code 25 Video data 26 Acoustic data B Bone conduction means D Display means

Claims (1)

A display means and a bone conduction means, having a video content including a character with dialogue, and erasing all of the video content or the speech of the predetermined character, and outputting the sound; Mainly a karaoke performance device equipped with mixing audio output means for mixing and outputting the speech of the user and the speech of the user,
The display means outputs the video content as video,
The bone conduction means is synchronized with the video output of the video content for a predetermined time in advance, and the erased speech is bone conduction output.
A karaoke system comprising output control means for performing control.

Images