JP5131290B2 - Karaoke equipment, karaoke system, set-top box - Google Patents

Description

  The present invention relates to a karaoke apparatus, a karaoke system, and a set-top box that can record a video of a singer.

  Conventionally, a karaoke apparatus capable of recording the singer's singing content has been proposed. For example, the karaoke recording device described in Patent Document 1 records a singer's singing voice together with accompaniment music. The karaoke recording apparatus is configured to record only accompaniment music.

Japanese Patent Laid-Open No. 2003-167582

  Here, in the field of karaoke devices, services can be diversified and enriched by recording not only the singing voice of the singer but also the state of the singing of the singer as a video. Providing such a service is preferable for a karaoke company from the viewpoint of improving the ability to attract customers.

  Usually, in a karaoke system, a singer sings while watching a lyrics telop displayed on a display. Also, during playback of the music, a predetermined background video is displayed on the display. Here, when the state of the singing of the singer is photographed, the content of the display can be photographed and recorded together with the singer. In this regard, when karaoke singing is performed using content for which recording of lyrics telop or background video is prohibited, it is necessary to have a configuration capable of prohibiting recording of the lyrics telop and background video (including uploading to a server or the like). is there.

  The present invention has been made to solve the above-described problems, and is a karaoke apparatus that can shoot a singer's singing state and record it as a video, and uses karaoke content for which recording is prohibited. In such a case, an object is to provide a karaoke apparatus or the like that can appropriately limit recording of photographing contents.

  The karaoke apparatus according to claim 1 according to one aspect of the present invention is a karaoke apparatus comprising a display, a camera, a recording unit, a video output control unit, an audio output unit, and a transmission control unit, wherein the audio output unit is And outputting a sound signal based on the musical sound information included in the karaoke data, and the video output control means can output the video signal included in the karaoke data to the display, and obtains control information for the karaoke data. Then, when outputting the video signal to the display, according to the acquired control information, color information is inserted into the video signal with a predetermined color and brightness, and the video signal is captured by the camera. The transmission control unit extracts color information from the shooting signal when recording the shooting signal in the recording unit, and records the recording signal. It is determined whether or not the color information has been extracted from the shooting signal recorded in the information, and if the color information has been extracted, the information related to the shooting signal is transmitted to an external device connected via a communication network. In contrast, the transmission is prohibited.

  The karaoke apparatus inserts and outputs color information in a video signal included in karaoke data in accordance with control information related to karaoke data. In this case, when a display that displays a video based on the video signal is shot by the camera, the shooting signal includes color information output together with the video signal from the display. When color information is extracted from the shooting signal, the karaoke device prohibits transmission of information related to the shooting signal to an external device via a communication network. Therefore, the karaoke apparatus can appropriately limit the recording when using karaoke content or the like for which recording is prohibited while providing the charm that the singing state of the singer can be photographed and recorded as a video. .

  A karaoke apparatus according to a second aspect of the present invention is the karaoke apparatus according to the first aspect, wherein the video output control means outputs the video signal included in the karaoke data to the display. In accordance with the acquired control information, color information is inserted into the video signal and output at predetermined timings, and timing information indicating the timing at which the color information is inserted into the video signal is transmitted to the transmission control means. The transmission control means acquires the time information, and extracts the color information from a photographing signal photographed by the camera at a timing indicated by the time information.

  The karaoke apparatus can extract color information from a photographing signal efficiently and with high accuracy. As a result, the karaoke apparatus can more reliably limit the processing of shooting content when using karaoke content or the like whose recording is prohibited.

  The karaoke apparatus according to claim 3 according to one aspect of the present invention is the karaoke apparatus according to claim 1 or 2, wherein the video output control means inserts color information into the video signal. In this case, the color information is inserted into an alpha blend layer constituting the video signal.

  The karaoke apparatus can perform restrictions on processing of photographing contents with a small processing burden when using karaoke contents or the like whose recording is prohibited.

  The karaoke apparatus according to claim 4 according to one aspect of the present invention is the karaoke apparatus according to any one of claims 1 to 3, wherein the karaoke data includes a background video and a lyrics telop, and the control information is Indicates whether to prohibit transmission of the shooting signal to the external device, and the video output control means prohibits the control information from transmitting the shooting signal to the external device. The color information is inserted into the alpha blend layer constituting the video signal at the timing when the lyrics telop is output from the video output means.

  The karaoke device configures the video signal at a timing when the lyric telop is output from the video output means when the control information indicates prohibiting transmission of the shooting signal to the external device. Since the color information is inserted into the alpha blend layer to be transmitted, it is possible to prohibit the transmission of the photographing signal including the background video and the lyrics telop in this case to the external device. In addition, since the color information is inserted into the alpha blend layer at the timing when the lyrics telop is output from the video output means, the karaoke device must forbid the transmission of the shooting contents to the external device with a small processing load. Can do.

  The karaoke system according to claim 5 according to one aspect of the present invention is a karaoke system including a commander and a set-top box, and the set-top box is connected to a camera and records a photographing signal photographed by the camera. The commander is connected to a display and is capable of outputting a video signal included in karaoke data to the display; and the commander acquires control information for the karaoke data, and the video signal Is output to the display by inserting color information with a predetermined color and brightness into the video signal according to the acquired control information, and the set top box outputs the shooting signal to the recording means. When recording, the color information is extracted from the shooting signal, and the shooting signal recorded in the recording unit is used to extract the color information. It is determined whether or not information has been extracted, and when the color information has been extracted, it is prohibited to transmit information relating to the photographing signal to an external device connected via a communication network. It is characterized by.

  In the karaoke system, the commander inserts color information into the video signal included in the karaoke data according to the control information related to the karaoke data and outputs the video signal. In this case, when a display that displays a video based on the video signal is shot by the camera, the shooting signal includes color information output together with the video signal from the display. When color information is extracted from the shooting signal, the karaoke system prohibits the set-top box from transmitting information related to the shooting signal to an external device via a communication network. Therefore, the karaoke system can restrict uploading of shooting contents including the karaoke data according to the control information related to the karaoke data. As a result, the karaoke system appropriately restricts recording when using karaoke content that is prohibited from being recorded while providing the charm that the singing state of the singer can be photographed and recorded as video. Can do.

  A set-top box according to claim 6 according to one aspect of the present invention is a set-top box connected to a display and connected to a commander having video output control means. A recording means for recording a photographed photographing signal, and extracting the color information inserted by the commander from the photographing signal when the photographing signal is recorded in the recording means, and the photographing signal recorded in the recording means; It is determined whether or not the color information has been extracted from, and when the color information is extracted, it is prohibited to transmit the information related to the photographing signal to an external device connected via a communication network It is characterized by doing.

  The set top box extracts the color information inserted by the commander from the shooting signal shot by the camera, and transmits the information related to the shooting signal to the external device when the color information is extracted from the shooting signal. Is prohibited. As a result, the set-top box provides the charm of being able to shoot a singer's singing state and record it as a video, while properly recording when using karaoke content that is prohibited from recording. Can be limited.

  According to the present invention, a karaoke device or the like shoots a singer's singing and provides the charm of recording it as a video, while using karaoke content that is prohibited from being recorded, shooting for an external device Prohibit content transmission. Thus, the present invention can contribute to diversification and enhancement of services in the karaoke business.

It is explanatory drawing regarding a karaoke system. It is explanatory drawing regarding the control structure of a karaoke system. It is explanatory drawing regarding the control structure of a video data reproduction part. It is explanatory drawing regarding reproduction | regeneration video data. It is explanatory drawing regarding a copyright flag. It is a flowchart of a video data reproduction processing program. It is a flowchart of an alpha blend signal output processing program. It is a flowchart of a color information detection confirmation processing program. It is a flowchart of a captured video upload processing program. It is a flowchart of an STB side control processing program. It is explanatory drawing regarding the control content in a karaoke system. It is explanatory drawing which shows an example of the analysis result of the picked-up image frame which satisfy | fills color information detection conditions. It is explanatory drawing which shows the relationship between display display content, imaging | photography content, etc. FIG.

  Hereinafter, an embodiment of the present invention will be described.

(System configuration)
First, the configuration of a karaoke system according to an embodiment of the present invention will be described with reference to FIGS. 1 and 2. The karaoke system according to the present embodiment basically includes a karaoke apparatus 100 installed in karaoke stores and the like in various places, a communication network N, and a server 600 (see FIG. 2). The karaoke apparatus 100 is installed for each guest room of the karaoke store. The karaoke apparatus 100 is connected to the server 600 by the communication network N via, for example, a router installed in a karaoke store.

(Composition of karaoke equipment)
Then, the structure of the karaoke apparatus 100 is demonstrated. The karaoke apparatus 100 includes a commander 200, an STB 300 (Set Top Box), a camera 410, a first display 421, a second display 422, a microphone 430, and a speaker 450. As shown in FIG. 1, the singer S performs karaoke singing using a microphone 430 in accordance with the accompaniment related to the desired music output from the speaker 450. At this time, the lyrics telop and the background image are displayed on the first display 421 and the second display 422 (see, for example, FIGS. 13A and 13C). Therefore, the singer S can perform karaoke singing according to the display of the lyrics telop on the second display 422 or the like.

  And the camera 410 is normally arrange | positioned in the position which can image | photograph the singer S. FIG. Therefore, the karaoke apparatus 100 can photograph the singer S who performs karaoke singing. Note that the camera 410 can be moved freely.

  The appearance of the karaoke apparatus 100 shown in FIG. 1 is merely an example, and the present invention is not limited to the karaoke apparatus 100 having the appearance. For example, in the present embodiment, the number of displays is two, but the second display 422 may be omitted and the display may be configured only by the first display 421.

(Composition of commander)
Next, the commander 200 constituting the karaoke apparatus 100 will be described with reference to FIG. The commander 200 includes a control unit 210, a video data playback unit 220, a playback video data storage unit 230, an instruction input unit 240, an audio playback unit, and an auxiliary storage unit.

  The control unit 210 has a CPU, ROM, and RAM. The CPU of the control unit 210 executes various programs (for example, a video data reproduction processing program described later). The ROM of the control unit 210 stores various data. Specifically, the ROM of the control unit 210 stores a video data reproduction processing program and the like (see FIGS. 6 to 9). The RAM of the commander 200 temporarily stores various data.

  The control unit 210 receives input of a copyright signal Cr based on a copyright flag, which will be described later, and a frame synchronization signal Fs accompanying playback output of the playback video data Pv, based on various control programs. Further, the control unit 210 outputs a shooting start signal St, a shooting end signal En, and an upload signal U based on the operation signal from the instruction input unit 240. Further, the control unit 210 outputs an alpha blend signal α described later based on the copyright signal Cr, the frame synchronization signal Fs, and various control programs. In addition, the control unit 210 receives an input of the color information detection signal Cd from the color information extraction unit 320 of the STB 300.

  The video data playback unit 220 reads the playback video data Pv stored in the playback video data storage unit 230 and plays back video based on the playback video data Pv. That is, the video data playback unit 220 outputs the audio signal Vo input from the microphone 430 to the first display 421 and the second display 422 together with the video signal Vi related to the playback video data Pv. In addition, the video data reproduction unit 220 receives an input of the alpha blend signal α output from the control unit 210.

  As shown in FIG. 3, the video data reproducing unit 220 includes an MPEG decoder 221 and an alpha blend layer setting unit 222. The MPEG decoder 221 decodes the reproduced video data Pv generated in the MPEG format, and outputs a video signal Vi and a frame synchronization signal Fs. The video signal Vi is an RGB video signal based on the reproduced video data Pv. The frame synchronization signal Fs includes HSYNC and VSYNC. HSYNC is a signal for measuring the drawing timing in the horizontal direction of the screen when drawing an image based on the reproduced video data Pv on the screen of the first display 421 or the like. VSYNC is a signal for measuring the drawing timing in the vertical direction of the screen when drawing an image based on the reproduced video data Pv on the screen of the first display 421 or the like. Then, the MPEG decoder 221 inputs the frame synchronization signal Fs (that is, HSYNC and VSYNC) to the alpha blend layer setting unit 222.

  The alpha blend layer setting unit 222 assigns an identification color to the reproduced video frame Pf based on the reproduced video data Pv based on the later-described alpha blend signal output processing program (see FIG. 7), the alpha blend signal α and the frame synchronization signal Fs. Set the alpha blend layer to display. Here, the identification color in this embodiment is light blue (B) indicating 200 at 255 gradations.

  And as shown in FIG. 2, the reproduction | regeneration video data storage part 230 has memorize | stored the reproduction | regeneration video data Pv corresponding to the music used for a karaoke song. The video based on the playback video data Pv is displayed on the first display 421 and the second display 422 via the video data playback unit 220 during karaoke singing. The karaoke data (music data) includes musical tone data such as MIDI in addition to the reproduced video data Pv. In this regard, the musical sound related to the musical sound data is not a feature of the present invention, and a configuration for reproducing the musical sound data is well known, and therefore illustration of these is omitted.

  Here, the reproduced video data Pv includes a background video and a lyrics telop as shown in FIGS. 13 (a) and 13 (c). In the background video and lyrics telop included in the playback video data Pv, “playback” for karaoke singing is permitted, but “memory” may be prohibited. In the singing mode shown in FIG. 1, it is assumed that the background video and the lyrics telop appear in the video taken by the camera 410 (see FIG. 13B).

  In the karaoke system according to the present embodiment, when recording of lyrics telop and background video is prohibited, a copyright flag is attached to the playback video data Pv (see FIGS. 4 and 5). As shown in FIG. 5, when the copyright flag for the reproduced video data Pv is “1”, the copyright flag indicates that storage of the background video and the lyrics telop related to the reproduced video data Pv is prohibited. On the other hand, when the copyright flag is “0”, the copyright flag indicates that storage of the background video and lyrics telop relating to the playback video data Pv is permitted. Therefore, the CPU of the commander 200 can recognize whether the background video and the lyrics telop related to the playback video data Pv are prohibited by checking the copyright flag.

  In this embodiment, the copyright flag is attached to the reproduced video data Pv. However, the copyright flag for each piece of music (reproduced video data Pv) may be defined as a table. In this case, the table is stored in the storage device of the commander 200 (for example, the reproduction video data storage unit 230 or an auxiliary storage unit described later).

  The instruction input unit 240 receives input of various instructions related to the karaoke apparatus 100. The instruction input unit 240 receives a user operation input to a control panel disposed on the commander 200 or a remote controller (not shown). The remote controller is wirelessly connected to the instruction input unit 240 so that infrared communication or radio wave communication is possible. Then, the instruction input unit 240 outputs a shooting start signal St, a shooting end signal En, and a copyright signal Cr described later to the camera 410 based on a user operation. In addition, the instruction input unit 240 outputs an upload signal U based on a user operation to the STB 300.

  The voice reproduction unit of the commander 200 reproduces the music constituting the karaoke data. The auxiliary storage unit of the commander 200 stores, for example, voice data (musical sound signal) necessary for music playback. Therefore, the audio reproduction unit reads out audio data related to the music desired by the user and reproduces the read out audio data.

  Note that the audio signal Vo output from the commander 200 is not limited to the audio signal Vo input from the microphone 430, but is an audio signal (a mixture of the musical sound signal and the audio signal Vo from the microphone 430 ( Hereinafter, the case of “mixed audio signal”) is included.

(STB configuration)
Then, STB300 which comprises the karaoke apparatus 100 is demonstrated, referring FIG. The STB 300 includes a CPU, a ROM, a RAM, an A / D converter 310, a color information extraction unit 320, an MPEG encoder 330, and a storage unit 340.

  The CPU of the STB 300 controls the entire STB 300 based on various control programs (for example, an STB side control processing program described later). The ROM of the STB 300 stores various data. Specifically, the ROM of the STB 300 stores an STB side control processing program (see FIG. 10). The RAM of the STB 300 temporarily stores various data.

  The A / D converter 310 outputs a captured video frame Rf by converting a captured video signal R (that is, an analog signal) captured by the camera 410 into a digital signal. Then, the A / D converter 310 outputs the captured video frame Rf to the MPEG encoder 330 and the color information extraction unit 320.

  The color information extraction unit 320 performs histogram analysis on the detection frequency of the color information (R value, G value, B value) in the captured video frame Rf based on the STB side control processing program (see FIG. 10). When the result of the histogram analysis satisfies the color information detection condition, the color information extraction unit 320 outputs a color information detection signal Cd to the control unit 210. The color information detection condition in the present embodiment is that the detection frequency of the B value of brightness indicating 200 at 255 gradations exceeds a predetermined threshold. Since the histogram analysis processing related to the color information detection frequency is already known, a detailed description of the configuration of the color information extraction unit 320 is omitted.

  The MPEG encoder 330 encodes the captured video frame Rf input from the A / D converter 310 and the audio signal Vo input from the microphone 430 in the MPEG format, and generates posted moving image data Co. Here, the format of the posted moving image data Co can be selected as appropriate.

  The storage unit 340 stores the posted moving image data Co generated by the MPEG encoder 330. Thereby, the captured video signal R from the camera 410 and the audio signal Vo from the microphone 430 are captured by the STB 300. Then, the posted moving image data Co stored in the storage unit 340 is to be uploaded to the server 600 described later. That is, the posted moving image data Co stored in the storage unit 340 is uploaded to the posted moving image database 610 of the server 600 via the communication network N based on the upload signal U.

  Note that the STB 300 is connected to the commander 200. The STB 300 functions as an external connection device for the commander 200. That is, the present invention can be realized by connecting the STB 300 to the existing commander 200. The commander 200 and the STB 300 are connected via a control line, and can control each other's devices using various control signals.

(Camera configuration)
Next, the camera 410 constituting the karaoke apparatus 100 will be described with reference to FIG. The camera 410 is basically a so-called digital video camera, and includes an image forming unit 411, a CPU, a ROM, a RAM, and a lens (not shown).

  The CPU of the camera 410 controls the entire camera 410 based on various control programs. Specifically, the CPU of the camera 410 performs control related to shooting by the camera 410 according to the shooting start signal St and the shooting end signal En output from the commander 200. The ROM of the camera 410 stores various data. Specifically, the ROM of the camera 410 stores a control processing program. The RAM of the camera 410 temporarily stores various data.

  The image forming unit 411 has an imaging surface, and generates a captured video signal R that is an analog signal based on light incident on the imaging surface via a lens. Then, the image forming unit 411 outputs the generated captured video signal R to the A / D converter 310 of the STB 300. Since the configuration of the image forming unit 411 is already known, a detailed description thereof will be omitted.

(Other configurations)
Next, other configurations constituting the karaoke apparatus 100 will be described with reference to FIGS. 1 and 2. The first display 421 and the second display 422 are so-called liquid crystal displays. Based on the frame synchronization signal Fs, the first display 421 and the second display 422 draw and display an image related to the input video signal (for example, the video signal Vi based on the reproduction video data Pv) on the screen.

  The microphone 430 is used when the singer S performs karaoke singing, and inputs an audio signal Vo based on the singing or the like to the commander 200 and the MPEG encoder 330. The number of microphones 430 can be set as appropriate. The speaker 450 is connected to the commander 200 via an amplifier (not shown). The audio signal Vo output from the commander 200 is amplified by an amplifier and output from the speaker 450 (see FIG. 1).

  Next, the structure of the server 600 which comprises the karaoke system which concerns on this embodiment is demonstrated in detail, referring drawings. As shown in FIG. 2, the server 600 has a posted moving image database 610. The posted moving image database 610 stores posted moving image data Co uploaded from the karaoke apparatus 100. The posted moving image database 610 can be accessed via a personal computer, a commander, or the like. A user of the posted photographed video can view the posted photographed video by reading and reproducing the posted movie data Co from the posted movie database 610 via a personal computer or another commander.

  The server 600 has a karaoke database (not shown). The karaoke database stores karaoke data used for reproducing karaoke music. The karaoke data includes audio data that is a generation origin of the karaoke music, and reproduction video data Pv that is a generation origin of the lyrics telop and the background video (moving image, still image) displayed during the reproduction of the karaoke music. The server 600 distributes karaoke data stored in the karaoke database to each karaoke store.

  The above internal configuration is merely an example. It goes without saying that the present invention can be realized with an internal configuration equivalent to the internal configuration described above.

(Contents of commander side control processing)
Next, the commander side control process executed by the commander 200 according to the karaoke apparatus 100 will be described in detail with reference to the drawings. First, a video data reproduction processing program executed by the control unit 210 of the commander 200 will be described in detail with reference to FIG.

  First, in S1, the control unit 210 determines whether or not there is a music reproduction instruction based on an operation signal from a remote controller or the like. When there is a music reproduction instruction (S1: YES), the control unit 210 shifts the process to S2. When there is no music reproduction instruction (S1: NO), the control unit 210 stands by for processing.

  If transfering to S2, the control part 210 will reproduce | regenerate a user desired music. At this time, the control unit 210 reads the reproduction video data Pv related to the music from the reproduction video data storage unit 230, and transmits the video signal Vi based on the reproduction video data Pv to the first display via the video data reproduction unit 220. 421 and output to the second display 422. At the same time, the control unit 210 outputs the audio signal Vo input from the microphone 430 to the speaker 450. Thereafter, the control unit 210 shifts the process to S3.

  In S3, control unit 210 determines whether or not there is a posting instruction based on an operation signal from a remote controller or the like. When there is a posting instruction (S3: YES), control unit 210 outputs upload signal U to STB 300. At this time, the control unit 210 outputs a shooting start signal St to the STB 300 and the camera 410. Thereby, the camera 410 starts the imaging | photography regarding the mode of the singer's S singing. And after outputting the upload signal U etc., the control part 210 transfers a process to S4. When there is no posting instruction (S3: NO), the control unit 210 shifts the process to S6.

  In S4, the control unit 210 determines whether or not a copyright flag is attached to the reproduced video data Pv related to the music. That is, the control unit 210 determines whether or not the copyright flag of the reproduced video data Pv is “1” based on the copyright signal Cr. When the copyright flag is attached (S4: YES), the control unit 210 shifts the process to S5. When the copyright flag is not attached (S4: NO), the control unit 210 shifts the process to S6.

  After shifting to S5, the control unit 210 executes alpha blend signal output processing. In the alpha blend signal output process (S5), since the copyright flag is attached to the reproduced video data Pv of the music, it is determined that recording of the reproduced video data Pv is prohibited, and the alpha blend signal α is The data is output to the video data reproduction unit 220 and the color information extraction unit 320 of the STB 300. In the alpha blend signal output process, the control unit 210 executes an alpha blend signal output process program to be described later. Details of the alpha blend signal output processing will be described later in detail with reference to the drawings. After outputting the alpha blend signal α, the control unit 210 shifts the process to S6.

  In S6, the control unit 210 determines whether or not the reproduction of the music (that is, the video based on the playback video data Pv) is finished. When the reproduction of the music is finished (S6: YES), the control unit 210 shifts the process to S7. On the other hand, when the music is still being reproduced (S6: NO), the control unit 210 returns the process to S4.

  In S7, the control unit 210 executes a photographing end signal output process. In the shooting end signal output process (S8), the control unit 210 determines that the singing of the singer S has ended with the end of the reproduction of the music, and outputs a shooting end signal En to the STB 300 and the camera 410. Thereby, the camera 410 complete | finishes imaging | photography regarding the mode of singing of the singer S, and complete | finishes a video data reproduction | regeneration processing program.

  Next, the alpha blend signal output processing program executed in S5 of the video data reproduction processing program will be described in detail with reference to FIG. The alpha blend signal output processing program is executed by the CPU of the control unit 210.

  When the process proceeds to the alpha blend signal output process (S5), the control unit 210 first counts the frame synchronization signal Fs (S11). At this time, the control unit 210 individually counts HSYNC and VSYNC constituting the frame synchronization signal Fs. Specifically, the control unit 210 refers to the counter value formed in the RAM of the control unit 210. After counting the frame synchronization signal Fs, the controller 210 proceeds to S12.

  In S12, the control unit 210 determines whether or not the counter value is a predetermined number. That is, the control unit 210 determines whether or not a predetermined number of frame synchronization signals Fs have been counted. When the value of the counter is a predetermined number (S12: YES), the control unit 210 shifts the process to S13. On the other hand, when the value of the counter is less than the predetermined number (S12: NO), the control unit 210 shifts the process to S16.

  In S13, the control unit 210 sends the alpha blend signal α to the video data playback unit 220 and the color information extraction unit 320 of the STB 300 for a predetermined period (for example, a period required for rendering one playback video frame Pf). Output. After outputting the alpha blend signal α for a predetermined period, the control unit 210 proceeds to S14.

  After shifting to S14, the control unit 210 executes alpha blend setting processing. In the alpha blend setting process (S14), the control unit 210 controls the alpha blend layer setting unit 222 to reproduce the identification color (that is, blue (B) having a brightness indicating 200 in 255 gradations) as a reproduction video frame Pf. Set the alpha blend layer to display in. When the alpha blend setting process ends, the control unit 210 shifts the process to S15.

  In S15, the control unit 210 clears the value of the counter formed in the RAM of the control unit 210 and initializes it to “0”. After clearing the counter, the control unit 210 ends the alpha blend signal output processing program and shifts the processing to S6 of the video data reproduction processing program.

  In S16, the control unit 210 adds “1” to the value of the counter. That is, the value of the counter indicates the number of frame synchronization signals Fs in a predetermined period. After adding “1” to the value of the counter, the control unit 210 ends the alpha blend signal output processing program and shifts the processing to S6 of the video data reproduction processing program.

  As described above, the alpha blend signal output process (S5) is repeatedly executed until the music reproduction (that is, reproduction of the reproduced video data Pv) is completed. Therefore, the alpha blend signal output processing program is executed by the control unit 210 on the entire reproduced video data Pv.

  Next, the color information detection confirmation processing program executed by the control unit 210 of the commander 200 will be described in detail with reference to FIG. The color information detection confirmation processing program is a program for confirming that the identification color is detected from the captured video frame Rf in the color information extraction unit 320 of the STB 300.

  First, in S21, the control unit 210 determines whether or not the reproduction of the reproduced video data Pv is started based on an operation signal from a remote controller or the like. When the reproduction of the reproduced video data Pv is started (S21: YES), the control unit 210 shifts the process to S22. On the other hand, when the reproduction of the reproduced video data Pv has not been started (S21: NO), the control unit 210 waits for processing.

  In S <b> 22, the control unit 210 resets the color information detection memory formed in the RAM configuring the control unit 210. After initializing the stored contents of the color information detection memory, the control unit 210 moves the process to S23.

  In S23, the control unit 210 determines whether or not the color information detection signal Cd has been received. The color information detection signal Cd is output from the color information extraction unit 320 when the color information extraction unit 320 detects an identification color from the captured video frame Rf in an STB side control processing program (FIG. 10) described later. When the color information detection signal Cd is received (S23: YES), the control unit 210 proceeds to S24. On the other hand, when the color information detection signal Cd is not received (S23: NO), the control unit 210 proceeds to S25.

  In S24, the control unit 210 sets the color information detection memory in response to receiving the color information detection signal Cd. The setting of the color information detection memory means that an identification color has been detected from the captured video frame Rf, and indicates that recording of video including the playback video data Pv is prohibited by the camera 410. After setting the color information detection memory, the control unit 210 shifts the process to S25.

  In S25, the control unit 210 determines whether or not the reproduction of the reproduced video data Pv is finished. When the reproduction of the reproduced video data Pv has been completed (S25: YES), the control unit 210 ends the color information detection confirmation processing program. On the other hand, when the reproduction of the reproduced video data Pv has not been finished yet (S25: NO), the control unit 210 returns the process to S23.

  Next, a captured video upload processing program executed by the control unit 210 of the commander 200 will be described in detail with reference to FIG. The captured video upload processing program is executed when the posted moving image data Co captured by the camera 410 is uploaded.

  First, in S31, the control unit 210 determines whether there is a posting instruction from the user. Specifically, the control unit 210 performs the determination process of S31 depending on whether or not an upload signal U is output. When there is a posting instruction (S31: YES), the control unit 210 shifts the process to S32. On the other hand, when there is no posting instruction (S31: NO), the control unit 210 waits for processing.

  In S32, the control unit 210 determines whether or not the color information detection memory formed in the RAM is set. When the color information detection memory is set (S32: YES), the control unit 210 shifts the process to S33. On the other hand, when the color information detection memory is not set (S32: NO), the control unit 210 proceeds to S34.

  After shifting to S33, the control unit 210 executes upload non-permission processing. In the upload disapproval process (S33), it is determined that the video of the reproduced video data Pv whose recording is prohibited is included in the posted video data Co, and the control unit 210 does not upload the posted video data Co. Then, a control signal is output to the STB 300 so as to delete the posted moving image data Co from the storage unit 340. Further, in the upload non-permission process (S33), the control unit 210 determines that an image of “the upload of the post video data Co is prohibited and cannot be uploaded” (hereinafter referred to as “non-permission notification image”). 1 is displayed on the display 421 or the like (see FIG. 13D). When the upload disapproval process ends, the control unit 210 ends the captured video upload process program.

  In S34, the control unit 210 executes upload permission processing. In the upload permission process (S34), the control unit 210 outputs a control signal to the STB 300 in order to upload the posted moving image data Co to the posted moving image database 610 of the server 600 via the communication network N. When the upload permission process ends, the control unit 210 ends the captured video upload process program. When receiving the control signal output in the upload permission process, the STB 300 reads the posted moving image data Co indicated by the control signal from the storage unit 340 and uploads it to the posted moving image database 610 via the communication network N.

(Contents of STB side control processing)
Next, the STB side control processing program executed by the STB 300 according to the karaoke apparatus 100 will be described in detail with reference to FIG. The STB side control processing program is executed by the CPU of the STB 300.

  First, in S41, the STB 300 determines whether or not the imaging start signal St output from the commander 200 has been received. When the imaging start signal St is received (S41: YES), the STB 300 shifts the process to S42. When the imaging start signal St is not received (S41: NO), the STB 300 waits for processing.

  In step S42, the STB 300 determines whether an alpha blend signal α is received. As described above, the alpha blend signal α is output from the commander 200 when the reproduced video data Pv whose recording is prohibited is reproduced on the screen of the first display 421 or the like (S5). When the alpha blend signal α is received (S42: YES), the STB 300 shifts the process to S43. On the other hand, when the alpha blend signal α is not received (S42: NO), the STB 300 shifts the process to S47.

  In S43, the STB 300 executes a captured video frame extraction process. In the captured video frame extraction process (S 43), the STB 300 extracts one captured video frame Rf based on the captured video signal R from the camera 410 as a still image and inputs it to the color information extraction unit 320. After extracting the captured video frame Rf, the STB 300 shifts the process to S44.

  In S44, the STB 300 executes color information histogram analysis processing. Specifically, the STB 300 controls the color information extraction unit 320 to target the captured video frame Rf extracted in S43, and regarding the R value, G value, and B value of the pixels constituting the captured video frame Rf, Histogram analysis is performed using the detection frequency for each lightness of 255 gradations (see FIG. 12). Since the processing content of the color information extraction unit 320 in the color information histogram analysis processing (S44) is already known, detailed description thereof will be omitted. When the analysis result of the color information histogram analysis process is stored in the RAM of the STB 300, the STB 300 ends the color information histogram analysis process, and proceeds to S45.

  In step S45, the STB 300 determines whether the analysis result of the color information histogram analysis process (S44) satisfies the color information detection condition. Here, the color information detection condition in the present embodiment is that “the detection frequency of the B value corresponding to the lightness of 200 in 255 gradations is equal to or higher than a threshold (for example, 70%)”. That is, the STB 300 determines whether an identification color included in the video displayed on the first display 421 or the like is detected from the captured video frame Rf. For example, if the analysis result of the color information histogram analysis process is in the form shown in FIG. 12, the STB 300 determines that the color information detection condition is satisfied. When the analysis result in S44 satisfies the color information detection condition (S45: YES), the STB 300 moves the process to S46. On the other hand, when the analysis result in S44 does not satisfy the color information detection condition (S45: NO), the STB 300 shifts the process to S47.

  Here, there is a possibility that the threshold value related to the color information detection condition cannot be determined uniformly. This is because the reference (that is, the threshold value) for determining that the shooting target is not the singer S but the video displayed on the first display 421 or the like depends on the concept of the video for each author of the playback video data Pv. . In such a case, the threshold value is determined in advance as the author of the reproduced video data Pv, and information indicating the determined threshold value is attached to the reproduced video data Pv together with the copyright flag.

  Regarding the process on the commander 200 side in the above case, when the control unit 210 detects the copyright flag in S4, the attached threshold value is read, and at the timing during the transition from S4 to S5, Information is transmitted to the STB 300 in the same manner as the imaging start signal St and the like. On the other hand, on the STB 300 side, when the color information extraction unit 320 receives information related to the threshold from the commander 200, the threshold related to the color information detection condition in S45 is set based on the information related to the threshold. At this time, the STB 300 side has already received the shooting start signal St in S41, but the commander 200 side has not reached S5 of the video data reproduction process. Therefore, the alpha blend signal α is not output from the commander 200 side. In other words, even this configuration does not hinder the control of the present invention. Since the color information detection condition is determined for each reproduction video data Pv by the configuration of the reproduction video data Pv, the process on the commander 200 side, and the processing on the STB 300 side, the intention for the reproduction video for each author of the reproduction video data Pv Can be reflected.

  In S46, the STB 300 performs a color information detection signal output process. In the color information detection signal output process (S46), the STB 300 detects the identification color from the captured video frame Rf that constitutes the posted moving image data Co by the processes of S43 to S45, and thereby the control unit 210 of the commander 200. The color information detection signal Cd is output. When the color information detection signal output process (S46) ends, the STB 300 proceeds to S47.

  In S47, the STB 300 determines whether or not the photographing end signal En output from the commander 200 has been received. When the imaging end signal En is received (S47: YES), the STB 300 ends the STB side control processing program. On the other hand, when the photographing end signal En is not received (S47: NO), the STB 300 returns the process to S42.

(Contents of control during upload prohibited video playback)
Subsequently, in the karaoke apparatus 100 according to the present embodiment, control contents when the control programs shown in FIGS. 6 to 10 are executed will be described with reference to the drawings. In the following description, a case will be described in which a video (hereinafter referred to as upload prohibited video) related to the playback video data Pv with the copyright flag is output to the first display 421 and the like.

  First, the control contents related to the output of the upload prohibited video performed on the commander 200 side will be described. As described above, the reproduction video data Pv related to the upload prohibited video is accompanied by the copyright flag “1” in the reproduction video data storage unit 230. When playback of the upload prohibited video (for example, see FIG. 13C) is started, the control unit 210 outputs a frame synchronization signal Fs (HSYNC) output when the upload prohibited video is rendered on the first display 421 or the like. , VSYNC) is counted (S5).

  Then, the control unit 210 executes the alpha blend output process (S5) and the determination process of S6, so that the alpha blend signal α is output every predetermined frame (for example, 30 frames) of the playback video frame Pf related to the upload prohibited video. Are output to the video data playback unit 220 and the color information extraction unit 320 for a period corresponding to one frame of the playback video frame Pf.

  As shown in FIG. 11, the output period of the alpha blend signal α is specified by VSYNC and HSYNC that constitute the frame synchronization signal Fs. That is, the output start timing of the alpha blend signal α is synchronized with the timing at which VSYNC related to the playback video frame Pf is input to the control unit 210. The output end timing of the alpha blend signal α is synchronized with the timing at which the HSYNC group input immediately after the VSYNC completes input to the control unit 210. Thus, the control unit 210 can output the alpha blend signal α for one frame of the playback video frame Pf.

  As described above, in the alpha blend setting process (S14), when the alpha blend signal α is input to the video data playback unit 220, the control unit 210 controls the alpha blend layer setting unit 222 to perform playback video frame Pf. The alpha blend layer is set so that the identification color is displayed in one frame.

  As a result, when the upload prohibited video is output to the first display 421 or the like, the playback video frame Pf including the identification color is displayed on the first display 421 or the like every 30 frames of the playback video frame Pf related to the upload prohibited video. The

  Here, the karaoke apparatus 100 which concerns on this embodiment can image | photograph the mode of singing of the singer S with the camera 410. FIG. When shooting the state of the singing of the singer S, the first display 421 or the like displaying the upload prohibited video may be reflected.

  Next, in the karaoke apparatus 100 according to the present embodiment, details of the control when the first display 421 or the like that displays the upload-prohibited video is reflected when shooting with the camera 410 will be described in detail with reference to FIG. .

  As described above, when the camera 410 receives the shooting start signal St, the camera 410 shoots the singing state of the singer S and the like. Here, when the upload prohibited video is displayed on the first display 421 or the like, the first display 421 or the like displays a playback video frame Pf including an identification color for every 30 frames of the playback video frame Pf related to the upload prohibited video. indicate. Therefore, when the first display 421 or the like that displays the upload-prohibited video is reflected on the camera 410, the video captured by the camera 410 includes the identification color displayed on the first display 421 or the like.

  Then, the STB 300 converts the captured video signal R captured by the camera 410 into a captured video frame Rf. At this time, when receiving the alpha blend signal α from the commander 200 (S42: YES), the STB 300 extracts the captured video frame Rf and inputs it to the color information extraction unit 320 (S43). Thereafter, the STB 300 controls the color information extraction unit 320 to execute a color information histogram analysis process (S44) for the extracted captured video frame Rf.

  Here, when the first display 421 or the like that displays the upload-prohibited video is reflected on the camera 410, the video shot by the camera 410 includes the identification color displayed on the first display 421 or the like. That is, the captured video frame Rf at this time includes an identification color. Therefore, in the color information histogram analysis process (S44), the STB 300 can detect the identification color in the captured video frame Rf. When the identification color is detected from the captured video frame Rf, the analysis result of the captured video frame Rf satisfies the color information detection condition (S45: YES). Therefore, as shown in FIGS. 10 and 11, the STB 300 outputs the color information detection signal Cd to the control unit 210 of the commander 200 via the color information extraction unit 320 (S46).

  When the color information detection signal Cd is received, the control unit 210 of the commander 200 sets the color information detection memory (S24). Then, when the color information detection memory is set (S32: YES), the controller 210 executes an upload non-permission process (S33). In the upload non-permission process (S33), the control unit 210 outputs a control signal to the STB 300, and deletes the posted moving image data Co from the storage unit 340 without uploading it to the posted moving image database 610. At this time, the control unit 210 displays a non-permission notification image (see FIG. 13D) on the first display 421 and the like.

(Contents of control during upload permitted video playback)
Next, in the karaoke system according to the present embodiment, details of the control when the upload permission video is reproduced on the first display 421 or the like will be described in detail with reference to the drawings. Here, the upload-permitted video is a video that is permitted to record lyrics telop and background video, and means a video related to the playback video data Pv whose copyright flag is “0”.

  Here, when shooting the state of the singer S singing the music related to the upload permission video, the first display 421 and the second display 422 (hereinafter referred to as the first display 421 and the like) play back the upload permission video. Based on the video data Pv, video including lyrics telop and background video is output (see FIG. 13A). In this case, since the copyright flag indicates “0”, when the upload-permitted video is output to the first display 421 or the like, the alpha blend signal α is not output and is identified by the alpha blend layer setting unit 222. The reproduced video frame Pf in which the color is set is not displayed on the first display 421 or the like.

  In this case, since the reproduced video frame Pf including the identification color is not displayed on the first display 421 or the like, each captured video frame Rf constituting the posted moving image data Co satisfies the color information detection condition. Absent. Therefore, the control unit 210 of the commander 200 executes the upload permission process (S34). Thereby, the STB 300 reads the posted moving image data Co including the upload permission video (for example, see FIG. 13B) from the storage unit 340 and uploads it to the posted moving image database 610 of the server 600 via the communication network N. .

  As described above, the present invention is a karaoke system including the karaoke apparatus 100 and the server 600, and the karaoke apparatus 100 includes the commander 200, the STB 300, the camera 410, and the like. When the singer S sings about the music related to the reproduced video data Pv with the copyright flag attached, the karaoke apparatus 100 causes the video data reproducing unit 220 to perform a predetermined reproduction video frame Pf related to the reproduced video data Pv. Then, an alpha blend layer is set so as to display a predetermined identification color (S14), and the video related to the playback video data Pv is output to the first display 421 or the like. In this case, the captured video frame Rf captured by the camera 410 includes the color information in the reproduced video frame Pf. When the color information extraction unit 320 detects color information from the captured video frame Rf (S32: YES), the karaoke apparatus 100 executes upload non-permission processing (S33), and posted moving image data including the captured video frame Rf. Co is deleted from the storage unit 340 without being uploaded to the server 600.

  Thus, the karaoke system can reliably prohibit the upload of the posted moving image data Co including the upload prohibited video to the server 600 by the copyright flag. In the upload non-permission process (S33), the karaoke apparatus 100 displays a non-permission notification image (see FIG. 13D) on the first display 421 and the like. Thereby, the singer S or the like can grasp that uploading of the reproduced video data Pv related to the music is prohibited and that the posted moving image data Co taken by the camera 410 has not been uploaded.

  On the other hand, when the singer S sings the singing of the music related to the reproduced video data Pv without the copyright flag and uploads the content, the karaoke apparatus 100 displays the identification color. The playback video frame Pf related to the playback video data Pv is output to the first display 421 or the like without setting the alpha blend layer. That is, the captured video frame Rf in this case does not include the identification color. Therefore, the karaoke apparatus 100 uploads the posted video data Co including the captured video frame Rf to the server 600 without detecting the color information from the captured video frame Rf by the color information extraction unit 320 (S32: NO) ( S34). Thereby, the karaoke system and the karaoke apparatus can record the video data including the content of the upload permission video and upload the video data to the server 600.

  As a result, when the karaoke system and the karaoke apparatus use karaoke content that is prohibited from uploading (that is, upload prohibited video), the karaoke system and the karaoke apparatus appropriately prohibit the singing of the singer S and uploading it. obtain. When the karaoke content permitted to be uploaded (that is, the upload permitted video) is used, the display content of the first display 421 and the like can be photographed and uploaded together with the state of singing by the singer S. The system and karaoke apparatus can contribute to diversification and enhancement of services in the karaoke business.

  Although the present invention has been described based on the embodiments, the present invention is not limited to the above-described embodiments, and various improvements and modifications can be made without departing from the spirit of the present invention. For example, in the present embodiment, the alpha blend layer is set so that the identification color is displayed in the reproduced video frame Pf, but the present invention is not limited to this mode. If an identification color can be displayed in a specific playback video frame, various modes can be adopted. For example, if the playback video data Pv is displayed in a letterbox or pillar box, the identification color is displayed in the blank portion (so-called border) of the playback video frame Pf related to the letterbox or the like. Is also possible.

  In the present embodiment, when color information is detected from the captured video frame Rf, uploading is prohibited and deleted from the storage unit 340 when the posted video data Co including the captured video frame Rf is uploaded to the server 600. However, the present invention is not limited to this mode. For example, it is possible to configure so that the photographing by the camera 410 is stopped when the color information is detected from the photographed video frame Rf.

  In this embodiment, the image forming unit 411 is disposed in the camera 410 and the A / D converter 310 is disposed in the STB 300. However, the camera 410 includes the image forming unit and the A / D converter. The structure which has may be sufficient.

  Furthermore, each flowchart described above is merely an example, and the processing may be realized by another flowchart as long as the same result as the processing of each flowchart can be obtained.

  And this invention is realizable also as a karaoke apparatus mentioned above, a karaoke system, the method concerning STB, the program for making a computer perform this method, the recording medium which recorded this program, etc.

100 Karaoke device 200 Commander 210 Control unit 220 Video data playback unit 222 Alpha blend layer setting unit 230 Playback video data storage unit 300 STB
340 Storage unit 320 Color information extraction unit 410 Camera 421 First display 422 Second display 450 Speaker Pv Playback video data Cr Copyright signal α Alpha blend signal Pf Playback video frame Rf Shooting video frame Cd Color information detection signal

Claims (6)

A karaoke apparatus comprising a display, a camera, a recording means, a video output control means, an audio output means, and a transmission control means,
The voice output means outputs a voice signal based on musical tone information included in karaoke data,
The video output control means includes
The video signal included in the karaoke data can be output to the display,
Obtaining control information for the karaoke data;
When outputting the video signal to the display, in accordance with the acquired control information, color information is inserted into the video signal with a predetermined color and brightness, and output,
The recording means records a photographing signal photographed by the camera,
The transmission control means includes
Extracting color information from the photographing signal when the photographing signal is recorded in the recording means;
Determining whether or not the color information is extracted from the photographing signal recorded in the recording means;
A karaoke apparatus characterized by prohibiting transmission of information relating to the photographing signal to an external apparatus connected via a communication network when the color information is extracted. The karaoke apparatus according to claim 1,
The video output control means includes
When outputting the video signal included in the karaoke data to the display, according to the acquired control information, for each predetermined timing, color information is inserted into the video signal and output,
Output timing information indicating the timing of inserting the color information to the video signal to the transmission control means,
The transmission control means includes
Obtaining the time information,
A karaoke apparatus, wherein the color information is extracted from a photographing signal photographed by the camera at a timing indicated by the time information. The karaoke apparatus according to claim 1 or 2,
The video output control means includes
A karaoke apparatus characterized in that, when color information is inserted into the video signal, the color information is inserted into an alpha blend layer constituting the video signal. A karaoke apparatus according to any one of claims 1 to 3,
The karaoke data includes background video and lyrics telop,
The control information indicates whether to prohibit transmission of the imaging signal to the external device,
The video output control means includes
When the control information indicates that the photographing signal is prohibited from being transmitted to the external device,
A karaoke apparatus, wherein the color information is inserted into an alpha blend layer constituting the video signal at a timing when the lyrics telop is output from the video output means. A karaoke system consisting of a commander and a set-top box,
The set top box is
Connected to the camera,
Recording means for recording a photographing signal photographed by the camera;
The commander
Connected to the display,
The video signal included in the karaoke data can be output to the display,
Furthermore,
The commander
Obtaining control information for the karaoke data;
When outputting the video signal to the display, in accordance with the acquired control information, color information is inserted into the video signal with a predetermined color and brightness, and output,
The set top box is
Extracting the color information from the shooting signal when the shooting signal is recorded in the recording means;
Determining whether or not the color information is extracted from the photographing signal recorded in the recording means;
A karaoke system for prohibiting transmission of information relating to the photographing signal to an external device connected via a communication network when the color information is extracted. A set-top box connected to a display and connected to a commander having video output control means,
Connected to the camera,
Recording means for recording a photographing signal photographed by the camera;
When recording the shooting signal in the recording means, the color information inserted by the commander is extracted from the shooting signal;
Determining whether or not the color information is extracted from the photographing signal recorded in the recording means;
A set-top box, which, when the color information is extracted, prohibits transmission of information related to the photographing signal to an external device connected via a communication network.

Images