KR100917990B1 - Settop-box having voice recognition function of singing room and method thereof - Google Patents

Abstract

A set-top box having a voice analysis function of a karaoke and a method thereof are provided to offer the karaoke service by using a portable remote controller to which a microphone and camera using the WLAN are attached. A set-top box having a voice analysis function of a karaoke comprises a voice/video receiver(112), an encoder(113), a decoder(114), a video/audio output unit(115), a hard disk(118) and a flash memory(121). The voice/video receiver receives the karaoke voice and video data of a user from a portable remote controller to which a microphone(110) and camera(111) are attached, and then transmits the data to the encoder. The video/audio output unit mixes the karaoke voice and video data decoded by the decoder with a selected sound source and sing caption, and then outputs the mixed result to a TV or video medium(116).

Description

Set top-box having voice recognition function of singing room and method

The present invention relates to a set-top box having a voice analysis function of karaoke, and a method thereof. In particular, a TV and a portable terminal equipped with a microphone and a camera using a camera and a microphone or WLAN installed in a set-top box connected to a digital TV for terrestrial or cable broadcasting. Provides karaoke service using the remote control, separates the voice signal from the original song into melody and singer voice, separates it when there is a song subtitle, and outputs the high and low sound signals graphically from the TV. The present invention relates to a set-top box having a voice analysis function of karaoke, and a method thereof, which provide a "your own record" function that provides a recording (recording) and a partial excerpt editing function with a PVR function.

1 is a configuration diagram of a song selection system of a conventional karaoke.

The song selection system includes key input means (10) for starting and ending selection of a song, selecting a song selection method, and inputting song classification information; Voice input means 20 for converting and inputting voice into an electrical signal; Voice analysis means (30) for detecting voice analysis information by analyzing voice signals input through the voice input means (20); A song information DB (40) for storing a plurality of song information including preliminary song service information and song classification information and voice analysis information; According to the key input from the key input means 10, and provides a song selection menu, and recognizes the selection of the song selection method, if the song selection method is a key input method through the key input means 10 Compares the matching degree between the input song classification information and the song classification information of the song information DB 40 and selects a song according to a matching score indicating a matching degree, and when the song selection method is a voice input method, the voice is selected. By comparing the matching degree between the voice analysis information analyzed by the analysis means 30 and the voice analysis information of the song information DB 40, the song is selected according to the matching score indicating the matching degree, and the song of the selected song Song selection control means for providing service information (50); And Display means 60 for outputting the song service information provided by the song selection control means 50 on the screen.

Recently, with the spread of IPTV, set-top boxes connected to digital TVs can receive satellite broadcasts, terrestrial broadcasts, or cable broadcasts.

The set-top box optionally includes a tuner and a channel decoder, and includes a control unit, ROM / RAM, flash memory, hard disk (HDD), smart card interface unit, decoder unit, infrared receiver unit, PCMCIA, LAN interface as an external interface. Consists of IEEE 1394 for video and xDSL interface, USB interface, VCR, camera, and PC, and is used in connection with home server that controls all devices in the home by adding home networking function. Is being released.

The basic functions of a set-top box (STB) are to descramble and demultiplex digital multimedia data transmitted from terrestrial (ACAP) or cable (OCAP) or satellite (DVB-MHP) to MPEG-2 TS. Demultiplexing) and playback through A / V decoding.

However, although TV viewers provided karaoke services by installing cameras and microphones from a set-top box connected to a digital TV for terrestrial or cable broadcasting, installing a camera and a microphone, using a portable remote control equipped with a microphone and a camera using a WLAN There was a problem that did not provide a "my own record" function that provides a recording (recording) and partial excerpt editing function as a PVR function.

The present invention has been proposed to solve the problems of the prior art, a TV viewer using a portable remote control with a microphone and a camera using a camera or microphone or WLAN installed in a set-top box connected to a digital TV for terrestrial or cable broadcasting Provides service, separates the voice signal from the original song into melody and singer voice, separates the song subtitles when there is a song, and outputs the high and low sound signals graphically on the screen, and records with the PVR function. It is an object of the present invention to provide a set-top box having a voice analysis function of karaoke, and a method thereof, which provide a " your own record " function that provides (recording) and partial excerpt editing functions.

In order to achieve the object of the present invention, the present invention provides a tuner, a channel decoder, a smart card reader, a descrambler, a demultiplexer, a MPEG A / V decoder unit, a ROM / RAM, an infrared receiver unit, a USB interface unit, and an Ethernet connection unit. And a set top box having a voice analysis function of a karaoke having a VDSL modem connection unit, the set top box comprising: a voice / video receiver for receiving a user's karaoke voice and image data from a portable remote controller equipped with a microphone and a camera; An encoder for encoding karaoke voice and image data of the user received from the voice / video receiver; A decoder for decoding the karaoke voice and image data of the user; A video / audio output unit configured to mix the decoded user's karaoke voice and image data with a selected karaoke sound source and song subtitles and output the result to a TV or a video medium; Hard disk (HDD) for storing the karaoke sound source by music genre downloaded from the karaoke server; Flash memory for storing karaoke and speech analysis software; And a wireless LAN connection unit for receiving a karaoke control signal and a user's karaoke voice and video data through a wireless LAN through a portable remote controller equipped with a microphone and a camera equipped with the WLAN card and a wireless LAN access point (AP).

The portable remote controller is characterized by using any one of a PDA (Pocket-PC), a handheld PC (HPC), or a tablet PC equipped with a WLAN card.

The karaoke and voice analysis software may play karaoke sources of music genres stored in a hard disk (HDD) on a digital TV screen and a speaker connected to a set-top box, and set a karaoke background, an avatar, and a song subtitle, and to the karaoke server. You can download the karaoke sound source you want by accessing the unicast method, and when playing the sound source, separate the voice signal from the original song into melody and singer voice through frequency voice analysis, separate the song subtitles separately, and separate the voice signal from the TV. It is characterized by outputting the high and low sound to the screen graphically.

The karaoke and voice analysis software is characterized by providing a "your own record" function that provides recording (recording) and partial excerpt editing function as a PVR function.

The karaoke server receives the subscriber information on the IPTV karaoke service, manages the members, provides a karaoke sound source in a download & play manner, and connects to a payment server (PG) for each karaoke sound cell phone payment or It is characterized by processing the billing by credit card payment method.

In order to achieve another object of the present invention, a method for providing a karaoke service in a set-top box having a voice analysis function according to the present invention, (a) after the set-top box connected to the digital TV DTV, STB ON initialization, DHCP server from the DHCP client Connecting to a mobile IP address, and then transmitting an authentication request message including a set-top box ID (SAID) to a personalization authentication server of the IPTV headend system to perform terminal authentication and PIN authentication of the set-top box; (b) after the PIN authentication, selecting a karaoke menu to run the karaoke and voice analysis software to download the desired sound source using a mobile phone payment or credit card payment to store in the hard disk; (c) driving the karaoke and voice analysis SW in the EPG menu to select an equalizer, a volume control, a desired song selection, a wallpaper and an avatar, and a song subtitle; (d) When purchasing a karaoke sound source, after accessing a karaoke server from a set-top box to a karaoke server and paying for a desired karaoke sound source, a payment server (PG) is used to make a mobile phone payment or a credit card payment, and then the karaoke sound source Downloading the data and storing it in a hard disk (HDD) or a USB memory; (e) Using a portable remote controller equipped with a microphone and a camera equipped with a WLAN card, access the set-top box via the wireless LAN AP to adjust the karaoke volume, select the karaoke sound source, and set-up the voice and video of the user who sings. Receiving and encoding the audio / video receiver of the box; (f) karaoke and voice analysis SW recognizes the voice signal from the original song by frequency to separate the original song melody and voice signal, and separate the song subtitles when there is a song subtitle including a background and chorus avatar ; And (g) decoding and graphically outputting the voice and video signals I have called through the video / audio output unit to the TV and the video medium together with the song subtitles and song lyrics having a background and chorus avatar. It includes.

In the set-top box having a voice analysis function according to the present invention, the method for providing a karaoke service includes recording (recording) and extracting and editing voice and video using a PVR function when a user's own record function is set in the karaoke and voice analysis software. The method further includes a step of storing the song on the hard disk (HDD) of the set-top box together with the chorus background and song lyrics of the avatar of the song subtitle.

The method of providing a karaoke service in a set-top box having a voice analysis function according to the present invention includes receiving subscriber information on an IPTV karaoke service by the karaoke server, managing members, and providing a karaoke sound source in a download & play manner. It includes more.

In the set-top box having a voice analysis function according to the present invention, the method for providing a karaoke service, by the karaoke server connected to the payment server (PG) for each karaoke sound source requested by the user to process the billing by mobile phone payment or credit card payment method It further includes.

As described above, the set-top box having a voice analysis function of the karaoke according to the present invention and the method is that the microphone and the camera using a camera or microphone or WLAN installed in the set-top box connected to the digital TV for terrestrial or cable broadcasting Provides karaoke service using the attached portable remote control, separates the voice signal from the original song into melody and singer voice, separates it when there is song subtitle, and separates the voice signal separated by TV into the graphic It has the effect of providing a "My Record" function that outputs high and low, and provides recording (recording) and partial excerpt editing function with the PVR function.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is a block diagram of a set-top box having a voice analysis function of karaoke according to the present invention.

An IP set-top box including a tuner and a channel decoder (QPSK DVB demodulator, tuner, FEC decoder), a smart card reader, a descrambler of a reception limiting module, a demultiplexer, and an MPEG A / V decoder unit includes a microphone 110 and a camera 111. And a video / audio output unit 115 and a controller connected to a voice / video receiver 112, an encoder 113, a decoder 114, a TV, or a video medium 116 connected to the karaoke user. 117, flash memory 121, ROM 120 / RAM 119, hard disk (HDD) 118, Ethernet connection 122, VDSL modem connection 123, wireless LAN connection 124, infrared receiver (125), a hardware layer composed of STB hardware such as the USB interface unit 126, a system software layer including a device driver and an operating system, a DHCP client, a Java Virtual Machine (JVM), a Java Network Interface (JNI) ), OCAP API, or ACAP API (ACAP-J, ACAP-X API) (Java TV, Havi UI, JMF, DAVIC, CA Interface, conditional access system (CAS) module, API for media service (Navigator, Audio streaming API, VOD, Flash player, HDS Client, SSO Client), streaming protocol It supports middleware layer with (RTP, RTSP), codec for MPEG2, MPEG4, H.264 and other media, and includes EPG client and web browser.

The control unit 117 is a multimedia processor (embedded MPEG-4 / H.264 A / V decoder), smart card reader, reception limiting module, ETHERNET connector 122, VDSL modem connector 123, infrared receiver 125, USB The interface unit 126, the STB panel unit, the SMPS and the power supply unit, the flash memory 121, the ROM 120, the RAM 119, and the hard disk (HDD) 118 are connected.

The control unit 117 is in charge of controlling each module of the IPTV user's EMM right confirmation and reception restriction control function, descrambling, demultiplexing, and A / V decoding function by the smart card.

The tuner performs frequency generation, bit rate code, symbol rate detection, and the like, required for channel tuning of the analog signal of the selected channel.

The channel decoder is demodulated by a COFDM, QAM, VSB, or QPSK demodulator, derandomized by a demapper, and transmitted by an FEC decoder to detect and correct errors at the receiving end, depending on the broadcast type. After descrambling, the MPEG2 TS packet is restored by a TS-Demultiplexer, and then video, audio, data, and PSI information is decoded by a decoder (video decoder, audio decoder, data decoder). Decode

The MPEG A / V decoder unit includes an audio decoder, an audio DAC, a video decoder, a video DAC, and a data decoder.

The decoded audio data is converted into an analog voice signal through an audio digital / analog converter (Audio DAC), amplified by OP-AMP, and then output to the left and right speakers in a stereo manner.

The decoded video data displays an RGB signal generated through a video digital-to-analog converter (Video DAC) to a digital TV.

In this case, the set-top box should embed data broadcasting middleware according to the standardization of data broadcasting of ACAP (Advanced Common Application Platform, terrestrial wave) or OCAP (Open Cable Application Platform, cable).

The smart card reader is connected to a conditional access module and reads the EMM authorization information of the service subscriber stored in the IC card chip of the smart card inserted by the user.

A smart card reader is a part of inputting a smart card of an IPTV service subscriber. The smart card reader stores a user's authority and a key necessary for the operation of a descrambler of a CAS (Conditionl Access System) on a smart card or stores data from the smart card. Read.

The reception restriction module descrambles the transport stream encrypted by the control word (CW) according to the subscriber's EMM authorization information read from the smart card reader.

The voice / video receiver 112 receives the user's karaoke voice and video data from the microphone 110 equipped with the WLAN card and the portable remote controller (portable terminal) equipped with the camera 111 and transmits the karaoke voice and video data to the encoder 113.

The portable terminal may use any one of a PDA (Pocket-PC), a handheld PC (HPC), and a tablet PC (Tablet PC) equipped with a WLAN card.

The encoder 113 encodes the user's karaoke voice and video data received from the voice / video receiver 112 and temporarily stores the karaoke voice and video data in the hard disk (HDD) 118.

The decoder 114 decodes the user's karaoke voice and video data.

The video / audio output unit 115 mixes the decoded user's karaoke voice and image data with the karaoke sound source and the song subtitle selected in the karaoke menu and outputs them to the TV or the image medium 116 at a predetermined volume level.

The hard disk (HDD) 118 is connected to the karaoke server through the Ethernet connection unit 122 or the VDSL modem connection unit 123 and stores the received karaoke sound for each genre of music.

The flash memory 121 separates the voice signal from the original song into a melody and a singer voice, and separates it when there is a song subtitle, and outputs the sound level on the screen graphically of the voice signal separated by the TV, and the PVR function. Stores karaoke and voice analysis software that provides "your own record" functionality for recording (recording) and partial excerpt editing.

The Ethernet connection unit 122 is connected to the control unit 117 and provides a LAN interface.

The VDSL modem connection unit 123 is connected to the control unit 117 and provides an xDSL modem connection interface.

Set-top box having a voice analysis function of karaoke according to the present invention is characterized in that it further comprises a wireless LAN connection unit 124 in the configuration of the existing set-top box.

The wireless LAN connection unit 124 is a microphone equipped with the WLAN card using a wireless LAN protocol through a microphone equipped with a WLAN card, a portable remote controller (portable terminal) equipped with a camera, and a wireless LAN access point (AP). It is used to receive karaoke control signal, microphone and user's voice and video data from camera and portable remote controller (portable terminal) with camera through wireless LAN.

The portable remote controller equipped with a microphone equipped with a WLAN card and a camera provides a karaoke microphone function using a microphone attached to the remote controller, acquires a user's karaoke image with the camera, and controls karaoke for operating the karaoke function. Signals and voice and video data from the camera and the camera are transmitted to the set-top box via a wireless LAN access point (AP).

The infrared receiver 125 receives an infrared signal of an 8-bit keycode transmitted from the infrared transmitter of the remote controller.

The USB interface unit 126 provides an interface connected to a user's USB memory card.

The STB panel input unit 127 provides a key input function selected by a user for karaoke service.

3 is a configuration diagram of a karaoke service system having a voice analysis function according to an embodiment of the present invention.

Karaoke service system having a voice analysis function according to an embodiment of the present invention IPTV including a personalization authentication server 71, a data server 72, and a multiplexing system (IP Multiplexer), data broadcasting system (DBS), EPG server Set-top box 74 connected to a head-end system 70, a karaoke server 80 with a data agent, a payment server 81, a digital TV 75 with karaoke and voice analysis SW installed, and a WLAN card 77 It includes a portable remote control (portable terminal) 78 with a microphone and a camera attached thereto.

IPTV headend system 70 is a router (R) and L3 switch using PIM-SM multicast routing protocol, DSLAM and Fast Ethernet Switch (FES: 100Mbps) using IGMP Snoopying protocol with IGMP Proxy function. Multicasting of broadcast video and audio signals, data for broadcasting data, program specific information (PSI), service information (SI), and electronic program guide (EPG) through L2 network equipment It transmits to a plurality of IP set-top boxes 74 joined to a broadcast channel (Multicast Group) including a karaoke service.

The personalization authentication server 71 of the IPTV headend system 70 sets up a set-top box ID (SAID) and subscriber information (name, address, social security number, home phone number, mobile phone number) for IPTV karaoke service from the IP set-top box requesting PIN authentication. Receive an authentication request message including a telephone number, etc. through the return pass system, and transmit the authentication ticket to the IP set-top box requested through the return path system in response to the authentication request message. Authenticate

The set-top box 74 is connected to a digital TV 75 for terrestrial or cable broadcasting and is connected to an ADSL modem / VDSL modem or a Fast Ethernet Switch (FES) 73 through a DSL splitter that distributes and combines DSLAM and optical wavelengths. It is connected to a DHCP server and assigned a floating IP address by the DHCP protocol.

Routers (R) and L3 switches (L3) in an IP network use the PIM-SM multicast routing protocol and are joined to a multicast group associated with the broadcast channel via a rendezvous point (RP). The media data is transmitted through a multicast tree formed by the set top box 74.

The set-top box 74 connected to the digital TV 75 uses IGMP (Internet Group Management Protocol) protocol for selecting and releasing broadcast channels, and DSLAM and Fast Ethernet Switch (FES) with xDSL concentrator function (L2 equipment). Uses the IGMP Snooping protocol.

The set-top box 74 connected to the digital TV 75 transmits an IGMP Join / Ledave message to a multicast group associated with a broadcast channel selected to request broadcast channel selection / deselection. Transmit to L3 switch by IGMP Snooping protocol (73).

The set-top box 74 connected to the digital TV 75 with karaoke and voice analysis SW is joined to a broadcast channel (Multicast Group) including karaoke service (IGMP Join), and the PIM-SM from the IPTV headend system 70 is installed. Receive broadcast video and audio signals, data broadcasting data, program specific information (PSI), service information (SI), and electronic program guide (EPG) according to the multicast routing protocol in a multicast manner. After selecting the karaoke service menu, and driving the karaoke and sound source analysis SW, and access to the karaoke server 80 by the Unicast method to download and use the desired karaoke sound source.

Karaoke and voice analysis software plays multiple karaoke sources for each genre of music stored on the hard disk (HDD) on digital TV screens and speakers connected to the set-top box, sets karaoke backgrounds, avatars, and song subtitles. You can download the desired karaoke sound by accessing the cast method, and the voice signal from the original song when playing the sound source is separated into melody and singer voice through frequency voice analysis as shown in FIG. Separate subtitles when there are subtitles, and graphically output voice signals separated by TV, and provide “My Record” function that provides recording (recording) and partial excerpt editing function with PVR function. .

The karaoke server 80 provides a karaoke sound source, receives subscriber information on the IPTV karaoke service, manages the members, and transmits data related to the karaoke service by the data agent 79 to the data of the IPTV headend system. After transmitting to the server 72, receiving the karaoke sound source request from the user's set-top box terminal, the set-top box terminal after the payment provided to the user's set-top box terminal by the download and play (member & download) method for each member Karaoke and voice analysis provided by SW.

Karaoke sound source uses Digital Rights Management (DRM) technology to protect copyright of sound source.

The payment gateway (PG) 81 charges by mobile phone payment or credit card payment for each karaoke sound source requested by the user.

The set-top box 74 connected to the digital TV 75 installed with karaoke and voice analysis SW is connected to a wireless LAN access point 76, and a portable remote controller (a mobile terminal with a microphone and a camera equipped with a WLAN card 77) is attached. 78) receives a karaoke control signal and voice and video of a user singing in real time via a wireless LAN (WLAN).

A portable remote controller (mobile terminal) 78 with a microphone and a camera equipped with a WLAN card 77 receives a singing user's voice as a microphone, and photographs a singing user's video with an attached camera.

5 is a flowchart illustrating a method for providing karaoke service in a set-top box having a voice analysis function of karaoke according to the present invention.

Set-top box connected to digital TV is connected to DHCP server from DHCP client after initializing DTV, STB ON, and assigned a dynamic IP address according to DHCP protocol, and then sends an authentication request message including set-top box ID (SAID) to IPTV headend. Transmission to the personalization authentication server of the system, the terminal authentication and PIN authentication of the set-top box (step S10).

The personalization authentication server 71 of the IPTV head-end system 70 receives an authentication request message including a set-top box ID (SAID) and subscriber information for the IPTV karaoke service from the IP set-top box requesting PIN authentication through a return pass system. In response to the authentication request message, the authentication ticket is transmitted to the requested IP set-top box through a return path system to authenticate the set-top terminal (step S11).

The SAID of the set-top box is a unique ID assigned to the terminal by the communication company when the service is opened. The HDS client of the personalization authentication server and the set-top box (STB) manages the information (SAID, IP address, MAC address, terminal model name) of the opened STB terminal. In addition, IP set-top box 60 includes a single sign-on (SSO) client, HDS client for opening terminal information management, and stores the SAID of the terminal in the HDS client in the set-top box (STB).

In personal identification number (PIN) authentication with a personal authentication-based service, the personalization authentication server assigns one master PIN number (consisting of four digits) to a home and assigns a plurality of PIN information to household members.

After the PIN authentication (step S12) of the IPTV viewer, the user selects the karaoke menu of the STB, runs the karaoke and voice analysis software, and downloads the desired sound source by using a mobile phone payment or a credit card payment. 118) to execute.

The karaoke server 80 provides data related to the karaoke service to the data server 72 of the IPTV headend system 70 through the data agent 79, and transmits the data to the IPTV karaoke service from the user's set-top box terminal. Receives the subscriber information for managing the members (step S13), provides a karaoke sound source by the download and play (download & play) method, payment server (PG: Payment Gateway) for each karaoke sound source provided to the user's set-top box terminal Connect to (81) and charge by mobile phone or credit card.

The user drives the karaoke and voice analysis SW in the electronic program guide (EPG) menu to select an equalizer, volume control, desired song selection, background and avatar selection, and song subtitle (step S14).

When purchasing a karaoke sound source, access the karaoke server 80 from the karaoke and voice analysis software of the set-top box to access the payment server (PG: Payment Gateway) 81 to pay the fee for the sound source that you want to purchase. Credit card payment is used (step S15).

The desired sound source is downloaded from the karaoke server 80 to the karaoke and voice analysis software of the user's set-top box and stored in a hard disk (HDD) 118 of the set-top box or a USB memory connected to the set-top box (step S16).

Access the set-top box via a wireless LAN access point (AP) using a microphone equipped with a WLAN card (77) and a camera-equipped remote control (mobile terminal) 78 to adjust the karaoke volume and select the karaoke sound source. The voice and video of the singing user are received by the voice / video receiver 112 of the set-top box and encoded by the encoder 113 (step S17).

The karaoke and voice analysis SW recognizes the voice signal from the original song by frequency and separates the original melody and the voice signal, and separates the song subtitles when there are song subtitles including a background and a chorus avatar (step S18). .

After decoding by the decoder 114, the song subtitle and song lyrics having an avatar which choruses the voice and the video signal which I have called through the video / audio output unit 115 to the TV and the video medium 116 as the background screen. And output to the screen graphically in real time (step S19).

Whenever you finish a single song for the original song melody, it evaluates the voice of the song I sang for the reference melody and displays the karaoke score by calculating the pitch and beat according to the lyrics by the pitch and time signature module of the karaoke and voice analysis SW. Mark on.

If your own recording feature is set in the karaoke and voice analysis software of the set-top box, the PVR function will record the recorded (recorded), extracted and edited voices and videos with the chorus background and song lyrics of the "Is stored in the hard disk (HDD) 118 of the set-top box (step S20).

Therefore, the user can use the karaoke using a camera and a microphone installed in a set-top box connected to a digital TV, or a portable remote control equipped with a microphone and a camera, and separates the voice signal from the original song into a melody and a singer's voice. Separately, it will utilize the "My Record" function that provides a graphic output of the audio signal separated by the TV, and provides recording (recording) and partial excerpt editing function with the PVR function.

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form.

As described above, although described with reference to the preferred embodiment of the present invention, those skilled in the art various modifications of the present invention without departing from the spirit and scope of the present invention described in the claims below. Can be modified or modified.

1 is a configuration diagram of a song selection system of a conventional karaoke.

Figure 2 is a block diagram of a set-top box having a voice analysis function of karaoke in accordance with the present invention.

3 is a configuration diagram of a karaoke service system having a voice analysis function according to an embodiment of the present invention.

Figure 4 is the original song, a voice and melody, a diagram that distinguished the lyrics.

5 is a flowchart illustrating a method for providing karaoke service in a set-top box having a voice analysis function of karaoke according to the present invention.

<Explanation of symbols for the main parts of the drawings>

110: MIC 111: camera

112: voice / video receiver 113: encoder

114: decoder 115: video / audio output unit

116: TV or video medium 117: control unit

118: hard disk (HDD) 119: RAM

120: ROM 121: flash memory

122: Ethernet connection 123: VDSL modem connection

124: wireless LAN connection 125: infrared receiver

126: USB interface unit 127: STB panel input unit

Claims (9)

Voice analysis function of karaoke with tuner, channel decoder, smart card reader, descrambler, demultiplexer, MPEG A / V decoder, ROM / RAM, infrared receiver, USB interface, Ethernet connection, VDSL modem connection In the set-top box having, A voice / video receiver for receiving a user's karaoke voice and image data from a portable remote controller equipped with a microphone and a camera and transmitting the received karaoke voice and image data to an encoder; An encoder for encoding karaoke voice and image data of the user received from the voice / video receiver; A decoder for decoding the karaoke voice and image data of the user; A video / audio output unit configured to mix the decoded user's karaoke voice and image data with a selected karaoke sound source and song subtitles and output the result to a TV or a video medium; Hard disk (HDD) for storing the karaoke sound source by music genre downloaded from the karaoke server; Flash memory for storing karaoke and speech analysis software; And A wireless LAN connection unit for receiving a karaoke control signal and a user's karaoke voice and video data through a wireless LAN through a microphone equipped with a WLAN card, a portable remote controller equipped with a camera, and a wireless LAN access point (AP); Set top box with a voice analysis function of karaoke including a. The method of claim 1, The portable remote control, A set-top box having a voice analysis function of karaoke, using any one of a PDA (Pocket-PC), a handheld PC (HPC), and a tablet PC equipped with a WLAN card. The method of claim 1, The karaoke and voice analysis software, Play the karaoke sound sources by music genre stored in the hard disk (HDD) on the digital TV screen and speakers connected to the set-top box, set the karaoke background, avatar, and song subtitles, and connect to the karaoke server in a unicast manner. The sound source can be downloaded, and the sound signal from the original song is separated into melody and singer's voice through the voice analysis and the song subtitles are separated separately, and the sound signal separated by the TV is displayed graphically. Set-top box with a voice analysis function of karaoke, characterized in that the output. The method of claim 1, The karaoke and voice analysis software, Set-top box with voice analysis function of karaoke, which provides a "your own record" function that provides recording (recording) and partial excerpt editing function with the PVR function. The method of claim 1, The karaoke server, Manage subscribers by receiving subscriber information about IPTV karaoke service, provide karaoke sound recording by download & play method, and connect to payment server (PG) by karaoke sound source by mobile phone payment or credit card payment method Set-top box having a voice analysis function of karaoke, characterized in that the charge processing. In the method of providing karaoke service in a set-top box having a voice analysis function, (a) After the set-top box connected to the digital TV is initialized with DTV and STB ON, the DHCP client connects to the DHCP server and receives a dynamic IP address, and then sends an authentication request message including the set-top box ID (SAID) to the IPTV headend system. Transmitting to the personalization authentication server of the terminal to perform terminal authentication and PIN authentication of the set-top box; (b) after the PIN authentication, selecting a karaoke menu to run the karaoke and voice analysis software to download the desired sound source using a mobile phone payment or credit card payment to store in the hard disk; (c) driving the karaoke and voice analysis SW in the EPG menu to select an equalizer, a volume control, a desired song selection, a wallpaper and an avatar, and a song subtitle; (d) When purchasing a karaoke sound source, after accessing a karaoke server from a set-top box to a karaoke server and paying for a desired karaoke sound source, a payment server (PG) is used to make a mobile phone payment or a credit card payment, and then the karaoke sound source Downloading the data and storing it in a hard disk (HDD) or a USB memory; (e) Using a portable remote controller equipped with a microphone and a camera equipped with a WLAN card, access the set-top box via the wireless LAN AP to adjust the karaoke volume, select the karaoke sound source, and set-up the voice and video of the user who sings. Receiving and encoding the audio / video receiver of the box; (f) karaoke and voice analysis SW recognizes the voice signal from the original song by frequency to separate the original song melody and voice signal, and separate the song subtitles when there is a song subtitle including a background and chorus avatar ; And (g) after decoding, graphically outputting the voice and video signals I have called through the video / audio output unit to the TV and the video medium together with the subtitles and song lyrics having a background and chorus avatar; Karaoke service providing method in a set-top box having a voice analysis function comprising a. The method of claim 6, When the personal recording function is set in the karaoke and voice analysis software, the recorded (recorded), extracted and edited voice and video are recorded in the PVR function together with the chorus background and song lyrics of the subtitle of the song. Karaoke service providing method in the set-top box having a voice analysis function further comprising the step of storing in the hard disk (HDD) of the set-top box. The method of claim 6, Receiving the subscriber information on the IPTV karaoke service by the karaoke server, and managing members, and providing a karaoke sound source in a download & play manner. The method of claim 6, Connecting to a payment server (PG) for each karaoke sound source requested by the karaoke server to process a billing by a mobile phone payment or a credit card payment method.

Images