KR20110049280A - Apparatus and method for servicing broadcasting - Google Patents

Abstract

PURPOSE: A device for a broadcasting service is provided to extract content from an AV signal in real time to broadcast the extracted contents with the AV signal. CONSTITUTION: A content extraction unit(130) divides content in an AV(Audio and Video) signal. The content extraction unit extracts content in which detailed information is stored in a database(120) among the divided contents. The content extraction unit broadcasts the extracted content with the AV signal. A detailed information providing unit(160) provides detailed information of corresponding content to the broadcasting signal receiver(140).

Description

Broadcasting service apparatus and method {Apparatus and method for servicing broadcasting}

The present invention relates to a broadcast service apparatus and method. In more detail, when a broadcaster extracts content to provide detailed information from an AV signal transmitted through a broadcasting network, broadcasts the content together with the AV signal, and when the broadcast signal receiver requests detailed information related to a predetermined content, details of the corresponding content. A broadcast service apparatus and method for providing information.

In general, data broadcasting is a character that appears on a screen or an audio signal of an AV signal when broadcasting a predetermined AV signal through a predetermined transmission medium such as over-the-air broadcasting, satellite, terrestrial, cable, wired or Internet network. Broadcast information including various detailed information including object information related to various objects such as, props and plots, and additional service information such as data broadcasting content addresses of the various objects, e-commerce and electronic shopping, etc. Service provided to the receiver. Through a broadcast signal receiver capable of receiving a data broadcast such as a digital television receiver or a computer, users can obtain detailed information on various contents included in the broadcast program while watching the broadcast program. .

In the current data broadcasting, the operator extracts predetermined contents while watching the AV signal in advance before broadcasting the AV signal through the broadcasting network, and prepares and stores detailed information of the contents in a database in advance.

When the broadcasting station wants to broadcast a predetermined AV signal through the broadcasting network, the extracted contents are broadcasted through the broadcasting network in synchronization with the time indicated in the AV signal, and when the broadcast signal receiver requests detailed information of the predetermined content, The detailed information of the content is read and provided to the broadcast signal receiver.

However, such data broadcasting is required to broadcast the extracted contents in synchronization with the time when the contents appear in the AV signal, which is very difficult to synchronize, and therefore, it is very difficult to broadcast the contents in real time in synchronization with the AV signal.

Accordingly, an object of the present invention is to provide a data broadcasting apparatus and method for broadcasting a content which extracts content from an AV signal to be broadcasted in real time and provides the extracted content to a broadcasting network.

Technical problems to be achieved by the present invention are not limited to the above-mentioned technical problems, and other technical problems not mentioned above may be clearly understood by those skilled in the art to which the present invention pertains. There will be.

According to an embodiment of the present invention, a data broadcasting apparatus includes a database in which detailed information on each of a plurality of contents and contents is prestored, and contents which are separated and separated from contents contained in an AV signal (Audio and Video) provided by a broadcasting station. A contents extraction unit for extracting contents stored in the database with detailed information and providing the extracted contents to a broadcasting network for broadcasting together with the AV signal provided by the broadcasting station; and a broadcast signal receiver requesting detailed information about predetermined contents. In this case, it is configured to include a detailed information providing unit for searching the database for detailed information of the corresponding content and providing the detailed information to the broadcast signal receiver.

The content extractor comprises: an AV signal separator for separating the AV signal provided by the broadcasting station into a video signal and an audio signal, a screen display unit for displaying the video signal separated by the AV signal separator, and the screen display unit on the screen. A video capture unit for capturing an image of the displayed video signal at a predetermined time interval, a video content extractor for extracting contents included in the image of the video signal captured by the video capture unit, and the video content extractor; It is characterized in that it comprises a content providing unit for extracting only the content is stored in the database from the additionally extracted content to provide to the broadcast network.

The content extractor comprises: an AV signal separator for separating the AV signal provided by the broadcasting station into a video signal and an audio signal, an analog audio signal converter for converting the audio signal separated by the AV signal separator into an analog audio signal; An audio content extraction unit for extracting content included in the analog audio signal converted by the analog audio signal conversion unit, and only content having detailed information stored in the database from the contents extracted by the audio content extraction unit; Characterized in that it comprises a content providing unit provided to.

The content extractor comprises: an AV signal separator for separating the AV signal provided by the broadcasting station into a video signal and an audio signal, a screen display unit for displaying the video signal separated by the AV signal separator, and the screen display unit on the screen. A video capture unit for capturing an image of the displayed video signal at predetermined time intervals, a video content extractor for extracting contents included in the image of the video signal captured by the video capture unit, and the AV signal separation unit An analog audio signal converter for converting the separated audio signal into an analog audio signal, an audio content extractor for extracting content contained in the analog audio signal converted by the analog audio signal converter, and the video content extractor; And the audio content extraction unit respectively extract It characterized by configured to extract only the content among the content, that is, the details stored in the database includes a service that provides content to the broadcast network.

The video content extracting unit extracts content by analyzing an object displayed on an image of the captured video signal by using a scale invariant feature transform (SIFT) or a support vector machine (SVM) algorithm.

The audio content extractor extracts content by recognizing the analog audio signal.

The recognition of the analog audio signal is performed by monitoring a process in which audio is spoken, assigning a unique model to each target word or phoneme, and from which model the audio signal input from the analog audio signal converter is most likely to be generated. It is characterized by measuring and recognizing.

Modeling of the audio signal is characterized in that the modeling by HMM (Hidden Markov Model) technique.

In addition, the data broadcasting method of the present invention comprises the steps of the content extraction unit for separating the AV signal provided by the broadcasting station into a video signal and an audio signal, the content extraction unit separates the content from the separated video signal and audio signal, the separated content Extracting the contents of which the detailed information is stored in a database, providing the contents of the extracted detailed information to a broadcasting network, and broadcasting them together with the AV signal provided by the broadcasting station; When the request for the detailed information of the content characterized in that it comprises a step of providing a detailed information providing unit reads the detailed information of the corresponding content from the database to the broadcast signal receiver.

The extracting of the content may include displaying the separated video signal on a screen, capturing an image of the video signal displayed on the screen at a predetermined time interval, and being included in the image of the captured video signal. And extracting only the contents having detailed information stored in the database from the extracted contents.

The extracting of the content may include converting the separated audio signal into an analog audio signal, extracting content included in the converted analog audio signal, and detail information may be provided in the database. And extracting only the stored content.

The extracting of the content may include displaying the separated video signal on a screen, capturing an image of the video signal displayed on the screen at a predetermined time interval, and being included in the image of the captured video signal. Extracting the contents, converting the separated audio signal into an analog audio signal, extracting content included in the converted analog audio signal, an image of the video signal, and the analog audio signal. And extracting only content that has detailed information stored in the database among the contents extracted from.

The content extraction from the image of the video signal is characterized in that the content is extracted by analyzing the object displayed on the image of the video signal by a scale invariant feature transform (SIFT) or support vector machine (SVM) algorithm.

Content extraction from the analog audio signal is characterized in that to extract the content by recognizing the analog audio signal.

The recognition of the analog audio signal is performed by monitoring a process in which audio is spoken, assigning a unique model to each target word or phoneme, and from which model the audio signal input from the analog audio signal converter is most likely to be generated. It is characterized by measuring and recognizing.

Modeling of the audio signal is characterized in that the modeling by HMM (Hidden Markov Model) technique.

The present invention extracts contents from an AV signal broadcasted through a broadcasting network in real time, and provides the extracted contents to the broadcasting network for broadcasting together with the AV signal, which is precisely displayed at the time displayed on the screen of the AV signal or outputted as an audio signal. Contents can be provided in synchronization, and when the detailed information is requested, the detailed information can be accurately checked in synchronization with the AV signal, so that data broadcasting can be viewed more accurately.

The following detailed description is only illustrative, and merely illustrates embodiments of the present invention. In addition, the principles and concepts of the present invention are provided for the purpose of explanation and most useful.

Accordingly, various forms that can be implemented by those of ordinary skill in the art, as well as not intended to provide a detailed structure beyond the basic understanding of the present invention through the drawings.

1 is a block diagram showing the configuration of a preferred embodiment of a data broadcasting apparatus of the present invention. Here, reference numeral 100 denotes a broadcast station. The broadcasting station 100 provides an AV signal of a predetermined television broadcast program to be broadcast.

Reference numeral 110 is a broadcasting network. The broadcasting network 110 transmits an AV signal provided by the broadcasting station through a predetermined transmission medium including airwaves, satellites, terrestrial, cable, wired, and internet networks.

Reference numeral 120 is a database. The database stores various contents to be broadcast through the broadcasting network, detailed information related to the contents, and the like.

Reference numeral 130 is a content extraction unit. The content extraction unit 130 separates the content from the AV signal provided by the broadcasting station 100. The content extractor 130 extracts content having detailed information stored in the database 120 among the separated contents, and extracts the extracted content along with the AV signal provided by the broadcasting station 100 from the broadcasting network ( Broadcast via 110).

Reference numeral 140 denotes a broadcast signal receiver. The broadcast signal receiver 140 may receive, for example, an AV signal transmitted through the broadcast network 110 as a set top box or a digital television receiver so that a user can view it. In addition, the broadcast signal receiver 140 displays the content transmitted through the broadcast network 110, and obtains detailed information about the content selected by the user through the network 150 so that the user can check it.

Reference numeral 160 is a detailed information provider. The detail information providing unit 160 extracts detailed information about predetermined content requested by the broadcast signal receiver 140 through the network 150 from the database 120 and transmits the detailed information to the broadcast signal receiver 140. to provide.

The data broadcasting apparatus of the present invention having such a configuration first stores various contents included in the AV signal to be broadcast by the operator through the broadcasting network 110 and detailed information related to the contents in the database 120 in advance.

The broadcasting station 100 provides a predetermined AV signal to be broadcasted to the broadcasting network 110.

The AV signal provided by the broadcasting station 100 is input to the content extraction unit 130 to separate the AV signal, and predetermined contents included in the separated video and audio signals are separated.

The content extractor 130 extracts content in which detailed information is stored in the database 120 among the separated contents, and provides the extracted contents to the broadcasting network 110.

Then, the broadcasting network 110 broadcasts the AV signal provided by the broadcasting station 100 and the contents provided by the content extracting unit 130. The AV signal and contents broadcasted by the broadcasting network 110 are received by the broadcast signal receiver 140 so that the user can watch the AV signal and display predetermined contents included in the AV signal on the screen so that the user can check it. .

In this state, when the user selects predetermined content displayed on the screen, the broadcast signal receiver 140 accesses the detailed information providing unit 160 through the network 150 and displays detailed information about the content selected by the user. request.

Then, the detailed information providing unit 160 searches a database to read detailed information about the content, and provides the read detailed information to the broadcast signal receiver 140 through the network 150 to broadcast the receiver. 140 displays detailed information of the content selected by the user on the screen.

FIG. 2 is a block diagram illustrating a detailed configuration of the content extraction unit of FIG. 1. Here, reference numeral 200 denotes an AV signal separator. The AV signal separator 200 separates a video signal and an audio signal by inputting an AV signal provided from the broadcasting station 100.

Reference numeral 210 denotes a screen display. The screen display unit 210 displays the video signal separated by the AV signal separation unit 200 on the screen.

Reference numeral 220 is a video capture unit. The video capture unit 220 captures an image of a video signal displayed on the screen by the screen display unit 210 at predetermined time intervals.

Reference numeral 230 is a video content extraction unit. The video content extracting unit 230 extracts predetermined contents included in the image of the video signal captured by the video capturing unit 220.

Reference numeral 240 denotes an analog audio signal converter. The analog audio signal converter 240 converts the audio signal separated by the AV signal separator 200 into an analog audio signal.

Reference numeral 250 is an audio content extraction unit. The audio content extractor 250 extracts content included in the analog audio signal converted by the analog audio signal converter 240.

Reference numeral 260 is a content providing unit. The content providing unit 260 extracts only the content of which the detailed information is stored in the database 120 among the contents extracted by the video content extracting unit 230 and the audio content extracting unit 250, and then broadcasts the content. To provide.

In the content extracting unit 130 having the above configuration, the AV signal separating unit 200 receives the AV signal provided by the broadcasting station 100 into a video signal and an audio signal.

The video signal separated by the AV signal separation unit 200 is input to the screen display unit 210 to display an image of the video signal on the screen, and the video capture unit 220 captures the image of the displayed video signal at unit time intervals. do.

When the video capture unit 220 captures an image of a video signal at unit time intervals, the video content extractor 230 captures an image using an algorithm such as Scale Invariant Feature Transform (SIFT) or Support Vector Machine (SVM). The object represented by the image of the video signal is analyzed and the content is extracted. The content extracted by the video content extracting unit 230 is output to the content providing unit 260.

The audio signal separated by the AV signal separator 200 is input to the analog audio signal converter 240, converted into an analog audio signal, and then input to the audio content extractor 250.

Then, the audio content extraction unit 250 recognizes the analog audio signal and extracts predetermined contents.

Here, the recognition of the audio signal can be classified into two types. First, a method of measuring similarity with a registered pattern regarded as a kind of pattern, and second, by monitoring a process of generating audio, assigning a unique model to each target word or phoneme, and converting the analog audio signal converter 240 ), There is a method of measuring and recognizing which model has the highest probability of generating an audio signal.

Preferably, the second method in the present invention uses a method of extracting contents by recognizing an audio signal.

Here, the HMM (Hidden Markov Model) technique may be used as a method of modeling the audio signal.

The contents extracted by the audio content extraction unit 250 are output to the content providing unit 260.

The content provider 260 inputs the contents extracted by the video content extractor 230 and the audio content extractor 250 to determine whether detailed information of the corresponding contents is stored in the database 120. In addition, the content is stored in the database 120, the content is extracted and provided to the broadcast network (110).

3 is a signal flow diagram illustrating an operation of a preferred embodiment of a data broadcasting method of the present invention. Referring to FIG. 3, the content extraction unit 130 inputs an AV signal provided by the broadcasting station 100 to the broadcasting network 110 (S300), and the AV signal separation unit 200 uses the video signal and the AV signal from the input AV signal. The audio signal is separated (S302).

The separated video signal is input to the screen display unit 210 so that an image of the video signal is displayed on the screen, the video capture unit 220 captures the displayed image (S304), and the video content extraction unit 230 from the captured image. ) Extracts the content and outputs the content to the content provider 260 (S306).

The audio signal separated from the AV signal is converted into an analog audio signal by the analog audio signal converter 240 (S308), and the converted analog audio signal is input to the audio content extractor 250 and included in the analog audio signal. The predetermined contents are extracted (S310), and the extracted contents are input to the content provider 260.

The content provider 260 determines whether detailed information of the contents extracted by the video content extractor 230 and the audio content extractor 250 is stored in the database 120, and then determines whether the database 120 is included in the database 120. Extract the contents in which the detailed information is stored (S312), and outputs the extracted contents to the broadcasting network 110 to broadcast (S314).

In this state, the detail information providing unit 160 determines whether the broadcast signal receiver 140 requests the detailed information of the predetermined content by accessing the network 150 (S316).

When the detailed information of the predetermined content is requested as a result of the determination, the detailed information providing unit 160 searches the database 120 to read detailed information on the predetermined content (S318), and reads the read detailed information on the network 150. The broadcast signal receiver 140 is provided to the broadcast signal receiver 140 (S320) so that the broadcast signal receiver 140 displays detailed information on the screen and can be confirmed by the user.

The present invention has been described in detail with reference to exemplary embodiments, but those skilled in the art to which the present invention pertains can make various modifications without departing from the scope of the present invention. Will understand.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined by the claims below and equivalents thereof.

1 is a block diagram showing the configuration of a preferred embodiment of a data broadcasting device of the present invention;

2 is a block diagram showing a detailed configuration of the content extraction unit of FIG. 1;

3 is a signal flow diagram illustrating an operation of a preferred embodiment of a data broadcasting method of the present invention.

Claims (16)

A database in which detailed information about each of the plurality of contents and the contents is stored in advance; The contents included in the AV signal (Audio and Video) provided by the broadcasting station are separated, and the contents of which the detailed information is stored in the database are extracted, and the extracted content is provided to the broadcasting network to provide the broadcasting network. A content extraction unit for broadcasting together with the AV signal; And And a detailed information providing unit for retrieving detailed information of the corresponding content from the database and providing the detailed information of the corresponding content to the broadcast signal receiver when the broadcast signal receiver requests detailed information on a predetermined content. The method of claim 1, wherein the content extraction unit; An AV signal separator for separating the AV signal provided by the broadcasting station into a video signal and an audio signal; A screen display unit displaying a video signal separated from the AV signal separator by a screen; A video capture unit for capturing an image of a video signal displayed on the screen at predetermined time intervals; A video content extraction unit for extracting contents included in an image of a video signal captured by the video capture unit; And And a content providing unit for extracting only content having detailed information stored in the database among the extracted contents from the video content extracting unit and providing the content to the broadcasting network. The method of claim 1, wherein the content extraction unit; An AV signal separator for separating the AV signal provided by the broadcasting station into a video signal and an audio signal; An analog audio signal converter for converting the audio signal separated by the AV signal separator into an analog audio signal; An audio content extraction unit for extracting content included in the analog audio signal converted by the analog audio signal conversion unit; And And a content providing unit for extracting only contents having detailed information stored in the database from the contents extracted by the audio content extracting unit and providing the extracted contents to the broadcasting network. The method of claim 1, wherein the content extraction unit; An AV signal separator for separating the AV signal provided by the broadcasting station into a video signal and an audio signal; A screen display unit displaying a video signal separated from the AV signal separator by a screen; A video capture unit for capturing an image of a video signal displayed on the screen at predetermined time intervals; A video content extraction unit for extracting contents included in an image of a video signal captured by the video capture unit; An analog audio signal converter for converting the audio signal separated by the AV signal separator into an analog audio signal; An audio content extraction unit for extracting content included in the analog audio signal converted by the analog audio signal conversion unit; And And a content providing unit for extracting only content having detailed information stored in the database from the extracted contents of the video content extracting unit and the audio content extracting unit, and providing the content to the broadcasting network. The apparatus of claim 2 or 4, wherein the video content extractor; And extracting content by analyzing an object displayed on an image of the captured video signal by a scale invariant feature transform (SIFT) or a support vector machine (SVM) algorithm. The method of claim 3 or 4, wherein the audio content extraction unit; And recognizing the analog audio signal to extract content. The method of claim 6, wherein the recognition of the analog audio signal; It monitors the process of the audio utterance, assigns a unique model to each target word or phoneme, and measures and recognizes which model has the highest probability that the audio signal input from the analog audio signal converter is generated. Broadcast service device. The method of claim 7, wherein the modeling of the audio signal; Broadcast service device, characterized in that modeling by the HMM (Hidden Markov Model) technique. Dividing the AV signal provided by the broadcasting station into a video signal and an audio signal; Separating the content extracting unit from the separated video signal and the audio signal, and extracting contents having detailed information stored in a database from the separated contents; Providing contents, in which the extracted detailed information is stored, to a broadcasting network to broadcast together with an AV signal provided by a broadcasting station; And When the broadcast signal receiver requests the detailed information of the predetermined content, the detailed information provider reads the detailed information of the corresponding content from the database and transmits the detailed information to the broadcast signal receiver. The method of claim 9, wherein the extracting of the content comprises: Displaying the separated video signal on a screen and capturing an image of the video signal displayed on the screen at a predetermined time interval; Extracting contents included in an image of the captured video signal; And And extracting only content having detailed information stored in the database among the extracted contents. The method of claim 9, wherein the extracting of the content comprises: Converting the separated audio signal into an analog audio signal; Extracting content included in the converted analog audio signal; And And extracting only content having detailed information stored in the database among the extracted contents. The method of claim 9, wherein the extracting of the content comprises: Displaying the separated video signal on a screen and capturing an image of the video signal displayed on the screen at a predetermined time interval; Extracting contents included in an image of the captured video signal; Converting the separated audio signal into an analog audio signal; Extracting content included in the converted analog audio signal; And And extracting only the content of which the detailed information is stored in the database from the image of the video signal and the contents extracted from the analog audio signal. 13. The method according to claim 10 or 12, wherein the content extraction in the picture of the video signal is performed; And extracting content by analyzing an object displayed on an image of the video signal by a scale invariant feature transform (SIFT) or a support vector machine (SVM) algorithm. 13. The method of claim 11 or 12, wherein content extraction from the analog audio signal is performed; Broadcast service method, characterized in that to extract the content by recognizing the analog audio signal. The method of claim 14, wherein the recognition of the analog audio signal; It monitors the process of the audio utterance, assigns a unique model for each target word or phoneme, and measures and recognizes which model has the highest probability that the audio signal input from the analog audio signal converter is generated. Broadcast service method. The method of claim 15, wherein the modeling of the audio signal; Broadcast service method characterized in that the modeling by HMM (Hidden Markov Model) technique.

Images