KR100879674B1 - System and device and method of setting presentation time stamp for synchronized image frame with comparing image frame on broadcasting-communication program - Google Patents

Abstract

The present invention relates to a synchronization screen setting system and apparatus and method by screen comparison of a broadcast communication program, comprising: a broadcasting station providing a broadcast program capable of providing additional information in a stream form; An additional information server that receives a program broadcast from a broadcasting station in a stream form, calculates and sets a broadcast start time by screen comparison, and detects and provides additional information corresponding to time information of a selected screen; A mobile communication network which broadcasts a program provided by a broadcasting station in a stream form to a plurality of terminals and provides additional information provided from the additional information server through data communication with a designated terminal; A terminal for viewing a broadcast program by communicating with a mobile communication network and requesting and receiving additional information of a selected screen; It is characterized by including a configuration, etc., and compares each screen of the program broadcasted by the broadcasting station with the screen of the synchronization information provided by the additional information production company, there is an effect that it is easy to detect and set the broadcast start time of the program.

Mobile Communication, Content, Vector, XML, Broadcasting, Bidirectional, Similarity

Description

SYSTEM, DEVICE AND METHOD OF SYNCHRONIZING PLAN SETTING BY SCREEN COMMUNICATION OF BROADCAST PROGRAM TECHNICAL FIELD

1 is a functional configuration diagram of a synchronization surface setting system by screen comparison of a broadcast communication program according to an embodiment of the present invention;

2 is a flowchart illustrating a method for operating a synchronization surface setting system by screen comparison of a broadcast communication program according to an embodiment of the present invention;

3 is a conceptual diagram illustrating a synchronization surface setting method by screen comparison of the present invention.

4 is a diagram showing a program broadcast start time of the present invention and a time when a screen is selected during viewing;

5 is a functional configuration diagram of an additional information server according to an embodiment of the present invention;

6 is a detailed functional configuration of the image comparison unit according to an embodiment of the present invention;

7 is a conceptual diagram of a method of vectorizing screen information of the present invention;

8 is a flowchart illustrating a method of operating an additional information server according to an embodiment of the present invention;

9 is a flowchart illustrating a method of operating an additional information server according to another embodiment of the present invention;

10 is a flowchart illustrating a method of operating a synchronization screen setting terminal according to the present invention.

          ** Explanation of symbols for main parts of drawings **

10: content production company 20: broadcasting station

30: additional information shop 40: additional information server

41: broadcast receiver 42: decoder

43: synchronization information unit 44: video comparison unit

45: start time section 50: mobile communication network

60 terminal 441 vector unit

442: parsing unit 443: comparison unit

The present invention is to confirm the time information of the screen selected by the two-way broadcast communication terminal, in particular, to set the synchronization screen to start the broadcast-linked data service program by screen comparison and to provide additional information linked to the selected screen The present invention relates to a synchronization surface setting system, an apparatus and a method by screen comparison of a broadcast communication program.

The mobile communication system has evolved from the first generation (1G), which initially uses voice signals, to the second generation (2G), which provides initial-stage data communication services such as text messages. It is developing into 3G.

A broadcasting communication service is a combination of such a third generation mobile communication system and broadcasting, and a representative example is digital multimedia broadcasting (DMB).

Digital multimedia broadcasting is a broadcasting service that can instantly use various contents such as music, text, data, and video anytime, anywhere while traveling at about 200 km per hour.

Such digital multimedia broadcasting is called variously, such as DAB (Digital Audio Broadcasting), DAR (Digital Audio Radio), DRB (Digital Radio Broadcasting), etc., which means high-quality digital audio broadcasting.

Such broadcast communication is a broadcast-linked data service that can communicate with a broadcasting station or communicate with high speed data while watching a broadcast by using a terminal. In case of selecting or inputting by touch screen or mouse, it is a service to receive additional information.

In such bidirectional broadcast communication, in order to provide the corresponding additional information of the selected screen, the synchronization between the broadcast screen and the additional information must be exactly matched.

In other words, the server providing the additional information must know exactly the information of how many frames or how much time has passed since the selected screen for which the terminal requests the additional information is broadcasted.

Conventionally, the broadcast linked data service by bidirectional broadcast communication does not need to coincide exactly with the broadcast screen and additional information, and is a service for providing general information.

Therefore, since the start position or time of the broadcast program is exactly matched with the additional information, there is a need to develop a technology for accurately providing the additional information of the screen selected by the terminal.

The present invention calculates the time information or frame information of the screen selected by the terminal by setting the starting time point at which the program is broadcasted in the bidirectional broadcasting communication in the screen comparison in the server, so that the additional information is correctly detected, in particular, the vector value of the screen. It is an object of the present invention to provide a synchronization screen setting system, apparatus, and method for screen comparison of a broadcast communication program that detects a broadcast start screen and sets a program broadcast start time (PTS (S)) by comparing similarities.

The present invention devised to achieve the above object is a broadcast station for providing a broadcast program that can provide additional information in the form of a stream; An additional information server that receives a program broadcast from a broadcasting station in a stream form, calculates and sets a broadcast start time by screen comparison, and detects and provides additional information corresponding to time information of a selected screen; A mobile communication network which broadcasts a program provided by a broadcasting station in a stream form to a plurality of terminals and provides additional information provided from the additional information server through data communication with a designated terminal; A terminal for viewing a broadcast program by communicating with a mobile communication network and requesting and receiving additional information of a selected screen; Present a configuration that includes.

In addition, the present invention devised to achieve the above object, the synchronization surface detection and program through the screen analysis of the program provided as a stream from the broadcast station by the additional information server and the additional information and the synchronization information provided from the additional information production company Setting a broadcast start time; Notifying the additional information server if a bidirectional broadcast communication request is received from the terminal by the mobile communication network and delivering a broadcast program provided as a stream from the broadcast station; Calculating, by the additional information server, the additional information of the screen selected from the terminal, calculating an elapsed time after the program is broadcast, and searching and providing additional information; This presents the included configuration.

In addition, the present invention devised to achieve the above object, the additional information to receive additional information and synchronization information from the broadcast program and the additional information production station, set the program start time and provide additional information of the selected time A server, comprising: a broadcast receiver for receiving a stream program of a broadcast station; A decoder for decoding the program signal received in the stream into screen unit information; A synchronization information unit for recording additional information and synchronization information provided from the additional information manufacturer; An image comparator configured to vectorize screen information of the decoder unit and sync information of the sync information unit to select a program start screen and set the corresponding time as a program start time if the similarity is equal to or greater than a predetermined threshold value; A start time unit which records and manages a start time set by the image comparing unit and calculates a time when a designated screen is broadcasted; Present a configuration that includes.

In addition, the present invention has been made in order to achieve the above object, the program process for inputting the program from the broadcasting station as a stream by the additional information server, decoded and converted into a vector value; An additional step of inputting additional information and synchronization information of a program from an additional information server by an additional information server, parsing the XML, decoding each encoded form, and converting the vector value into a vector value; Comparing the similarity of each vector value and setting it as a synchronous image and a start time of the program when the value is larger than a set threshold value; This presents the included configuration.

In addition, the present invention devised to achieve the above object is connected to a terminal via a mobile communication network, a program is provided as a stream from a broadcasting station, and the additional information server receives additional information and synchronization information from the additional information manufacturer Determining whether the terminal requests additional information of the selected screen while watching a broadcast program; When the terminal requests additional information, inputting time information of the selected screen and coordinate information of the selected point and calculating an elapsed time in the program; Searching for and providing additional information corresponding to the selected screen and coordinate information to the terminal; This presents the included configuration.

In addition, the present invention devised to achieve the above object, the process of confirming whether the terminal receives a two-way broadcast communication signal; When receiving a broadcast communication signal by the terminal, receiving and viewing a bidirectional broadcast communication signal, and determining whether to check additional information of a specific screen; When the additional information of the specific screen being viewed is checked, the additional information process of providing time information and coordinate information of the selected screen to the additional information server and receiving the additional information; This presents the included configuration.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a synchronization screen setting system, an apparatus, and a method according to screen comparison of a broadcast communication program will be described in detail with reference to the accompanying drawings.

1 is a functional configuration diagram of a synchronization surface setting system according to screen comparison of a broadcast communication program, according to an embodiment of the present invention, and FIG. 2 is an embodiment of the present invention. Fig. 3 is a schematic diagram illustrating a method of operating a synchronization screen setting system by screen comparison of a broadcast communication program, and FIG. 3 is a conceptual diagram illustrating a synchronization surface setting method by screen comparison of a broadcast communication program according to the present invention. FIG. 5 is a diagram illustrating a start time and a time when a screen is selected during viewing. FIG. 5 is a functional configuration diagram of an additional information server according to an embodiment of the present invention, and FIG. FIG. 7 is a conceptual diagram of a method for vectorizing screen information of the present invention, and FIG. 8 is a real view of the present invention. 9 is a flowchart illustrating a method of operating an additional information server, and FIG. 9 is a flowchart illustrating a method of operating an additional information server according to another embodiment of the present invention, and FIG. 10 is a synchronization screen setting according to the present invention. Flowchart of how to operate the terminal.

In describing the embodiments of the present invention, descriptions are omitted for technical contents that are not directly related to the present invention and are well known, and thus, the present invention is clearly transmitted without passing the gist of the present invention.

Referring to FIG. 1, according to an embodiment of the present invention, a synchronization plane setting system by screen comparison of a broadcast communication program will be described. A broadcasting station 20 which broadcasts a program produced by a content production company or a self-produced program over the air or provides a stream on a designated wired path; An additional information shop 30 for producing and supplying additional information necessary for each screen of program content and synchronization information of a screen for starting a program; An additional information server 40 for inputting additional information and synchronization information provided by a program broadcasted from a broadcasting station as a stream and additional information production facilities, detecting a broadcast start time and start time by screen comparison, and providing selected additional information; A mobile communication network 50 broadcasting a program broadcast by a broadcasting station to a plurality of terminals and providing additional information provided by the additional information server to a specified terminal by communication; A terminal 60 connected to the mobile communication network in a communication state, watching a broadcast program, and requesting and confirming additional information of the selected screen; It includes a configuration.

Referring to FIG. 2, according to an embodiment of the present invention, a system for setting a synchronization surface by screen comparison of a broadcast communication program is provided by an additional information server, and the program is provided as a stream from a broadcasting station. Receiving additional information and synchronization information about each screen of the program in an XML form, and if the similarity is greater than or equal to the threshold value by comparing the vector values of the screen, setting the synchronization start time and setting the program start time; Receiving a two-way broadcasting communication program from a broadcasting station and an additional information server through a mobile communication network and transmitting the two-way broadcasting communication service request to the terminal; If there is a request for providing additional information of a screen selected from the terminal by the additional information server, calculating an elapsed time from a program start time, searching for the additional information, and providing the additional information to the terminal; It includes a configuration.

1 and 2, according to an embodiment of the present invention, a synchronization screen setting system and a method of operating the same according to screen comparison of a broadcast communication program will be described. Programs of various contents consisting of text, images, moving pictures, etc. are produced and supplied to the broadcasting station 20 and the additional information production facility 30.

The broadcast station 20 broadcasts the selected program over the airwaves and the designated wireline at the scheduled and designated time.

At this time, the additional information production office 30 confirms in advance the broadcast time through consultation with a broadcasting station or a content production company in advance, produces various additional information about the corresponding content, and produces synchronization information starting from the program. .

The additional information may vary, for example, personal information about actors, singers or costumes worn by the program, costumes, accessories, etc., clubs, next appearance and performance plans, contact information, sales offices, prices, quantities, etc. It is applied in various ways according to preference.

Since such additional information must be produced to correspond to the screen of the program, after the program starts broadcasting, the location of the designated screen must be accurately identified to search for and provide the additional information.

The present invention is to match the program and the additional information in this way, and relates to a technology for confirming the time the program was broadcast, the time of the screen selected by the viewer to accurately search and provide the additional information.

At this time, each screen of the program and the selected screen can be checked by time or frame-by-frame, and selected by the system operator.

The additional information server 40 inputs screen unit additional information of the program provided from the additional information manufacturer and information on the synchronization plane, and receives a program broadcast from a broadcasting station in a stream format through a wire.

The additional information server 40 detects the synchronization information by parsing the additional information and the synchronization information provided in the XML format from the additional information manufacturer 30, and decodes according to the detected encoding type (ENCODE TYPE) of the synchronization information. Converted screen to vector

The additional information provided from the additional information manufacturer 30 to the additional information server 40 is XML information of the following form.

<INFO>

<SYNC encode Type = "full" data = "V1, V2, V3 ..., VN" />

<PPL id = "1" beginTime = "20s" url = ">

<PPL id = "2" beginTime = "60s" url = ">

</ INFO>

This SYNC tag means synchronization information, and the PPL tag indicates a URL of additional information.

The additional information server 40 decodes the broadcast program provided as a stream from the broadcasting station 20 in units of screens, and converts it into a vector value.

In this way, the similarity between each screen of the broadcast program converted into a vector value and the synchronization information is found to find a time point at which the broadcast is started.

In the similarity comparison, a method such as Euclidean distance or cosine distance is used as a method used for measuring the distance between vectors.

In this manner, the broadcast start time (PTS (s); PRESENT TIME STAMP (START) is detected and recorded, and the additional information is also recorded and managed as time-related information.

In addition, by selection, it is possible to record and manage in a state linked to the frame number order of the screen instead of the time PTS.

The mobile communication network 50 receives a program broadcast from the broadcasting station 20 in a stream manner and simultaneously broadcasts wirelessly through a wireless channel designated to a plurality of terminals 60 to use a bidirectional broadcast communication service.

At this time, the mobile communication network 50 provides the information of the terminal 60 using the two-way broadcast communication service to the additional information server by communication.

When the terminal 60 selects a specific screen using the touch screen while watching a broadcast program, the terminal 60 checks the corresponding time information PTS (i) and coordinate information (x, y), and checks the mobile communication network ( 50 to communicate with the additional information server 40 through.

The additional information server 40 calculates a start time PTS (s) in which a program is broadcast and a time PTS (i) of a screen selected by the terminal, and searches for additional information corresponding to the calculated time.

In this way, the information corresponding to the coordinate information is searched again, and the retrieved information is transmitted to the corresponding terminal 60 through a mobile communication network in a communication method.

Such additional information may include text, an image, a video, a URL address, and the like.

Referring to FIG. 3, a signal flow state between the terminal 60 and the additional information server 40 may be known.

That is, the terminal 60 provides a time (PTS (i)) and coordinate information (x, y) of selecting a screen for which the additional information is to be checked, and converts the additional information into a text, an image, a video, and a URL address. Check provided.

4 illustrates a relationship between time information and a broadcasted program in order to search and provide additional information.

That is, the program has a start time (T0) and an end time (PTS (n)), and the additional information server 40 searches for and sets the broadcast start time (PTS (s)). The broadcast time is transmitted in units of video packets, and the time PTS (i) in which the terminal 60 selects a specific screen to check additional information is displayed as the current viewing time.

The additional information server 40 may classify and record additional information associated with a broadcast program in units of time and record or manage the additional information.

If the additional information associated with the program is classified and recorded and managed in units of frames, the above description becomes a frame instead of time.

Therefore, the terminal 60 connects to the mobile communication network to receive and watch a program broadcast by a broadcasting station in a broadcast manner, and the additional information on the selected screen is transmitted to the time or frame information from the additional information server 40 connected through the communication method. The additional information retrieved is provided.

The signal flow will be described in detail with reference to FIG. 2, and the additional information server 40 receives the additional information and the synchronization information of the broadcast program from the additional information production facility 30 in XML form (S100). The program broadcast from the broadcasting station 20 is provided in a stream manner (S110).

The additional information server 40 parses and separates the synchronous information provided from the additional information company 30, decodes and vector converts, decodes and vector converts each program provided from the broadcasting station 20 on a screen basis, and synchronizes. The screen search and broadcast start time (PTS (s)) are set, recorded and managed (S120).

The mobile communication network 50 notifies the additional information server 40 of the information of the terminal 60 to the additional information server 40 when the request signal for the service by the bidirectional broadcasting communication is input from the terminal 60 (S130). Request to provide a program that is broadcasted at (S140).

The mobile communication network 50 receives a program broadcast from the broadcasting station 20 (S150), and transmits the program to the terminal 60 through a designated wireless channel among wireless channels allocated by the mobile communication method (S160).

In this way, the terminal 60 viewing the program by the bidirectional broadcast communication requests the additional information server 40 through the mobile communication network 50 for additional information of the selected screen (S170).

The additional information server 40 detects the corresponding time (PTS (i)) information of the screen for which the additional information is to be provided from the terminal 60, and executes the program through calculation and start time (PTS (s)) information managed for recording. The elapsed time after the broadcast is obtained, and additional information corresponding to the elapsed time obtained as described above is searched for (S170).

In this case, when the coordinate information (x, y) is required, the additional information is searched including the coordinate information, and the additional information includes text, an image, a video, and URL address information.

The additional information searched by the additional information server 40 is provided to the terminal 60 through the mobile communication network (S180).

Therefore, the broadcast start screen and time are detected and set by comparing the vector value of the screen of the program broadcasted by the broadcasting station 20 with the vector value of the synchronization information screen provided by the additional information manufacturer 30.

Referring to FIG. 5, according to an embodiment of the present invention, the additional information server may include: a broadcast receiver 41 receiving a program broadcast from a broadcasting station in a stream format; A decoder 42 for decoding the screen unit image information of the program received by the broadcast receiver; A synchronization information unit 43 for recording and managing additional information and synchronization information provided from the additional information production facility 30 in XML form information; Since the synchronization information unit receives the synchronization surface information in the form of XML and the screen unit program information from the decoder unit, and converts the vectorized information into similarity levels, if it is equal to or greater than a predetermined threshold value, the broadcasting start time (PTS (s) is set. An image comparator 44 detecting)); A start time section 45 for recording and managing the start time PTS (s) provided from the video comparing section; It includes a configuration.

Referring to FIG. 6, the image comparator 44 will be described in more detail. The screen unit information signal provided from the decoder 42 and the information of the synchronization surface provided from the parser are decoded according to an encoded form. A vector unit 441 for converting the screen information signal, and the additional information and the synchronization information provided in the XML form from the synchronization information unit 43 are parsed to separate the synchronization information, decoded according to the encoding type, and converted to the vector value. The parsing unit 442 for providing information determines whether the vector information similarity of each screen provided from the vector unit and the parsing unit is larger than a predetermined threshold value, and discards the small value screen and selects the large value screen. And a comparator 443 for setting the corresponding time as a start time.

Referring to FIG. 8, according to an embodiment of the present invention, a method of operating an additional information server may include: inputting, decoding, and converting a program broadcasted from a broadcasting station into a vector value; Inputting additional information and synchronization information from the additional information factory by the additional information server, parsing the XML, decoding the encoded information into an encoded form, and converting the converted information into vector values; Comparing the similarity of each vector value and setting it as a synchronous image and a start time of the program when the vector value is greater than the set threshold value; It includes a configuration.

Referring to FIG. 5 and FIG. 6, according to an embodiment of the present invention, the additional information server and its operation method will be described. The broadcasting station 20 broadcasts a program wirelessly at a corresponding frequency and at the same time streams through a designated wire. Broadcast to the additional information server 40.

The broadcast receiver 41 of the additional information server 40 receives a program transmitted as a stream and provides the program to the decoder 42. The decoder 42 decodes the video information data signal in units of screens to the video comparator. to provide.

In addition, the additional information and the synchronization information of the program provided in the XML form from the additional information manufacturer 30 are received and recorded by the synchronization information unit 43 and provided to the video comparison unit 44.

The vector unit 441 of the video comparing unit 44 inputs the screen unit video signal provided from the decoder 42 into the vector unit 441 and converts it into a vector value.

In addition, the parsing unit 442 parses the information in the XML form provided from the synchronization information unit 43 to separate the data information of the synchronization surface, and decodes the separated synchronization surface information according to the encoded form. To provide.

The vector unit 441 converts each screen image into a vector value, and provides the converted vector value to a comparison unit.

Referring to FIG. 7, the vector unit 441 obtains a vector value of each screen image by using a FULL method, a CROSS method, and an OBLIQUE method. The FULL method is most accurate, but the amount of data is large and time consuming. In addition, the OBLIQUE method is less accurate than the amount of data and the time required.

Since such vectorization characteristics differ in processing time, memory space, accuracy, and the like, an appropriate method is selected according to the application.

The broadcast program and the synchronized image information converted into the vector value by the vector unit 441 are provided to the comparison unit 443 to determine whether the similarity is greater than the set threshold value, and the program screen having the similarity smaller than the threshold value is The program screen of similarity larger than the threshold value is discarded and set as the broadcast start screen and set to the broadcast start time (PTS (s)).

As such, the method of measuring the similarity by the comparator 443 is a method of measuring a distance between vectors, and includes a Euclidean distance method and a cosine distance method.

The start time PTS (s) information set by the image comparator 44 including the vector part 441, the parser 442, and the comparator 443 is provided to the start time part 45 to be recorded and managed. do.

This process will be described in more detail with reference to FIG. 8. The additional information server 40 checks whether a broadcast program is provided as a stream by the additional information server 40 (S200).

When the broadcast program is provided in a stream manner, the broadcast program is input by the broadcast receiver 41 so that the broadcast program is received and provided to the decoder 42 to decode the video signal or the screen signal in units of screens (S210).

The screen unit signal of the demodulated program is provided to the image comparator 44 and converted into screen unit vector values (S220).

Also, it is checked whether the additional information and the synchronization information are provided in the XML form from the additional information manufacturer 30 (S230). When the additional information and the synchronization information are provided, the image information is inputted by the synchronization information unit 43. To provide.

The parsing unit 442 of the image comparator 44 parses the information of the XML form, separates the information of the synchronization surface (S240), and decodes each encoding type (S250), and the decoded information is a vector by the vector unit. It is converted to a value (S260).

As described above, the degree of similarity between the vector value of the program and the vector value of the synchronization plane information is compared to determine whether the value is greater than a predetermined threshold value (S270).

If the similarity value between the vector value of the program screen and the synchronization surface vector value is larger than the predetermined threshold value, the corresponding program screen is set as the broadcast start screen, and the time when the set screen is broadcast is set to the broadcast start time (PTS ( s)) and set (S280).

Accordingly, the broadcasting start time is detected and set by comparing the screen of the program broadcast by the broadcasting station 20 with the synchronization information screen provided by the additional information production facility 30.

Referring to FIG. 9, when a method of operating an additional information server is described according to another embodiment of the present disclosure, it is determined by the additional information server 40 that the terminal 60 requests additional information of a selected screen. Process of doing; Inputting time information and coordinate information of a screen selected by the terminal and calculating an elapsed broadcast time of a program; Searching for and providing additional information corresponding to the selected screen and coordinate information to the terminal; It includes a configuration.

In more detail, the additional information server 40 checks whether the terminal 60 requests the provision of the additional information by selecting a specific screen while watching the program broadcasted (S300).

If it is confirmed that the terminal 60 selects a screen and requests the provision of additional information, the terminal 60 receives inputted time information PST (i) and coordinates (x, y) of the screen (S310).

The additional information server 40 calculates the broadcast start time PST (s) by the broadcast start screen already detected and set and the time information PST (i) of the information request screen provided by the terminal 60. In operation S320, elapsed time after the program is broadcast is obtained.

The additional information server 40 searches for additional information corresponding to the calculated time value and the coordinate value (S330), and provides the additional information to the terminal 60 (S340).

Referring to Figure 10, when explaining the operation method of the synchronization-plane setting terminal according to the present invention the screen communication program screen comparison, the process of checking whether the terminal 60 receives the broadcast communication signal; In the case of receiving a broadcast communication signal, determining whether to receive and watch a program and confirm additional information; In the case of confirming the additional information, providing time information and coordinate information of the screen and receiving and outputting additional information including text, an image, audio, a video, and a URL; It includes a configuration.

In more detail, the terminal 60 is connected to the mobile communication network 50 in a communication state to determine whether to receive and watch a program broadcast by the broadcasting station 20 by using the bidirectional broadcasting communication service (S400).

When it is confirmed that the terminal 60 receives the two-way broadcasting communication, the terminal 60 receives and watches a program broadcast through a designated wireless channel of the mobile communication (S410), and designates a specific screen in a state of viewing the program, thereby providing additional information. It is determined whether to confirm (S420).

When the terminal 60 confirms the additional information by designating a specific screen, the terminal 60 transmits the corresponding time information PST (i) and coordinate information (x, y) of the selected screen through the mobile communication network 50 to the additional information server ( 40) (S430).

The additional information server 40 receives additional information including text, image, audio, video, and URL information from the additional information server 40 and outputs the information through the corresponding display unit and the audio unit (S440).

Accordingly, the present invention compares the screen of a broadcast program with a screen based on synchronization information, checks a broadcast start time, and accurately searches for and provides additional information on a screen selected by the terminal.

Although the present invention has been described in the embodiments as described above, the present invention is not necessarily limited to these embodiments, and various modifications can be made without departing from the spirit of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

The present invention having the above-described configuration compares the screens of the programs broadcast by the broadcasting stations with the screens of the synchronization information provided by the additional information manufacturer, and thus has an industrial use effect of easily detecting and setting the broadcast start time of the programs.

In addition, since the broadcast start time of the program is detected, there is a convenient effect of selecting and searching additional information associated with the program and the broadcast time easily.

In addition, there is an effect that is convenient in use to search for and provide additional information linked in units of frames of a broadcast program.

Claims (32)

Broadcasting station for providing a broadcast program that can provide additional information in the form of a stream; An additional information server that receives a program broadcast from the broadcasting station in a stream form, calculates and sets a broadcast start time by screen comparison, and detects and provides additional information corresponding to time information of a selected screen; A mobile communication network that broadcasts a program provided by the broadcasting station in a stream form to a plurality of terminals, and provides additional information provided from the additional information server through data communication with a designated terminal; A terminal for viewing a broadcast program by communicating with the mobile communication network and checking and receiving additional information of a selected screen; Synchronization surface setting system by screen comparison of the broadcast communication program comprising a. The method of claim 1, A content production station for producing and providing a multimedia content program to be broadcast by the broadcasting station; An additional information production station for producing synchronization information for confirming the start of broadcasting of a content program provided by the content production facility and additional information corresponding to a screen for each time unit after being broadcasted and providing the additional information server to the additional information server; The synchronization surface setting system by the screen comparison of the broadcast communication program further comprises. The method of claim 2, wherein the additional information shop, And synthesizing the additional information in a state corresponding to screen frame units of a broadcast program. The method of claim 2, The additional information server decodes a program provided as a stream from the broadcasting station on a screen basis and converts the program into a first vector value, and decodes the additional information and the synchronization information provided from the additional information manufacturer according to an encoding form. Converting to a second vector value and comparing the first vector value with the second vector value to set a screen of the program having a similarity level or more as a threshold value and to detect a broadcast start time (PTS); A synchronization surface setting system by screen comparison of a broadcast communication program, characterized in that. The method of claim 2 or 3, wherein the additional information shop, And providing the additional information and the synchronization information in the form of XML to the additional information server. The method of claim 1, wherein the additional information server, And detecting the time information of the screen selected and requested by the terminal, and searching and providing the additional information. The method of claim 1, wherein the mobile communication network, When a broadcast program provided as a stream from the broadcasting station is simultaneously broadcasted to a plurality of terminals, and the terminal selects a screen and requests additional information, the terminal provides the time information of the selected screen to the additional information server to provide the additional information to the terminal. A synchronization surface setting system by screen comparison of a broadcast communication program, characterized in that consisting of a transmission. The method of claim 1, wherein the terminal, When configuring the touch screen, and requesting additional information of a specific screen while watching a program broadcast through the mobile communication network, inputting a request signal to the touch screen, characterized in that consisting of the configuration to check the delivered additional information Synchronization surface setting system by screen comparison of the broadcast communication program. Setting a synchronization plane detection and program broadcast start time through screen analysis of a program provided as a stream from a broadcasting station and additional information and synchronous information provided from an additional information manufacturer by the additional information server; Notifying the additional information server if a bidirectional broadcast communication request is received from the terminal by the mobile communication network and delivering a broadcast program provided as a stream from the broadcast station; Calculating, by the additional information server, the additional information of the screen selected from the terminal, calculating an elapsed time after the program is broadcast, and searching and providing additional information; Method of operating a synchronization surface setting system by the screen comparison of the broadcast communication program comprising a. The method of claim 9, wherein the setting process, Receiving additional information and synchronization information of a program from an additional information shop by the additional information server; Receiving a program broadcast from a broadcasting station as a stream by the additional information server; Converting the synchronization information and the broadcasted program into a vector value and detecting a synchronization surface of the program and setting a start time by comparing similarities; Method of operating a synchronization surface setting system by screen comparison of a broadcast communication program comprising a. The method of claim 10, The additional information and the synchronization information provided by the additional information server is a synchronization screen setting system operating method by screen comparison of a broadcast communication program, characterized in that the XML format. The method of claim 10, wherein the similarity comparison, Decoding the broadcast program to obtain a vector value, parsing information provided by the additional information company to separate sync information, and obtaining a vector value of a decoded screen according to the encoded form of the separated sync information, If the similarity value of the obtained vector value is larger than the predetermined threshold value, it is detected by the synchronization surface and set as the broadcast start time of the program. The method of claim 9, wherein the delivery process, Requesting a bidirectional broadcast communication service from a mobile communication network wirelessly connected by the terminal; Notifying a broadcast communication request of a terminal to an additional information server by the mobile communication network, and requesting a broadcast station to provide a program; Inputting a broadcast program provided as a stream by a broadcasting station by the mobile communication network; Delivering a broadcast program provided as the stream to a terminal; Method of operating a synchronization surface setting system by screen comparison of a broadcast communication program comprising a. The method of claim 13, The additional information server notified of the request contents of the terminal through the mobile communication network, further comprising the step of monitoring the service use state of the terminal, characterized in that the synchronization screen setting system operating method according to the screen comparison of the broadcast communication program. The method of claim 9, wherein the providing process, Providing an additional information request signal of a screen selected by the terminal to an additional information server; Calculating a start time and a selected time of a program by the additional information server; Searching for additional information corresponding to a calculated time of a program by the additional information server; Providing the searched additional information to a terminal; Method of operating a synchronization surface setting system by the screen comparison of the broadcast communication program comprising a. The method of claim 15, wherein the start time operation of the program comprises: A method of operating a synchronization surface setting system by screen comparison of a broadcast communication program, characterized in that the calculation is performed on a frame basis of a broadcast program. A synchronization screen setting apparatus for receiving additional information and synchronization information from a program broadcasted by a broadcasting station and an additional information manufacturer, setting a program start time, and providing additional information of a selected time, A broadcast receiver which receives the program broadcast by the broadcast station; A decoder to decode the program into screen unit information; A synchronization information unit for recording the additional information and the synchronization information; If the similarity is equal to or greater than a predetermined threshold by comparing the first vector value obtained by vectorizing the screen information of the decoder unit and the second vector value obtained by vectorizing the synchronization information, the screen of the program having the first vector value equal to or greater than the threshold value is displayed. An image comparator configured to set a program start screen and set a time at which the program screen is broadcasted as a program start time; A start time unit which records and manages a program start time set by the image comparison unit and calculates a time when a designated screen is broadcasted; Synchronization surface setting apparatus of a broadcast communication program comprising a. The method of claim 17, wherein the image comparison unit, A vector unit for converting a program screen provided from the decoder unit into a first vector value; A parsing unit for parsing additional information provided from the synchronization information unit, separating the synchronization information, and providing the second vector value decoded according to the encoding form of the synchronization information to the vector unit; The first vector value of the program screen and the second vector value of the synchronization information are respectively input, and it is determined whether the similarity is greater than a predetermined threshold value. If the similarity is large, the program screen is designated as a program start screen. A comparator configured to set a time at which the program screen is broadcasted as a program start time; Apparatus for setting a synchronization surface of a broadcast communication program comprising a. The method of claim 17, wherein the start time unit, And a configuration for calculating a frame order of the designated program screen. The method of claim 18, wherein the vector unit, And a vector value of the decoded program screen signal using one of a full method, a cross method, and an object method. A program step of decoding an input broadcast program and converting the received broadcast program into a first vector value; An additional step of parsing XML by inputting additional information and synchronization information of the broadcast program, decoding the synchronization information, and converting the synchronization information into a second vector value; Setting a screen of the broadcast program larger than a threshold as a synchronous image by comparing the similarity between the first vector value and the second vector value and setting a time at which the broadcast program screen is broadcasted as a start time; Method of setting a synchronization surface of a broadcast program comprising a. The method of claim 21, wherein the program step, Checking whether the broadcast program is input in the form of a stream; When the broadcast program is input in the form of a stream, receiving and decoding the decrypted code on a screen basis; Converting the decoded broadcast program into the first vector value in units of screens; Method of setting a synchronization surface of a broadcast program comprising a. The method of claim 21, wherein the adding step, Checking whether the additional information and the synchronization information are input; Classifying the synchronization information on the screen by parsing the XML when the additional information and the synchronization information are input; Decoding a screen by decoding the screen of the parsed synchronization information for each encoding type; Converting the screen of the decoded synchronization information into the second vector value; Method of setting a synchronization surface of a broadcast program comprising a. The method of claim 21, wherein the setting step, Checking whether a similarity value comparing the first vector value of the screen unit of the broadcast program with the second vector value of the synchronization information screen is greater than a predetermined threshold value; If the similarity value is greater than a threshold value, selecting a screen of the broadcast program larger than the threshold value as the synchronization image and setting a time at which the screen of the broadcast program is broadcasted as the start time; Method of setting a synchronization surface of a broadcast program comprising a. The method of claim 21 or 24, The similarity value comparison method includes a Euclidean distance method and a cosine distance method for measuring the distance between vectors. The method of claim 23, And the additional information and the synchronization information are input in an XML format. By an additional information server connected to a terminal through a mobile communication network, receiving a program from a broadcasting station as a stream, and receiving additional information and synchronization information from a supplementary information shop, Checking whether the terminal requests additional information of the selected screen while watching a broadcast program; When the terminal requests additional information, inputting time information of a selected screen and coordinate information of a selected point and calculating an elapsed time in a program; Searching for and providing additional information corresponding to the selected screen and coordinate information to a terminal; Method of setting a synchronization surface of a broadcast program comprising a. The method of claim 27, wherein the operation process, Inputting current time information and coordinate information after the broadcast of the selected screen of the program; Calculating an elapsed time by calculating the input current time information and the start time information of the selected screen; Method of setting a synchronization surface of a broadcast program comprising a. The method of claim 28, wherein the time information of the selected screen, And frame number information of the selected screen of the program. Checking whether a terminal receives a bidirectional broadcast communication signal; When receiving the broadcast communication signal by the terminal, receiving and watching a bidirectional broadcast communication program, and determining whether to check additional information of a specific screen; An additional information process of providing time information and coordinate information of the selected screen to the additional information server and confirming the additional information of the specific screen being viewed; Method of operating a terminal setting the synchronization surface of the broadcast program comprising a. The method of claim 30, wherein the additional information process, Providing time information and coordinate information of the broadcast program screen selected by the terminal to the additional information server; Receiving additional information of the selected screen provided from the additional information server; Method of operating a terminal setting the synchronization surface of a broadcast program comprising a. The method of claim 31, wherein the additional information, Method of operating a terminal setting the synchronization surface of a broadcast program, characterized in that the text, images, video.

Images