CN102572534A - System and method for synchronizing with multimedia broadcast program - Google Patents

System and method for synchronizing with multimedia broadcast program Download PDF

Info

Publication number
CN102572534A
CN102572534A CN2010105920011A CN201010592001A CN102572534A CN 102572534 A CN102572534 A CN 102572534A CN 2010105920011 A CN2010105920011 A CN 2010105920011A CN 201010592001 A CN201010592001 A CN 201010592001A CN 102572534 A CN102572534 A CN 102572534A
Authority
CN
China
Prior art keywords
situation
multimedia programming
synchronous
incident
multimedia
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2010105920011A
Other languages
Chinese (zh)
Inventor
刘文山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute for Information Industry
Original Assignee
Institute for Information Industry
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute for Information Industry filed Critical Institute for Information Industry
Priority to CN2010105920011A priority Critical patent/CN102572534A/en
Publication of CN102572534A publication Critical patent/CN102572534A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a system and a method for synchronizing with a multimedia broadcast program, which is used for synchronizing with at least one multimedia program being played. The system comprises a context server and a client device. The context server is configured to provide at least one context event of each multimedia program, the context event is generated based on the occurrence of at least one preset context program in the context content of each multimedia program. The client device is used for receiving and analyzing the context event of each multimedia program to obtain at least one group of context event data of each multimedia program. The client device also comprises at least one application means for carrying out at least one action based on at least one group of context event data.

Description

The System and method for synchronous with multimedia broadcasting program
Technical field
The invention relates to a kind of and the synchronous System and method for of multimedia broadcasting program, particularly relevant for a kind of System and method for synchronous that is the basis with situation (Context) with multimedia broadcasting program.
Background technology
Along with the progress of Information technology, the interactive service of utilization the Internet strengthens the rating of TV to be experienced, and receives liking of spectators gradually.This kind interactive service is when a certain program is being play, and along with the carrying out of this program, lets client can carry out some action, so that this program is responded to some extent.Known technology is to utilize for example NTP (Network Time Protocol; NTP) or global positioning system (GlobalPositioning System; GPS) zebra time (UNIVERSAL TIME), make the reproduction time of time and TV programme of client terminal device synchronous.In known technology, client terminal device must preestablish a time action schedule and be synchronous during with the TV station school, and wherein this time action schedule is set with according to program and carries out the action that the time preface is arranged.Then, when TV programme proceeded to certain time point, client terminal device can be carried out the action of setting on this time action schedule, for example: show that the exercise question that the host asking, the leading role who is performing introduce etc., experience with the rating that strengthens TV.
Yet each orthochronous point that the making of known time action schedule must have TV programme to carry out, these programs carry out time point must just can be obtained after television program designing is accomplished, so known technology is not suitable for live show.Moreover, when the length of TV programme or content change to some extent, then must make relevant time action schedule again.Known time action schedule is to each program custom-made, can only use one to one, and can not repeated application in other program.
Summary of the invention
The objective of the invention is to carry out synchronization through the situation incident of programme content, to overcome the shortcoming of above-mentioned known technology providing a kind of and the synchronous System and method for of multimedia broadcasting program.
Therefore, an execution mode of the present invention is providing a kind of and the synchronous system of multimedia broadcasting program, in order to synchronous with in progress at least one multimedia programming.This and the synchronous system of multimedia broadcasting program comprise situation server and client side device.The situation server is at least one the situation incident that is configured to provide each multimedia programming, and wherein this situation incident is that appearance according at least one the preset situation project in the contextual content of each multimedia programming produces.Client terminal device is in order to receive and to resolve the situation incident of each multimedia programming, to obtain at least one group of situation event data of each multimedia programming.Client terminal device also comprises at least one application apparatus (Means), in order to carry out at least one action according at least one group of situation event data.
Another embodiment of the present invention is to provide a kind of and the synchronous method of multimedia broadcasting program.In the synchronous method of this and multimedia broadcasting program, at first obtain in progress at least one multimedia programming.Then, according at least one the preset situation project in the contextual content of each multimedia programming, produce at least one situation incident of each multimedia programming.Then, receive and resolve the situation incident of each multimedia programming, to obtain at least one group of situation event data of each multimedia programming.Then, carry out at least one action according at least one group of situation event data.
According to one embodiment of the invention, the aforesaid and synchronous method of multimedia broadcasting program also comprises: set a situation action schedule; And compare the situation event data to the situation action schedule, to carry out at least one action, wherein the situation action schedule is set with the action of presetting the situation project and corresponding to.
According to another embodiment of the present invention, the aforesaid and synchronous method of multimedia broadcasting program also comprises: selected at least one filtercondition filters out the situation incident of each multimedia programming.
Another embodiment of the invention be provide a kind of in storage be used for the computer program synchronous with multimedia broadcasting program, when this computer program of computer loads and after carrying out, can accomplish the above-mentioned method synchronous with multimedia programming.
Use the present invention and have advantage.Client terminal device only needs to set the incident project (preset situation project) that program possibly occur in advance, and desires the action (situation action schedule) carried out, thereby when not needing with TV station or school, broadcasting station; The making flow process and the progress that need not cooperate program; Do not receive the influence of change of programme content yet.The present invention can be applicable to on-site real-time (Real-time) program; Reusable program in similar situation (for example: serial); But condition filter is selected the situation incident, so that personalized service to be provided; And can receive situation incident simultaneously from a plurality of programs.In addition; Application apparatus of the present invention can be through coming and TV or broadcast program interlock than known " time synchronized " more resilient mode; And the application program that can convey program interaction is able to separately make or open by independently third party's exploitation, and still can keep the interlock running.
Description of drawings
For letting above and other objects of the present invention, characteristic, advantage and the embodiment can be more obviously understandable, the explanation of appended accompanying drawing be following:
Figure 1A illustrates according to an embodiment of the present invention and the functional block diagram synchronous system of multimedia programming;
Figure 1B is the illustration sketch map that illustrates the situation event data shown in Figure 1A;
Fig. 2 illustrates according to an embodiment of the present invention and the flow chart synchronous method of multimedia programming.
[primary clustering symbol description]
100: TV station or broadcasting station 102: multimedia programming
104: client TV 106: contextual content
108: electronic programming forms 110: the situation server
112: situation incident 114: filter
116: register device 120: client terminal device
122: situation middleware device 124: situation event data
126: application apparatus 128: display unit
130: the Internet
200: obtain in progress multimedia programming
210: the situation incident that produces multimedia programming
220: set the situation action schedule
230: line is set up in registration
240: filter out the situation incident
250: wait for receiving
260: receive and resolve the situation incident
270: comparison situation event data
280: move
Embodiment
Below will clearly demonstrate spirit of the present invention with accompanying drawing and detailed description; Has common knowledge the knowledgeable under any in the technical field after understanding preferred embodiment of the present invention; When can be by the technology of teachings of the present invention, change and modification, it does not break away from spirit of the present invention and scope.
The present invention comes synchronization TV or broadcast program and client terminal device with the situation incident of TV of broadcasting or broadcast program contents.Owing to carry out synchronization with the situation incident of programme content, client terminal device need not be earlier and when TV station or school, broadcasting station, carries out synchronized shortcoming so can overcome known technology with " time ", for example: can be applicable to the on-site real-time program.
Please with reference to Figure 1A, it illustrates according to an embodiment of the present invention and the functional block diagram synchronous system of multimedia programming.This and the synchronous system of multimedia programming comprise: situation server 110 and client terminal device 120.Situation server 110 can be for example high in the clouds server, and it is to see through the Internet 130 to carry out communication with client terminal device 120.Client terminal device 120 can be for example handheld apparatus, for example: mobile phone, personal digital assistant, remote controller etc.Client terminal device 120 also can be integrated into client TV 104.Client terminal device 120 can let the user when watching at least one multimedia programming 102 through client TV 104; Simultaneously this multimedia programming 102 is responded with interactive to some extent, and for example reach: the effect of Web TV (Internet TV), interactive TV (Interactive TV).
In this execution mode, this at least one multimedia programming 102 just can be at least one TV or the broadcast program of playing at least one TV station or broadcasting station 100.Yet multimedia programming 102 also can be the program of just in any medium, playing, for example: the crossfire program of just playing in the website.Therefore, embodiment of the present invention and not subject to the limits.
Situation server 110 can be obtained the contextual content 106 and electronic programming forms 108 of media program 102 from TV station or broadcasting station 100.Electronic programming forms 108 are available for users to see through client terminal device 120 preserved program in situation server 11O.Situation server 110 is at least one situation incident 112 to the client terminal device 120 that is configured to provide multimedia programming 102, to make client terminal device 120 and multimedia programming 102 synchronizations through situation incident 112.Situation incident 112 is that the appearance according at least one the preset situation project in the contextual content 106 of in progress multimedia programming 102 produces; Wherein preset situation project is the keyword and the video-audio equal samples of representative contextual content; Be the contextual content that spectators should note in the multimedia programming, for example: (for example problem enquirement), scene (Scene) conversion, the appearance of crucial voice or its combination etc. take place in high priest's appearance, incident.The preset reusable program in similar situation of situation project (for example: serial).Situation incident 112 can use the form of a structured language to represent, for example: extensible SGML (eXtensible Markup Language; XML) form.
The contextual content 106 of multimedia programming can be multimedia programming 102 itself or multimedia programming 102 the angle this.If contextual content 106 is this time of angle of multimedia programming 102, then situation incident 112 can originally directly be picked out by the angle.Below be example when being TV programme with multimedia programming 102, the production method of situation incident 112 is described when contextual content 106 during for multimedia programming 102.Certainly, when multimedia programming 102 is broadcast program, can make relevant situation incident 112 by the part that is directed against sound in the following explanation.
After the contextual content that receives in progress multimedia programming 102 106; Situation server 110 sees through audio-visual recognition software or Artificial Cognition's method; Detect situation project preset in the contextual content 106 and whether occurred, will represent the character string information of this situation project to be made into situation incident 112 then.Begin to handle before the contextual content 106, represent the keyword of contextual content and video-audio equal samples (preset situation project) to be ready to for comparison in advance.Below illustrate the step that produces situation incident 112, but embodiment of the present invention and not subject to the limits.At first, carry out scene detection.Because TV programme are made up of a plurality of scene,, shot transition capable of using detecting (Shot Change Detection) algorithm occurs so detecting new scene.Then, to the image in each scene, sound and caption data are found out the situation that occurs in this scene with the mode of sample comparison.To image partly, earlier by extraction 1 or several images in the key frame (Frames) of image, re-use process identification and human face recognition algorithm and detect object or personage in the preset situation project.To the sound part, but the mode that service band filters is isolated the voice voice, re-uses voice to text-recognition (Speech to Text) software and produces the Chinese character string of dialogue or aside.If had closed caption (Closed Caption) in the TV programme, but then bypass voice identification, and whether directly search with the data of closed caption has the keyword of representing the situation project to occur.Then, represent all situation projects that detect in the present scene, and be packaged into the form of structured language, thereby obtain situation incident 112 with character string.
What deserves to be mentioned is,, can apply mechanically extra discrimination method and improve discrimination power to dissimilar TV programme.For example: to the athletic competition program, the generation that volume, tone and the velocity variations that can compare aside detected special incident (for example: homerun).To the intelligence development information please, but the feature picture of identification problem literal is followed the problem content of reading of voice, so as to more accurately detecting the incident that problem is putd question to.
Situation server 110 comprises: register device 116 and filter 114.When user's desire used client terminal device 120 to ask the service of situation server 110, the user needed to see through earlier client terminal device 120 and come to register device 116 registrations, setting up a line, and the multimedia programming 102 that receives of selected desire.Simultaneously, because preset situation project is a kind of universal setting, if the user does not want too many preset situation project, the user also can impose a condition at filter 114, filters out the situation incident 112 that it desires to want, so that personalized service to be provided.The situation server is to see through a kind of situation incident 112 to client terminal device 120 of broadcasting the selected and multimedia programming 102 that filters out of (Push) technology transfer that pushes away.
Above-described structured language, audio-visual recognition software, push technology etc. are all to be familiar with this art and to know, so not at this detailed description.
Client terminal device 120 can comprise: situation middleware device 122, at least one application apparatus 126 and display unit 128.It should be noted that; The situation middleware device 122 of this execution mode only is in order to illustrate; The function of the situation middleware device 122 of the following stated also can by client terminal device 120 itself or in be contained at least one application apparatus 126 and carry out, so embodiment of the present invention is also not subject to the limits.
Situation middleware device 122 is in order to receive the also situation incident 112 of definition multimedia program, to obtain at least one group of situation event data 124 of multimedia programming, shown in Figure 1B.Application apparatus 126 is application programs, in order to carry out according to situation event data 124 by programmed logic the corresponding action that goes out.The user can set a situation action schedule at client terminal device 120, carries out at least a action for application apparatus 126, and wherein this situation action schedule is set with preset situation project and corresponds at least a action of presetting the situation project.Application apparatus 126 can be compared situation event data 124 to situation action schedule and carry out at least a action, for example: the situation event data is presented at display unit 128.Except that the application of situation action schedule, application apparatus 126 also sees through alternate manner and moves according to situation event data 124.In addition; Application apparatus 126 also can be linked to the Internet 130; To obtain the related data of situation event data 124, for example: the relevant characteristic of the associated uses of the relevant introduction of programm name AA, the background context of personage BB, object CC or shopping webpage, position DD etc.Application apparatus 126 also can be according at least one preset factor, for example: user's hobby, data category, friend recommend etc., come the situation event data of multimedia programming is sorted, so that important situation event data is shown earlier or handles.
From the above; Application apparatus 126 can be through coming and TV or broadcast program interlock than known " time synchronized " more resilient mode; And the application program that can convey program interaction is able to separately make or open by independently third party's exploitation, and still can keep the interlock running.
Below narrate the method synchronous of an embodiment of the present invention with multimedia programming.
Please with reference to Fig. 2, it illustrates according to an embodiment of the present invention and the flow chart synchronous method of multimedia programming.An embodiment of the present invention can be with the synchronous method of multimedia programming in fact as a computer program, and be stored in the computer-readable medium storing, and carry out and the synchronous method of multimedia programming after making computer read this recording medium.Computer-readable medium storing can be read-only memory, flash memory, floppy disk, hard disk, CD, with oneself dish, tape, can or be familiar with the computer-readable medium storing that identical function can thought and have to this art easily by the database of network access.
In the synchronous method of this and multimedia programming, at first, in the situation server, carry out step 200, to obtain in progress at least one multimedia programming.Then, carry out step 210,, produce at least one situation incident of each multimedia programming with appearance according at least one the preset situation project in the contextual content of each multimedia programming.Simultaneously, in client terminal device, carry out step 220, to set a situation action schedule, wherein the situation action schedule is set with preset situation project and corresponds at least a action of presetting the situation project.Then, carry out step 230, with to the situation server registration setting up a line, and selected multimedia programming.Then, carry out step 240, filter out the situation incident of multimedia programming with selected at least one filtercondition.Then, carry out step 250 and 260, with the situation incident of wait and reception and definition multimedia program, and at least one group of situation event data of acquisition multimedia programming.Then, carry out step 270, to compare the situation event data to the situation action schedule.Then, carry out step 280, carry out at least a action with the result of step 270.
Though the present invention discloses as above with execution mode; Right its is not in order to limit the present invention; Anyly be familiar with this art; Do not breaking away from the spirit and scope of the present invention, when can doing various changes and retouching, so protection scope of the present invention is as the criterion when looking the scope that appending claims defines.

Claims (22)

1. a system synchronous with multimedia programming is characterized in that, in order to synchronous with in progress at least one multimedia programming, should comprise with the synchronous system of multimedia programming:
One situation server is configured to provide at least one situation incident of each this at least one multimedia programming, and wherein the appearance of at least one preset situation project in this at least one situation incident contextual content that is this at least one multimedia programming according to each produces; And
One client terminal device, in order to receive and to resolve this at least one situation incident of each this at least one multimedia programming, to obtain at least one group of situation event data of each this at least one multimedia programming, this client terminal device comprises:
At least one application apparatus is in order to carry out at least one action according to this at least one group of situation event data.
2. according to claim 1 and the synchronous system of multimedia programming is characterized in that this at least one application apparatus is linked to the Internet.
3. according to claim 1 and the synchronous system of multimedia programming is characterized in that this client terminal device also comprises:
One display unit is used for this at least one application apparatus to show this at least one group of situation event data.
4. according to claim 1 and the synchronous system of multimedia programming; It is characterized in that; This at least one group of situation event data to situation action schedule of this at least one each this at least one multimedia programming of application apparatus comparison; To carry out this at least one action, wherein this situation action schedule is set with this at least one preset situation project and corresponds to this at least one action of this at least one preset situation project.
5. according to claim 1 and the synchronous system of multimedia programming is characterized in that this at least one application apparatus comes this at least one group of situation event data of this at least one multimedia programming to each to sort according at least one preset factor.
6. according to claim 1 and the synchronous system of multimedia programming is characterized in that, at least one preset situation project is a group that is selected from by a scene change, a personage occur, an incident takes place, crucial voice occur and its combination is formed.
7. according to claim 1 and the synchronous system of multimedia programming is characterized in that this situation server also comprises:
One register device is used for this client terminal device to this situation server registration setting up a line, and selected this at least one multimedia programming.
8. according to claim 1 and the synchronous system of multimedia programming is characterized in that this situation server also comprises:
One filter is used this at least one situation incident that filters out each this at least one multimedia programming for the selected at least one filtercondition of this client terminal device.
9. according to claim 1 and the synchronous system of multimedia programming is characterized in that, this situation server is to see through this at least one situation incident that a push technology transmits each this at least one multimedia programming to this client terminal device.
10. according to claim 1 and the synchronous system of multimedia programming is characterized in that this situation server is a high in the clouds server.
11. the according to claim 1 and synchronous system of multimedia programming is characterized in that this client terminal device is a handheld apparatus.
12. a method synchronous with multimedia programming is characterized in that, comprises:
Obtain in progress at least one multimedia programming;
The appearance of at least one preset situation project according to each in the contextual content of this at least one multimedia programming produces at least one situation incident of each this at least one multimedia programming;
Receive and resolve this at least one situation incident of each this at least one multimedia programming, to obtain at least one group of situation event data of each this at least one multimedia programming;
Carry out at least one action according to this at least one group of situation event data.
13. the according to claim 12 and synchronous method of multimedia programming is characterized in that this at least one situation incident is to use an audio-visual recognition software to produce.
14. the according to claim 12 and synchronous method of multimedia programming is characterized in that this at least one situation incident is to use an Artificial Cognition mode to produce.
15. the according to claim 12 and synchronous method of multimedia programming is characterized in that this at least one action comprises:
Be linked to the Internet, to obtain the relevant information of this at least one group of situation event data.
16. the according to claim 12 and synchronous method of multimedia programming is characterized in that this at least one action comprises:
Show this at least one group of situation event data.
17. the according to claim 12 and synchronous method of multimedia programming is characterized in that this at least one action comprises:
Come this at least one group of situation event data of this at least one multimedia programming to each to sort according at least one preset factor.
18. the according to claim 12 and synchronous method of multimedia programming is characterized in that, at least one preset situation project is a group that is selected from by a scene change, a personage occur, an incident takes place, crucial voice occur and its combination is formed.
19. the according to claim 12 and synchronous method of multimedia programming is characterized in that, also comprises:
Set a situation action schedule, wherein this situation action schedule is set with this at least one preset situation project and corresponds to this at least one action of this at least one preset situation project; And
Compare this at least one group of situation event data to this situation action schedule, to carry out this at least one action.
20. the according to claim 12 and synchronous method of multimedia programming is characterized in that, also comprises:
Selected at least one filtercondition filters out this at least one situation incident of each this at least one multimedia programming.
21. the according to claim 12 and synchronous method of multimedia programming is characterized in that this at least one multimedia programming is to be broadcasted by at least one TV station or broadcasting station.
22. the according to claim 12 and synchronous method of multimedia programming is characterized in that this at least one group of situation incident is to use the form of a structured language to represent.
CN2010105920011A 2010-12-09 2010-12-09 System and method for synchronizing with multimedia broadcast program Pending CN102572534A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010105920011A CN102572534A (en) 2010-12-09 2010-12-09 System and method for synchronizing with multimedia broadcast program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010105920011A CN102572534A (en) 2010-12-09 2010-12-09 System and method for synchronizing with multimedia broadcast program

Publications (1)

Publication Number Publication Date
CN102572534A true CN102572534A (en) 2012-07-11

Family

ID=46416806

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010105920011A Pending CN102572534A (en) 2010-12-09 2010-12-09 System and method for synchronizing with multimedia broadcast program

Country Status (1)

Country Link
CN (1) CN102572534A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1810031A (en) * 2003-05-22 2006-07-26 特纳广播网有限公司 Systems and methods for dynamically generating and distributing synchronized enhancements to a broadcast signal
CN1941895A (en) * 2005-09-29 2007-04-04 年代数位媒体股份有限公司 Intelligent adaptive programm broadcasting method
WO2010117213A2 (en) * 2009-04-10 2010-10-14 Samsung Electronics Co., Ltd. Apparatus and method for providing information related to broadcasting programs

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1810031A (en) * 2003-05-22 2006-07-26 特纳广播网有限公司 Systems and methods for dynamically generating and distributing synchronized enhancements to a broadcast signal
CN1941895A (en) * 2005-09-29 2007-04-04 年代数位媒体股份有限公司 Intelligent adaptive programm broadcasting method
WO2010117213A2 (en) * 2009-04-10 2010-10-14 Samsung Electronics Co., Ltd. Apparatus and method for providing information related to broadcasting programs

Similar Documents

Publication Publication Date Title
CN108769723B (en) Method, device, equipment and storage medium for pushing high-quality content in live video
CN103226947B (en) A kind of audio-frequency processing method based on mobile terminal and device
EP3451679B1 (en) Method for providing media-content related information based on closed caption information, server, and computer-readable storage medium for executing the method
CN108536414B (en) Voice processing method, device and system and mobile terminal
CN102833596B (en) Information transmitting method and device
US9426411B2 (en) Method and apparatus for generating summarized information, and server for the same
CN106021496A (en) Video search method and video search device
CN103299648A (en) Method for receiving enhanced service and display apparatus thereof
CN102422284A (en) Bookmarking system
CN102193794B (en) Link real-time media situation is to relevant application program and service
US20070130611A1 (en) Triggerless interactive television
CN105489072A (en) Method for the determination of supplementary content in an electronic device
CN103947220A (en) Display device and method for providing content using the same
CN110958470A (en) Multimedia content processing method, device, medium and electronic equipment
CN103929669A (en) Interactive video generator, player, generating method and playing method
CN103747277A (en) Multimedia program identification method and device
CN105427687A (en) Self-help reading system for infants
US20120150990A1 (en) System and method for synchronizing with multimedia broadcast program and computer program product thereof
CN109359203B (en) Method and device for processing motion trail video
KR102244195B1 (en) Providing Method for virtual advertisement and service device supporting the same
CN106331743A (en) Video interaction system and method based on audio watermarking
CN106202421B (en) method and device for obtaining video and method and device for playing video
WO2017008498A1 (en) Method and device for searching program
KR20200024541A (en) Providing Method of video contents searching and service device thereof
CN103023923A (en) Information transmission method and information transmission device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20120711