CN101606171A - The apparatus and method of access and first media data correlation combiner information - Google Patents

The apparatus and method of access and first media data correlation combiner information Download PDF

Info

Publication number
CN101606171A
CN101606171A CNA2007800424577A CN200780042457A CN101606171A CN 101606171 A CN101606171 A CN 101606171A CN A2007800424577 A CNA2007800424577 A CN A2007800424577A CN 200780042457 A CN200780042457 A CN 200780042457A CN 101606171 A CN101606171 A CN 101606171A
Authority
CN
China
Prior art keywords
data
information
combined information
media
access
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2007800424577A
Other languages
Chinese (zh)
Inventor
克里斯多佛·M·克拉克
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CN101606171A publication Critical patent/CN101606171A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309Transmission or handling of upstream communications
    • H04N7/17318Direct or substantially direct transmission and handling of requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2381Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782Web browsing, e.g. WebTV
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8126Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/08Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division

Abstract

Apparatus and method can be described as to the medium recipient distribution combined information relevant with first media data of experiencing first media data (as TV, broadcasting, film or relay in real time).These combined informations can be the medium recipient obtain side information direct link as website by the Internet access, it is relevant with first medium medium.Because combined information can guide the medium recipient to obtain side information, so, need not medium recipient oneself search.In various embodiments of the invention, directly link sends to wireless telecommunications system by wireless base station apparatus, again by wireless telecommunications system access side information.Generally speaking, directly link is extracted from first media data flow or copy formation.Therefore, combined information can extract from a unidirectional first media data flow and extract from two-way information medium (as the Internet or wireless communication networks).

Description

The apparatus and method of access and first media data correlation combiner information
Technical field
The present invention relates to field of media data transmission and provide.More particularly, the present invention relates to the system of a kind of access and first media data correlation combiner information.
Background technology
Media services provider is constantly seeking new to provide information to media consumer's with unique mode.Especially, the method that media services provider always seeks to innovate to provide to the potential consumer advertiser's information, attracts consumer's attention, and points out the consumer to seek more information about product or service, as the product or the service of this advertisement.Present challenge is exactly not rely on classic method fully advertising message is provided, as not adopting traditional method of intercutting advertisement between TV or program of radio station fragment.
A kind of method is " property inserted marketing " in film and TV programme, and wherein advertiser's product is that a scene of giving prominence to appears at the movie or television program.Though this method obtains the product that the consumer pays close attention to the advertiser effectively, the product information amount that this method can allow the consumer provide is limited.The consumer preferably can be provided the mode simple, that relevant product or service more information are obtained in happiness, obtain the website of information or receive information by Email as visit.
What need now is that a kind of to guide it to obtain when the consumer experiences media services or after experiencing more about products or service method.
Summary of the invention
For satisfying above-mentioned and other needs, different embodiments of the invention provide different apparatus and method, distribute relevant information to the medium recipient who experiences media information (as TV, broadcasting, film and relay in real time).Combined information can be some direct links, and the medium recipient uses these link access side informations, and as the website of the Internet, these links are related with first medium.Because combined information can guide the medium recipient to obtain side information, so need not medium recipient oneself search.
In different embodiments of the invention, but directly link the communication apparatus that is sent to the direct access side information.In some cases, directly link is extracted from original media data stream or copy formation.Therefore, in the embodiment of the invention, from " unidirectional " first media data flow, extract combined information, utilize combined information access side information from " two-way " information medium (as the Internet, wireless communication networks) alternately again.Therefore, the invention provides the method that " unidirectional " medium (as TV, broadcasting, film and video) are converted into " two-way " medium (as internet and cordless communication network).
Unit's display advertising can be counted as one " backward " and experience, but not necessarily interactive.Yet using directly to link provides the experience of one " forward " or interactivity can strengthen first medium real-time, because the medium receiver can utilize link access side information.
In the preferred embodiment of the present invention, provide a kind of media information has been transferred to medium recipient's method from the media information source, this method comprises:
(a) accept media data flow from the media information source, media data flow comprises metadata and combined information, and wherein metadata comprises monobasic display advertising and combined information, and combined information points to the side information related with first display advertising;
(b) provide first display advertising according to metadata to the medium recipient;
(c) with the streamed access combined information of media data;
(d) be that the side information position is determined on the basis with the combined information;
(e) the position access side information of from (d), determining;
(f) show side information to the medium recipient.
In the preferred embodiment of the present invention, step (a) comprises from the service provider of TV programme obtains media data flow; Step (b) is included in shows TV programme on the equipment of televising.In certain embodiments, (a) comprise from the service provider of broadcast program and obtain media data flow; Step (b) is included in shows broadcast program on the broadcasting equipment.In other embodiments, (a) comprise from Digital Media playback equipment such as DVD player, CD Player or digital music player and obtain media data flow.In extremely indivedual embodiment, (a) comprise that putting shadow equipment from cinema film obtains media data flow; Step (b) comprises uses projector equipment showing the film function in the cinema.Also have in certain embodiments, (a) be included as big format video display device and obtain media data flow from video data source; Step (b) is showed video frequency program in real time on big format video display device.
In yet another aspect, this invention provides a device to be used to operate the media data flow of being made up of metadata and combined information.Wherein, metadata comprises first display advertising, and combined information points to the side information relevant with first display advertising.In the preferred embodiment of the present invention, device comprises an associated data access device and a combined information receiving equipment.Wherein, associated data access device comprises an extraction circuit from the media data flow input of media data source receiving media data stream, an access combined information from media data flow, one provides the combined information output, one of combined information to provide the metadata output of metadata to form to the metadata presentation device to the combined information receiving trap.The data splitting receiving trap is used to receive data splitting, access is indicated the side information of position and showed side information to the medium recipient by combined information.
In certain embodiments, the combined information receiving equipment is mobile phone or the personal digital assistant device with wireless communication ability.In other embodiments, the data splitting receiving trap can be the assembly of personal computer, notebook computer.Side information will be provided for personal computer or the notebook computer of having equipped display device.Simultaneously, side information will offer display device and personal computer or notebook computer.
In certain embodiments, associated data access is the assembly of mobile phone, digital media player, digital music player, DVD player, CD Player, personal digital assistant device, notebook computer, personal computer, satellite television receiving trap, CATV (cable television) receiving trap, terrestrial television receiving trap, satellite broadcast receiving device or terrestrial broadcasting receiving trap.
Description of drawings
Detailed description with reference to the accompanying drawings, advantage of the present invention is conspicuous.Content is not wherein amplified so that more clearly illustrate details, in all diagrams, and the content that identical numeral is identical.
Fig. 1 has described the apparatus function block diagram that the access combined information relevant with first media data is provided in the preferred embodiment of the present invention;
Fig. 2 has described the method flow diagram that access and first media data correlation combiner information are provided in the preferred embodiment of the present invention;
Fig. 3 has described the method flow diagram that access and first video data correlation combiner information are provided in the preferred embodiment of the present invention;
Fig. 4 has described the method flow diagram that access and first video data correlation combiner information are provided in the another embodiment of the present invention;
Fig. 5 A has described the apparatus function block diagram that the access combined information relevant with first media data is provided in the preferred embodiment of the present invention;
Fig. 5 B has described the apparatus function block diagram that the access combined information relevant with first media data is provided in another embodiment of the present invention;
Fig. 6 has described the apparatus function block diagram that the access combined information relevant with first video data is provided in the first embodiment of the invention;
Fig. 7 describes the apparatus function block diagram of the further details of Fig. 6;
Fig. 8 describes an embodiment who is embedded in data splitting in the media data flow;
Fig. 9 describes the further apparatus function block diagram of details of Fig. 6;
Figure 10 A describes the embodiment that first video data is showed, first video data is showed the side information based on the preferred embodiment of the present invention;
Figure 10 B describes with form web page and show a embodiment based on the side information of the preferred embodiment of the present invention on display device;
Figure 11 has described the apparatus function block diagram that the access combined information relevant with first media data is provided in the second embodiment of the invention;
Figure 12 has described the method flow diagram that access and first media data correlation combiner information are provided in another embodiment of the present invention;
Figure 13 has described the apparatus function block diagram that the access combined information relevant with first media data is provided in the third embodiment of the invention;
Figure 14 has described the apparatus function block diagram that the access combined information relevant with first media data is provided in the fourth embodiment of the invention;
Figure 15 has described the method flow diagram that access and first media data correlation combiner information are provided in another preferred embodiment of the present invention.
Embodiment
Fig. 1 has described a preferred embodiment of system 10, and system 10 provides access the combined information relevant with first media data.For this explanation, " first media data " just provides or the information of transfers media content.For example, first media data comprises but the video, audio frequency, image or the text data that are not limited to transform by any way." combined information " is the information of pointing to the side information source and existing in any form.Wherein, the side information source is related with first media data in some way.For example, combined information can include but not limited to link, the network address, computer application program, file, Email information, note, voice messaging or the data character string of webpage.
Video data comprises may be by the TV data of satellite transmission, wired or wireless ground signal, be stored in the video information in storage medium such as DVD or other CD or the hard disk.Video information transmits by communication network (as the Internet), and video information is presented at big format video display screen, as the JumboTron of Sony TMVideo information projection in screen and the cinema.
Voice data comprises may be by the wireless broadcast data of satellite transmission, wired or wireless ground signal, be stored in the audio-frequency information in storage medium such as CD or other CD or the hard disk.Audio-frequency information is present in on-the-spot media activity, and as concert or competitive sports, audio-frequency information is present in film sound tracks.Audio-frequency information transmits by communication network (as the Internet).Audio-frequency information can exist with the multiple form of any one coding, as MP3, Dolby Digital, DTS and Windows Media Audio.
As shown in Figure 1, system 10 comprises a media data source 12, and media data source 12 provides or transmit first media data.In a preferred embodiment, media data source 12 can be the dubbing in background music of digital media player, DVD player, CD Player, MP3 player, numerical tape player, hard disc of computer, CD or film of a satellite television service provider, CATV (cable television) service supplier, ground TV broadcast merchant, satellite broadcast service provider, electrophone service provider, terrestrial broadcasting merchant, internet, personal computer.Media data source 12 is not limited to above-mentioned institute's array apparatus or source among the present invention.Media data source 12 generates or transmits the media data flow by arrow 14 marks.In a preferred embodiment, media data flow 14 transmits first media data and relevant information simultaneously.In another embodiment, independently transmit in channel or path with media data flow 14 by one for part or all of combined information.
Continuation is with reference to Fig. 1, and system 10 comprises an associated data access device 16, and the media data flow 14 that is provided by media data source 12 is provided associated data access device 16.In the preferred embodiment of the present invention, associated data access device 16 accesses are present in the combined information in media data flow 14 or the joint channel.Following usefulness one embodiment makes more detailed description, wherein, whether associated data access device 16 detects combined information and exists, and extracts from media data flow 14 or other passage or the copy combined information, then separate code combination information if necessary, write combined information to associated data access device internal memory 16.In different embodiment, associated data access device 16 is ingredients of following equipment, and these equipment comprise: satellite television receiving trap, CATV (cable television) receiving trap or terrestrial television receiving trap (being referred to as the STB set-top box), personal computer TV receiving card, digital video recording equipment, satellite broadcast receiving device, ground or electrophone receiving trap, Wireless Telecom Equipment (as mobile phone, personal digital assistant device PDA), DVD player, CD Player and other apparatus for media playing.
In the preferred embodiment of the present invention, associated data access device 16 decodings or processing are present in the first media data in the media data flow 14, produce a media information signal 18.Media information signal 18 transmits first media program with the form of video or audio frequency to first media data presentation device 20.Then, first media data presentation device 20 provides first media program to the medium recipient.In another embodiment of the present invention, do not change data mode behind the relevant data insertion equipment 16 access combined informations and directly transmit first media data.In the middle of these embodiment, first media data presentation device 20 decoding and processing elements media datas.
Associated data access device 16 provides combined information by data link 24a to a combined information receiving equipment 22a.In some embodiments of the invention, there is the link of a plurality of combined information receiving equipments and data, as another combined information receiving equipment 22b and another data link 24b that Fig. 1 showed.In the preferred embodiment of the present invention, combined information receiving equipment 22a, 22b are made up of personal computer, notebook computer, server, personal digital assistant device PDA, mobile phone or other Wireless Telecom Equipment respectively.Generally speaking, the function of combined information receiving equipment 22a, 22b comprises from associated data access device 16 reception combined informations, access provides side information by the side information one or more addresses of combined information indication with to the medium recipient.
For needs are described, " side information " is defined as combined information and specifies and relevant with first media data to a certain extent information.For example, side information can include but not limited to webpage, computer applied algorithm, electronic information, video data file, audio data file, text data file, note, voice messaging or image data file.Side information among the various embodiment is following to be described in detail more.
In the embodiment in figure 1, media data source 12, associated data access device 16 and combined information receiving equipment 22a, 22b are connected with communication network widely, as the Internet.
In some embodiments of the invention, associated data access device 16 can link by non-direct communication with combined information receiving equipment 22a and communicate, and these non-direct communications links comprise: (1) associated data access device 16 is connected 24c with network between the media data source 12; (2) media data source 12 is connected 24d with network between the communication network 28; (3) communication network 28 is connected 24f with network between the combined information receiving equipment 22a.In the preferred embodiment of the present invention, network connects that 24c and first media data 14 are the same to be provided by identical communication channel.For example, if media data source 12 is cable television providers, network connects 24c and will be connected by physical coaxial cable or optical fiber with CATV (cable television) data 14.
In some embodiments of the invention, associated data access device 16 can be utilized alternate manner to link by non-direct communication with combined information receiving equipment 22a and communicate, and these non-direct communication links comprise:
(1) associated data access device 16 is connected 24e with network between the communication network 28; (2) communication network 28 is connected 24f with network between the combined information receiving equipment 22a.
Equally, between associated data access device 16 and the combined information receiving equipment 22b various alternative connectivity options are arranged, and to connect 24g relevant with network.
In some preferred embodiments of the invention, it is that wireless data link (as wireless connections WiFi IEEE 802.11), bluetooth connect IEEE 802.15.1, move connection as global system for mobile communications GSM, infrared serial connection that network connects 24a to 24g).In other preferred embodiment of the present invention, it is wired connection (as by general-purpose serial bus USB, periphery component interconnection pci bus, LAN (Local Area Network) LAN, wide area network WAN such as the Internet) that network connects 24a to 24g.
In some preferred embodiments of the invention, combined information receiving equipment 22a just preserves combined information and connects (24f, 24g and communication network 28) transmission combined information to the second combined information receiving equipment 22b by immediate data connection 30 or by network in internal memory.Second combined information receiving equipment 22b possesses the part or all of function of above-mentioned first combined information receiving equipment 22a.In the preferred embodiment of the present invention, second combined information receiving equipment 22b is made up of personal computer, notebook computer, server, personal digital assistant device PDA, mobile phone or other wireless Wireless Telecom Equipment, also can be above-mentioned arbitrary equipment.It can be that wireless data link (connecting as WiFi), bluetooth connect, move connection, infrared connection that immediate data connects 30).In addition, immediate data connection 30 also can be wired connection (as connecting by USB connection, pci bus, LAN (Local Area Network) LAN connection, wide area network WAN).
With reference to Fig. 1, first media data presentation device 20 is from associated data access device 16 receiving media information signals 18.In a preferred embodiment, associated data access device 16 decoding and processing elements media datas, unit's media data presentation device 20 is by LCD display, PDA or mobile phone, the motion-picture projection machine of television display equipment, audio receiver/amplifier/loudspeaker, computing machine, the video display apparatus of digital projector or big form.In other embodiments, associated data access device 16 transmits first media data, first media data presentation device 20 is made up of decoding and processing element, the form (as LCD display, the motion-picture projection machine of television display equipment, audio receiver/amplifier/loudspeaker, computing machine, the input format of the video display apparatus of digital projector or big form) that these decodings and processing element are used for compatibility provides first media information.
In some preferred embodiments of the invention, associated data access device 16, combined information receiving equipment 22a and first media data presentation device 20 are ingredients of independent media's data display equipment.These independent media's data display equipment such as personal computer, notebook computer, PDA or mobile phones.These embodiment are following to be described in more detail.
According to combined information, can locate (step 110) side information, as the network address of side information.Side information will be provided side information (step 116) to the medium recipient simultaneously by first associated data access device 22a or second associated data access device 22b access (step 112) then.In processing procedure, first media content such as TV, film, broadcasting, music or relay in real time provide (step 116) by first media data presentation device 20 to the medium recipient simultaneously.
Fig. 3 has described the method among Fig. 2 embodiment.In this embodiment, this method comprises the video data stream 14 of acceptance from video data source 12, and wherein, video data stream 14 comprises MPEG-2 or MPEG-4 video flowing.Wherein, audio data source 12 can be the media player (step 118) of satellite or CATV (cable television) service supplier, DVD player, numerical tape player or computer.Associated data access device 16 (step 102) access is embedded in uniform resource locator (URL) information in the video data stream 14, and URL information is offered personal computer 22a (step 122).According to URL information, can locate the network address of (step 124) supplemental information data file, supplemental information data file such as HTML(Hypertext Markup Language) file, video file or audio file, then by access (step 126), and offer personal computer 22a, provide side information (step 130) to the medium recipient simultaneously.In the processing procedure, first media content shows medium recipient (step 128) by video display apparatus simultaneously.
Fig. 4 has described the method among Fig. 2 embodiment.In this embodiment, this method comprises the video data stream 14 of acceptance from video data source 12, and wherein, video data stream 14 comprises MPEG-2 or MPEG-4 video flowing.Wherein, audio data source 12 can be the media player (step 132) of satellite or CATV (cable television) service supplier, DVD player, numerical tape player or computer.Identical with the embodiment among Fig. 3, associated data access device 16 (step 134) access is embedded in uniform resource locator (URL) information in the video data stream 14.But among the embodiment of Fig. 4, URL information does not offer personal computer.On the contrary, URL information is combined, and Information Access equipment 16 is handled and the network address (step 136) of location supplemental information data file.Supplemental information data file (as HTML (Hypertext Markup Language) html file or video file) is then by access (step 138), and shows (step 142) to the medium recipient on video display apparatus.In the processing procedure, first video content shows that by identical video presentation device 20 is to medium recipient displaying (step 140) simultaneously.
Fig. 4 is the method for an embodiment, wherein, mobile phone or PDA receiver, video fragment or snatch of music, the encoded URL in video segment or snatch of music of mobile phone or PDA access re-uses the webpage that URL visits relevant video segment or snatch of music.The method of Fig. 4 also comprises another embodiment, wherein, unit's media data is exactly the media data file by the personal computer media renderer plays, and the application program in the computing machine re-uses the webpage that URL visits relevant media data file with the encoded URL in media data file of access.
Fig. 5 A has described one embodiment of the present invention, and wherein, the source media content is a TV programme.Among this embodiment, media data source 12 is media data service provider 12 (as wired or satellite TV providers).Associated data access device 16 is exactly a television/computer interface 16, and the combined information receiving equipment is exactly personal computer 22a, and first media data presentation device is exactly a television display equipment 20.
Fig. 6 has described television/computer interface 16, from the invention preferred embodiment as can be known, television/computer interface 16 is contained in the set-top box.Television/computer interface 16 comprises data extractor 34, and wherein, data extractor 34 receives digital media stream 14 from TV media data source 12.In the present embodiment, data extractor 34 effects are to extract from digital media stream or the copy combined information.
Be different purposes, combined information may be present in the digital media stream 14, for example needs to identify the source of first TV programme or is used to generate or during the software type of coding video frequency data.As mentioned previously, combined information also can be used for providing information about product or service to the consumer.
Combined information may be embedded in digital media stream 14 " user data " section.Following have a more detailed description, and data extractor 34 is monitored coded data stream 14 beginnings of " listening to " " user data " simultaneously.When detecting " user data " section, data extractor 34 copies combined information and transmits to interface controller 44 from digital media stream 14.Interface controller 44 connects 24a by network and transmits to computing machine 22a from data extractor 34.In the some embodiments of the invention, interface controller 44 extracts graph data and sends to graphics controller 38 from combined information.Although combined information is to obtain when digital media stream 14 copies from digital media stream 14 during by data extractor 34, the digital media stream 14 that enters in the television/computer interface 16 is not changed by data extractor 34 time.
In the preferred embodiment of the present invention, data extractor 34 flows in 14 to digital media data as a listening port patch (increase).As shown in Figure 7, data extractor 34 comprises a data extractor processor 60, and data extractor processor 60 Monitoring Data stream 14 is sought the sequence number that is present in combined information in the Digital Media media signal.Data extractor 34 comprises that again ROM (read-only memory) (ROM) 62 is used for stored program instruction and internal memory (RAM) 64 is used for interim store data.
For the running that provides background knowledge to be used for description data extraction device 34, the data layout of MPEG-2 is described out for the first time as shown in Figure 8, and it has represented the standard MPEG-2 data of representing with hexadecimal data.As shown in Figure 8, the MPEG-2 data stream comprises a plurality of different " opening codes ", the different piece of expression data stream.According to the digital video Moving Picture Experts Group-2 of ISO/IEC 13818-2 regulation, " opening code " is special bit pattern, can not come across in the video flowing.Each " opening code " is made of opening code prefix and opening code code value.
According to Moving Picture Experts Group-2, " opening code " prefix is that a value is zero, and length is that 23 character string heels 1 are formed, and therefore, " opening code " prefix is a character string " 0,000 0,000 0,000 0,000 0,000 0001 " (0,000 01 sexadecimal).Immediately following being the opening code code value after " opening code " prefix, code value is 8 integer numbers, is used for sign " opening code " type.Great majority " opening code " have only a bit code value.
The sexadecimal opening code code value of " user data " part is " b2 " in the MPEG-2 stream, therefore, and as shown in Figure 8, the sexadecimal of " user data " " opening code "Yes" 0000 01b2 ".User data comprises that all closely follow " opening code " the data between end code (or next " opening code ").User data can be a data with arbitrary length.User data shown in Figure 8 is " 2,153 8,846 8468 1d4e 356a ".
SMPTE registration body (LLC) is at present by the registration body of International Organization for Standardization mandate registration MPEG-2 format identifier.The description of registration Moving Picture Experts Group-2 is to be provided by International standardization standard 13818-1, and purpose is that still do not stipulate in the Moving Picture Experts Group-2 of generally acknowledging at present by these user data transmitting clear and definite user data on the Moving Picture Experts Group-2 for the permission user.The MPEG-2 video transmission standard that this regulation allows transmits data of different types, provides clear and definite authentication method to discern wherein private data simultaneously.
To the entity of the SMPTE registration code with a designated uniqueness, this code can be identified in video flowing.Use this registration code, entity can be partially submerged into concrete combined information at the user data of video data stream.This registration code can also be used for the location and extract combined information.
According to Fig. 7, data extractor processor 60 is based on the user data " opening code " (0000 01B2) in the programmed instruction monitoring MPEG-2 data stream that is stored among the ROM 62.In case user data " opening code " is detected, processor 60 jumps to another section program among the ROM, begins to monitor suitable registration code.When registration code was detected, processor 60 began to copy the place ahead data and arrives internal memory 64 till stop code is detected.Processor 60 is transmitted the data that are kept in the internal memory and is arrived interface controller 44.Processor 60 repeats to begin to monitor next user data " opening code " then.
After video flowing passed through data extractor 34, demoder 36 (as MPEG-2 or MPEG-4 demoder) decoded digital Media Stream became a pure digi-tal brightness/chroma (Y/C) signal.In the some embodiments of the invention, decoded media signal offers graphics controller 38, the graph data among graphics controller 38 integrated mediums stream and the computing machine 22a (if indication is done like this).At last, according to the situation of television/computer interface 16 and the television display equipment 20 that using, the digital media signal in video interface 40 may convert one or more simulating signals to once more.Therefore, according to a special embodiment, the signal that offers television display equipment 20 can be made up of video, composite video, digital visual interface (DVI), HDMI (High Definition Multimedia Interface) (HDMI) or other video or multimedia.
Fig. 9 has described the computing machine 22a in the preferred embodiment of the present invention, and computing machine 22a comprises computer interface controller 50, processor 52, hard disk 54, internal memory 56, communication network interface 58, video graphic card 60 and display device 62.Wherein, interface controller 50 may be a local net network interface card, USB controller or address/data bus (as pci bus).Interface controller 50 provides the data-interface between television/computer interface 16 and the processor 52.
According to the type of the combined information that receives from television/computer interface 16, processor 52 utilizes hard disk 54,56 pairs of combined informations of internal memory to handle.If combined information is a link by the Internet webpage accessible, processor 52 will use visit device software to obtain info web by communication network interface 58.In the preferred embodiment of the present invention, the webpage figure will show in computer display apparatus 62, and processor 52 generates webpage graphics command data according to link data, and the graphics command data are sent to computer video graphics card 60.
As shown in Figure 7, interface controller 44 comprises an interface processor controls 84 (being used for communicating by letter with opertaing device interface 42), data extractor 34 and graphics controller 38.Opertaing device interface 42 and data extractor 34 provide data to interface processor controls 84, and processor 84 is handled data according to the instruction that is kept at ROM 86.How these instruction decision processors 84 are revised combined information and are sent to network interface unit (NIC) 90 on the computing machine 22a, and the software that amended combined information must be run on the computing machine 22a is discerned.Before the modification combined information sends to network interface unit (NIC) 90, be stored among the RAM88.
In preferred embodiments more of the present invention, the processor 84 in the interface controller 44 extracts text-string from combined information, and in the display device 20 that is inserted into display video, graphics controller 38 sends the text-string that extracts then.Processor 84 also is responsible for transmitting combined information to computing machine 22a by network interface unit 90 and link 24a.In certain embodiments, interface controller 44 is waited for the transmission instruction of opertaing device 46, just combined information is sent to computing machine 22a.In other embodiments, interface controller 44 sends combined information to computing machine 22a automatically, as long as interface controller 44 receives combined information from data extractor 34.
Just the reverse function mode of these operations also is the same.When network interface card 90 receives automatic network to connect 24 data, transmit data and give processor 84.Processor 84 is carried out the correct data that receive of revising of the instruction that is stored in ROM86, sends to graphics controller 38 then.Data were kept at the suitable transmitting time of wait among the RAM88 always before being sent to graphics controller 38.
As shown in Figure 7, graphics controller 38 provides a system to be used to produce figure and it has been embedded into digital media stream synchronously.In the preferred embodiments of the present invention, graphics controller 38 comprises digital switch controller, exchanges data 72, graphics card 74, the graphic process unit that contains RAM 76 and ROM 78 and the digital video code 82 that contains RAM 68 and ROM 70.
In one embodiment of the invention, digital switch controller 66 receives instruction from interface controller 44, and it is separated into graphics command and embeds instruction.Digital switch controller 66 sends graphics command to graphics card 74, preserves to embed instruction in RAM 68.Digital switch controller 66 is responsible for the digital media signal of monitoring by data extractor 34 simultaneously, and the mode of its monitoring digital media signal is identical with data extractor 34.Digital switch controller 66 is monitored digital media signal and is activated switch 72 in place in data stream, allow it allow figure to be embedded in the stream.Embedded location is according to the embedding instruction decision that is stored among the RAM 68.Under the normal mode, exchange 72 allows the digital media signal no change to pass through.When switch 72 when digital switch controller 66 receives suitable instruction, switch 72 is with the running of figure inserted mode, promptly the figure of being created by graphic process unit 76 is inserted in the video flowing synchronously.In the preferred embodiments of the present invention, this synchronous exchange uses the switching logic door to finish in exchange 72.An identical switch mode is: wired or satellite set top box guides to insert the program figure in the vision signal of video programming signal.
In the preferred embodiment of the present invention, graphics card 74 is consistent with graphics card function mode on the personal computer.Graphics card 74 receives graphics command from digital switch controller 66, and these graphics commands are identical or closely similar with the form of the instruction that personal computer provides.
Based on the image indication that digital switch controller 66 sends, graphics card 74 output image datas, 76 copy image data of graphic process unit are to RAM 78.After graphic process unit 76 receives from digital switch controller 66 signals, just view data is embedded digital media signal.Digital switch controller 66 sends the signal of embedded images data to image processor 76, and this signal comprises the data volume of embedding and the time that stops to embed.Image processor receives the embedding indication and to digital video decoder 82 output datas, this demoder becomes suitable video format with data-switching.For example, video card 74 produces image information with rgb format, and digital video decoder 82 becomes digital video brightness/chroma (Y/C) form with data-switching.Exchange 72 receives the data of sending from digital video decoder 82, and data are embedded digital media signal.
Figure 10 A has described an example that is produced tv screen image by Fig. 6 embodiment.When the video data stream that receives about apple IPod television advertising 200, data extractor 34 detects and the copy combined information in comprising the video data stream that textual phrase " buys IPod ".According to this combined information, graphics controller 38 generations one have the pattern exhibiting of same text phrase and are embedded in the foregoing digital media signal.At last, the pattern exhibiting of " buying IPod " appears on the television display equipment 20 with first video information of television advertising 200.
In this example, data extractor 34 detects combined information and Info Link is arrived webpage, and the client obtains more information and buys IPod by Web link.Combined information provides with URL or IP address pattern.In the preferred embodiment of the present invention, combined information is copied and is sent to interface controller 44 automatically, thereby provides data by link 24a to computing machine 22a.
As shown in Figure 6, by transmitter 45 (as bluetooth transmitters) selectivity or additivity ground wireless transmit combined information, combined information is launched into Wireless Telecom Equipment 22b in transmitter 45 communication ranges, Wireless Telecom Equipment 22b (as mobile phone, PDA or laptop computer) can be used to the side information that access is pointed to by combined information.
Referring again to Figure 10 A, when text image 202 occurring, is that the product side information of the subscriber-related advertisement of prompting can be obtained.The user presses the button of remote controller 46 (Fig. 6), and activation interface controller 44 transmits request signal to computing machine 22a, and side information just can be obtained.Be response request signal, computing machine 22a carries out the webpage of browser program access URL indication.For example, the webpage of the server stores of television advertising computer system 22b (Fig. 5 A).Shown in Figure 10 B, webpage 206 is shown (Fig. 9) by the display device 62 of computing machine 22a.In another embodiment, the user can use same mouse, touch pad or telepilot to remove positioning cursor 204, clicks text image 202 (Figure 10 A) activation interface controller 44 and sends request signal to computing machine 22a.
Figure 11 has described one embodiment of the present invention, and wherein first media content is audio program (as deriving from a digital music file or digital broadcasting stream).In this embodiment, media data source 12 is audio media data source 12, the digital music file that digital music file that transmits as satellite broadcast service provider, by network or access CD or hard disk obtain.The combined information access device 16 of present embodiment may be the assembly of the card in satellite broadcast reception converter, the personal computer, or the assembly of CD player, MP3 player or other digital music player.First media data presentation device 20 of present embodiment comprises audio receiver/amplifier/loudspeaker and combining audio generator (loudspeaker or earphone).In the embodiment of graphics card 1, the first combined information receiving equipment 22a comprises a mobile radio communication device (as mobile phone, PDA or notebook computer), and mobile radio communication device carries out radio communication (as WiFi, honeycomb, bluetooth or infrared link) by wireless connections 24 and associated data access device 16.The embodiment of Figure 11 also comprises the second combined information receiving equipment 22b (as personal computer), and the second combined information receiving equipment 22b communicates by letter with mobile radio communication device 22b by direct connection 30 or communication network 28.
Figure 12 describes the embodiment that uses among Figure 11 is sent to the audio frequency of audio frequency media information the medium recipient from audio data sources method.In an embodiment, this method comprises from audio data sources 12 (step 144) reception voice data 14 (as MPEG or MP3 audio stream).The URL that is embedded into voice data 14 uses 16 accesses (step 146) of combined information access device, and simultaneously, URL is forwarded to mobile radio communication device 22a (step 148).(step 152) determined according to URL in the network address of supplemental information data file.Supplemental information data file (as webpage, video file or other audio file) is the address access by appointment (154 step) simultaneously, and offers mobile radio communication device 22a.Simultaneously, combined information provides or is stored in the internal memory for visit from now on to medium recipient (step 158).In treatment combination information, first audio frequency content (as broadcast program, podcast, other music program) provides (step 156) by audio receiver/amplifier/loudspeaker 20 to the medium recipient.Meanwhile, url data may by communicate to connect 30 or network 28 (step 150) send to personal computer 22b from mobile radio communication device 22a.
Figure 13 has described one embodiment of the present invention, and wherein first media content is to derive from dubbing in background music of Film Animation displaying.In this embodiment, media data source 12 is audio media data source 12, as the digital audio file that obtains from access film sound tracks, other magnetic or optical storage medium.Combined information access device 16 among the embodiment may be a dub in background music ingredient of treatment facility (as Dolby Digital processor or Digital Theater System (DTS Inc.) processor) of animation.First media data presentation device 20 among the embodiment comprises big device of an audio interface receiving/releasing and combining audio playback equipment, as the loudspeaker of cinema.In representative embodiment Figure 13, the first combined information receiving equipment 22a is made up of Wireless Telecom Equipment, as wireless telephone, PDA or notebook computer.This Wireless Telecom Equipment is communicated by letter with associated data access device 16 by wireless link 24a (as WiFi, honeycomb, bluetooth or infrared connection).The embodiment of Figure 13 comprises the second combined information receiving equipment 22b (as personal computer) simultaneously, personal computer by connect 30 or network 28 communicate with mobile radio communication device 22.
Figure 12 describes method of the present invention and is to use the described method of Figure 13 embodiment to transmit the exemplary process of first film sound tracks voice data and combined information.In this embodiment, this method comprises from film sound tracks 12 reception voice datas 14 (as Dolby Digital or DTS voice data) (step 144).The URL that is embedded in the voice data 14 uses associated data access device 16 (step 146) access, then URL is sent to mobile radio communication device 22a (step 148).(step 152) determined according to URL in the network address of supplemental information data file.Supplemental information data file (as webpage, video file or other audio file) by access (step 154), offers mobile radio communication device 22a in the address of appointment then.Simultaneously, combined information provides or is stored in the internal memory for visit from now on to medium recipient (step 158).In treatment combination information, film sound tracks (step 156) at the cinema provides to the medium recipient by audio receiver/amplifier/loudspeaker 20.Meanwhile, url data may by communicate to connect 30 or network 28 (step 150) send to personal computer 22b from mobile radio communication device 22a.This step handles to go back home the filmgoer and just takes place, and this processing will be downloaded combined information to computing machine 22b from wireless device 22a.
Figure 14 has described one embodiment of the present invention, and wherein, first media content is the video frequency program that shows towards big format video.Display screen 20 among the embodiment may be the JumboTron of Sony that is applied to stadiums and public gathering place (as the Times Square in New York) TM Screen.Display screen 20 among the embodiment also comprises the display screen that is used for other public place (as market, retail shop, dining room, sports bar etc.).Relay media data 12 in real time and may derive from hard disc of computer, DVD CD, digital video tape or any other digital video source.Just right, the function of the combined information access device 16 in the present embodiment is identical with the function of the described equipment 16 of Fig. 6.Yet in the present embodiment, first-selected communicating to connect is wireless, and first-selected combined information receiving trap 22a is the mobile communication equipment as mobile phone with Bluetooth function or PDA etc.
The described embodiment of Figure 14 can be used for real-time relay (as sports tournament or concert).Sort of activity, commerce or out of Memory may be displayed in the playground big format video and show on 20.In real-time relaying process, the combined information that extracts from first video data stream 14 sends to the portable wireless device 22a that audience is carried by on-the-spot or near transmitting set 45 (see figure 6)s.For example, in university student's football match, the video information of host team can be showed on display device 20.Between match period, combined information is sent to the side information that portable wireless device guiding spectators that spectators carry obtain relevant host team or university.Simultaneously, the advertisement video in dining room will be showed near recommending, and combined information can be the special sign indicating number information of dining room guide and food or beverage discount.
Combined information may be a note of issuing on-the-spot every displacement mobile phone spectators, and wherein, note comprises special sign indicating number, and spectators can access information by special sign indicating number.For example, combined information can be to point to the webpage URL that can only use special sign indicating number visit.In one embodiment of the present invention, send and adopt Bluetooth transmission, have only mobile phone, PDA or other scene or near the equipment of Bluetooth function to receive.In an embodiment, combined information can by communicate to connect 30 or network 28 be sent to personal computer 22b from mobile radio communication device 22a.Word message there comprises a special code, and spectators can be used for the access data.This step may be gone back home spectators and just be taken place, and this processing will be downloaded combined information to computing machine 22b from wireless device 22a.
Based on another embodiment of the present invention, Figure 15 describes the method for access and first media information correlation combiner information.Although this method can be applied to a plurality of embodiment, following description is directed to the embodiment of Fig. 5 B.One associated data access device (as television/computer interface 16) receives TV media data 14 from TV media data source (step 160).Television/computer interface 16 provides first content of TV program to television display equipment 20, and simultaneously, program provides (step 162) to the medium recipient.Television/computer interface 16 is extracted or copy event data character string (step 164) from TV media stream.In this preferred embodiment, this event data character string is contained in " user data " section of mpeg stream noted earlier.
According to the event data character string, television/computer interface 16 produces graphic icons, literal or a window (step 166) that is shown on television display equipment or the computer display apparatus.These graphic icons or window are informed the side information that the medium recipient can use.When the medium recipient uses opertaing device 46 (Fig. 6) or connects the click icon of computing machine, request character string produces and sends to the third party's computer system 22b computer system of advertising message (as combine) (step 168) by connecting 24e, communication network 28 and being connected 24g from television/computer interface 16.Request character string in the step 168 sends to other third party's computer system 22b by connecting 24e, communication network 28 and being connected 24g simultaneously.The request of request character string initialization and TV programme related supplemental information.Wherein, TV programme comprises the incident character string.Request is handled by computer system 22b, and request responding will send to medium recipient (step 170) from computer system 22b.In this preferred embodiment, response sends to the e-mail server (step 172) that has medium recipient e-mail address with the Email form by communication network.The medium recipient can be by use a computer mail on the 22a bar access e-mail server of network 28.In this preferred embodiment, mail comprises side information and/or combined information (recipient obtains further side information from the website as the guiding medium).
Shown in Fig. 5 B, one embodiment of the invention comprise the TV network computer system that can communicate by letter by communication network 28 with personal computer 22a.Personal computer 22a in the present embodiment can download the application program of an access combined information from TV network computer system 27.After installation and operation application program on the personal computer 22a, the triggering character string that application program uses access television Media Stream 14 to obtain provides the side information that is kept in the TV network computer system 27.In this case, side information can comprise the plan information relevant with network TV program.Present embodiment has been showed a kind of situation, and wherein, combined information and side information stem from public resource such as TV network.But they are directly by two different communication channels.Unit's media data is by TV data source 12 (as satellite or CATV (cable television) supplier), and the combined information that derives from TV network computer system 27 is then by communication network 28.
Embodiment among Fig. 5 B says so exactly and sets up the bridge of crossing between TV and the Internet.It allows the televiewer directly to jump to internet website from TV.Use this embodiment, the Internet link of pointing to commercial advertisement can be created by advertiser.Simultaneously, embodiment makes TV network produce cross-platform experience, strengthens television program receiving by linked media in the Internet and information.TV network can use these links to receive from spectators about liking what program and interactively vote information next time.For example, the embodiment among Fig. 5 can be used to allow the televiewer to choose them in a vote to like watching what program next time.Such as, TV programme can be taken in many ways, allows the viewer polls be with A or B mode.According to voting results, TV network can select to show montage A or B.This embodiment also can allow spectators obtain to remind by Email or note and go to watch or program recording.
In the present embodiment, e-mail server 22 allows to collect a large amount of solicited messages simultaneously, and for example, server 22 is preserved and gathered access request data on all channels.These data can generate various analytical statements, how many spectators to watch, to watch how what program, spectators wait for the interest of program if any.
In the preferred embodiment of the present invention, the purpose of above-mentioned patent description is to illustrate and describe the present invention better.Illustrate and do not plan detailedly, just as far as possible accurately disclose.Above-mentioned technology is significantly revised or changed is possible.Selecting the embodiment purpose is preferably to show and practical application for the principle of the invention provides, and makes that simultaneously ordinary skill plays a role in the present invention.By different modifications with adapt in the imagination application.Reasonable in order to meet, just, the fairness doctrine, all such modifications are all in the scope of accessory claim.

Claims (35)

1, a kind of media information is transferred to medium recipient's method from the media information source, is characterised in that this method may further comprise the steps:
(a) accept media data flow from the media information source, media data flow comprises metadata and combined information, and wherein metadata comprises that monobasic display advertising and combined information point to the side information related with first display advertising;
(b) provide first display advertising according to metadata to the medium recipient;
(c) with the streamed access combined information of media data,
(d) be that the side information position is determined on the basis with the combined information;
(e) the position access side information of from (d), determining; And
(f) show side information to the medium recipient.
2, method according to claim 1 is characterized in that: also be included in step (c) back and provide combined information to the first combined information receiving trap.
3, method according to claim 2 is characterized in that: also comprise combined information is sent to the second combined information receiving trap from the first combined information receiving trap.
4, method according to claim 3, it is characterized in that: provide the step of combined information to comprise by network to the first combined information receiving trap and provide combined information to first computing equipment, this first computing equipment is selected from the group facility of being made up of server, personal computer, notebook computer, personal digital assistant and Wireless Telecom Equipment; And
The step that combined information is provided to the second combined information receiving trap from the first combined information receiving trap is by providing combined information to form from first computing equipment to second computing equipment, and second computing equipment is selected from the group facility of being made up of server, personal computer, notebook computer, personal digital assistant and Wireless Telecom Equipment; And
Step (d), (e) and (f) finish by first computing equipment or second computing equipment.
5, method according to claim 2, it is characterized in that: provide the step of combined information to comprise to the first combined information receiving trap and form by mobile radio communication device transmission combined information, and step (d), (e) and (f) finish by mobile radio communication device.
6, method according to claim 1 is characterized in that: step (a) comprises the receiving media data stream from tv services provider; And step (b) is included in shows TV programme on the television display equipment.
7, method according to claim 1 is characterized in that: step (a) comprises the receiving media data stream from broadcast program service provider; And step (b) is included in shows broadcast program on the audio frequency apparatus.
8, method according to claim 1 is characterized in that: step (a) comprises the playback equipment receiving media data stream from Digital Media, and described Digital Media playback equipment is selected from the group facility of being made up of DVD player, CD Player and digital music player.
9, method according to claim 1 is characterized in that: step (a) comprises from movie equipment receiving media data and flowing; And step (b) is included in shows the film function on cinema's projector equipment.
10, method according to claim 1 is characterized in that: step (a) comprises from video data source in real time big format video display device receiving media data stream; And step (b) comprises by in real time big format video display device shows video frequency program.
11, method according to claim 1 is characterized in that: step (c) comprise from media data flow, detect combined information, separate code combination information and duplicate through the decoding combined information to memory device.
12, method according to claim 1 is characterized in that:
Step (c) comprises from the one or more uniform resource locators of access (URL) data character string through the combined information of decoding;
Step (d) comprises from determine the network address composition of side information at least according to one or more uniform resource locators (URL) data character string;
Step (e) comprises that access comprises the step of the data file of side information in the definite network address of step (d);
Step (f) comprises that execution comprises the data file of side information, thereby shows supplementing media to the medium recipient.
13, method according to claim 1 is characterized in that: step (c) comprises the one or more data markers of access, and the indication of described data markers is deposited on the remote computer effectively in the side information.
14, a kind of device that is used to handle media data flow, described media data flow comprises metadata and combined information, metadata wherein comprises a first display advertising and relevant data point, the relevant side information of the related first display advertising of data point, be characterised in that this device comprises: an associated data access device and is used to receive combined information, access is indicated the side information of position and showed the first combined information receiving trap of side information by combined information, and described associated data access device comprises: one is used for from the input of media data receiving media data stream; One is used for from the extraction circuit of media data flow access combined information; One provides first combined information output of combined information to the combined information receiving trap; One provides the first display advertising output of first medium to first display advertising equipment.
15, device according to claim 14, it is characterized in that: the first combined information receiving trap is made up of second combined information output that combined information is provided to the second combined information receiving trap, and the output of second combined information is selected from the group facility of being made up of wireless data interface equipment and cable data interfacing equipment.
16, device according to claim 14, it is characterized in that: first combined information output comprises that a wireless data transmission transmitter and that combined information is transferred to the combined information receiving trap includes the combined information receiving trap first time of mobile radio communication device.
17, device according to claim 16 is characterized in that: described mobile radio communication device comprises and one is selected from by cell phone, has the personal digital assistant of wireless communication ability and have the group facility that the notebook computer of wireless communication ability is formed.
18, device according to claim 14, it is characterized in that: first relevant data output comprises that one feeds to the network interface of communication network transmission combined information, and the first combined information receiving trap comprises that one is connected to the computing equipment of communication network, and described computing equipment is selected from the group facility of being made up of personal computer, server, notebook computer and personal digital assistant.
19, device according to claim 14 is characterized in that: the described associated data access device and the first combined information receiving trap are placed on independent covering in the box.
20, according to the device in the claim 19, it is characterized in that: the described associated data access device and the first combined information receiving trap are the ingredient of an equipment, and this equipment is selected from the group facility of being made up of cell phone, digital media player, digital music player, DVD player, CD Player, personal digital assistant device, notebook computer, personal computer, satellite television receiving trap, CATV (cable television) receiving trap, terrestrial television receiving trap, satellite broadcast receiving device and terrestrial radio receiving trap.
21, device according to claim 14, it is characterized in that: described associated data access device is an ingredient of an equipment, and this equipment is selected from the group facility of being made up of cell phone, digital media player, digital music player, DVD player, CD Player, personal digital assistant device, notebook computer, personal computer, satellite television receiving trap, CATV (cable television) receiving trap, terrestrial television receiving trap, satellite broadcast receiving device and terrestrial radio receiving trap.
22, device according to claim 14 is characterized in that: the input of described media data flow comprises that a service provider from TV programme obtains the extraction circuit of the television data stream input of television data stream, access relevant information from television data stream and the metadata output that first TV programme is provided to the equipment of televising.
23, device according to claim 14 is characterized in that: the first combined information receiving trap is the ingredient of personal computer, and side information is provided for the display device that combines with personal computer.
24, device according to claim 14 is characterized in that: media data flow input comprises that a service provider from broadcast program receives the extraction circuit of media data flow input, access relevant information from broadcast data stream of broadcast data stream and the metadata output that the broadcast program program is provided to broadcasting equipment.
25, device according to claim 14 is characterized in that: the input of media data flow comprises that one obtains the extraction circuit of digital video input, access data video from television data stream of data video and the metadata output that digital video programs is provided to video player from the DVD read-write equipment.
26, device according to claim 14 is characterized in that: the input of media data flow comprises that a cinema film presentation device receives the extraction circuit of cinema film data input, access combined information from the cinema film data of cinema film data and the metadata output that the cinema film program is provided to the cinema film presentation device.
27, device according to claim 26 is characterized in that: the cinema film data comprise voice data.
28, device according to claim 14 is characterized in that: the input of media data flow comprises that one obtains the extraction circuit of big format video data input, access combined information from video data of video data and the metadata output that video frequency program is provided to the video data presentation device of big form from video data source for the video data presentation device of big form.
29, device according to claim 14 is characterized in that: one is used for the first combined information receiving trap that the one or more uniform resource locators of access (URL) are used to receive one or more uniform resource locators (URL) data character string at the extraction circuit, of media data flow coded data character string, determine the relevant information network address according at least one or a plurality of uniform resource locator (URL) data character string.
30, device according to claim 29 is characterized in that: the data file that comprises side information that the first combined information receiving trap is used for further carrying out is to show supplementing media.
31 1 kinds are transferred to TV media recipient's method to media information from the TV media information source, and this method comprises:
(a) accept TV media data stream from the TV media information source, TV media data stream comprises metadata and combined information, and metadata wherein comprises that the monobasic TV media shows and relevant data point, the data point association side information of first TV media displaying;
(b) on the equipment of televising, show first TV media to the medium recipient;
(c) with the streamed access combined information of TV media data;
(d) based on combined information, indication side information position from first TV media is showed;
(e) send the request of relevant side information, request is from the computer equipment that combines the TV media receiver, and transmits by communication network;
(f) determine based on the network address of asking and comprise side information;
(g) send information notification by network and send the relevant available supplemental information of the TV media recipient network address;
(h) deposit access information by the computer equipment that combines the TV media receiver via network; With
(i) computer equipment by combining the TV media receiver and via the network access side information.
32, method according to claim 31 is characterized in that: step (d) is included in and shows an icon on the TV pick-up attacnment.
33, method according to claim 31 is characterized in that:
Step (f) comprises determining of the side information network address, and these network addresss are embedded in uniform resource locator (URL) data of TV media data stream;
Step (g) comprises that transmission comprises uniform resource locator (URL) data; With
Step (i) comprises the side information of access by the appointment of uniform resource locator (URL) data.
34, method according to claim 31 is characterized in that: step (g) comprises the e-mail server send Email to the computer equipment access that combines the medium receiver.
35, method according to claim 31 is characterized in that: step (i) is included in and uses visit device access side information in the computer equipment that combines the medium receiver.
CNA2007800424577A 2006-11-15 2007-11-15 The apparatus and method of access and first media data correlation combiner information Pending CN101606171A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/559,922 2006-11-15
US11/559,922 US20070089158A1 (en) 2005-10-18 2006-11-15 Apparatus and method for providing access to associated data related to primary media data

Publications (1)

Publication Number Publication Date
CN101606171A true CN101606171A (en) 2009-12-16

Family

ID=39402478

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2007800424577A Pending CN101606171A (en) 2006-11-15 2007-11-15 The apparatus and method of access and first media data correlation combiner information

Country Status (9)

Country Link
US (1) US20070089158A1 (en)
EP (1) EP2097865A2 (en)
JP (1) JP2010510723A (en)
KR (1) KR20090080557A (en)
CN (1) CN101606171A (en)
AU (1) AU2007319185A1 (en)
BR (1) BRPI0717217A2 (en)
CA (1) CA2668697A1 (en)
WO (1) WO2008061184A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638706A (en) * 2011-02-14 2012-08-15 迪士尼企业公司 System and method for synchronizing on-air commercial programming with interactive applications
CN104809120A (en) * 2014-01-24 2015-07-29 腾讯科技(深圳)有限公司 Information processing method and device
CN105052164A (en) * 2012-11-06 2015-11-11 无线电广播技术研究所有限公司 Management of multilingual graphics for television broadcasting
CN111814714A (en) * 2020-07-15 2020-10-23 前海人寿保险股份有限公司 Image identification method, device and equipment based on audio and video recording and storage medium

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10417298B2 (en) 2004-12-02 2019-09-17 Insignio Technologies, Inc. Personalized content processing and delivery system and media
US20090019061A1 (en) * 2004-02-20 2009-01-15 Insignio Technologies, Inc. Providing information to a user
WO2008021409A2 (en) * 2006-08-14 2008-02-21 Backchannelmedia Inc. Systems and methods for accountable media planning
US20080103875A1 (en) * 2006-10-31 2008-05-01 Michael Kokernak Methods and systems for an interactive data finder
US20080167992A1 (en) * 2007-01-05 2008-07-10 Backchannelmedia Inc. Methods and systems for an accountable media advertising application
US8146126B2 (en) * 2007-02-01 2012-03-27 Invidi Technologies Corporation Request for information related to broadcast network content
US7870026B2 (en) * 2007-06-08 2011-01-11 Yahoo! Inc. Selecting and displaying advertisement in a personal media space
US8744118B2 (en) 2007-08-03 2014-06-03 At&T Intellectual Property I, L.P. Methods, systems, and products for indexing scenes in digital media
US8191088B2 (en) 2007-09-14 2012-05-29 At&T Intellectual Property I, L.P. Apparatus and method for managing media content
US8739200B2 (en) 2007-10-11 2014-05-27 At&T Intellectual Property I, L.P. Methods, systems, and products for distributing digital media
US8051455B2 (en) 2007-12-12 2011-11-01 Backchannelmedia Inc. Systems and methods for providing a token registry and encoder
US8160064B2 (en) 2008-10-22 2012-04-17 Backchannelmedia Inc. Systems and methods for providing a network link between broadcast content and content located on a computer network
US20100098074A1 (en) * 2008-10-22 2010-04-22 Backchannelmedia Inc. Systems and methods for providing a network link between broadcast content and content located on a computer network
US9094721B2 (en) 2008-10-22 2015-07-28 Rakuten, Inc. Systems and methods for providing a network link between broadcast content and content located on a computer network
US9154942B2 (en) 2008-11-26 2015-10-06 Free Stream Media Corp. Zero configuration communication between a browser and a networked media device
US10880340B2 (en) 2008-11-26 2020-12-29 Free Stream Media Corp. Relevancy improvement through targeting of information based on data gathered from a networked device associated with a security sandbox of a client device
US9386356B2 (en) 2008-11-26 2016-07-05 Free Stream Media Corp. Targeting with television audience data across multiple screens
US9986279B2 (en) 2008-11-26 2018-05-29 Free Stream Media Corp. Discovery, access control, and communication with networked services
US10631068B2 (en) 2008-11-26 2020-04-21 Free Stream Media Corp. Content exposure attribution based on renderings of related content across multiple devices
US10334324B2 (en) 2008-11-26 2019-06-25 Free Stream Media Corp. Relevant advertisement generation based on a user operating a client device communicatively coupled with a networked media device
US10567823B2 (en) 2008-11-26 2020-02-18 Free Stream Media Corp. Relevant advertisement generation based on a user operating a client device communicatively coupled with a networked media device
US8180891B1 (en) 2008-11-26 2012-05-15 Free Stream Media Corp. Discovery, access control, and communication with networked services from within a security sandbox
US9519772B2 (en) 2008-11-26 2016-12-13 Free Stream Media Corp. Relevancy improvement through targeting of information based on data gathered from a networked device associated with a security sandbox of a client device
US9961388B2 (en) 2008-11-26 2018-05-01 David Harrison Exposure of public internet protocol addresses in an advertising exchange server to improve relevancy of advertisements
US10977693B2 (en) 2008-11-26 2021-04-13 Free Stream Media Corp. Association of content identifier of audio-visual data with additional data through capture infrastructure
US10419541B2 (en) 2008-11-26 2019-09-17 Free Stream Media Corp. Remotely control devices over a network without authentication or registration
US9014832B2 (en) 2009-02-02 2015-04-21 Eloy Technology, Llc Augmenting media content in a media sharing group
TWI384878B (en) * 2009-04-13 2013-02-01 Avermedia Tech Inc Display system and display method of tv program appended information
DE102009025263A1 (en) * 2009-06-17 2010-12-30 Amusys Amusement Systems Electronics Gmbh Method and device for transmitting event data
US8463100B2 (en) * 2009-11-05 2013-06-11 Cosmo Research Company Limited System and method for identifying, providing, and presenting content on a mobile device
KR101664430B1 (en) * 2009-11-13 2016-10-10 삼성전자주식회사 Method and apparatus for providing remote UI service
KR101657119B1 (en) * 2010-04-22 2016-09-30 엘지전자 주식회사 A digital broadcast receiver and method for providing a search service
JP2012010311A (en) * 2010-05-26 2012-01-12 Sony Corp Transmitter, transmission method, receiver, reception method and transmission/reception system
US8850495B2 (en) * 2010-08-14 2014-09-30 Yang Pan Advertisement delivering system based on digital television system and mobile communication device
JP5730092B2 (en) * 2011-03-28 2015-06-03 株式会社電通 Detailed information management system
CN103797811B (en) 2011-09-09 2017-12-12 乐天株式会社 The system and method for the control contacted for consumer to interactive television
US8832750B2 (en) * 2012-05-10 2014-09-09 Time Warner Cable Enterprises Llc Media synchronization within home network using set-top box as gateway
PL2902912T3 (en) 2012-09-28 2019-04-30 Saturn Licensing Llc Information processing device, portable terminal, information processing method, program, and information processing system
US20140150017A1 (en) * 2012-11-29 2014-05-29 At&T Intellectual Property I, L.P. Implicit Advertising
CN105100863A (en) * 2014-04-28 2015-11-25 阿里巴巴集团控股有限公司 Television channel switching method and system, mobile terminal and set top box
US11794094B2 (en) * 2016-10-17 2023-10-24 Aquimo Inc. Method and system for using sensors of a control device for control of a game
US10984065B1 (en) * 2019-09-30 2021-04-20 International Business Machines Corporation Accessing embedded web links in real-time

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5883661A (en) * 1990-09-28 1999-03-16 Ictv, Inc. Output switching for load levelling across multiple service areas
US5694546A (en) * 1994-05-31 1997-12-02 Reisman; Richard R. System for automatic unattended electronic information transport between a server and a client by a vendor provided transport software with a manifest list
US5654747A (en) * 1994-12-29 1997-08-05 International Business Machines Corporation Intelligent multimedia set-top control method and apparatus in which billing signals are communicated to an information network upon presentation of downloaded media programs
US5818441A (en) * 1995-06-15 1998-10-06 Intel Corporation System and method for simulating two-way connectivity for one way data streams
JP3785579B2 (en) * 1995-11-22 2006-06-14 サムソン インフォメーション システムズ アメリカ Home multimedia network architecture
US6005861A (en) * 1995-11-22 1999-12-21 Samsung Electronics Co., Ltd. Home multimedia network architecture
US6240555B1 (en) * 1996-03-29 2001-05-29 Microsoft Corporation Interactive entertainment system for presenting supplemental interactive content together with continuous video programs
US5929849A (en) * 1996-05-02 1999-07-27 Phoenix Technologies, Ltd. Integration of dynamic universal resource locators with television presentations
CA2262737A1 (en) * 1997-06-18 1998-12-23 Shinichi Shishino Multimedia information communication system
US6553022B2 (en) * 1998-07-16 2003-04-22 Openwave Systems, Inc. Method and apparatus for providing a connection to a data network
US6970183B1 (en) * 2000-06-14 2005-11-29 E-Watch, Inc. Multimedia surveillance and monitoring system including network configuration
US6425131B2 (en) * 1998-12-30 2002-07-23 At&T Corp. Method and apparatus for internet co-browsing over cable television and controlled through computer telephony
US6556659B1 (en) * 1999-06-02 2003-04-29 Accenture Llp Service level management in a hybrid network architecture
US6795506B1 (en) * 1999-10-05 2004-09-21 Cisco Technology, Inc. Methods and apparatus for efficient scheduling and multiplexing
US6564274B1 (en) * 1999-12-17 2003-05-13 Omnicluster Technologies, Inc. Modular architecture for small computer networks
US6889385B1 (en) * 2000-01-14 2005-05-03 Terayon Communication Systems, Inc Home network for receiving video-on-demand and other requested programs and services
US6658000B1 (en) * 2000-06-01 2003-12-02 Aerocast.Com, Inc. Selective routing
US6938080B1 (en) * 2000-06-07 2005-08-30 Nortel Networks Limited Method and computer system for managing data exchanges among a plurality of network nodes in a managed packet network
JP4272801B2 (en) * 2000-08-10 2009-06-03 キヤノン株式会社 Information processing apparatus and method
US6898799B1 (en) * 2000-10-23 2005-05-24 Clearplay, Inc. Multimedia content navigation and playback
US20020083464A1 (en) * 2000-11-07 2002-06-27 Mai-Ian Tomsen System and method for unprompted, context-sensitive querying during a televison broadcast
WO2002047390A1 (en) * 2000-12-04 2002-06-13 Isurftv E-mail, telephone number or url within tv frame
US20020095677A1 (en) * 2001-01-17 2002-07-18 Davis T. Ron Method and system for supplementing television programming with e-mailed magazines
US20020138851A1 (en) * 2001-03-23 2002-09-26 Koninklijke Philips Electronics N.V. Methods and apparatus for simultaneously viewing multiple television programs
US6912517B2 (en) * 2001-11-29 2005-06-28 Koninklijke Philips Electronics N.V. Intelligent information delivery system
US20030135868A1 (en) * 2002-01-16 2003-07-17 Degeorge Martin Method and apparatus for programming the memory of NTSC capable devices using data contained in a video stream
US7831992B2 (en) * 2002-09-18 2010-11-09 General Instrument Corporation Method and apparatus for forwarding television channel video image snapshots to an auxiliary display device
US20060026067A1 (en) * 2002-06-14 2006-02-02 Nicholas Frank C Method and system for providing network based target advertising and encapsulation
CN1203403C (en) * 2003-01-17 2005-05-25 天图信息技术(上海)有限公司 Background downloading device and method in net video network advertiing system
US20050185635A1 (en) * 2003-07-30 2005-08-25 C.L. Nagendra Virtual service provider system and method for delivering media services to an end user
US8171516B2 (en) * 2004-02-24 2012-05-01 At&T Intellectual Property I, L.P. Methods, systems, and storage mediums for providing multi-viewpoint media sharing of proximity-centric content
JP2006019949A (en) * 2004-06-30 2006-01-19 Toshiba Corp Communication device and communication control method
US9021520B2 (en) * 2004-09-29 2015-04-28 Hewlett-Packard Development Company, L.P. Systems and methods for providing and processing print-augmented broadcast signals

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638706A (en) * 2011-02-14 2012-08-15 迪士尼企业公司 System and method for synchronizing on-air commercial programming with interactive applications
CN102638706B (en) * 2011-02-14 2015-04-15 迪士尼企业公司 System and method for synchronizing on-air commercial programming with interactive applications
CN105052164A (en) * 2012-11-06 2015-11-11 无线电广播技术研究所有限公司 Management of multilingual graphics for television broadcasting
CN104809120A (en) * 2014-01-24 2015-07-29 腾讯科技(深圳)有限公司 Information processing method and device
CN111814714A (en) * 2020-07-15 2020-10-23 前海人寿保险股份有限公司 Image identification method, device and equipment based on audio and video recording and storage medium
CN111814714B (en) * 2020-07-15 2024-03-29 前海人寿保险股份有限公司 Image recognition method, device, equipment and storage medium based on audio and video recording

Also Published As

Publication number Publication date
WO2008061184A3 (en) 2008-08-07
KR20090080557A (en) 2009-07-24
EP2097865A2 (en) 2009-09-09
BRPI0717217A2 (en) 2013-09-24
CA2668697A1 (en) 2008-05-22
WO2008061184A2 (en) 2008-05-22
AU2007319185A1 (en) 2008-05-22
US20070089158A1 (en) 2007-04-19
JP2010510723A (en) 2010-04-02

Similar Documents

Publication Publication Date Title
CN101606171A (en) The apparatus and method of access and first media data correlation combiner information
US20080288600A1 (en) Apparatus and method for providing access to associated data related to primary media data via email
CN105392022B (en) Information interacting method and device based on audio frequency watermark
US10235025B2 (en) Various systems and methods for expressing an opinion
US20180167686A1 (en) Interactive distributed multimedia system
KR102227686B1 (en) Pushing content to secondary connected devices
KR101774039B1 (en) Automatic media asset update over an online social network
US8407752B2 (en) Synchronizing broadcast content with corresponding network content
US10681429B2 (en) System and method for internet protocol television product placement data
US9621963B2 (en) Enabling delivery and synchronization of auxiliary content associated with multimedia data using essence-and-version identifier
US20110214143A1 (en) Mobile device application
US20070124789A1 (en) Wireless interactive communication system
US20130301392A1 (en) Methods and apparatuses for communication of audio tokens
US10699296B2 (en) Native video advertising with voice-based ad management and machine-to-machine ad bidding
JP2001507533A (en) Interactive audiovisual programs
CN102129636A (en) System and method for providing viewer identification-based advertising
TW200926036A (en) Bookmarking in videos
KR20120103961A (en) Apparatus for personalized related advertisement, mobile for playing related advertisement and method for providing personalized related advertisement
KR101607649B1 (en) Apparatus for providing contents inserted music and advertisement based on music sharing service and method thereof
EP2271048B1 (en) Method for provisioning a multimedia service
KR101537547B1 (en) On-line live-broadcasting advertisement system and method using overlay streaming
BRPI1102545A2 (en) method and system to synchronize and allow the interactivity of program content and advertising broadcast on television with interactive media such as the internet, mobile and social networks, implementing through signal identifying the programming item being broadcasted, a signal that is sent by the broadcaster TV for the inventor's software and platform
CN106982375A (en) Information-pushing method, system and TV
TW200839671A (en) Cross-platform advertisement method and device for digital TV
TW476894B (en) Method for controlling a computer using an embedded unique code in the content of recording media

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Open date: 20091216