CN106454441B - Method, front end, terminal and system for accurate advertisement and information delivery of live television - Google Patents

Method, front end, terminal and system for accurate advertisement and information delivery of live television Download PDF

Info

Publication number
CN106454441B
CN106454441B CN201610944213.9A CN201610944213A CN106454441B CN 106454441 B CN106454441 B CN 106454441B CN 201610944213 A CN201610944213 A CN 201610944213A CN 106454441 B CN106454441 B CN 106454441B
Authority
CN
China
Prior art keywords
frame
audio
stream
information
tag data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610944213.9A
Other languages
Chinese (zh)
Other versions
CN106454441A (en
Inventor
吴景轩
周爱
张淼舰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China (hefei) Technology Co Ltd
Original Assignee
China (hefei) Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China (hefei) Technology Co Ltd filed Critical China (hefei) Technology Co Ltd
Priority to CN201610944213.9A priority Critical patent/CN106454441B/en
Publication of CN106454441A publication Critical patent/CN106454441A/en
Application granted granted Critical
Publication of CN106454441B publication Critical patent/CN106454441B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2668Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389Multiplex stream processing, e.g. multiplex stream encrypting
    • H04N21/23895Multiplex stream processing, e.g. multiplex stream encrypting involving multiplex stream encryption
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6143Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a satellite

Abstract

The application provides a method, a front end, a terminal and a system for accurate advertisement and information delivery of live television, wherein the method of the front end side comprises the following steps: encoding audio and video data to form audio and video TS (transport stream) flow, wherein the audio and video data comprise replaceable programs and non-replaceable programs; determining frame tag data of each frame of image of audio and video data, and encoding the frame tag data to form a frame tag data TS stream, wherein the frame tag data comprises a frame characteristic value, program information, a start frame mark and an end frame mark; broadcasting the frame tag data TS stream and the audio and video TS stream to a terminal by a satellite broadcasting system; and determining the accurate advertisement/information corresponding to the replaceable program, establishing a mapping relation between the replaceable program and the accurate advertisement/information, and sending the accurate advertisement/information and the mapping relation to the terminal or broadcasting the accurate advertisement/information and the mapping relation to the terminal by a satellite broadcasting system. The method and the system have the advantages that the front-end environment does not need to be replaced, the original framework is not influenced, accurate advertisement/information can be put in the unidirectional network and the bidirectional network, and the method and the system are easy to deploy.

Description

Method, front end, terminal and system for accurate advertisement and information delivery of live television
Technical Field
The application belongs to the technical field of digital televisions, and particularly relates to a method, a front end, a terminal and a system for accurate advertisement and information delivery of live television.
Background
When the traditional television station and operators play advertisements, different advertisements can not be delivered according to different users like internet video manufacturers, so that the advertisement delivery value is low, the valuable delivery and coverage capacity is wasted, the value maximization is not achieved in the aspect of advertisement income, and more accurate advertisement delivery is urgently needed, so that the income is increased and the competitiveness is improved.
In view of the above problems, a technical solution for accurate advertisement delivery in live tv has appeared, which needs to insert an identification tag into a live program (including a replaceable program and a non-replaceable program), and replace the replaceable program with an accurate advertisement according to the identification tag, but the solution has the problems of complex processing process and narrow application range (if the solution is not suitable for a scenario where a program provider does not allow modification).
Disclosure of Invention
The application provides a method, a front end, a terminal and a system for accurate advertisement and information delivery of a live television, which are used for solving the problems that in the prior art, an accurate advertisement replacement scheme is complex in processing process, narrow in application range and not suitable for the situation that a program provider does not allow a program to be modified.
In order to solve the above technical problem, a technical solution of the present application is a method for providing accurate advertisement and information delivery of live tv described from a front end side, including: encoding audio and video data to form audio and video TS (transport stream) flow, wherein the audio and video data comprise replaceable programs and non-replaceable programs;
determining frame tag data of each frame of image of the audio and video data, and encoding the frame tag data to form a frame tag data TS (transport stream) stream, wherein the frame tag data comprises a frame characteristic value, program information, a start frame mark and an end frame mark;
broadcasting the frame tag data TS stream and the audio and video TS stream to a terminal by a satellite broadcasting system;
and determining the accurate advertisement/information corresponding to the replaceable program, establishing a mapping relation between the replaceable program and the accurate advertisement/information, and sending the accurate advertisement/information and the mapping relation to a terminal or a satellite broadcasting system to broadcast the accurate advertisement/information and the mapping relation to the terminal.
The application further provides a method for accurate advertisement and information delivery of live television, which is described from a terminal side, and the method comprises the following steps: receiving and storing the mapping relation between the accurate advertisement/information, the replaceable program and the accurate advertisement/information;
receiving and caching audio and video TS (transport stream) and frame tag data TS which are broadcast by a satellite broadcasting system;
decoding the cached audio and video TS stream by a first decoding module; extracting frame tag data in a cached frame tag data TS stream, wherein the frame tag data comprises a frame characteristic value, program information, a starting frame mark and an ending frame mark; calculating a frame characteristic value of each frame of cached image;
matching corresponding program information and a start frame mark from the frame tag data according to the frame characteristic value of the next display frame image, judging whether the next display frame is a start frame of a replaceable program according to the program information and the start frame mark, and switching the first decoding module to a second decoding module if the next display frame is the start frame of the replaceable program;
and obtaining the corresponding accurate advertisement/information of the replaceable program according to the frame characteristic value of each frame of cached image and the mapping relation, and loading the corresponding accurate advertisement/information to the second decoding module for decoding.
The application also provides a front end for accurate advertisement and information delivery of the live television, which comprises a live broadcast platform, an advertisement/information delivery operation platform and a satellite delivery system, wherein the live broadcast platform comprises an audio and video encoder and a frame tag data encoder;
the audio and video encoder is used for encoding audio and video data to form audio and video TS (transport stream) flow, and the audio and video data comprise replaceable programs and non-replaceable programs;
the frame tag data encoder is used for determining frame tag data of each frame of image of the audio and video data, the frame tag data are encoded to form a frame tag data TS stream, and the frame tag data comprise a frame characteristic value, program information, a start frame mark and an end frame mark;
the satellite broadcasting system broadcasts the frame tag data TS stream and the audio and video TS stream to a terminal;
the advertisement/information delivery operation platform is used for determining accurate advertisement/information corresponding to the replaceable program, establishing a mapping relation between the replaceable program and the accurate advertisement/information, and sending the accurate advertisement/information and the mapping relation to a terminal or a satellite broadcast system to the terminal.
The application also provides a terminal for the accurate advertisement and information delivery of the live television, which comprises: the device comprises a first receiving module, a second receiving module, a first decoding module, a second decoding module, a calculating module, an extracting module, a switching module and a frame tag data processing module;
the second receiving module is used for receiving and storing the mapping relation between the accurate advertisement/information, the replaceable program and the accurate advertisement/information;
the first receiving module is used for receiving and caching audio and video TS (transport stream) and frame tag data TS (transport stream) broadcasted by the satellite broadcasting system;
the first decoding module is used for decoding audio and video TS stream;
the extraction module is used for extracting frame tag data in a cached frame tag data TS stream, wherein the frame tag data comprises a frame characteristic value, program information, a starting frame mark and an ending frame mark;
the calculation module is used for calculating the frame characteristic value of each frame of cached image;
the frame tag data processing module is used for matching corresponding program information and a start frame mark from the frame tag data according to a frame characteristic value of a next display frame image, judging whether a next display frame is a start frame of a replaceable program according to the program information and the start frame mark, if the next display frame is the start frame of the replaceable program, sending a first switching instruction to the switching module, and switching the first decoding module to a second decoding module by the switching module according to the first switching instruction;
the frame tag data processing module is further configured to obtain accurate advertisements/information corresponding to the replaceable program according to the frame feature value of each frame of the cached image and the mapping relationship, and load the corresponding accurate advertisements/information to the second decoding module for decoding.
The application also provides a system for the accurate advertisement and information delivery of the live television, which comprises the front end and the terminal of the embodiment.
The method comprises the steps of analyzing audio and video data to obtain frame tag data (including a frame characteristic value and program information) of each frame of image of the audio and video data, and sending the frame tag data to a terminal; the terminal can judge whether the next display frame is the start frame of the replaceable program or not according to the frame characteristic value of the next display frame and the frame label data, and if the next display frame is the start frame of the replaceable program, the terminal is switched to a second decoding module for playing accurate advertisements/information; and according to the frame characteristic value and the mapping relation (the mapping relation between the replaceable program and the accurate advertisement/information) of each frame of image cached by the terminal, the corresponding accurate advertisement/information can be obtained, and the corresponding accurate advertisement/information is loaded to the second decoding module for decoding. The method and the device are suitable for the condition that program providers do not allow to modify program contents, the front end (operators) do not need to change the foreground environment, the original architecture is not influenced, accurate advertisement/information can be put in under a one-way network and a two-way network, the method and the device have the characteristic of easiness in deployment, and the experience of the operators can be improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a flowchart of a method for accurate advertisement and information delivery of a front-end live television according to an embodiment of the present application;
FIG. 2 is a flow chart of a process for determining frame tag data according to an embodiment of the present application;
fig. 3 is a flowchart of a method for delivering precise advertisements and information directly broadcast by a terminal side in an embodiment of the present application;
fig. 4 is a front-end structure diagram of the precise advertisement and information delivery of the live tv in the embodiment of the present application;
FIG. 5 is a diagram illustrating a frame tag data format according to an embodiment of the present application;
fig. 6 is a terminal structure diagram of the precise advertisement and information delivery of the live television according to the embodiment of the present application.
Detailed Description
In order to make the technical features and effects of the present application more obvious, the technical solutions of the present application are further described below with reference to the accompanying drawings, and the present application may also be described or implemented by other different specific examples, and any equivalent changes made by those skilled in the art within the scope of the claims are included in the protection scope of the present application.
In the description herein, reference to the description of the terms "one embodiment," "a particular embodiment," "some embodiments," "for example," "an example," "a particular instance," or "some examples," etc., means that a particular feature, structure, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. The sequence of steps involved in the various embodiments is provided to schematically illustrate the practice of the invention, and the sequence of steps is not limited and can be suitably adjusted as desired.
As used herein, "first," "second," …, etc., are not specifically intended to mean in a sequential or chronological order, nor are they intended to limit the application, but merely to distinguish between elements or operations described in the same technical language.
As used herein, the terms "comprising," "including," "having," "containing," and the like are open-ended terms that mean including, but not limited to.
The replaceable programs described in the present application are, for example, advertisements, trailers, public films, etc., the contents that may not be of interest to the user, and the non-replaceable programs are the programs that the user wants to watch, such as news simulcasts, television dramas, entertainment programs, etc.
As shown in fig. 1, fig. 1 is a flowchart of a method for accurate advertisement and information delivery of a front-end live television according to an embodiment of the present application. The embodiment is used for solving the problems that the precise advertisement replacement scheme in the prior art is complex in processing process and narrow in application range, and can be applied to the situation that a program provider does not allow a program to be modified. Specifically, the method comprises the following steps:
step 101: and encoding audio and video data to form audio and video TS (transport stream) flow, wherein the audio and video data comprises replaceable programs and non-replaceable programs. Step 101 is a real-time process, the audio and video data is obtained from the broadcast control system, and the encoding of the audio and video data is completed in the process of obtaining the audio and video data.
Step 102: and determining frame tag data of each frame of image of the audio and video data, and encoding the frame tag data to form a frame tag data TS stream, wherein the frame tag data comprises a frame characteristic value, program information, a start frame mark and an end frame mark. Step 102 is also a real-time process. In order to facilitate the terminal to extract the frame tag data TS stream, during the encoding, a specific PID value is set in the frame tag data TS packet, and the frame tag data TS stream can be obtained only by extracting the TS packet with the specific PID value by the terminal.
Step 103: and broadcasting the frame tag data TS stream and the audio and video TS stream to the terminal by the satellite broadcasting system. In specific implementation, the frame tag data TS stream and the audio/video TS stream need to be multiplexed and then broadcast to the terminal.
In detail, for a satellite operator, a terminal can directly receive a multiplexed TS stream (including a frame tag data TS stream and an audio/video TS stream) broadcast by a direct broadcast satellite; for a cable operator, a terminal cannot directly receive a multiplexed TS stream broadcasted by a direct broadcast satellite, but receives an audio and video TS stream and a frame tag data TS stream through the cable operator.
Step 104: and determining the accurate advertisement/information corresponding to the replaceable program, establishing a mapping relation between the replaceable program and the accurate advertisement/information, and sending the accurate advertisement/information and the mapping relation to a terminal or a satellite broadcasting system for broadcasting to the terminal.
In practice, step 104 is performed in an advertisement/information delivery operation platform, and may determine the precise advertisement/information corresponding to the replaceable program according to the program information, where the program information may be obtained from a program list provided by a broadcast control system (unidirectional network), or obtained from a program list fed back by a terminal (bidirectional network), or obtained from frame tag data.
The mapping relationship between the replaceable program and the precise advertisement/information is a mapping relationship between frame tag data of each frame image of the replaceable program and the precise advertisement/information, or a mapping relationship between frame feature values of each frame image of the replaceable program and the precise advertisement/information, or a mapping relationship between program information of the replaceable program and the precise advertisement/information, specifically, for example, a mapping relationship between a program name (ID) of the replaceable program and a program name (ID) of the precise advertisement/information. The method and the device do not limit the specific mapping relation, and only need to ensure that the terminal can determine accurate advertisements/information according to the frame characteristic value of each frame of cached images.
Further, as shown in fig. 2, the determining, in step 102, frame tag data of each frame image of the audio-video data includes:
step 201: and calculating the frame characteristic value of each frame of image of the audio and video data. The frame characteristic value can uniquely identify each frame of image, and various methods exist for calculating the frame characteristic value, such as calculation according to each pixel value in one frame of image.
Step 202: and matching the frame characteristic value from a frame tag database to obtain corresponding frame tag data. The method is convenient for modular operation and improves the generation process of the frame label data.
The frame tag database establishment process comprises the following steps: the audio and video data are acquired from a media asset database in advance, the frame characteristic value of each frame image of the audio and video data acquired in advance is calculated, a starting frame mark and an ending frame mark of a program are determined, and the starting/ending frame mark is used for identifying whether the frame image is a starting frame or an ending frame;
and generating frame tag data according to a frame characteristic value, a starting frame mark, an ending frame mark and a program list of the audio and video data, which are acquired in advance, of each frame image of the audio and video data.
Further, step 202 may also be implemented to generate frame tag data in real time according to the frame feature value, the audio/video data (for determining a start frame flag and an end frame flag), and the program list of the audio/video data.
In detail, the media asset database is an original database of the television station and is used for storing audio and video data to be played. The program listings are used to provide program information including, but not limited to: program name (which may be a program ID), program attributes (which identify whether an alternative program is available).
Further, in order to improve the data security, before the multiplexing processing is performed on the frame tag data TS stream and the audio/video TS stream in step 103, the method further includes: and respectively scrambling the frame tag data TS stream and the audio and video TS stream.
As shown in fig. 3, fig. 3 is a flowchart of a method for delivering precise television advertisements and information directly on a terminal side according to an embodiment of the present application. Specifically, the method comprises the following steps:
step 301: and receiving and storing the mapping relation between the precise advertisement/information and the replaceable program and the precise advertisement/information.
Step 302: and receiving and caching audio and video TS (transport stream) and frame tag data TS which are broadcast by a satellite broadcasting system.
In implementation, the received multiplexed stream of the audio and video TS stream and the frame tag data TS stream may be determined by searching for a TS packet with a predetermined PID value.
Step 303: decoding the cached audio and video TS stream by a first decoding module; extracting frame tag data in a cached frame tag data TS stream, wherein the frame tag data comprises a frame characteristic value, program information, a starting frame mark and an ending frame mark; and calculating the frame characteristic value of each frame of the buffered image. The frame characteristic value can uniquely identify each frame of image and can be determined according to the pixel value of each frame of image, and the generation algorithm of the frame characteristic value is not limited in the application.
Step 304: and matching corresponding program information and a start frame mark from the frame tag data according to the frame characteristic value of the next display frame image, judging whether the next display frame is the start frame of the replaceable program or not according to the program information and the start frame mark, and switching the first decoding module to the second decoding module if the next display frame is the start frame of the replaceable program.
Wherein, the program information includes but is not limited to: program name (which may be a program ID), program attributes (which identify whether an alternative program is available).
In practice, the first decoding module and the second decoding module may be two input ports of the same decoder, or two decoders.
Specifically, the detailed process of step 304 is: matching the frame characteristic value of the next display frame image with the frame characteristic value in the frame tag data, determining the corresponding program information and the start frame mark after matching the frame characteristic value of the next display frame image, judging whether the next frame image is a replaceable program according to the program information, if so, judging whether the next frame image is a start frame according to the start frame mark, and if so, switching the next frame image to a second decoding module by the first decoding module.
Step 305: and obtaining the corresponding accurate advertisement/information of the replaceable program according to the frame characteristic value of each frame of cached image and the mapping relation, and loading the corresponding accurate advertisement/information to the second decoding module for decoding.
Specifically, if the mapping relationship is a mapping relationship between a frame characteristic value of each frame of image of the replaceable program and the accurate advertisement/information, the frame characteristic value of each frame of image cached in the mapping relationship is searched, and if at least one frame characteristic value of the cached video data can be searched, the corresponding accurate advertisement/information is loaded to the second decoding module.
If the mapping relation is the mapping relation between the replaceable program ID and the accurate advertisement/information ID, firstly, the frame characteristic value of each frame of cached image is matched with the frame characteristic value in the frame tag data, after the frame characteristic value is matched, the corresponding program ID is determined, whether the corresponding accurate advertisement/information ID exists or not is searched in the mapping relation, and if the corresponding accurate advertisement/information ID exists, the corresponding accurate advertisement/information is loaded to the second decoding module.
In practice, the present application does not limit the sequence of the above steps, and step 301 and step 302 may be performed simultaneously, or step 304 may be performed first and then step 305 may be performed, or step 305 may be performed first and then step 304 may be performed.
Further, the method further comprises the step 306: and judging whether the next display frame is the start frame of the non-replacement program or not according to the program information and the start frame mark, and if the next display frame is the start frame of the non-replacement program, switching the second decoding module to the first decoding module.
The method comprises the steps of analyzing audio and video data to obtain frame tag data (including a frame characteristic value and program information) of each frame of image of the audio and video data, and sending the frame tag data to a terminal; the terminal can judge whether the next display frame is the start frame of the replaceable program or not according to the frame characteristic value of the next display frame and the frame label data, and if the next display frame is the start frame of the replaceable program, the terminal is switched to a second decoding module for playing accurate advertisements/information; and according to the frame characteristic value and the mapping relation (the mapping relation between the replaceable program and the accurate advertisement/information) of each frame of image cached by the terminal, the corresponding accurate advertisement/information can be obtained, and the corresponding accurate advertisement/information is loaded to the second decoding module for decoding. The method and the device are suitable for the condition that program providers do not allow to modify program contents, the front end (operators) do not need to change the front end environment, the original architecture is not influenced, accurate advertisement/information can be put in under a one-way network and a two-way network, the method and the device have the characteristic of easiness in deployment, and the experience of the operators can be improved.
As shown in fig. 4, fig. 4 is a front-end structure diagram of accurate advertisement and information delivery of live tv in the embodiment of the present application. Specifically, the front end comprises a live broadcast platform, an advertisement/information delivery operation platform 405 and a satellite broadcasting system 404, wherein the live broadcast platform comprises an audio and video encoder 401 and a frame tag data encoder 402;
the audio/video encoder 401 is configured to encode audio/video data to form an audio/video TS stream. The audio and video data comprises replaceable programs and non-replaceable programs and is obtained from a broadcast control system of the live broadcast platform, the broadcast control system is connected with a media asset database, and the media asset database stores the audio and video data to be played.
The frame tag data encoder 402 is configured to determine frame tag data of each frame of image of the audio/video data, encode the frame tag data to form a frame tag data TS stream, where the frame tag data includes a frame characteristic value, program information, a start frame flag, and an end frame flag, and the program information is provided by a program list and at least includes a program name and a program attribute.
In a specific embodiment, the format of the frame tag data is as shown in fig. 5, and a value calculated according to an image pixel is recorded at a frame feature value 1; the ID value corresponding to the program is recorded at the program name 2; the program attribute 3 identifies whether the program is a replaceable program, if so, the corresponding program is a replaceable program, and if so, the corresponding program is a non-replaceable program; the start frame mark 4 identifies whether the frame image is a start frame, if so, the frame image is a start frame, and if so, the frame image is not a start frame; the end frame flag 5 identifies whether the frame image is an end frame, and if so, the frame image is not an end frame.
The frame tag data TS stream and the audio/video TS stream are broadcast to the terminal by the satellite broadcast system 404. In a specific implementation, the system further includes a multiplexer 403, where the multiplexer 403 is configured to multiplex the frame tag data TS stream and the audio/video TS stream, and then the satellite broadcasting system 404 broadcasts the multiplexed TS stream to the terminal.
The advertisement/information delivery operation platform 405 is configured to determine accurate advertisement/information corresponding to the replaceable program, establish a mapping relationship between the replaceable program and the accurate advertisement/information, and send the accurate advertisement/information and the mapping relationship to a terminal or a satellite delivery system 404 delivers the accurate advertisement/information and the mapping relationship to the terminal. In specific implementation, each live broadcast platform (television station) corresponds to an advertisement/information delivery operation platform so as to make accurate advertisement/information according to a broadcasting plan of the television station.
In the embodiment, only the frame tag data encoder is accessed to the original direct broadcasting platform system, the front end (operator) does not need to change the foreground environment, the original architecture is not influenced, accurate advertisement/information can be put in both the unidirectional network and the bidirectional network, the frame tag data encoder has the characteristic of easy deployment, and the experience of the operator can be improved.
Further, a frame tag database 406 is further included, and the process of determining the frame tag data of each frame image of the audio-video data by the frame tag data encoder 402 includes:
and calculating a frame characteristic value of each frame of image of the audio and video data, matching the frame characteristic value from a frame tag database 406 to obtain corresponding frame tag data, or generating the frame tag data according to the frame characteristic value, the audio and video data and a program list of the audio and video data.
In implementation, each frame of image can be uniquely identified by the frame characteristic value, and various methods exist for calculating the frame characteristic value, such as calculation according to each pixel value in one frame of image.
The frame tag database 406 is established by a frame tag production system, and the establishment process includes: the audio and video data are acquired from a media asset database in advance, the frame characteristic value of each frame image of the audio and video data which are acquired in advance is calculated, and a starting frame mark and an ending frame mark of a program are determined; and generating frame tag data according to the pre-acquired frame characteristic value of each frame image of the audio and video data, the start frame mark, the end frame mark and the program list of the audio and video data.
Further, in order to ensure the security of data transmission, a first scrambler 407, a second scrambler 408 and a security system are also included. The first scrambler 407 is configured to scramble the audio/video TS stream; the second scrambler 408 is configured to scramble the frame tag data TS stream.
Further, as shown in fig. 6, fig. 6 is a terminal structure diagram of the precise advertisement and information delivery of the live television according to the embodiment of the present application. Specifically, the terminal includes: a first receiving module 601, a second receiving module 602, a first decoding module 603, a second decoding module 604, a calculating module 605, an extracting module 606, a switching module 607 and a frame tag data processing module 608.
The second receiving module 602 is configured to receive and store the precise advertisement/information, the frame feature value of the replaceable program, and the mapping relationship of the precise advertisement/information. In implementation, the second receiving module 602 is controlled by the frame tag data processing module 608, and after receiving the accurate advertisement/information, the second receiving module 602 performs signature verification first, and sends the acquisition completion information to the frame tag data processing module 608 after the signature verification is passed.
The first receiving module 601 is configured to receive and cache an audio/video TS stream and a frame tag data TS stream broadcast by a satellite broadcast system.
The first decoding module 603 is configured to decode an audio/video TS stream.
The extracting module 606 is configured to extract frame tag data in a frame tag data TS stream, where the frame tag data includes a frame feature value, program information, a start frame flag, and an end frame flag.
The calculating module 605 is configured to calculate a frame feature value of each frame of the buffered image. When the method is implemented, the calculation module acquires the cached image data of each frame according to the storage address of the cached image.
The frame tag data processing module 608 is configured to match corresponding program information and a start frame flag from the frame tag data according to a frame feature value of a next display frame image, determine whether a next display frame is a start frame of a replaceable program according to the program information and the start frame flag, send a first switching instruction to the switching module 607 if the next display frame is the start frame of the replaceable program, and switch the first decoding module 603 to the second decoding module 604 by the switching module 607 according to the first switching instruction.
The frame tag data processing module 608 is further configured to obtain the corresponding accurate advertisement/information of the replaceable program according to the frame feature value of each frame of the cached image and the mapping relationship, and load the corresponding accurate advertisement/information to the second decoding module for decoding 604.
Further, the frame tag data processing module 608 is further configured to determine whether a next display frame is a start frame of a non-replacement program according to the program information and the start frame flag, and if the next display frame is the start frame of the non-replacement program, send a second switching instruction to the switching module 607, and the switching module 607 switches the second decoding module to the first decoding module according to the second switching instruction.
In an embodiment of the present application, a system for accurate advertisement and information delivery of a live tv is further provided, and specifically, the system includes the front end in any of the above embodiments and the terminal in any of the above embodiments. Since the front end and the terminal have been described in detail in the above embodiments, they are not described herein again.
The method comprises the steps of analyzing audio and video data to obtain frame tag data (including a frame characteristic value and program information) of each frame of image of the audio and video data, and sending the frame tag data to a terminal; the terminal can judge whether the next display frame is the start frame of the replaceable program or not according to the frame characteristic value of the next display frame and the frame label data, and if the next display frame is the start frame of the replaceable program, the terminal is switched to a second decoding module for playing accurate advertisements/information; and according to the frame characteristic value and the mapping relation (the mapping relation between the replaceable program and the accurate advertisement/information) of each frame of image cached by the terminal, the corresponding accurate advertisement/information can be obtained, and the corresponding accurate advertisement/information is loaded to the second decoding module for decoding. The method and the device are suitable for the condition that program providers do not allow to modify program contents, the front end (operators) do not need to change the foreground environment, the original architecture is not influenced, accurate advertisement/information can be put in under a one-way network and a two-way network, the method and the device have the characteristic of easiness in deployment, and the experience of the operators can be improved.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only for the purpose of illustrating the present disclosure, and any person skilled in the art can modify and change the above embodiments without departing from the spirit and scope of the present disclosure. Therefore, the protection scope of the claims of the present application shall be subject to the claims.

Claims (15)

1. A method for accurate advertisement and information delivery of live television is characterized by comprising the following steps:
encoding audio and video data to form audio and video TS (transport stream) flow, wherein the audio and video data comprise replaceable programs and non-replaceable programs;
determining frame tag data of each frame of image of the audio and video data, and encoding the frame tag data to form a frame tag data TS (transport stream) stream, wherein the frame tag data comprises a frame characteristic value, program information, a start frame mark and an end frame mark;
the satellite broadcasting system multiplexes the frame tag data TS stream and the audio/video TS stream and broadcasts the multiplexed stream to a terminal, wherein the multiplexing of the frame tag data TS stream and the audio/video TS stream comprises the following steps: directly multiplexing the frame tag data TS stream and the audio and video TS stream for a satellite operator, or transcoding the audio and video TS stream for a cable operator, and multiplexing the transcoded audio and video TS stream and the frame tag data TS stream;
and determining the accurate advertisement/information corresponding to the replaceable program, establishing a mapping relation between the replaceable program and the accurate advertisement/information, and sending the accurate advertisement/information and the mapping relation to a terminal or a satellite broadcasting system to broadcast the accurate advertisement/information and the mapping relation to the terminal.
2. The method for precise advertisement and information delivery of live television of claim 1, wherein determining the frame tag data of each frame image of the audio-video data comprises:
calculating a frame characteristic value of each frame of image of the audio and video data;
and matching the frame characteristic value from a frame tag database to obtain corresponding frame tag data, or generating the frame tag data according to the frame characteristic value, the audio and video data and a program list of the audio and video data.
3. The method for precise advertisement and information delivery of live television of claim 2, wherein the frame tag database establishing process comprises:
the audio and video data are acquired from a media asset database in advance, and a frame characteristic value, a starting frame mark and an ending frame mark of each frame image of the audio and video data which are acquired in advance are calculated;
and generating frame tag data according to the pre-acquired frame characteristic value, the start frame mark, the end frame mark and the program list of the audio and video data of each frame image of the audio and video data.
4. The method for precise advertisement and information delivery of live television as claimed in any one of claims 1 to 3, wherein the program information is provided by a program list and comprises program name and program attribute.
5. The method for accurate advertisement and information delivery of live television as claimed in claim 1, wherein the process of determining the accurate advertisement/information corresponding to the replaceable program comprises:
and searching the accurate advertisement/information corresponding to the replaceable program according to the program information.
6. A method for accurate advertisement and information delivery of live television is characterized by comprising the following steps:
receiving and storing the mapping relation between the accurate advertisement/information, the replaceable program and the accurate advertisement/information;
receiving and caching an audio and video TS stream and a frame tag data TS stream which are broadcasted by a satellite broadcasting system and are subjected to multiplexing processing, wherein the audio and video TS stream and the frame tag data TS stream which are subjected to multiplexing processing are as follows: directly multiplexing the frame tag data TS stream and the audio and video TS stream for a satellite operator, or transcoding the audio and video TS stream for a cable operator, and multiplexing the transcoded audio and video TS stream and the frame tag data TS stream;
decoding the cached audio and video TS stream by a first decoding module; extracting frame tag data in a cached frame tag data TS stream, wherein the frame tag data comprises a frame characteristic value, program information, a starting frame mark and an ending frame mark; calculating a frame characteristic value of each frame of cached image;
matching corresponding program information and a start frame mark from the frame tag data according to the frame characteristic value of the next display frame image, judging whether the next display frame is a start frame of a replaceable program according to the program information and the start frame mark, and switching the first decoding module to a second decoding module if the next display frame is the start frame of the replaceable program;
and obtaining the corresponding accurate advertisement/information of the replaceable program according to the frame characteristic value of each frame of cached image and the mapping relation, and loading the corresponding accurate advertisement/information to the second decoding module for decoding.
7. The method for accurate advertisement and information delivery of live television of claim 6, further comprising: and judging whether the next display frame is the start frame of the non-replacement program or not according to the program information and the start frame mark, and if the next display frame is the start frame of the non-replacement program, switching the second decoding module to the first decoding module.
8. A front end for accurate advertisement and information delivery of a live broadcast television is characterized by comprising a live broadcast platform, an advertisement/information delivery operation platform and a satellite broadcast system, wherein the live broadcast platform comprises an audio and video encoder and a frame tag data encoder;
the audio and video encoder is used for encoding audio and video data to form audio and video TS (transport stream) flow, and the audio and video data comprise replaceable programs and non-replaceable programs;
the frame tag data encoder is used for determining frame tag data of each frame of image of the audio and video data, the frame tag data are encoded to form a frame tag data TS stream, and the frame tag data comprise a frame characteristic value, program information, a start frame mark and an end frame mark;
the satellite broadcasting system multiplexes the frame tag data TS stream and the audio/video TS stream and broadcasts the multiplexed stream to a terminal, wherein the multiplexing of the frame tag data TS stream and the audio/video TS stream comprises the following steps: directly multiplexing the frame tag data TS stream and the audio and video TS stream for a satellite operator, or transcoding the audio and video TS stream for a cable operator, and multiplexing the transcoded audio and video TS stream and the frame tag data TS stream;
the advertisement/information delivery operation platform is used for determining accurate advertisement/information corresponding to the replaceable program, establishing a mapping relation between the replaceable program and the accurate advertisement/information, and sending the accurate advertisement/information and the mapping relation to a terminal or a satellite broadcast system to the terminal.
9. The front end of the precise advertisement and information delivery of the live television of claim 8, further comprising a frame tag database, wherein the process of determining the frame tag data of each frame of image of the audio/video data by the frame tag data encoder comprises:
calculating a frame characteristic value of each frame of image of the audio and video data;
and matching the frame characteristic value from a frame tag database to obtain corresponding frame tag data, or generating the frame tag data according to the frame characteristic value, the audio and video data and a program list of the audio and video data.
10. The live-tv precision advertising and information delivery front-end of claim 9, wherein the frame tag database establishment process comprises:
the audio and video data are acquired from a media asset database in advance, and a frame characteristic value, a starting frame mark and an ending frame mark of each frame image of the audio and video data which are acquired in advance are calculated;
and generating frame tag data according to the pre-acquired frame characteristic value, the start frame mark, the end frame mark and the program list of the audio and video data of each frame image of the audio and video data.
11. The live television precision advertising and information delivery headend of any of claims 8 to 10, wherein the program information is provided by a program guide, including program title, program attributes.
12. The front-end of precise advertisement and information delivery of live television according to claim 8, wherein the advertisement/information delivery operation platform searches precise advertisement/information corresponding to the replaceable program according to the program information.
13. The utility model provides a terminal of accurate advertisement of live broadcast TV, information delivery which characterized in that includes: the device comprises a first receiving module, a second receiving module, a first decoding module, a second decoding module, a calculating module, an extracting module, a switching module and a frame tag data processing module;
the second receiving module is used for receiving and storing the mapping relation between the accurate advertisement/information, the replaceable program and the accurate advertisement/information;
the first receiving module is used for receiving and caching the audio and video TS stream and the frame tag data TS stream which are broadcasted by the satellite broadcasting system and are subjected to multiplexing processing, wherein the audio and video TS stream and the frame tag data TS stream which are subjected to multiplexing processing are as follows: directly multiplexing the frame tag data TS stream and the audio and video TS stream for a satellite operator, or transcoding the audio and video TS stream for a cable operator, and multiplexing the transcoded audio and video TS stream and the frame tag data TS stream;
the first decoding module is used for decoding audio and video TS stream;
the extraction module is used for extracting frame tag data in a cached frame tag data TS stream, wherein the frame tag data comprises a frame characteristic value, program information, a starting frame mark and an ending frame mark;
the calculation module is used for calculating the frame characteristic value of each frame of cached image;
the frame tag data processing module is used for matching corresponding program information and a start frame mark from the frame tag data according to a frame characteristic value of a next display frame image, judging whether a next display frame is a start frame of a replaceable program according to the program information and the start frame mark, if the next display frame is the start frame of the replaceable program, sending a first switching instruction to the switching module, and switching the first decoding module to a second decoding module by the switching module according to the first switching instruction;
the frame tag data processing module is further configured to obtain accurate advertisements/information corresponding to the replaceable program according to the frame feature value of each frame of the cached image and the mapping relationship, and load the corresponding accurate advertisements/information to the second decoding module for decoding.
14. The terminal for precise advertisement and information delivery of live tv as claimed in claim 13, wherein the frame tag data processing module is further configured to determine whether a next display frame is a start frame of a non-replacement program according to the program information and the start frame flag, and if the next display frame is the start frame of the non-replacement program, send a second switching instruction to the switching module, and the switching module switches the second decoding module to the first decoding module according to the second switching instruction.
15. A system for accurate advertisement and information delivery of live television, comprising the front end of any one of claims 8 to 12; and a terminal as claimed in claim 13 or 14.
CN201610944213.9A 2016-11-02 2016-11-02 Method, front end, terminal and system for accurate advertisement and information delivery of live television Active CN106454441B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610944213.9A CN106454441B (en) 2016-11-02 2016-11-02 Method, front end, terminal and system for accurate advertisement and information delivery of live television

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610944213.9A CN106454441B (en) 2016-11-02 2016-11-02 Method, front end, terminal and system for accurate advertisement and information delivery of live television

Publications (2)

Publication Number Publication Date
CN106454441A CN106454441A (en) 2017-02-22
CN106454441B true CN106454441B (en) 2019-12-20

Family

ID=58178208

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610944213.9A Active CN106454441B (en) 2016-11-02 2016-11-02 Method, front end, terminal and system for accurate advertisement and information delivery of live television

Country Status (1)

Country Link
CN (1) CN106454441B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108810578A (en) * 2017-05-05 2018-11-13 赵阳 Advertisement cut-in method and system applied to user terminal
CN115309920A (en) * 2022-10-08 2022-11-08 国家广播电视总局信息中心 Audio and video management method and system based on fusion big data

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104811774A (en) * 2015-04-29 2015-07-29 北京中传数广技术有限公司 Live television precise advertisement and information delivery method and system
CN104883515A (en) * 2015-05-22 2015-09-02 广东威创视讯科技股份有限公司 Video annotation processing method and video annotation processing server
CN105142026A (en) * 2014-06-04 2015-12-09 Tcl集团股份有限公司 Intelligent TV precise advertising method and system
CN105187795A (en) * 2015-09-14 2015-12-23 博康云信科技有限公司 Video label positioning method and device based on view library
CN105933725A (en) * 2016-06-28 2016-09-07 北京中传数广技术有限公司 Method and system for delivering precise advertisement and information in live broadcast television

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9661382B2 (en) * 2014-08-05 2017-05-23 Verizon Patent And Licensing Inc. Commercial advertising platform

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105142026A (en) * 2014-06-04 2015-12-09 Tcl集团股份有限公司 Intelligent TV precise advertising method and system
CN104811774A (en) * 2015-04-29 2015-07-29 北京中传数广技术有限公司 Live television precise advertisement and information delivery method and system
CN104883515A (en) * 2015-05-22 2015-09-02 广东威创视讯科技股份有限公司 Video annotation processing method and video annotation processing server
CN105187795A (en) * 2015-09-14 2015-12-23 博康云信科技有限公司 Video label positioning method and device based on view library
CN105933725A (en) * 2016-06-28 2016-09-07 北京中传数广技术有限公司 Method and system for delivering precise advertisement and information in live broadcast television

Also Published As

Publication number Publication date
CN106454441A (en) 2017-02-22

Similar Documents

Publication Publication Date Title
CN103348322B (en) Message processing device, information processing method and program
US10038925B2 (en) Server side adaptive bit rate reporting
US10715571B2 (en) Self-adaptive streaming medium processing method and apparatus
US8978060B2 (en) Systems, methods, and media for presenting advertisements
US8863164B1 (en) Server side adaptive bit rate reporting
US20050238062A1 (en) Communication of TV-anytime crids
MX2015002326A (en) On demand access to scheduled content.
JP6294503B2 (en) Broadcast signal transmitting apparatus, broadcast signal receiving apparatus, broadcast signal transmitting method, and broadcast signal receiving method
US20150007218A1 (en) Method and apparatus for frame accurate advertisement insertion
EP2773108B1 (en) Reception device, reception method, program, and information processing system
CA2842810C (en) Fragmenting media content
US20180027263A1 (en) Stream Messaging for Program Stream Automation
US20170118495A1 (en) Methods and Systems for Dynamically Editing, Encoding, Posting and Updating Live Video Content
CN103763588A (en) Stream forwarding method, device, server and system for video advertising insertion
MX2014005650A (en) Information processing device, information processing method, information provision device, and information provision system.
US20220318857A1 (en) Methods And Systems For Providing Content
CN105872599A (en) Method and device for providing and downloading videos
KR20150035808A (en) Transmission device, information processing method, program, reception device, and application linking system
KR20110014403A (en) System and method for generating keword information from each moving picture scene
CN106454441B (en) Method, front end, terminal and system for accurate advertisement and information delivery of live television
KR20150013110A (en) Device and method for processing bi-directional service related to broadcast program
CN107864403B (en) Method, device and system for inserting advertisement
US20150067749A1 (en) Method and apparatus for providing extended tv data
Le Feuvre et al. Hybrid broadcast services using MPEG DASH
US20100043043A1 (en) Method of switching digital tv application

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant