GB2489748A

GB2489748A - Controlling the timed release of multimedia content, synchronising unscheduled (user-accessed) multimedia content and scheduled broadcast content

Info

Publication number: GB2489748A
Application number: GB201106029A
Authority: GB
Inventors: Neil Maycock
Original assignee: Snell Ltd
Current assignee: Snell Advanced Media Ltd
Priority date: 2011-04-08
Filing date: 2011-04-08
Publication date: 2012-10-10
Also published as: GB201106029D0

Abstract

A method is disclosed for controlling the release timing (e.g. by Internet service provider (ISP)) of secondary (user accessed, unscheduled) multimedia content - audio, video or data, either individually or combined, and different from scheduled broadcast channel content - to a listener or viewer by a broadcast system. The secondary content is released in response to data output from the broadcast system, distributed to recipients via a multi-user network (e.g. Internet). Data output may be encrypted, define a release time derived from the stored play schedule (e.g. from the occurrence of an event in a live broadcast), and may include event metadata; events can include the appearance of a person or product. Also claimed is a similar method controlling the release timing of secondary (e.g. on demand) multimedia content, comprising, prior to outputting a broadcast channel to the distribution network: identifying trigger events in the broadcast channel content; and distributing, to at least one recipient independent of the distribution network, data identifying the time of intended content playing representing the trigger event, permitting content release in synchronism with the trigger.

Description

METHOD AND APPARATUS FOR TIMING RELEASE OF

MULTIMEDIA CONTENT

FIELD OF INVENTION

This invention concerns broadcast automation.

BACKGROUND OF THE INVENTION

The rapid increase in the use of portable multimedia devices such as smart phones' and tablet' computing devices -particularly to access so-called social media' -has lead to a market need for software applications and web-based media to provide content to users that is related to conventional broadcast media channels. Viewers and listeners want to interact with their peers in real-time in response to broadest programmes; and, content providers and advertisers also want to interact with consumers of products and services in the same timely manner.

There is thus a need for synchronisation between one or more sources of unscheduled' multimedia content (either accessed by a web browser, or generated by another software application) and events broadcast according to a predetermined schedule by a television or radio channel.

In this specification the term second-screen' will be used to refer to the device used to present the unscheduled' multimedia content; the first-screen' being the presentation device for the scheduled, broadcast service.

One known solution to the problem of synchronisation is for the second-screen device to incorporate a monitoring function that receives and analyses the output from the first-screen device and responds to predetermined trigger' events in that output. An example is a microphone (or other audio input device) and audio processor that responds to the audio output from the first-screen device. This method is not particularly reliable because of the difficulty of obtaining undistorted audio and the difficulty of choosing unambiguous, easily-recognised audio events that do not detract from the intended audio experience.

SUMMARY OF THE INVENTION

The invention consists in a method and apparatus for controlling the timing of the release of secondary multimedia content to a listener or viewer by a broadcast playout system that outputs a broadcast channel to a distribution network in response to a stored playout schedule, where the said secondary multimedia content comprises audio, video or data, either individually or in combination and is different from the content of the said broadcast channel, wherein the said secondary multimedia content is released in response to a data output from the said broadcast playout system that is distributed to a plurality of recipients via a multi-user communication network.

Suitably, the said data output defines a time of release derived from the said stored playout schedule.

In certain embodiments the said data output defines a time of release derived from the occurrence of an event in a live broadcast.

Advantageously, the said data output includes metadata associated with a particular event broadcast in the said broadcast channel.

In a preferred embodiment the said data output is encrypted.

And, the said multi-user communication network is the Internet.

In certain embodiments the said secondary multimedia content is released by an internet service provider.

In other embodiments the said secondary multimedia content is released by a software application.

The said particular event can be the appearance of a particular person in the said broadcast channel.

Or, the said particular event can be the appearance of a particular product in the said broadcast channel.

BRIEF DESCRIPTION OF THE DRAWINGS

An example of the invention will now be described with reference to the drawings in which: Figure 1 shows a block diagram illustrating an application of the invention.

DETAILED DESCRIPTION OF THE INVENTION

An example of the use of the invention is shown in Figure 1. A broadcasting system (10) outputs a broadcast channel (11) to a distribution network, which would typically comprise satellite up-links, terrestrial transmitters etc. The broadcast channel (11) comprises a scheduled stream of multimedia content.

This content typically includes a video stream, related audio streams and related data streams. These constituent parts of the broadcast channel (11) are often referred to in standards documents as different varieties of essence', and this term will be used in this specification. The broadcast channel will comprise a sequence of items of content (programmes, films, commercials etc.).

The broadcasting system (10) includes a data store (12) that holds the items of content that will be broadcast over some period of time. The data store (12) also contains metadata' that was acquired during the production of the items of content that will be broadcast. This metadata identifies the times of significant events within each item of content, for example the time at which a particular person or product appears. The timings of these significant events are defined relative to the timing of the respective item of content. For a television channel timings can be expressed using the well-known time-code that identifies particular fields of frames of a video sequence; for a radio channel timings can be expressed as count of audio samples from the start of the item.

Items of content are retrieved from the data store (12) and are output to the broadcast channel (11) by a broadcast playout system (13), which has previously been provided with a transmission schedule that defines the times at which various items are to be output in terms of clock time. The playout system (13) has an associated real-time clock (14) that controls the playout of items according to the transmission schedule. Note that the propagation delay of a broadcast distribution channel is typically short so that the time of output at a viewer's or listener's receiving device can be assumed equal to the time of transmission from the playout system (13).

The playout system (13) compares the scheduled timing of the playout of each item of content with the metadata for that item of content to determine the times at which significant events having associated metadata are intended to be broadcast. At a suitable time, typically just prior to the broadcasting of the respective significant event, the broadcasting system (10) sends the respective intended time of broadcasting and the associated metadata to a web-server (15), that makes the metadata and the respective intended transmission time of the respective significant event available via the internet to suitable software clients.

The availability of this data enables the release of secondary' multimedia content as will be described below. The release of the secondary multimedia content may comprise making all or part of that secondary multimedia content available for access; or, alternatively, it may comprise actual rendering and presentation all or part of the content to a listener or viewer. Preferably the metadata and timings are encrypted so that only authorised software clients can access the data and timings.

The metadata and timings are accessed by an online service provider (120) that creates and formats secondary multimedia content related to the significant events that is intended for presentation on second-screen devices. Typically this creation and formatting process takes place prior to the relevant broadcast, making use of information about one or more of the significant events. In real-time the online service provider monitors, and if necessary decrypts, the times and metadata from the web-server (15). An on-line service platform (123) compares the time from a real-time clock (121) with the intended timings of the transmission of significant events, and makes available multimedia content related to each relevant significant event, at a time corresponding to the intended transmission of that event by the broadcast system (10).

The online service provider (120) may publish the relevant secondary multimedia content on a web-site provided by a web-server (122), or it may stream the relevant related multimedia content via the web-server (122) as part of an internet-delivered multimedia service.

A consumer's second-screen device (130) can access the service provider's secondary multimedia content via a web-browser application (131). Or, a mobile application (132) residing on the second-screen device (130) can be triggered in response to data sent to its IP address by the web-server (122). Or, the mobile application (132) may access the metadata and timing information from the web-server (15) and compare the intended transmission time of a significant event with the time from a local real-time clock (133). The second-screen device will typically include appropriate rendering software and hardware that enables the user to view and/or listen to multimedia content. Thus by one or more of the above-described mechanisms, the user of the second-screen device (130) is either presented with, or is able to access, secondary multimedia content related to a significant event that has just occurred in the broadcast channel (11).

The times that are transmitted by the web-server (15) may be advanced relative to the intended transmission time, so as to allow for the propagation time of the delivery network for the second-screen content. Similarly, the times may be retarded to allow for the propagation time of the delivery network for the broadcast channel (11).

Typically, the transmission schedule for the broadcast channel (11) will be known in advance -some aspects of it will probably be in the public domain -however, the times of significant events (particularly the times at which specific products or services are to be advertised) are likely to be secret and only known to the operator of the broadcast system (10). However, the transmission schedule is also subject to short notice change, particularly if live events are broadcast.

These considerations will determine the time prior to the broadcasting of a significant event at which the time and metadata for that event are made available via the web-server (15). It may be necessary to up-date previously transmitted time information as a result of changes to the transmission schedule.

If it is concluded that there is no need for the advance transmission of metadata, the scheduled timings of significant events need not be included in the data made available by the web-server (15). Relevant metadata, which may include triggering instructions causing client software applications to output particular multimedia content, can be made available at the time the relevant significant event is broadcast; or, at a time related to that time of broadcasting. Specific time-code values for the played-out content may trigger the distribution of metadata or essence, or the trigger or transmission may be initiated in response to ancillary' data contained in the blanking intervals of digitally-encoded video, or carried on additional audio channels that are not needed for audio essence.

As well as controlling the timing of second-screen content related to pre-recorded material as described above, the system of the invention is applicable to live broadcasts. In this case the essence comprising the broadcast programme will not be supplied from the data store (12); instead it will be input to the playout system (13) as a live' stream. Typically this live stream will be the output of a studio or outside broadcast' vehicle. Suitable, likely significant events, or possible alternative outcomes, can be identified prior to the event and suitable live' metadata trigger inputs from an operator can initiate the provision of relevant second-screen material. For example, the operator may trigger the distribution of a particular package of metadata when an anticipated event occurs, or may select a particular package of metadata from a number of possible alternatives in response to broadcast events as they occur.

As will be apparent from the above description, the invention may be applied in many ways, including, but not limited to, the following. The broadcast channel may deliver audio, video or audiovisual programming, which may or may not include data, such a sub-title content. The secondary multimedia content may be audio, video, audiovisual or data, either individually or in combination. The secondary multimedia content may be streaming content or it may comprise a collection of data items between which the user navigates at will.

Claims

CLAIMS1. A method for controlling the timing of the release of secondary multimedia content to a listener or viewer by a broadcast playout system that outputs a broadcast channel to a distribution network in response to a stored playout schedule, where the said secondary multimedia content comprises audio, video or data, either individually or in combination and is different from the content of the said broadcast channel; wherein the said secondary multimedia content is released in response to a data output from the said broadcast playout system that is distributed to a plurality of recipients via a multi-user communication network.
2. A method according to Claim I where the said data output defines a time of release derived from the said stored playout schedule.
3. A method according to Claim I or Claim 2 where the said data output defines a time of release derived from the occurrence of an event in a live broadcast.
4. A method according to any preceding claim where the said data output includes metadata associated with a particular event broadcast in the said broadcast channel.
5. A method according to any preceding claim where the said data output is encrypted.
6. A method according to any preceding claim where the said multi-user communication network is the Internet.
7. A method according to any preceding claim where the said secondary multimedia content is released by an internet service provider.
8. A method according to any of Claims I to 7 where the said secondary multimedia content is released by a software application.
9. A method according to any preceding claim where the said particular event is the appearance of a particular person in the said broadcast channel.
IO.A method according to any preceding claim where the said particular event is appearance of a particular product in the said broadcast channel.
11. Apparatus for controlling the timing of the release of secondary multimedia content to a listener or viewer by a broadcast playout system that outputs a broadcast channel to a distribution network in response to a stored playout schedule, where the said secondary multimedia content comprises audio, video or data, either individually or in combination and is different from the content of the said broadcast channel wherein the said secondary multimedia content is released in response to a data output from the said broadcast playout system that is distributed to a plurality of recipients via a multi-user communication network.
12. Apparatus according to Claim 11 where the said data output defines a time of release derived from the said stored playout schedule.
13. Apparatus according to Claim 11 or Claim 12 where the said data output defines a time of release derived from the occurrence of an event in a live broadcast.
14. Apparatus according to any of Claims 11 to 13 where the said data output includes metadata associated with a particular event broadcast in the said broadcast channel.
15. Apparatus according to any of Claims 11 to 14 where the said data output is encrypted.
16. Apparatus according to any of Claims 11 to 15 where the said multi-user communication network is the Internet.
17. Apparatus according to any of Claims 11 to 16 where the said secondary multimedia content is released by an internet service provider.
18. Apparatus according to any of Claims 11 to 16 where the said secondary multimedia content is released by a software application.
19. Apparatus according to any of Claims 11 to 18 where the said particular event is the appearance of a particular person in the said broadcast channel.
20. Apparatus according to any of Claims 11 to 19 where the said particular event is the appearance of a particular product in the said broadcast channel.
21. A method for controlling the timing of the release of secondary multimedia content to a listener or viewer by a broadcast playout system that outputs a broadcast channel to a distribution network, comprising the steps, prior to the outputting of that broadcast channel to the distribution network, of identifying trigger events in the broadcast channel content;and distributing to at least one recipient independent of the distribution network data identifying the time of intended playout of content representing the respective trigger event, to permit the release by said recipient of secondary multimedia content in synchronism with the trigger event.
22. A method according to any preceding claim where the said data is encrypted.
23. A method according to any preceding claim where the trigger event is the appearance of a particular person or product in the said broadcast channel.
24. Programmable apparatus programmed to implement a method according to any one of Claims Ito 10 or Claims 21 to 23.
25. A computer program product adapted to cause programmable apparatus to implement a method according to any one of Claims I to 10 or Claims 21 to 23.