EP2525569A1 - Enhanced programme preview content - Google Patents

Enhanced programme preview content Download PDF

Info

Publication number
EP2525569A1
EP2525569A1 EP11166892A EP11166892A EP2525569A1 EP 2525569 A1 EP2525569 A1 EP 2525569A1 EP 11166892 A EP11166892 A EP 11166892A EP 11166892 A EP11166892 A EP 11166892A EP 2525569 A1 EP2525569 A1 EP 2525569A1
Authority
EP
European Patent Office
Prior art keywords
audiovisual content
programme
epg
content
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP11166892A
Other languages
German (de)
French (fr)
Inventor
Dale Mountain
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dish Technologies LLC
Original Assignee
EldonTechnology Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by EldonTechnology Ltd filed Critical EldonTechnology Ltd
Priority to EP11166892A priority Critical patent/EP2525569A1/en
Priority to CA2777439A priority patent/CA2777439A1/en
Priority to MX2012005830A priority patent/MX2012005830A/en
Priority to US13/475,808 priority patent/US8595768B2/en
Publication of EP2525569A1 publication Critical patent/EP2525569A1/en
Priority to US14/071,613 priority patent/US20140068675A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/64322IP

Definitions

  • This invention relates to methods of concurrent first and second audiovisual content display and apparatus for implementing these methods, and particularly to the acquisition of audiovisual clips for display in PiP windows or EPG banners.
  • Modern broadcast media content such as TV programmes that are broadcast over a satellite network is often provided with an EPG (Electronic Programme Guide) so that users may browse content listings.
  • EPG Electronic Programme Guide
  • the EPG or a reduced version of an EPG can be made available to view on a part of a screen while a first piece of media content such as a TV programme continues to play on the rest of the screen.
  • the EPG content may also be provided on a bespoke EPG content channel, separate to the channels used to broadcast programme content.
  • FIG. 1 An example of an EPG banner function is shown in Figure 1 .
  • a screen or monitor 1 of an output device shows a current programme 2, which has been received by a media playback device, such as a STB (set-top-box) from a satellite or cable network for example and relayed to the monitor 1.
  • a media playback device such as a STB (set-top-box) from a satellite or cable network for example and relayed to the monitor 1.
  • a media playback device such as a STB (set-top-box) from a satellite or cable network for example and relayed to the monitor 1.
  • an EPG banner 4 is additionally displayed on the screen while the current programme 2 is still being shown.
  • the EPG banner displays textual information about current and future programmes.
  • a user may, by using the remote control, navigate through the channels to determine what programme content is currently being broadcast, as well as navigate through future time slots for programme content scheduled for transmission.
  • a current programme may be selected for viewing, in which case the current programme displayed on the
  • a method of displaying first and second audiovisual content comprising receiving the first audiovisual content at a media playback device, receiving the second audiovisual content at the media playback device from a remote content system over a packet-based data network, and in response to user input, outputting the first and second audiovisual content to an output device having a screen, and controlling the screen of the output device to display the first and second audiovisual content concurrently.
  • the second audiovisual content is displayed in response to a user input request entered via a channel change selection function. This helps provide improved user comprehension of the information being presented.
  • the channel change selection function comprises an on-screen graphical user interface (GUI), displaying textual information and scheduling information for current and future broadcast programmes. This provides further information to users.
  • GUI graphical user interface
  • the user input request is to navigate to part of the channel change selection function displaying information corresponding to audiovisual content for future broadcast.
  • the second audiovisual content is displayed on the output device in the graphical user interface (GUI) of the channel change selection function. This provides the information integrally.
  • GUI graphical user interface
  • the second audiovisual content is displayed on the output device in a PiP (picture-in-picture) window. This provides greater flexibility as the second audiovisual content may then be displayed separately to the GUI.
  • PiP picture-in-picture
  • the second audiovisual content is requested from a service provider or from a third party.
  • the second audiovisual content is requested using a satellite connection, a wireless connection, a cable connection, and/or a packet-based network connection.
  • the second audiovisual content is requested in response to the user input in real or near real time. This avoids the need to store large quantities of data.
  • the second audiovisual content and/or the programme broadcast schedule is stored on the media playback device or on a local storage module associated with the media playback device. This allows the second audiovisual content to be played straight away without relying on an external connection.
  • the second audiovisual content is requested prior to the user input.
  • the second audiovisual content is requested periodically. This allows the stored data for future second audiovisual content to be kept up to date.
  • the second audiovisual content is selectively requested based on one or more parameters, the parameters comprising popularity ratings, user preferences, and user browsing patterns. This allows for more efficient use of storage and bandwidth.
  • the packet-based data network is the Internet.
  • the first and/or second audiovisual content comprise video or video with audio.
  • the audio of one of the first audiovisual content and the second audiovisual content is muted. This avoids two audio tracks being superimposed on top of one another.
  • both the first and second audiovisual content have an audio element
  • the audio element of one of the first audiovisual content or the second audiovisual content is muted based on a default setting or a user preference. This provides for the preferred audio track to be chosen.
  • the output device comprises one or more of a television, a monitor, a screen, a computer, and/or a loudspeaker.
  • the user input is provided via a user input device.
  • the user input device is a remote controller or a control interface on the media device or the output device.
  • the media playback device is a set-top-box (STB) or a computer.
  • STB set-top-box
  • a method for controlling a screen wherein the display is operable in a first mode, in which a first current programme is displayed on the screen, a second mode, in which in response to a user input, a first current programme, a second current program and an EPG or EPG banner are shown,and a third mode, in which in response to a user input, a current programme, an audiovisual clip and an EPG or EPG banner are shown.
  • the audiovisual clip is shown in a PiP window. In one embodiment, the audiovisual clip is related to a future programme. In one embodiment, the second current programme is shown in a PiP window.
  • the audiovisual clip is obtained by a method of the first aspect of the invention.
  • a PiP window is only shown if the current programme does not match a highlighted programme in the EPG or EPG banner. This avoids duplication of information or unnecessary blank, spaces on the display.
  • a media playback device configured to carry out one or more of the methods of the first and second aspects of the invention.
  • the media playback device is a STB.
  • a system comprising the device of the third aspect of the invention and the output device of the first aspect of the invention, or the screen of the second aspect of the invention.
  • the system additionally comprises the user input device as described in any previous aspect of the invention.
  • a computer-readable medium having computer-executable instructions for performing the method recited in the first or the second aspect of the invention.
  • Figure 2 is a schematic illustration of a general operating environment showing components and features of an example embodiment.
  • Figure 2 includes a service provider 104 that transmits or otherwise provides a programme service transmission to a receiver 108, having a media playback device such as a STB (set-top-box), a cable receiver, or a general purpose computer.
  • a service provider 104 that transmits or otherwise provides a programme service transmission to a receiver 108, having a media playback device such as a STB (set-top-box), a cable receiver, or a general purpose computer.
  • STB set-top-box
  • the receiver 108 may be associated with or located near an individual, business, or other entity, user or subscriber that receives a programme service transmission from the service provider 104.
  • the programme service transmission may be received through a subscription to the service.
  • the terms "user” and/or “subscriber” refer to an individual or company who receives a programme service transmission. This may include those who have purchased a subscription to the programme service transmission. Additionally, the terms “user” and/or “subscriber” may refer to individuals who have been given access to the programme service transmission through promotional offers and/or other non-fee-based agreements. There may be more than one service provider 104.
  • the service provider 104 may provide a programme service transmission through an uplink centre 112.
  • the uplink centre 112 may include a transmitter or other equipment operable to transmit a modulated signal having data representing audio and/or visual content.
  • the modulated signal may be received at a satellite 116, which in turn retransmits the modulated signal to be received at one or more terrestrial locations.
  • the retransmitted signal may be received from the satellite 116 at one or more satellite dishes 120, which are typically associated with one or more receivers 108.
  • a receiver 108 may includes a tuner 124 operable to receive the programme service transmission signal through the satellite dish 120 and a decoder 128 to decode the received signal.
  • the decoder 128 may be programmed to decrypt or otherwise decode some or all of the received signal in accordance with purchases and selections made by a user.
  • Embodiments may operate with different product transmission services. Accordingly, although a satellite system is provided as an example of a programme service transmission system, other networks or broadcasts for transmitting data may be used by alternative embodiments. For example, embodiments may be implemented in connection with a cable service or a packet data network rather than a satellite system.
  • the service provider 104 and the receiver 108 may communicate over a communication path that includes various combinations of local and wide area networks and/or the Internet.
  • the receiver 108 may be configured to access a web site, a file transfer protocol (FTP) site, a file sharing system or site, and so on.
  • FTP file transfer protocol
  • the receiver includes a network interface 132.
  • the network interface 132 may be operable to communicate or send information across a data network, such as a packet based data network 136.
  • the network interface 132 may take the form of a modem network interface card, cable plug or jack, or the like.
  • the receiver may communicate over a network 136 such as the public switched telephone network (PSTN).
  • PSTN public switched telephone network
  • the network 136 may be any type of network capable of data communication, such as, for example, a local or wide area network or the Internet.
  • the receiver 108 may communicate through the network connection 132 using any suitable communication protocol such as TCP/IP.
  • TCP/IP Transmission Control Protocol
  • the receiver 108 may also communicate with one or more websites 138 through the network connection 132. In so doing, the receiver 108 may reference and receive information or other content that may be outputted on a display to provide an enhanced or expanded graphical user interface (GUI), in accordance with an example embodiment of the invention. Additionally, the receiver 108 may receive information or other content that may be outputted on a display from the service provider 104. This information could be provided within an optional storage module 113 provided by the service provider 104, or could be provided elsewhere such as on another server. This information could include audiovisual clips or the like.
  • GUI graphical user interface
  • the service provider employs a server, or server-like device, that accepts commands and information using hypertext transfer protocol (HTTP) requests from a web browser agent, here, the receiver 108.
  • HTTP hypertext transfer protocol
  • the network connection of the receiver is a modem, or modem-like device.
  • the receiver 108 may additionally include a processor 140 operable to run executable code in connection with various functions associated with the receiver 108, For example, the processor 140 may display graphics, images, animations or other content on a display 144, such as a television (TV) or monitor. In the case of receiving commands or other information relating to changes to the account status, the processor 140 may be further operable to initiate or facilitate transmission of one or more messages to the service provider 104. The processor 140 may be further operable to recall and display stored content, such as purchased or recorded programmes.
  • a processor 140 operable to run executable code in connection with various functions associated with the receiver 108
  • the processor 140 may display graphics, images, animations or other content on a display 144, such as a television (TV) or monitor.
  • the processor 140 may be further operable to initiate or facilitate transmission of one or more messages to the service provider 104.
  • the processor 140 may be further operable to recall and display stored content, such as purchased or recorded programmes.
  • the processor 140 may also receive, store, snd/or display an on-screen graphical user interface (GUI) such as an Electronic Programme Guide (EPG), which may provide a schedule of programme content and/or other features.
  • GUI graphical user interface
  • EPG Electronic Programme Guide
  • the EPG may comprise a database or may otherwise access a database containing information including, for example, names or titles of viewing events (programs), corresponding channel numbers and names, brief descriptions of the programs, start and finish times, and rating and content information related to the events. This information may be called EPG information or programme information. Any suitable information may be included in the EPG information.
  • the EPG or programme information may be communicated to a set top box (STB) using a dedicated data channel.
  • STB set top box
  • the processor 140 executes a display module 148 or programme, which accesses stored EPG data 152 and provides a formatted graphic output on the display 144. Further, the EPG data 152 may by compiled at the service provider 104 through the operation of an EPG management module 154 and transmitted to the receiver 108.
  • a tuner in the STB "tunes" to the EPG data channel and collects the EPG information, which is stored in memory of the STB.
  • the EPG information is communicated in a serial fashion to the STB, and thus, has a beginning and an end,
  • the EPG information may start with "programme channel 1" and provide programming information for a predefined number of days or the like for that particular channel.
  • EPG information for "programme channel 2" for the predefined number of days or the like may follow, and so on, until the EPG information for all "programme channels” has been communicated to the STB.
  • the communication of the EPG information then starts again at the beginning of the EPG information.
  • the EPG information may simply be repeated.
  • the EPG information may be updated and then communicated, This looped, periodically repeating communication of the entire EPG information is referred to as a "carousel" EPG information format.
  • the STB begins receiving the EPG information midway during the communication of the "carousel" of EPG information, the STB understands that a complete set of EPG information has been received when it has gone through the entire carousel of EPG information. That is, the entire carousel of EPG information has been received when the received EPG information has returned to its initial entry point into the carousel of EPG information.
  • the STB While the STB is receiving the EPG information, or once the STB has received a full set of EPG information, the STB can construct and display an EPG to a viewer on their viewing device, such as a television or the like. If the entire carousel of EPG information has not yet been received, a partial EPG may be constructed and presented to the viewer.
  • the viewer is able to interactively scroll about the EPG to view available programming on a programme channel of interest. Also, the viewer is able to navigate about the EPG to view textual information related to scheduled programming at future times of interest on selected programme channels of interest.
  • Some EPGs are configured, based upon commands received from a remote control, to cooperatively work with a remote control so that the viewer may request selected operations on a programme of interest that is highlighted on the EPG. For example, the viewer may select a record feature on their remote control unit such that the highlighted programme on the EPG is recorded by a digital video recorder (DVR) in the STB.
  • DVR digital video recorder
  • a reduced EPG may be shown to the viewer in the form of a banner, such as that shown in Figure 1 .
  • the EPG data channel includes EPG information provided as the carousel of EPG information that is communicated in a periodic, serial fashion. That is, the EPG information in the EPG data channel is communicated in a serial format that is periodically repeated. If the receiver has multiple tuners, one of the tuners may be used to provide viewable programming and another tuner can be used to tune to the EPG data channel to receive the carousel of EPG information.
  • the processor 140 can also perform such tasks as executing commands received from a user.
  • User commands may be sent to the receiver 108 through a user input device 156 such as a remote or other wireless device, such as a remote control.
  • a "user input device” may include any device operable to receive input from a user and to convey the input to the receiver 108.
  • the user input device 156 may be a hand-held device having a number of buttons or keys that when actuated by a user cause the user input device 156 to convey information to the receiver 108 using a suitable communication means, such as an infrared signal.
  • the user input device 156 may include a pointing device or functionality that allows the user to control the position of a cursor that is displayed on the display 144.
  • the user input device 156 may include a track ball or glide plane that may be manipulated to control cursor movements.
  • the user input device 156 may include a motion sensor or accelerometer that allows a user to control displayed items or graphics, such as a cursor, through movements of his or her hand or arm that cause a displacement of the user input device 156.
  • the receiver 108 may itself have one or more controllers thereon that are configured to receive instructions from the viewer. It should be appreciated that other input devices such as a computer mouse or touch screen may be used and other communication means, wired or wireless, may be used.
  • Information sent to the receiver 108 may include, for example, a command to change the displayed channel, a command to pause and/or rewind a displayed programme, a command to display an EPG and/or a command to navigate through the EPG. Commands sent to the receiver 108 may be entered through a dedicated display menu,
  • the receiver 108 may include or be associated with a recorder 160, such as a DVR (digital video recorder).
  • the recorder 160 may be integrated into the receiver 108 or may be a stand-alone device.
  • the recorder 160 may be operated by a user who programs the device or receiver function to record a particular programme at a specified time. When the programme occurs, the recorder 160 will record and store the programme, which can then be viewed later.
  • the recorder 160 may buffer a certain amount of content during a currently broadcast transmission. Buffering a currently broadcast transmission allows a user to pause and/or rewind the content of the transmission and to then display the content in a non-live or delayed manner.
  • the receiver 108 may include or be associated with a memory or other storage device 164, such as magnetic or optical storage.
  • the storage device 164 may be operable to store data received from the decoded satellite signal.
  • the storage device 164 may be operable to store data received from the decoded satellite signal.
  • the storage device 164 may be volatile or non-volatile memory implemented using any suitable technique or technology such as, for example, random access memory (RAM), disk storage, flash memory, solid state, and the like.
  • RAM random access memory
  • the storage device 164 may be located either within the receiver or separately from the receiver.
  • the storage device may also be removable in nature.
  • the stored data set may include audio and/or visual content to be transmitted and displayed through the display 144. Generally, audio visual or audiovisual content may include still images, video images, animation and/or audio.
  • Portable Network Graphics or other appropriate formats, such as for example, Tagged image File Format (TIFF), Joint Photographic Experts Group (JPEG), Motion Picture Experts Group (MPEG) - 2, MPEG-4 may be used to display an image or video.
  • videos or other programmes may be stored locally in storage device 164.
  • Stored programmes may include for example recorded broadcasts, pay-per-view items and/or buffered portions of a current video broadcast.
  • the receiver itself and/or the storage device may contain various partitions or separate storage portions and may include a programme buffer, a DVR digital video recorder, an EPG access logic storing portion, and/or an EPG information storing portion.
  • the storage device 164 may additionally store an application, file, module or other data that is useable by the processor 140.
  • a stored application may be executed by the processor 140 to display content on the display 144, for example display module 148.
  • an application or module includes processor executable code that may be run to carry out one or more functions associated with the receiver 108.
  • processor executable code includes any computer-readable media or commands that may be ultimately interpreted by a processor, such as HTML or XML files that are rendered into user-viewable applications by an application executed by the processor.
  • the processor or the receiver may comprise a presentation device interface portion to hold this code.
  • a monitor 1 shows a current programme 2.
  • an EPG banner 4 is additionally shown on the screen.
  • the EPG banner initially displays information about the programme currently being watched and future programmes on the same channel, although the initial default display may be set to another time or channel.
  • the user may manipulate the EPG banner to show various information about current and future programmes on the same and different channel.
  • a PiP window 500 is also provided, either integrally with the EPG or EPG banner 4 or separate from it, to show a second piece of media content on a portion of the screen simultaneously to the first piece of media content.
  • the PiP window can display the audiovisual information associated with the media content currently highlighted or selected in the EPG, which may take the form of a preview of the media content.
  • a PiP window 500 is automatically added to the display to display audiovisual content relevant to the highlighted programme, in this case a programme that is currently being broadcast on a separate channel,
  • the user has further manipulated the information displayed by the EPG banner to highlight a programme scheduled for future broadcast.
  • the media playback device displays audiovisual content corresponding to a portion of the future broadcast programme, that has been obtained in advance, and displays this in the PiP window.
  • a user is able to view within the EPG or channel change selection function, audiovisual content corresponding to programmes that are scheduled for future broadcast.
  • This greatly facilitates user comprehension of the EPG and scheduling information being presented to them, and means that a user no longer has to rely solely on the litle of the programme to determine interest where the programme is as yet unviewed, or to recollect the content where the content has been viewed.
  • the presentation of audiovisual information also allows user who have impaired visual acuity or difficulty reading to use the EPG more effectively.
  • the highlighted programme currently selected by the user in the EPG banner is the programme for which the PiP window shows the additional audiovisual preview or information.
  • a programme may be highlighted automatically, as the user navigates through the EPG using directional buttons on the remote. In the example above, the highlighted programme is simply the programme shown leftmost in the EPG banner. Alternatively, the user may be able to move the highlighted position on the EPG banner to different times, without simultaneously altering the position of the information on the screen. There may be no physical indication of which programme is highlighted, or alternatively the highlighted programme, time or time slot may be indicated in some way on the screen, for example shown as a different colour to the rest of the EPG banner. Other methods of highlighting are also possible.
  • One or both of two concurrently shown pieces of audiovisual content may include audio.
  • the current programme and the PiP window content may include audio as well as video. In the case where there are two audio tracks that would otherwise be played at the same time, it is preferable to mute one or both of the audio tracks.
  • the audio element of the current programme and/or the PiP content may be muted based on a default setting, a user preference, a button on a user input device, a user selection using a cursor on the EPG or EPG banner, or another appropriate selection method.
  • Figure 6 shows a flowchart illustrating a method of receiving and displaying audiovisual content for display in the EPG or EPG banner
  • the receiver or media playback device receives an input from a control interface or a user input device, requesting audiovisual content.
  • This request may take the form of a user selecting a programme in a list on the EPG using a user input device 156, or simply moving the highlight cursor of the EPG into the programme in the manner described above, whereupon the receiver needs to source a audiovisual clip or suchlike to display.
  • the receiver 108 sends a request for the audiovisual content to the service provider 104 or from a third party provider.
  • the request may be made by any appropriate means, such as a cable network or a data packet network such as the internet.
  • the receiver 108 receives audiovisual content from the service provider 104.
  • the receiver 108 sends the audiovisual content to an output device such as display 144.
  • the display 144 will then output the audiovisual content.
  • the audiovisual content may be, for example, a video clip with or without sound.
  • the receiver may additionally control the screen of the display 144 to display the audiovisual content and other audiovisual content concurrently.
  • the audiovisual content corresponding to the EPG preview of a future programme is retrieved on demand from the server provider in response to a user request.
  • the audiovisual content is pre-emptively provided.
  • the receiver requests audiovisual content from the service provider for one or more future programmes.
  • the receiver is routinely sent the audiovisual content by the service provider, either at set times or upon initiation of the receiver. In this case, step 300 is not required, and the method starts with operation 302.
  • the receiver receives audiovisual content from the service provider, in a similar way to step 204 in Figure 6 .
  • the receiver stores the received audiovisual content in local memory.
  • the local memory may be within a storage device 164 or in another storage medium within or linked to the receiver, such as a PVR (personal video recorder) or an external hard drive.
  • PVR personal video recorder
  • the receiver receives a request for audiovisual content from a user input device, similarly to step 200 in Figure 6 .
  • the receiver retrieves the requested audiovisual content from local memory. This could comprise retrieving the requested audiovisual content from a local memory and adding the requested audiovisual content to a local cache memory or to the display module memory 148.
  • the receiver provides audiovisual content to an output device, similarly to step 206 in Figure 3 .
  • the receiver may be provided with all the appropriate audiovisual content for all channels for a pre-determined time period. For example, at a set time of day or upon initiation of the receiver, all the available audiovisual content for all future programs for the rest of the day are acquired.
  • the service provider may provide a selection of audiovisual content for just the most popular programs, or for a set of programs which, based on past viewing habits, the service provider anticipates that the user of the receiver is likely to wish to view.
  • audiovisual content could be provided for future programmes on the channel that the user is currently watching, or for favourite programme channels selected by the user.
  • Short-term pre-emptive requests for audiovisual clips could also be made. For example, when a user accesses a particular channel on the EPG, some or all of the clips for that particular channel could immediately be requested or automatically provided by the service provider.
  • audiovisual content for the most imminent programmes may be the first to be retrieved, followed by audiovisual content for later scheduled programming.
  • Other systems and patterns of pre-emptive audiovisual content storage based on user habits and real-time user browsing could also be employed.
  • a temporary storage approach to audiovisual content acquisition could be used, whereby audiovisual content acquired pre-emptively is only stored briefly, and is then deleted after a short period of time, for example five minutes after being loaded, or five minutes after a user stops browsing the EPG.
  • acquired audiovisual content would normally be deleted or overwritten at a later date, to allow for reuse of memory resources.
  • some of all audiovisual content may be provided on a dynamic basis.
  • no permanent memory storage capacity is used in the receiver's memory.
  • the receiver is operable to retrieve audiovisual clips of interest on a dynamic real time basis, or near real time basis.
  • the receiver may request information directly from the BBC via the Internet, or the BBC may routinely provide the audiovisual content without prompting.
  • the audiovisual content could be sourced from one or more websites 138. Instructions on where the receiver should source the audiovisual content may be part of the EPG metadata in the relevant block of EPG data routinely provided to the receiver by the service provider.
  • a browser or the like may be integrated into the EPG access logic. Accordingly, when the remote EPG content system is implemented as an internet accessible system, the browser can access EPG information of interest. Alternatively, the browser may be separately implemented as part of another component and/or function.
  • additional programme description information may include additional information on the programme plot or story line, additional information pertaining to programme actors or performers, and/or may provide information about related programming.
  • Such supplemental information can be too voluminous for inclusion in the carousel of EPG information.
  • Memory requirements to store the supplemental information in the receiver may be too extensive to justify memory costs.
  • the time to receive an entire carousel of EPG information that includes the supplemental information for every programme described in the EPG may be to long to be practical.
  • the audiovisual content may be formatted using a suitable video data standard, such as, but not limited to, the moving pictures experts group (MPEG) digital video broadcasting (DVB) standard or the American television standards committee (ATSC) standard.
  • MPEG moving pictures experts group
  • ASC American television standards committee
  • the EPG information is encoded using a common internet protocol (IP) format that may be selectively accessed by the receiver.
  • IP internet protocol
  • HTTP or XML formats may be used.
  • An exemplary embodiment of the receiver 108 is a set top box (STB).
  • STB set top box
  • Embodiments may be implemented in other media devices, such as, but not limited to stereos, radios, televisions (TVs), digital video disc (DVD) players, digital video recorders (DVRs), personal device assistants (PDAs), or personal computers (PCs).
  • TVs televisions
  • DVD digital video disc
  • DVRs digital video recorders
  • PDAs personal device assistants
  • PCs personal computers
  • the network is preferably the Internet, in some embodiments the network may also be a telephony system, a radio frequency (RF) wireless system, a microwave communication system, a fibre optics system, an intranet system, a local access network (LAN) system, an Ethernet system, a cable system, a radio frequency system, a cellular system, an infrared system, a satellite system, or a hybrid system comprised of multiple types of communication media.
  • RF radio frequency
  • RF radio frequency
  • the receiver establishes a link to the service provider via the network, such as, but not limited to, World Wide Web (WWW).
  • the link may be a persistent connection.
  • Non-limiting examples of possible persistent type connections are a HTTP keep-alive or a HTTP connection reuse.
  • the link is established on an as-needed basis.
  • a "receiver” may be any device capable of receiving audiovisual content included in a broadcast or other programme service transmission from a service provider.
  • a receiver may include a set-top-box (STB), a cable box, general purpose computer, and so on.
  • STB set-top-box
  • a "service provider” may include any entity that provides a programme service transmission to a receiver such as, without limitation, a satellite television distributor, a direct television provider or a cable television company. It should be understood that the term “programme service transmission” generally embraces not only satellite or terrestrial broadcasts and/or narrowcasts but also transmission of information across any wired or wireless transmission medium.
  • a "programme service transmission” encompasses transmission of information across a cable network (for example from a cable headend to a cable receiver), including Internet Protocol (IP) television transmissions, a wireless network such as a radio frequency or infrared network, and so on.
  • IP Internet Protocol
  • the above description includes only one PiP window. In some embodiments, two or more PiP windows may be simultaneously displayed.

Abstract

The invention provides methods and apparatus for providing an enhanced EPG or EPG banner. In particular, there is provided a method of displaying first and second audiovisual content, the first audiovisual content comprising a current programme and the second audiovisual content comprising audiovisual content relating to a future programme according to a programme broadcast schedule, the method comprising receiving the first audiovisual content at a media playback device, receiving the second audiovisual content at the media playback device from a remote content system over a packet-based data network, in response to user input, outputting the first and second audiovisual content to an output device having a screen, and controlling the screen of the output device to display the first and second audiovisual content concurrently. The invention also provides a method of controlling a screen, the display being operable in different modes according to whether a PiP window is shown, and whether currently broadcast or future content is shown.

Description

    TECHNICAL FIELD
  • This invention relates to methods of concurrent first and second audiovisual content display and apparatus for implementing these methods, and particularly to the acquisition of audiovisual clips for display in PiP windows or EPG banners.
  • BACKGROUND OF THE INVENTION
  • Modern broadcast media content such as TV programmes that are broadcast over a satellite network is often provided with an EPG (Electronic Programme Guide) so that users may browse content listings. The EPG or a reduced version of an EPG (such as a channel navigation or EPG banner) can be made available to view on a part of a screen while a first piece of media content such as a TV programme continues to play on the rest of the screen. The EPG content may also be provided on a bespoke EPG content channel, separate to the channels used to broadcast programme content.
  • An example of an EPG banner function is shown in Figure 1. A screen or monitor 1 of an output device shows a current programme 2, which has been received by a media playback device, such as a STB (set-top-box) from a satellite or cable network for example and relayed to the monitor 1. At the request of a user, operating an appropriate button on a remote control, an EPG banner 4 is additionally displayed on the screen while the current programme 2 is still being shown. The EPG banner displays textual information about current and future programmes. A user may, by using the remote control, navigate through the channels to determine what programme content is currently being broadcast, as well as navigate through future time slots for programme content scheduled for transmission. Using further buttons on the remote control, a current programme may be selected for viewing, in which case the current programme displayed on the monitor is updated, or a current or future programme can be selected for recording.
  • However, the information provided to a user by an EPG banner in this way is very limited, and it may be difficult for users to appreciate the nature of the displayed programmes simply by assimilating information provided in textual form. We have therefore appreciated that it would be advantageous to provide an enhanced EPG or EPG banner, facilitating clearer navigation of both currently broadcast programmes and for future programmes.
  • SUMMARY OF THE INVENTION
  • The invention is defined in the independent claims to which reference should now be made. Advantageous features are set forth in the appended claims.
  • According to a first aspect of the invention there is provided a method of displaying first and second audiovisual content, the first audiovisual content comprising a current programme and the second audiovisual content comprising audiovisual content relating to a future programme according to a programme broadcast schedule, the method comprising receiving the first audiovisual content at a media playback device, receiving the second audiovisual content at the media playback device from a remote content system over a packet-based data network, and in response to user input, outputting the first and second audiovisual content to an output device having a screen, and controlling the screen of the output device to display the first and second audiovisual content concurrently. This can provide improved user comprehension of the information being presented.
  • In one embodiment, the second audiovisual content is displayed in response to a user input request entered via a channel change selection function. This helps provide improved user comprehension of the information being presented.
  • In one embodiment, the channel change selection function comprises an on-screen graphical user interface (GUI), displaying textual information and scheduling information for current and future broadcast programmes. This provides further information to users.
  • In one embodiment, the user input request is to navigate to part of the channel change selection function displaying information corresponding to audiovisual content for future broadcast.
  • In one embodiment, the second audiovisual content is displayed on the output device in the graphical user interface (GUI) of the channel change selection function. This provides the information integrally.
  • In one embodiment, the second audiovisual content is displayed on the output device in a PiP (picture-in-picture) window. This provides greater flexibility as the second audiovisual content may then be displayed separately to the GUI.
  • In one embodiment, the second audiovisual content is requested from a service provider or from a third party.
  • In one embedment, the second audiovisual content is requested using a satellite connection, a wireless connection, a cable connection, and/or a packet-based network connection.
  • In one embodiment, the second audiovisual content is requested in response to the user input in real or near real time. This avoids the need to store large quantities of data.
  • In one embodiment, the second audiovisual content and/or the programme broadcast schedule is stored on the media playback device or on a local storage module associated with the media playback device. This allows the second audiovisual content to be played straight away without relying on an external connection.
  • In one embodiment, the second audiovisual content is requested prior to the user input.
  • In one embodiment, the second audiovisual content is requested periodically. This allows the stored data for future second audiovisual content to be kept up to date.
  • In one embodiment, the second audiovisual content is selectively requested based on one or more parameters, the parameters comprising popularity ratings, user preferences, and user browsing patterns. This allows for more efficient use of storage and bandwidth.
  • In one embodiment, the packet-based data network is the Internet.
  • In one embodiment, the first and/or second audiovisual content comprise video or video with audio.
  • In one embodiment, the audio of one of the first audiovisual content and the second audiovisual content is muted. This avoids two audio tracks being superimposed on top of one another.
  • In one embodiment, if both the first and second audiovisual content have an audio element, the audio element of one of the first audiovisual content or the second audiovisual content is muted based on a default setting or a user preference. This provides for the preferred audio track to be chosen.
  • In one embodiment, the output device comprises one or more of a television, a monitor, a screen, a computer, and/or a loudspeaker.
  • In one embodiment, the user input is provided via a user input device. In one embodiment, the user input device is a remote controller or a control interface on the media device or the output device.
  • In one embodiment, the media playback device is a set-top-box (STB) or a computer.
  • According to a second aspect of the invention there is provided a method for controlling a screen, wherein the display is operable in a first mode, in which a first current programme is displayed on the screen, a second mode, in which in response to a user input, a first current programme, a second current program and an EPG or EPG banner are shown,and
    a third mode, in which in response to a user input, a current programme, an audiovisual clip and an EPG or EPG banner are shown. This allows for optimal display at appropriate times, and avoids duplication of information.
  • In one embodiment, the audiovisual clip is shown in a PiP window. In one embodiment, the audiovisual clip is related to a future programme. In one embodiment, the second current programme is shown in a PiP window.
  • In one embodiment, the audiovisual clip is obtained by a method of the first aspect of the invention.
  • In one embodiment, a PiP window is only shown if the current programme does not match a highlighted programme in the EPG or EPG banner. This avoids duplication of information or unnecessary blank, spaces on the display.
  • According to a third aspect of the invention, there is provided a media playback device configured to carry out one or more of the methods of the first and second aspects of the invention. In one embodiment, the media playback device is a STB.
  • According to a fourth aspect of the invention, there is provided a system comprising the device of the third aspect of the invention and the output device of the first aspect of the invention, or the screen of the second aspect of the invention.
  • In one embodiment, the system, additionally comprises the user input device as described in any previous aspect of the invention.
  • According to a fifth aspect of the invention, there is provided a computer-readable medium having computer-executable instructions for performing the method recited in the first or the second aspect of the invention.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • An embodiment of the invention will now be described by way of example only and with reference to the accompanying drawings in which:
    • Figure 1 shows a known TV screen display format;
    • Figure 2 shows a schematic illustration of a system discussed herein;
    • Figures 3 to 5 show a TV screen display according to an example of the invention.
    • Figure 6 shows a flow chart of a method according to one aspect of the invention;
    • Figure 7 shows a flow chart of a method according to a second aspect of the invention.
    DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Figure 2 is a schematic illustration of a general operating environment showing components and features of an example embodiment. Figure 2 includes a service provider 104 that transmits or otherwise provides a programme service transmission to a receiver 108, having a media playback device such as a STB (set-top-box), a cable receiver, or a general purpose computer.
  • The receiver 108 may be associated with or located near an individual, business, or other entity, user or subscriber that receives a programme service transmission from the service provider 104. The programme service transmission may be received through a subscription to the service. Generally the terms "user" and/or "subscriber" refer to an individual or company who receives a programme service transmission. This may include those who have purchased a subscription to the programme service transmission. Additionally, the terms "user" and/or "subscriber" may refer to individuals who have been given access to the programme service transmission through promotional offers and/or other non-fee-based agreements. There may be more than one service provider 104.
  • In connection with embodiments that operate in the context of a satellite television service, the service provider 104 may provide a programme service transmission through an uplink centre 112. The uplink centre 112 may include a transmitter or other equipment operable to transmit a modulated signal having data representing audio and/or visual content. The modulated signal may be received at a satellite 116, which in turn retransmits the modulated signal to be received at one or more terrestrial locations. The retransmitted signal may be received from the satellite 116 at one or more satellite dishes 120, which are typically associated with one or more receivers 108. A receiver 108 may includes a tuner 124 operable to receive the programme service transmission signal through the satellite dish 120 and a decoder 128 to decode the received signal. The decoder 128 may be programmed to decrypt or otherwise decode some or all of the received signal in accordance with purchases and selections made by a user.
  • Embodiments may operate with different product transmission services. Accordingly, although a satellite system is provided as an example of a programme service transmission system, other networks or broadcasts for transmitting data may be used by alternative embodiments. For example, embodiments may be implemented in connection with a cable service or a packet data network rather than a satellite system. In this case, the service provider 104 and the receiver 108 may communicate over a communication path that includes various combinations of local and wide area networks and/or the Internet. In such embodiments, the receiver 108 may be configured to access a web site, a file transfer protocol (FTP) site, a file sharing system or site, and so on.
  • In this example, the receiver includes a network interface 132. The network interface 132 may be operable to communicate or send information across a data network, such as a packet based data network 136. The network interface 132 may take the form of a modem network interface card, cable plug or jack, or the like. Using the network interface, the receiver may communicate over a network 136 such as the public switched telephone network (PSTN). However, it should be appreciated that the network 136 may be any type of network capable of data communication, such as, for example, a local or wide area network or the Internet. The receiver 108 may communicate through the network connection 132 using any suitable communication protocol such as TCP/IP. Through the network interface 132, a user may communicate with the service provider 104. The receiver 108 may also communicate with one or more websites 138 through the network connection 132. In so doing, the receiver 108 may reference and receive information or other content that may be outputted on a display to provide an enhanced or expanded graphical user interface (GUI), in accordance with an example embodiment of the invention. Additionally, the receiver 108 may receive information or other content that may be outputted on a display from the service provider 104. This information could be provided within an optional storage module 113 provided by the service provider 104, or could be provided elsewhere such as on another server. This information could include audiovisual clips or the like.
  • If the network is the Internet, the service provider employs a server, or server-like device, that accepts commands and information using hypertext transfer protocol (HTTP) requests from a web browser agent, here, the receiver 108. In an exemplary embodiment, the network connection of the receiver is a modem, or modem-like device.
  • The receiver 108 may additionally include a processor 140 operable to run executable code in connection with various functions associated with the receiver 108, For example, the processor 140 may display graphics, images, animations or other content on a display 144, such as a television (TV) or monitor. In the case of receiving commands or other information relating to changes to the account status, the processor 140 may be further operable to initiate or facilitate transmission of one or more messages to the service provider 104. The processor 140 may be further operable to recall and display stored content, such as purchased or recorded programmes.
  • Among other functions, the processor 140 may also receive, store, snd/or display an on-screen graphical user interface (GUI) such as an Electronic Programme Guide (EPG), which may provide a schedule of programme content and/or other features. As used herein, the terms "electronic programming guide" or "EPG" are intended to encompass an interface that includes a schedule of programming content provided to a user as part of a programme service transmission system. The EPG may comprise a database or may otherwise access a database containing information including, for example, names or titles of viewing events (programs), corresponding channel numbers and names, brief descriptions of the programs, start and finish times, and rating and content information related to the events. This information may be called EPG information or programme information. Any suitable information may be included in the EPG information. The EPG or programme information may be communicated to a set top box (STB) using a dedicated data channel.
  • The processor 140 executes a display module 148 or programme, which accesses stored EPG data 152 and provides a formatted graphic output on the display 144. Further, the EPG data 152 may by compiled at the service provider 104 through the operation of an EPG management module 154 and transmitted to the receiver 108.
  • For EPG information provided on a specific channel, a tuner in the STB "tunes" to the EPG data channel and collects the EPG information, which is stored in memory of the STB. The EPG information is communicated in a serial fashion to the STB, and thus, has a beginning and an end, For example, the EPG information may start with "programme channel 1" and provide programming information for a predefined number of days or the like for that particular channel. Next, EPG information for "programme channel 2" for the predefined number of days or the like may follow, and so on, until the EPG information for all "programme channels" has been communicated to the STB. the communication of the EPG information then starts again at the beginning of the EPG information. In some instances, the EPG information may simply be repeated. At other times, the EPG information may be updated and then communicated, This looped, periodically repeating communication of the entire EPG information is referred to as a "carousel" EPG information format.
  • If the STB begins receiving the EPG information midway during the communication of the "carousel" of EPG information, the STB understands that a complete set of EPG information has been received when it has gone through the entire carousel of EPG information. That is, the entire carousel of EPG information has been received when the received EPG information has returned to its initial entry point into the carousel of EPG information.
  • While the STB is receiving the EPG information, or once the STB has received a full set of EPG information, the STB can construct and display an EPG to a viewer on their viewing device, such as a television or the like. If the entire carousel of EPG information has not yet been received, a partial EPG may be constructed and presented to the viewer.
  • The viewer is able to interactively scroll about the EPG to view available programming on a programme channel of interest. Also, the viewer is able to navigate about the EPG to view textual information related to scheduled programming at future times of interest on selected programme channels of interest. Some EPGs are configured, based upon commands received from a remote control, to cooperatively work with a remote control so that the viewer may request selected operations on a programme of interest that is highlighted on the EPG. For example, the viewer may select a record feature on their remote control unit such that the highlighted programme on the EPG is recorded by a digital video recorder (DVR) in the STB. A reduced EPG may be shown to the viewer in the form of a banner, such as that shown in Figure 1.
  • The EPG data channel includes EPG information provided as the carousel of EPG information that is communicated in a periodic, serial fashion. That is, the EPG information in the EPG data channel is communicated in a serial format that is periodically repeated. If the receiver has multiple tuners, one of the tuners may be used to provide viewable programming and another tuner can be used to tune to the EPG data channel to receive the carousel of EPG information.
  • The processor 140 can also perform such tasks as executing commands received from a user. User commands may be sent to the receiver 108 through a user input device 156 such as a remote or other wireless device, such as a remote control. As used herein, a "user input device" may include any device operable to receive input from a user and to convey the input to the receiver 108. For example, the user input device 156 may be a hand-held device having a number of buttons or keys that when actuated by a user cause the user input device 156 to convey information to the receiver 108 using a suitable communication means, such as an infrared signal. The user input device 156 may include a pointing device or functionality that allows the user to control the position of a cursor that is displayed on the display 144. For example, the user input device 156 may include a track ball or glide plane that may be manipulated to control cursor movements. The user input device 156 may include a motion sensor or accelerometer that allows a user to control displayed items or graphics, such as a cursor, through movements of his or her hand or arm that cause a displacement of the user input device 156. Alternatively, or additionally, the receiver 108 may itself have one or more controllers thereon that are configured to receive instructions from the viewer. It should be appreciated that other input devices such as a computer mouse or touch screen may be used and other communication means, wired or wireless, may be used. Information sent to the receiver 108 may include, for example, a command to change the displayed channel, a command to pause and/or rewind a displayed programme, a command to display an EPG and/or a command to navigate through the EPG. Commands sent to the receiver 108 may be entered through a dedicated display menu,
  • The receiver 108 may include or be associated with a recorder 160, such as a DVR (digital video recorder). The recorder 160 may be integrated into the receiver 108 or may be a stand-alone device. The recorder 160 may be operated by a user who programs the device or receiver function to record a particular programme at a specified time. When the programme occurs, the recorder 160 will record and store the programme, which can then be viewed later. In addition to this functionality, the recorder 160 may buffer a certain amount of content during a currently broadcast transmission. Buffering a currently broadcast transmission allows a user to pause and/or rewind the content of the transmission and to then display the content in a non-live or delayed manner.
  • The receiver 108 may include or be associated with a memory or other storage device 164, such as magnetic or optical storage. The storage device 164 may be operable to store data received from the decoded satellite signal. The storage device 164 may be operable to store data received from the decoded satellite signal. The storage device 164 may be volatile or non-volatile memory implemented using any suitable technique or technology such as, for example, random access memory (RAM), disk storage, flash memory, solid state, and the like. The storage device 164 may be located either within the receiver or separately from the receiver. The storage device may also be removable in nature. The stored data set may include audio and/or visual content to be transmitted and displayed through the display 144. Generally, audio visual or audiovisual content may include still images, video images, animation and/or audio. Portable Network Graphics (PNG) or other appropriate formats, such as for example, Tagged image File Format (TIFF), Joint Photographic Experts Group (JPEG), Motion Picture Experts Group (MPEG) - 2, MPEG-4 may be used to display an image or video. As a result commands or settings from a user, videos or other programmes may be stored locally in storage device 164. Stored programmes may include for example recorded broadcasts, pay-per-view items and/or buffered portions of a current video broadcast. The receiver itself and/or the storage device may contain various partitions or separate storage portions and may include a programme buffer, a DVR digital video recorder, an EPG access logic storing portion, and/or an EPG information storing portion.
  • The storage device 164 may additionally store an application, file, module or other data that is useable by the processor 140. In one instance, a stored application may be executed by the processor 140 to display content on the display 144, for example display module 148. As used herein, an application or module includes processor executable code that may be run to carry out one or more functions associated with the receiver 108. "Processor executable code" includes any computer-readable media or commands that may be ultimately interpreted by a processor, such as HTML or XML files that are rendered into user-viewable applications by an application executed by the processor. Alternatively the processor or the receiver may comprise a presentation device interface portion to hold this code.
  • An exemplary embodiment of the invention from a user's perspective is now described with reference to Figures 3, 4 and 5. With reference to Figure 3, a monitor 1 shows a current programme 2. On a command from a user, such as the pressing of a directional button on a remote control, an EPG banner 4 is additionally shown on the screen. The EPG banner initially displays information about the programme currently being watched and future programmes on the same channel, although the initial default display may be set to another time or channel. By further pressing of buttons on a remote control, the user may manipulate the EPG banner to show various information about current and future programmes on the same and different channel.
  • Moving to Figure 4, a PiP (picture-in-picture) window 500 is also provided, either integrally with the EPG or EPG banner 4 or separate from it, to show a second piece of media content on a portion of the screen simultaneously to the first piece of media content. When a PiP window is used in conjunction with an EPG, the PiP window can display the audiovisual information associated with the media content currently highlighted or selected in the EPG, which may take the form of a preview of the media content.
  • In the example in Figure 4, the user has changed the information in the EPG banner from displaying information about channel 1 to information about channel 2 by pressing a button. Now that the programme highlighted in the EPG banner (in this example, simply the programme shown leftmost in the EPG banner) is not the currently broadcast programme, a PiP window 500 is automatically added to the display to display audiovisual content relevant to the highlighted programme, in this case a programme that is currently being broadcast on a separate channel,
  • In Figure 5, the user has further manipulated the information displayed by the EPG banner to highlight a programme scheduled for future broadcast. As there is no current broadcast of this programme, the media playback device displays audiovisual content corresponding to a portion of the future broadcast programme, that has been obtained in advance, and displays this in the PiP window. In this way, a user is able to view within the EPG or channel change selection function, audiovisual content corresponding to programmes that are scheduled for future broadcast. This greatly facilitates user comprehension of the EPG and scheduling information being presented to them, and means that a user no longer has to rely solely on the litle of the programme to determine interest where the programme is as yet unviewed, or to recollect the content where the content has been viewed. The presentation of audiovisual information also allows user who have impaired visual acuity or difficulty reading to use the EPG more effectively.
  • The highlighted programme currently selected by the user in the EPG banner is the programme for which the PiP window shows the additional audiovisual preview or information. A programme may be highlighted automatically, as the user navigates through the EPG using directional buttons on the remote. In the example above, the highlighted programme is simply the programme shown leftmost in the EPG banner. Alternatively, the user may be able to move the highlighted position on the EPG banner to different times, without simultaneously altering the position of the information on the screen. There may be no physical indication of which programme is highlighted, or alternatively the highlighted programme, time or time slot may be indicated in some way on the screen, for example shown as a different colour to the rest of the EPG banner. Other methods of highlighting are also possible.
  • One or both of two concurrently shown pieces of audiovisual content may include audio. In the example of Figure 5, the current programme and the PiP window content may include audio as well as video. In the case where there are two audio tracks that would otherwise be played at the same time, it is preferable to mute one or both of the audio tracks. The audio element of the current programme and/or the PiP content may be muted based on a default setting, a user preference, a button on a user input device, a user selection using a cursor on the EPG or EPG banner, or another appropriate selection method.
  • Figure 6 shows a flowchart illustrating a method of receiving and displaying audiovisual content for display in the EPG or EPG banner, Initially, at step 200, the receiver or media playback device receives an input from a control interface or a user input device, requesting audiovisual content. This request may take the form of a user selecting a programme in a list on the EPG using a user input device 156, or simply moving the highlight cursor of the EPG into the programme in the manner described above, whereupon the receiver needs to source a audiovisual clip or suchlike to display.
  • At step 202, the receiver 108 sends a request for the audiovisual content to the service provider 104 or from a third party provider. The request may be made by any appropriate means, such as a cable network or a data packet network such as the internet. At step 204, the receiver 108 receives audiovisual content from the service provider 104.
  • At step 206. the receiver 108 sends the audiovisual content to an output device such as display 144. The display 144 will then output the audiovisual content. The audiovisual content may be, for example, a video clip with or without sound. At step 206, the receiver may additionally control the screen of the display 144 to display the audiovisual content and other audiovisual content concurrently. In this example, the audiovisual content corresponding to the EPG preview of a future programme is retrieved on demand from the server provider in response to a user request.
  • In another embodiment, illustrated by the flowchart in Figure 7, the audiovisual content is pre-emptively provided. At step 300, the receiver requests audiovisual content from the service provider for one or more future programmes. Optionally, the receiver is routinely sent the audiovisual content by the service provider, either at set times or upon initiation of the receiver. In this case, step 300 is not required, and the method starts with operation 302. At step 302, the receiver receives audiovisual content from the service provider, in a similar way to step 204 in Figure 6.
  • At step 304, the receiver stores the received audiovisual content in local memory. The local memory may be within a storage device 164 or in another storage medium within or linked to the receiver, such as a PVR (personal video recorder) or an external hard drive.
  • At step 306, the receiver receives a request for audiovisual content from a user input device, similarly to step 200 in Figure 6. At optional step 308, the receiver retrieves the requested audiovisual content from local memory. This could comprise retrieving the requested audiovisual content from a local memory and adding the requested audiovisual content to a local cache memory or to the display module memory 148. At step 310, the receiver provides audiovisual content to an output device, similarly to step 206 in Figure 3.
  • In the method outlined in Figure 7, the receiver may be provided with all the appropriate audiovisual content for all channels for a pre-determined time period. For example, at a set time of day or upon initiation of the receiver, all the available audiovisual content for all future programs for the rest of the day are acquired. Alternatively, the service provider may provide a selection of audiovisual content for just the most popular programs, or for a set of programs which, based on past viewing habits, the service provider anticipates that the user of the receiver is likely to wish to view.
  • Other strategies can also be used to choose which audiovisual content is provided, based on data acquired by the individual receiver. For example, audiovisual content could be provided for future programmes on the channel that the user is currently watching, or for favourite programme channels selected by the user. Short-term pre-emptive requests for audiovisual clips could also be made. For example, when a user accesses a particular channel on the EPG, some or all of the clips for that particular channel could immediately be requested or automatically provided by the service provider. In some embodiments, as an alternative or additional feature, audiovisual content for the most imminent programmes may be the first to be retrieved, followed by audiovisual content for later scheduled programming. Other systems and patterns of pre-emptive audiovisual content storage based on user habits and real-time user browsing could also be employed.
  • A temporary storage approach to audiovisual content acquisition could be used, whereby audiovisual content acquired pre-emptively is only stored briefly, and is then deleted after a short period of time, for example five minutes after being loaded, or five minutes after a user stops browsing the EPG. In any case, acquired audiovisual content would normally be deleted or overwritten at a later date, to allow for reuse of memory resources.
  • In some embodiments where the network provides for high speed communications, some of all audiovisual content may be provided on a dynamic basis. Thus, no permanent memory storage capacity is used in the receiver's memory. In this case, the receiver is operable to retrieve audiovisual clips of interest on a dynamic real time basis, or near real time basis.
  • Any other audiovisual content that has not been pre-emptively downloaded in this manner, and that subsequently becomes needed, can still be provided using the method described in Figure 6.
  • Some or all of the audiovisual content may be provided by third parties rather than by the service provider. For instance, for programmes scheduled on TV channel BBC1, the receiver may request information directly from the BBC via the Internet, or the BBC may routinely provide the audiovisual content without prompting. The audiovisual content could be sourced from one or more websites 138. Instructions on where the receiver should source the audiovisual content may be part of the EPG metadata in the relevant block of EPG data routinely provided to the receiver by the service provider.
  • As discussed elsewhere, a browser or the like may be integrated into the EPG access logic. Accordingly, when the remote EPG content system is implemented as an internet accessible system, the browser can access EPG information of interest. Alternatively, the browser may be separately implemented as part of another component and/or function.
  • By extension of the methods described herein, other supplemental information that may be of interest to the viewer may be additionally provided over the network link. For example, additional programme description information may include additional information on the programme plot or story line, additional information pertaining to programme actors or performers, and/or may provide information about related programming. Such supplemental information can be too voluminous for inclusion in the carousel of EPG information. Memory requirements to store the supplemental information in the receiver may be too extensive to justify memory costs. The time to receive an entire carousel of EPG information that includes the supplemental information for every programme described in the EPG may be to long to be practical.
  • The audiovisual content may be formatted using a suitable video data standard, such as, but not limited to, the moving pictures experts group (MPEG) digital video broadcasting (DVB) standard or the American television standards committee (ATSC) standard. Thus, the EPG information is encoded using a common internet protocol (IP) format that may be selectively accessed by the receiver. For example, HTTP or XML formats may be used.
  • An exemplary embodiment of the receiver 108 is a set top box (STB). Embodiments may be implemented in other media devices, such as, but not limited to stereos, radios, televisions (TVs), digital video disc (DVD) players, digital video recorders (DVRs), personal device assistants (PDAs), or personal computers (PCs).
  • While the network is preferably the Internet, in some embodiments the network may also be a telephony system, a radio frequency (RF) wireless system, a microwave communication system, a fibre optics system, an intranet system, a local access network (LAN) system, an Ethernet system, a cable system, a radio frequency system, a cellular system, an infrared system, a satellite system, or a hybrid system comprised of multiple types of communication media.
  • In an Internet-based environment, the receiver establishes a link to the service provider via the network, such as, but not limited to, World Wide Web (WWW). The link may be a persistent connection. Non-limiting examples of possible persistent type connections are a HTTP keep-alive or a HTTP connection reuse. In other embodiments, particularly where the link can be quickly established, the link is established on an as-needed basis.
  • As used herein, a "receiver" may be any device capable of receiving audiovisual content included in a broadcast or other programme service transmission from a service provider. For example, a receiver may include a set-top-box (STB), a cable box, general purpose computer, and so on. As used herein, a "service provider" may include any entity that provides a programme service transmission to a receiver such as, without limitation, a satellite television distributor, a direct television provider or a cable television company. It should be understood that the term "programme service transmission" generally embraces not only satellite or terrestrial broadcasts and/or narrowcasts but also transmission of information across any wired or wireless transmission medium. Accordingly, a "programme service transmission" encompasses transmission of information across a cable network (for example from a cable headend to a cable receiver), including Internet Protocol (IP) television transmissions, a wireless network such as a radio frequency or infrared network, and so on.
  • The above description includes only one PiP window. In some embodiments, two or more PiP windows may be simultaneously displayed.
  • Various modifications to the embodiments described are possible and will occur to those skilled in the art without departing from the invention which is defined by the following claims.

Claims (15)

  1. A method of displaying first and second audiovisual content, the first audiovisual content comprising a current programme and the second audiovisual content comprising audiovisual content relating to a future programme according to a programme broadcast schedule, the method comprising:
    receiving the first audiovisual content at a media playback device;
    receiving the second audiovisual content at the media playback device from a remote content system over a data network; and
    in response to user input, outputting the first and second audiovisual content to an output device having a screen; and
    controlling the screen of the output device to display the first and second audiovisual content concurrently.
  2. The method of claim 1, wherein the second audiovisual content is displayed in response to a user input request entered via a channel change selection function.
  3. The method of claim 2, wherein the channel change selection function comprises an on-screen graphical user interface (GUI), displaying textual information and scheduling information for current and future broadcast programmes.
  4. The method of claim 3, wherein the user input request is to navigate to part of the channel change selection function displaying information corresponding to audiovisual content for future broadcast.
  5. The method of any preceding claim, wherein the second audiovisual content is displayed on the output device in the graphical user interface of the channel change selection function.
  6. The method of any of claims 2 to 5, wherein the channel change selection function is an EPG or EPG banner.
  7. The method of any preceding claim, wherein the second audiovisual content is displayed on the output device in a PiP (picture-in-picture) window.
  8. The method of any preceding claim, wherein the second audiovisual content is requested from a service provider or from a third party.
  9. The method of any preceding claim, wherein the second audiovisual content and/or the programme broadcast schedule is stored on the media playback device or on a local storage module associated with the media playback device.
  10. The method of claim 9, wherein the second audiovisual content is requested prior to the user input or is requested periodically.
  11. The method of any preceding claim, in which the audio of one of the first audiovisual content and the second audiovisual content is muted.
  12. The method of any preceding claim, in which, if both the first and second audiovisual content have an audio element, the audio element of one of the first audiovisual content or the second audiovisual content is muted based on a default setting, user setting, or user preference.
  13. A media playback device configured to carry out the method of any preceding claim.
  14. The device of claim 13, wherein the media playback device is a STB.
  15. A computer-readable medium having computer-executable instructions for performing the method recited in any of claims 1 to 12.
EP11166892A 2011-05-20 2011-05-20 Enhanced programme preview content Ceased EP2525569A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP11166892A EP2525569A1 (en) 2011-05-20 2011-05-20 Enhanced programme preview content
CA2777439A CA2777439A1 (en) 2011-05-20 2012-05-18 Enhanced programme preview content
MX2012005830A MX2012005830A (en) 2011-05-20 2012-05-18 Enhanced programme preview content.
US13/475,808 US8595768B2 (en) 2011-05-20 2012-05-18 Enhanced program preview content
US14/071,613 US20140068675A1 (en) 2011-05-20 2013-11-04 Enhanced program preview content

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP11166892A EP2525569A1 (en) 2011-05-20 2011-05-20 Enhanced programme preview content

Publications (1)

Publication Number Publication Date
EP2525569A1 true EP2525569A1 (en) 2012-11-21

Family

ID=44583678

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11166892A Ceased EP2525569A1 (en) 2011-05-20 2011-05-20 Enhanced programme preview content

Country Status (4)

Country Link
US (2) US8595768B2 (en)
EP (1) EP2525569A1 (en)
CA (1) CA2777439A1 (en)
MX (1) MX2012005830A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430474A (en) * 2015-12-02 2016-03-23 浪潮软件集团有限公司 Channel previewing method and device
CN108419122A (en) * 2018-05-03 2018-08-17 深圳市茁壮网络股份有限公司 A kind of TV program guide method and device

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8584167B2 (en) 2011-05-31 2013-11-12 Echostar Technologies L.L.C. Electronic programming guides combining stored content information and content provider schedule information
US20120324507A1 (en) * 2011-06-15 2012-12-20 Michael Ryan Weber Interactive Ticker
US8627349B2 (en) 2011-08-23 2014-01-07 Echostar Technologies L.L.C. User interface
US9060152B2 (en) 2012-08-17 2015-06-16 Flextronics Ap, Llc Remote control having hotkeys with dynamically assigned functions
US11368760B2 (en) 2012-08-17 2022-06-21 Flextronics Ap, Llc Applications generating statistics for user behavior
US9602875B2 (en) 2013-03-15 2017-03-21 Echostar Uk Holdings Limited Broadcast content resume reminder
US8973038B2 (en) 2013-05-03 2015-03-03 Echostar Technologies L.L.C. Missed content access guide
WO2014186655A1 (en) * 2013-05-17 2014-11-20 Aereo, Inc. User interface for video delivery system with program guide overlay
US9930404B2 (en) 2013-06-17 2018-03-27 Echostar Technologies L.L.C. Event-based media playback
US9848249B2 (en) 2013-07-15 2017-12-19 Echostar Technologies L.L.C. Location based targeted advertising
US9066156B2 (en) 2013-08-20 2015-06-23 Echostar Technologies L.L.C. Television receiver enhancement features
US10297287B2 (en) 2013-10-21 2019-05-21 Thuuz, Inc. Dynamic media recording
CN103747319A (en) * 2013-12-16 2014-04-23 乐视致新电子科技(天津)有限公司 Intelligent television program previewing method and intelligent television
US9860477B2 (en) 2013-12-23 2018-01-02 Echostar Technologies L.L.C. Customized video mosaic
US9420333B2 (en) 2013-12-23 2016-08-16 Echostar Technologies L.L.C. Mosaic focus control
US9621959B2 (en) 2014-08-27 2017-04-11 Echostar Uk Holdings Limited In-residence track and alert
US9936248B2 (en) 2014-08-27 2018-04-03 Echostar Technologies L.L.C. Media content output control
US9628861B2 (en) 2014-08-27 2017-04-18 Echostar Uk Holdings Limited Source-linked electronic programming guide
US9681176B2 (en) 2014-08-27 2017-06-13 Echostar Technologies L.L.C. Provisioning preferred media content
US9681196B2 (en) 2014-08-27 2017-06-13 Echostar Technologies L.L.C. Television receiver-based network traffic control
US9565474B2 (en) 2014-09-23 2017-02-07 Echostar Technologies L.L.C. Media content crowdsource
US11863848B1 (en) 2014-10-09 2024-01-02 Stats Llc User interface for interaction with customized highlight shows
US10419830B2 (en) 2014-10-09 2019-09-17 Thuuz, Inc. Generating a customized highlight sequence depicting an event
US10536758B2 (en) 2014-10-09 2020-01-14 Thuuz, Inc. Customized generation of highlight show with narrative component
US10433030B2 (en) 2014-10-09 2019-10-01 Thuuz, Inc. Generating a customized highlight sequence depicting multiple events
US10432296B2 (en) 2014-12-31 2019-10-01 DISH Technologies L.L.C. Inter-residence computing resource sharing
US9800938B2 (en) 2015-01-07 2017-10-24 Echostar Technologies L.L.C. Distraction bookmarks for live and recorded video
US10440421B2 (en) 2015-08-14 2019-10-08 DISH Technologies L.L.C. Apparatus, systems and methods for electronic program guide information presented on a display
US9986285B2 (en) * 2015-12-01 2018-05-29 DISH Technologies L.L.C. Set future video recordings from audiovisual content
US10015539B2 (en) 2016-07-25 2018-07-03 DISH Technologies L.L.C. Provider-defined live multichannel viewing events
US10021448B2 (en) 2016-11-22 2018-07-10 DISH Technologies L.L.C. Sports bar mode automatic viewing determination
WO2019203370A1 (en) * 2018-04-16 2019-10-24 엘지전자 주식회사 Multimedia device and control method therefor
US11138438B2 (en) 2018-05-18 2021-10-05 Stats Llc Video processing for embedded information card localization and content extraction
US11025985B2 (en) 2018-06-05 2021-06-01 Stats Llc Audio processing for detecting occurrences of crowd noise in sporting event television programming
US11264048B1 (en) 2018-06-05 2022-03-01 Stats Llc Audio processing for detecting occurrences of loud sound characterized by brief audio bursts
CN113490030A (en) * 2021-06-28 2021-10-08 Vidaa美国公司 Display device and channel information display method
CN113784203A (en) * 2021-09-08 2021-12-10 Vidaa美国公司 Display device and channel switching method

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998037694A1 (en) * 1997-02-19 1998-08-27 Time Warner Entertainment Company, L.P., Doing Business As Time Warner Cable System and method for providing a full service television system
US6005562A (en) * 1995-07-20 1999-12-21 Sony Corporation Electronic program guide system using images of reduced size to identify respective programs
US20030126605A1 (en) * 2001-12-28 2003-07-03 Betz Steve Craig Method for displaying EPG video-clip previews on demand
KR20040025073A (en) * 2002-09-18 2004-03-24 주식회사 알티캐스트 Method for displaying schedule information on television screen with thumbnail channel image on digital broadcasting
WO2007064987A2 (en) * 2005-12-04 2007-06-07 Turner Broadcasting System, Inc. (Tbs, Inc.) System and method for delivering video and audio content over a network
WO2007098067A1 (en) * 2006-02-17 2007-08-30 The Directv Group, Inc. Dynamic viewership rating system
WO2009073925A1 (en) * 2007-12-12 2009-06-18 Colin Simon Method, system and apparatus to enable convergent television accessibility on digital television panels with encryption capabilities
EP2309733A1 (en) * 1996-03-15 2011-04-13 Gemstar Development Corporation Combination of VCR index and EPG

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6177931B1 (en) * 1996-12-19 2001-01-23 Index Systems, Inc. Systems and methods for displaying and recording control interface with television programs, video, advertising information and program scheduling information
CN1430851A (en) * 2000-05-23 2003-07-16 联合视频制品公司 Interactive TV. application with watch lists
KR20060128295A (en) 2005-06-10 2006-12-14 엘지전자 주식회사 Method for searching different broadcasting channel
US7532253B1 (en) 2005-07-26 2009-05-12 Pixelworks, Inc. Television channel change picture-in-picture circuit and method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6005562A (en) * 1995-07-20 1999-12-21 Sony Corporation Electronic program guide system using images of reduced size to identify respective programs
EP2309733A1 (en) * 1996-03-15 2011-04-13 Gemstar Development Corporation Combination of VCR index and EPG
WO1998037694A1 (en) * 1997-02-19 1998-08-27 Time Warner Entertainment Company, L.P., Doing Business As Time Warner Cable System and method for providing a full service television system
US20030126605A1 (en) * 2001-12-28 2003-07-03 Betz Steve Craig Method for displaying EPG video-clip previews on demand
KR20040025073A (en) * 2002-09-18 2004-03-24 주식회사 알티캐스트 Method for displaying schedule information on television screen with thumbnail channel image on digital broadcasting
WO2007064987A2 (en) * 2005-12-04 2007-06-07 Turner Broadcasting System, Inc. (Tbs, Inc.) System and method for delivering video and audio content over a network
WO2007098067A1 (en) * 2006-02-17 2007-08-30 The Directv Group, Inc. Dynamic viewership rating system
WO2009073925A1 (en) * 2007-12-12 2009-06-18 Colin Simon Method, system and apparatus to enable convergent television accessibility on digital television panels with encryption capabilities

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430474A (en) * 2015-12-02 2016-03-23 浪潮软件集团有限公司 Channel previewing method and device
CN108419122A (en) * 2018-05-03 2018-08-17 深圳市茁壮网络股份有限公司 A kind of TV program guide method and device

Also Published As

Publication number Publication date
US8595768B2 (en) 2013-11-26
CA2777439A1 (en) 2012-11-20
US20140068675A1 (en) 2014-03-06
US20120297422A1 (en) 2012-11-22
MX2012005830A (en) 2013-03-27

Similar Documents

Publication Publication Date Title
US8595768B2 (en) Enhanced program preview content
US11956514B2 (en) Systems and methods for enhanced trick-play functions
US7200857B1 (en) Synchronized video-on-demand supplemental commentary
US10230917B2 (en) Program guide graphical user interface systems and methods
US20080168503A1 (en) System and Method for Selecting and Viewing Broadcast Content Based on Syndication Streams
EP1578120A2 (en) Method and apparatus for generating a program guide
JP2005514876A (en) Method for displaying an on-demand preview of an electronic program guide (EPG) video clip
EP2460348B1 (en) Multi-user recording allocation
US20100325665A1 (en) Automatic Web Searches Based on EPG
US20090013355A1 (en) Broadcast scheduling method and broadcast receiving apparatus using the same
EP2381679A2 (en) A receiver and a method for providing access to viewer-orderable television events
US8799956B2 (en) EPG content tree
AU2006339439B2 (en) Systems and methods for enhanced trick-play functions
EP2211543A1 (en) System and method for remotely managing a recording device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20130521

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: ECHOSTAR UK HOLDINGS LIMITED

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: ECHOSTAR UK HOLDINGS LIMITED

17Q First examination report despatched

Effective date: 20170327

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: ECHOSTAR TECHNOLOGIES L.L.C.

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: DISH TECHNOLOGIES L.L.C.

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20190626