EP1491036A1 - Procede et appareil de presentation de graphiques sur un afficheur auxiliaire a l'aide de pilotes graphiques de bas niveau - Google Patents

Procede et appareil de presentation de graphiques sur un afficheur auxiliaire a l'aide de pilotes graphiques de bas niveau

Info

Publication number
EP1491036A1
EP1491036A1 EP03714207A EP03714207A EP1491036A1 EP 1491036 A1 EP1491036 A1 EP 1491036A1 EP 03714207 A EP03714207 A EP 03714207A EP 03714207 A EP03714207 A EP 03714207A EP 1491036 A1 EP1491036 A1 EP 1491036A1
Authority
EP
European Patent Office
Prior art keywords
display device
auxiliary display
graphics
stb
driver calls
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP03714207A
Other languages
German (de)
English (en)
Inventor
Barry P. Falvo
Aniela M. Rosenberger
Glen P. Ii Goffin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Arris Technology Inc
Original Assignee
Arris Technology Inc
General Instrument Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Arris Technology Inc, General Instrument Corp filed Critical Arris Technology Inc
Publication of EP1491036A1 publication Critical patent/EP1491036A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/10—Adaptations for transmission by electrical cable
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4431—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB characterized by the use of Application Program Interface [API] libraries
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
    • H04N7/163—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing by receiver means only

Definitions

  • the present invention generally relates to the transmission of interactive graphics for viewing and interacting with applications running on a processor of a remote device.
  • FIG. 1 shows a conventional two-screen digital cable TV system 100.
  • the system 100 includes an auxiliary display device 105 which communicates with a digital set-top box (STB) 110 (also referred to as a "local device") using a wireless connection.
  • STB digital set-top box
  • the wireless connection utilizes an external port 115 on the STB 110, such as a Universal serial bus (USB), Ethernet, or IEEE 1394 port equipped with an access point 120 that communicates with the auxiliary display device 105 over a wireless radio frequency (RF) link 125.
  • RF radio frequency
  • the access point 120 in this scenario is a device designed for a specific interface (e.g., USB) and is used to support wireless connectivity.
  • the auxiliary display device 105 may also be connected directly to a high-speed cable modem, digital subscriber (DSL) modem or any other high-speed Internet connection device to access the Internet 135.
  • TV video programming 140 is accessible via STB 110.
  • Typical wireless connection protocols that may be used by TV system 100 include, but are not limited to, HomeRF ® and IEEE 802.11.
  • a more traditional wired connection simply includes a cable or wire between the STB 110 and the auxiliary display device 105, again using a USB, Ethernet, or IEEE 1394 port.
  • the STB 110 is also connected to a television 130.
  • the two-screen digital cable TV system 100 allows for many enhanced capabilities over a one-screen system. For example, a user can view Internet data on the screen of the auxiliary display device 105, while watching video uninterrupted on the television 130. In another example, STB applications that are normally viewed on the television screen, are viewed on the screen of the auxiliary display device 105, leaving the television 130 available for video program viewing.
  • an electronic program guide is a specific example of an application that can be interacted with through an application running on a second screen device, such as auxiliary display device 105.
  • An EPG is used by a viewer to determine what programs are available for viewing on a television, at what time the programs will be broadcast, and on which channels. More sophisticated EPGs display supplemental information used by the viewer to determine whether the program is suitable for young children, what actors are in the program, how long the program is, and what the program is about. Normally in an EPG, an individual windowed portion is allocated for each program displayed. Viewers of CATV programs use a GUI to navigate an EPG and select program windows in the EPG that are of particular interest.
  • the present invention enables graphics information to be sent to an auxiliary display device for display in a communications system including an auxiliary display device and a set- top box (STB).
  • STB set- top box
  • the STB transmits graphical data to the auxiliary display.
  • the graphical data includes abstracted graphics driver calls.
  • the driver calls are processed in the auxiliary display device using graphic drivers residing in the auxiliary display device. Graphics are displayed on a display in the auxiliary display device, based on the processed driver calls.
  • User inputs may be transmitted from the auxiliary display device to the STB. The user inputs are responses to selections presented by the graphics on the display of the auxiliary display device.
  • a wireless local area network (WLAN) protocol and or infrared transmission may be used to transmit the user inputs.
  • the abstracted graphics driver calls may be packaged in a wireless local area network (WLAN) protocol.
  • the abstracted graphics driver calls may be low level graphics driver calls.
  • the displayed graphics may include a television program grid of an electronic program guide (EPG).
  • the communications system may be a cable television (CATV) system.
  • CATV cable television
  • the STB may include a local graphics application running at least one application program interface (API) layer, at least one driver layer, and at least one hardware layer including a processor.
  • API application program interface
  • the auxiliary display device may include a remote graphics application running at least one application program interface (API) layer, at least one driver layer, and at least one hardware layer including a processor.
  • API application program interface
  • FIG. 1 shows a conventional two-screen digital cable TV system
  • FIG. 2 shows a communications system operating in accordance with the present invention
  • FIG. 3 shows a simplified representation of two-screen API architecture used in accordance with the present invention
  • FIG. 4 shows a simplified representation of a remote control API architecture used in accordance with the present invention.
  • FIG. 5 is a high-level functional flowchart including steps implemented in accordance with the present invention. DETAILED DESCRIPTION OF THE INVENTION
  • Graphics information is transmitted from an STB to an auxiliary display device.
  • the graphics information does not include pixel representations, which would require high bandwidth and fast processing.
  • the graphics information include high level application program interface (API) calls.
  • API application program interface
  • the graphics information includes abstracted graphics call drivers, such as drivers that instruct a display to construct an image (e.g., draw a square, color red, large size at X, Y, Z coordinates).
  • the abstracted graphics driver calls are low level graphics drivers and are packaged in a wireless local area network (WLAN) protocol, such as 802.1 lb.
  • WLAN wireless local area network
  • the low level API gives a user complete access to the screen and to input events. Although, this access requires everything that is shown on the screen to be programmed, the memory and processing requirements for the auxiliary display device are drastically reduced.
  • an STB typically hosts applications that are capable of rendering graphics to the display device.
  • FIG. 2 shows a communications system (e.g., CATV system) 200 including an STB 205 and an auxiliary display device 210.
  • a communications system e.g., CATV system
  • the STB 205 (i.e., local device) includes a local graphics application 215 that runs on a first processor 220.
  • the local graphics application 215 includes at least one API layer, at least one driver layer, and at least one hardware layer.
  • the auxiliary display device 210 i.e., remote wireless device, second screen device
  • the remote graphics application 225 also includes at least one API layer, at least one driver layer, and at least one hardware layer.
  • the STB 205 communicates with a television 240 (i.e., first screen device).
  • the local graphics application 215 communicates with the remote graphics application 225.
  • the STB 205 communicates abstracted graphics driver calls to the auxiliary display device 210 via wireless communications medium 245, and processes remote control commands received from the auxiliary display device 210.
  • the abstracted graphics driver calls can be low level graphics driver calls.
  • FIG. 3 shows a two-screen API architecture supporting the transmission of graphics calls.
  • the STB 205 transmits graphical data including abstracted graphics driver calls over the wireless communications medium 245 to the auxiliary display device 210.
  • the driver calls are passed on to an API layer in the remote graphics application 225 of the auxiliary display device 210.
  • Graphics are displayed on display 235 of the auxiliary display device 210 in accordance with the driver calls received from STB 205.
  • the graphics displayed on display 235 can include a television program grid of an electronic program guide (EPG).
  • EPG electronic program guide
  • FIG. 4 shows a two-screen API architecture supporting the transmission of remote control commands.
  • the auxiliary display device 210 transmits remote control commands based on user inputs to the STB 205 over the wireless communications medium 245.
  • the remote control commands are passed to an API layer in the local graphics application 215 of the STB 205.
  • the remote graphics application 225 can accept user inputs (e.g., via a touch screen or keyboard) in response to the graphics presented.
  • the remote graphics application 225 communicates the user inputs to the local graphics application 215 via the wireless communications medium 245, and the user inputs are processed by the STB 205.
  • a wireless local area network (WLAN) protocol and/or infrared transmission can be used to transmit the user inputs to the STB 205.
  • the abstracted graphics driver calls can be based on proprietary or open standard- based graphics APIs.
  • the graphics APIs are encapsulated in a remote communications message such that the auxiliary display device 210 can process commands with its own specific hardware suite and drivers.
  • the abstracted graphics driver calls are suitable for implementing on-screen and interactive display applications, such as an electronic or interactive program guide, web- browsing, email, or the like.
  • Several "open standard" graphics APIs are cmrently in use throughout the computing industry. Some examples include: [0027] (1) OpenGL, for example:
  • the abstracted graphics driver calls are packaged by the STB 205 in at least one communications package, such as one using a WLA ⁇ protocol, which is sent to the auxiliary display device 210.
  • the auxiliary display device 210 receives and "unwraps" the communications package, and then processes the abstracted graphics driver calls with its own hardware and drivers.
  • FIG. 5 shows the steps implemented by a method operating in accordance with the present invention.
  • the STB 205 transmits graphical data to the auxiliary display device 210 over a wireless communications medium 245.
  • the graphical data includes abstracted graphics calls.
  • step 510 the driver calls are processed in the auxiliary display device 210 using graphic drivers residing in the remote graphics application 225.
  • graphics are displayed on display 235 in the auxiliary display device 210, based on the process - driver calls.
  • step 520 user inputs are transmitted from the auxiliary display device 210 to the STB 205 over the wireless communications medium 245. The user inputs are responses to selections presented by the graphics on the display 235 of the auxiliary display device 210.
  • the present invention may be implemented with any combination of hardware and software. If implemented as a computer-implemented apparatus, the present invention is implemented using means for performing all of the steps and functions described above.
  • the present invention can be included in an article of manufacture (e.g., one or more computer program products) having, for instance, computer useable media.
  • the media has embodied therein, for instance, computer readable program code means for providing and facilitating the mechanisms of the present invention.
  • the article of manufacture can be included as part of a computer system or sold separately.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Library & Information Science (AREA)
  • Computer Graphics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Details Of Television Systems (AREA)
  • Selective Calling Equipment (AREA)

Abstract

L'invention porte sur un procédé et appareil de présentation de graphiques sur un afficheur auxiliaire à l'aide de pilotes graphiques dans un système de communication (par exemple CATV) (200). Le système (200) comprend un dispositif auxiliaire d'affichage (210) et un décodeur (205) qui transmet des données graphiques au dispositif auxiliaire d'affichage (210) par l'intermédiaire d'un moyen de communication sans fil (245). Les données graphiques comportent des appels de conducteurs graphiques abrégés qui sont traitées dans le dispositif auxiliaire d'affichage (210) à l'aide des pilotes graphiques y résidant. Les graphiques sont présentés sur l'écran (235) du dispositif auxiliaire d'affichage (210) en utilisant les appels de conducteurs traités, et les entrées de l'utilisateur sont transmises du dispositif auxiliaire d'affichage (210) du décodeur (205) par un moyen de communication sans fil (245). Les entrées de l'utilisateur sont des réponses à des sélections présentées par des graphiques sur l'écran (235) du dispositif auxiliaire d'affichage (210).
EP03714207A 2002-04-04 2003-03-14 Procede et appareil de presentation de graphiques sur un afficheur auxiliaire a l'aide de pilotes graphiques de bas niveau Withdrawn EP1491036A1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US11563302A 2002-04-04 2002-04-04
US115633 2002-04-04
PCT/US2003/008124 WO2003085960A1 (fr) 2002-04-04 2003-03-14 Procede et appareil de presentation de graphiques sur un afficheur auxiliaire a l'aide de pilotes graphiques de bas niveau

Publications (1)

Publication Number Publication Date
EP1491036A1 true EP1491036A1 (fr) 2004-12-29

Family

ID=28789827

Family Applications (1)

Application Number Title Priority Date Filing Date
EP03714207A Withdrawn EP1491036A1 (fr) 2002-04-04 2003-03-14 Procede et appareil de presentation de graphiques sur un afficheur auxiliaire a l'aide de pilotes graphiques de bas niveau

Country Status (8)

Country Link
EP (1) EP1491036A1 (fr)
JP (1) JP2005522151A (fr)
KR (1) KR20040111483A (fr)
CN (1) CN1647500A (fr)
AU (1) AU2003218214A1 (fr)
CA (1) CA2481000A1 (fr)
MX (1) MXPA04009699A (fr)
WO (1) WO2003085960A1 (fr)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040235520A1 (en) 2003-05-20 2004-11-25 Cadiz Jonathan Jay Enhanced telephony computer user interface allowing user interaction and control of a telephone using a personal computer
US7549154B2 (en) * 2004-11-23 2009-06-16 Microsoft Corporation Extensible architecture for auxiliary displays
US7634780B2 (en) * 2004-11-23 2009-12-15 Microsoft Corporation Method and system for exchanging data between computer systems and auxiliary displays
US8659505B2 (en) * 2005-08-31 2014-02-25 Mircosoft Corporation Auxiliary display device driver interface
US9167209B2 (en) * 2007-09-18 2015-10-20 Thomson Licensing Method for a touch screen that interfaces with a set top box
US20090217170A1 (en) * 2008-02-27 2009-08-27 Audividi Inc. System and method for sharing display information
US9258402B2 (en) * 2009-04-14 2016-02-09 Qualcomm Incorporated System and method for controlling mobile devices
KR101964252B1 (ko) * 2011-01-05 2019-04-01 톰슨 라이센싱 멀티-스크린 상호 작용
GB2491634A (en) * 2011-06-10 2012-12-12 Ant Software Ltd Displaying Interactive Content from a Received Video Stream on a Second Screen

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6209132B1 (en) * 1995-06-15 2001-03-27 Intel Corporation Host apparatus for simulating two way connectivity for one way data streams
US6141002A (en) * 1996-11-12 2000-10-31 Opentv, Inc. System and method for downloading and rendering glyphs in a set top box
US6577849B1 (en) * 1999-02-03 2003-06-10 Motorola, Inc. Method and apparatus for providing additional information about a broadcast
GB9906378D0 (en) * 1999-03-18 1999-05-12 Pace Micro Tech Plc Infra red modem
BR0015498A (pt) * 1999-11-12 2002-07-23 Zenith Electronics Corp Sistema de recuperação de dados para recuperar dados de um sinal de difusão digital
EP1254563A2 (fr) * 2000-02-04 2002-11-06 Intel Corporation Affichage de contenu ameliore sur une unite de commande a distance

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO03085960A1 *

Also Published As

Publication number Publication date
WO2003085960A1 (fr) 2003-10-16
JP2005522151A (ja) 2005-07-21
CN1647500A (zh) 2005-07-27
AU2003218214A1 (en) 2003-10-20
MXPA04009699A (es) 2004-12-13
CA2481000A1 (fr) 2003-10-16
KR20040111483A (ko) 2004-12-31

Similar Documents

Publication Publication Date Title
JP4541476B2 (ja) マルチ画像表示システムおよびマルチ画像表示方法
KR100929474B1 (ko) 컨텍스추얼 웹 페이지 시스템 및 방법
TWI411297B (zh) 與遠端影像來源裝置相關之同屏顯示
US6020863A (en) Multi-media processing system with wireless communication to a remote display and method using same
US7574691B2 (en) Methods and apparatus for rendering user interfaces and display information on remote client devices
US6762798B1 (en) Methods and apparatus for providing video control for television applications
US6259443B1 (en) Method and apparatus for enabling multiple users to concurrently access a remote server using set-top boxes
JP4315239B2 (ja) 変化可能な透明度の表示
US6195797B1 (en) Apparatus and method for providing computer display data from a computer system to a remote display device
WO2021189708A1 (fr) Procédé de mise en marche de protection d'écran pour dispositif d'affichage, et dispositif d'affichage
WO2021189712A1 (fr) Procédé de commutation d'une vidéo d'une page web d'une lecture en plein écran à une lecture en incrustation et dispositif d'affichage
US11662971B2 (en) Display apparatus and cast method
EP1491036A1 (fr) Procede et appareil de presentation de graphiques sur un afficheur auxiliaire a l'aide de pilotes graphiques de bas niveau
JP2002033974A (ja) 複数のヘッダを用いることにより単一のｏｓｄピクスマップを複数のビデオラスタサイズにわたって使用する方法およびシステム
US7661122B2 (en) Method and device for initializing cable card and channel list using reset menu on OSD screen
CN112040309B (zh) 一种频道切换方法及显示设备
CN111954043B (zh) 一种信息栏显示方法及显示设备
EP1192617A1 (fr) Procedes et appareil permettant de creer une fenetre video au moyen de parametres definissant la position et l'echelle
CN111064982B (zh) 一种显示控制方法、存储介质及显示设备
CN111526401B (zh) 一种视频播放控制方法及显示设备
US20030142038A1 (en) Remote markup of a display device using a wireless internet appliance as an electronic canvas
US20040194145A1 (en) Leveraging PC processing power to handle CPU intensive tasks
CN111949179A (zh) 一种控件放大方法及显示设备
CN113436564B (zh) 一种epos的展示方法及显示设备
CN113542823B (zh) 一种显示设备及应用页面的展示方法

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20041014

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20071002

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230520