MXPA99009373A - System for forming and processing an mpeg compatible datastream incorporating internet information - Google Patents

Abstract

A data format includes MPEG compatible video data and Internet image information suitable for conveying packetized video program data and associated web image information. The data format comprises MPEG system data that includes a first transport packet with a header containing a first data identifier (PID) for identifying (605, 615) the video program data in a payload of the first transport packet. The MPEG system data also includes a second transport packet containing a second data identifier (PID) for identifying (605, 610) Internet information contained in a payload of the second transport packet. The MPEG system data also includes ancillary data supporting the identification and decoding (620, 625) of the Internet information and containing the second data identifier. Internet data in the composite data format is decoded and synchronized with video program data by applying the ancillary data in identifying, decoding and assembling (630) the Internet information.

Description

SYSTEM FOR FORMING AND PROCESSING A DATA CURRENT COMPATIBLE WITH MPEG THAT INCORPORATES INTERNET INFORMATION This is a non-provisional application of the provisional application with Serial Number 60 / 043,539 by R.J. Logan et al., Filed on April 14, 1997.

Field of the Invention This invention relates to the field of digital signal processing, and more particularly, to a data format, and to a system for decoding MPEG compatible data incorporating Internet information.

BACKGROUND OF THE INVENTION Home entertainment systems that combine functions of Personal Computer and Television (PC / TV systems), are becoming more and more generic communication devices, interactive with the User, from multiple sources, and from multiple destinations . These systems are required to communicate in different data formats between multiple locations for a variety of applications in response to User requests. For example, a PC / TV system can receive data from satellite or terrestrial sources that include High Definition Television (HDTV) transmissions, Multi-Point Microwave Distribution System (MMDS) transmissions, and Digital Video Transmissions (DVB). ). A PC / TV system can also receive and transmit data via telephone (for example, Internet) and coax (for example, cable TV), and both from remote and local sources, such as Video Disc type players. Digital (DVD), CDROM, VHS, and digital VHS (DVHSMR), PCs, and many other types of sources. A number of problems in the development of this generic PC / TV entertainment system are presented. Specifically, there are problems in the communication support between multiple data sources, and in the processing of data from multiple sources. A problem also arises from the need to devise a User interface for this system that supports complex user interactive tasks, while providing a simple command interface suitable for the general public. A user interface of the PC / TV system, for example, must allow a User to see a selected program, and allow the User to operate functions such as email, telephone, Internet access, fax, and video functions -phone. These applications require communication between a PC / TV unit and a variety of remote sources, such as a satellite service provider, such as a local DVD source, and a PC / TV. processing - decoding data in different data formats from different devices, and displaying the data received by the User These problems are solved by a system in accordance with the present invention References of the prior art include International Publication Number W097 / 13368, which gives to cpnocer a program guide processing system which involves using remote databases in the acquisition of program guide information from data sources in response to the command of the user.In addition, references of the prior art also include the article "Intercast Brings the Web to TV", January 21, 1997, PC magazine, which discloses a system for a program guide in the Vertical Blank Interval of an analog TV signal.

SUMMARY OF THE INVENTION Hereby, the inventors have recognized that a user interface type of program guide conveniently provides a simple and user-friendly interface for the operation by the User of functions such as electronic mail, telephone, access to Internet, fax, home control, and video-telephone functions. The User of a Program Guide for these functions also conveniently provides a single User interface for the operation by the User of multiple devices and associated functions. The inventors have further recognized that the Internet information requested by means of a program guide or other type of User interface, it can be transported in a convenient way in a composite data format, including MPEG compatible video data. In addition, they have recognized that it is desirable for a video decoder to be able to decode this composite data format. A disclosed data format includes video data compatible with MPEG and Internet image information, to transport the video program data in packets and the associated web image information. The data format comprises MPEG system data including a first transport packet with a header containing a first data identifier (PID) for identifying the video program data in a payload of the first transport packet. The MPEG system data also includes a second transport packet containing a second data identifier (PID) for identifying the Internet information contained in a payload of the second transport packet. MPEG system data also includes ancillary data that supports the identification and decoding of Internet information, and that contains the second data identifier. In a feature of the invention, a method for decoding data encoded in the composite data format involves applying the auxiliary data in the identification, decoding, and assembly of the Internet information. In another feature of the invention, a method for decoding data encoded in eXT composite data format involves synchronizing the information of the Internet with the video program, using the auxiliary data.

BRIEF DESCRIPTION OF THE DRAWINGS In the drawing: Figure 1 shows a home entertainment decoder system, according to the invention, for communicating with a plurality of sources, and for processing program guide information and content data of program. Figure 2 shows a visual display format of the Example Program Guide according to the invention. Figure 3 shows a data format, according to the invention, for packetizing Internet data to be transmitted within a compatible data stream. MPEG.

Figure 4 shows a flow diagram, according to the invention, to receive the program guide information, including the selection options of the user, and to process the information received in order to form a program guide that supports functions of communication selectable by the User. Figure 5 shows a flow diagram, according to the invention, for a process to form a program guide in a video decoder from the information received from a plurality of sources. Figure 6 shows a flow chart, according to the invention, for a process to automatically acquire and collate the program guide information from a plurality of sources, and form a program guide for its display. Figure 7 shows a black and white representation of a visual display format of the Guide to Example color programs, according to the invention, showing the menu options that allow a User to compare the programs by font and color attribute. Figure 8 shows a flow chart, according to the invention, for a process to acquire information requested by a user of the video receiver, by means of a selection made from the options of a program guide displayed.

Figure 9 shows a flow diagram, according to the invention, for a process to decode the incoming Internet information and the compressed video data, and form a composite video output for visual display.

Detailed Description of the Drawings Figure 1 shows a home entertainment decoder system, according to the invention, for communicating with multiple sources for the purpose of acquiring program guide information and program content data. The decoder system forms a program guide to be displayed from the acquired information and automatically collated from multiple sources. A User can initiate the functions of electronic mail, telephone, Internet access, fax, and video-telephone by selecting options from the program guide displayed. The decoder system decodes in an adaptive manner a stream of data encoded in the MPEG standard, which incorporates compressed program content data and Internet data representative of, for example, Hypertext Mark-up Language (HTML). The decoded data is formatted either as a composite video image, or as separate video images for visual display. The MPEG2 image coding standard (Moving Pictures Expert Group), hereinafter referred to as the "MPEG standard", is comprised of a section that encodes the system (ISO / IEC 13818-1). , June 10, 1994), and a section encoding the video (ISO / IEC 13818-2, January 20, 1995), hereinafter referred to as the "MPEG system standard" and "MPEG video standard" , respectively. Although the disclosed system is described in the context of a system for receiving an "MPEG compatible signal, it is exemplary only." The principles of the invention can be applied to systems wherein the types of transmission channels and protocols of communication may vary, or systems where the type of coding may vary., for example, systems not compatible with MPEG, which involve other types of coded data streams and other methods for transporting the Program Guide information. In addition, although the system disclosed is described as transmission program processing, this is exemplary only. The term 'program' is used to represent any form of data, such as telephone messages, computer programs, Internet data, or other communications, for example. In one scenario, in the video receiver system of Figure 1, a carrier modulated with video data is received from a transmission satellite via antenna 10, and processed by unit 15. The resulting digital output signal is demodulated by the demodulator 20, and errors are decoded and corrected by the decoder 30. In this exemplary mode, the demodulated and decoded output from the unit 30 is in the form of a transport stream compatible with MPEG containing compressed video data. MPEG and Internet data encoded in HTML. The video data encoded in the MPEG standard is in the form of a packet data stream, which normally includes the data content of many program channels (for example, the content corresponding to the cable television channels 1- 125). The transport stream compatible with MPEG is provided to the processor 25, which responds to commands from the remote control unit 125. The processor 25 communicates with other data sources, including the storage device 90, and either the server Internet data 83, or Internet connection service 87 (for example, America On-lineMR). The program guide information is acquired and automatically checked from the input transport stream and the storage device 90, and the server 83, or the connection service 87. The acquired information is merged by the processor 25 to form a program guide for exhibiting, which incorporates selection options that allow a User to initiate the functions of electronic mail, telephone, Internet access, fax, and video-telephone, among others, for example. The program guide to be displayed is also formed to include information not displayed from multiple sources, to identify and assemble the individual data packages that constitute the programs that are selected to be seen or heard by the User. This information is used to retrieve the content of selected programs from multiple sources. The processor 25 decompresses the compressed video input data in an adaptive manner, and decodes the HTML Internet data to provide a composite video image formatted to be displayed in the unit 75. The processor 25 also provides coded data outputs for storage in the storage medium 105 by means of the storage device 90, and provides coded data to other devices (not shown to simplify the drawing) by means of the odem 80 and the telephone lines. A User of the video receiver initiates functions, including the functions of electronic mail, telephone, Internet access, fax, and video-telephone, and the display and storage of selected programs by selecting options from the program guide displayed . A user selects an option displayed with a cursor, using the remote control unit 125. The commands from the remote control 125- are passed through the interface 120 to the controller 115 inside the processor 25. The unit 115 controls the operation of the elements of the processor 25, and responds to the remote control unit 125 with commands, using a bidirectional data bus and control signals C. The controller 115 controls the functions of the individual elements inside the processor 25.mix , setting the control register values inside these elements, with the control busbar C. The processor 25 also supports the storage and retrieval of data from the storage medium 105 by the storage device 90. The storage device 90 is a DVD-type device, and means 105 comprises a multi-disk stack unit containing a plurality of disks in this exemplary embodiment. Considering Figure 1 in detail, a modulated carrier with video data received by the antenna 100, is converted to a digital form, and processed by the input processor 15. The processor 15 includes a radio frequency (RF) tuner and an intermediate frequency (IF) r, and amplification stages to convert the input video signal down to a lower frequency band. The processor 15 also includes an analog-to-digital convert to digitize the converted signal downward, in order to produce a signal suitable for further processing. The resulting digital output signal is demodulated by the demodulator 20, and is decoded and the errors are corrected by the decoder 30. The output from the decoder 30 is further processed by the unit 45 of the processor 25. The data provided to the unit 45 are in the form of a packet transport data stream that complies with MPEG, as defined in the MPEG 2.4 system standards section, and includes the program guide information and the data content of one or more channels of programs. The processor 25 acquires and collates the program guide information automatically from the input transport stream and the storage device 90, and either the Internet data server 83 or the Internet connection service 87 (e.g. , America On-lineMR). The individual packages that comprise the content of particular program channels, or the Program Guide information, are identified by their Packet Identifiers (PIDs) contained within the header information. In response to the control signal C, the unit 45 selects the transport stream from the unit 30, or in a reproduction mode, a data stream recovered from the storage device 90 by means of the storage interface 95. In the normal operation, without reproduction, the individual packets comprising the program guide information are identified by the unit 45 in the transport stream from the unit 30, and assembled using the packet identifiers, which are previously determined and stored in an internal memory of the controller 115. The unit 45 couples the Packet Identifiers, of the input packets in the transport data stream from the decoder 30, with the values of Packet Identifiers previously loaded in the control registers' inside of the unit 45 by the controller 115. Accordingly, the information packets of the guidance of Satellite transmission programs (SPG) in the transport stream through unit 45 without additional PID information. The controller 115 acquires a complete SPG, having access to and assembling the PSG packets that are identified and captured by the unit 45. The PID information that enables the controller 115, in conjunction with the unit 45, to identify the data packets comprising individual programs, is called a map of programs or channels. The program map associates the PIDs with the data streams in individual packages that constitute a program and that are part of the SPG. The SPG may also contain additional information, for example, package assembly information, supporting retrieval of program guide data from the incoming transport stream. The controller 115 also configures the unit 45 using the control signal C to select the data packets comprising the DVD program guide information (DPG) derived from the DVD storage device 90, via the interface 95. The unit 45 couples the PIDs of the input packets in the packet data stream from the interface 95, with the PID values previously loaded in the control registers inside the unit 45 by the controller 115. Controller 115 acquires a complete DPG by accessing and assembling the DPG data packets that are identified and captured by unit 45. A similar process is followed in the acquisition of Internet program guide (IPG) information, from the Internet server 83 or from the Internet connection service 87, by means of telephone line communication via the modem 80. In the acquisition of the IPG, analogous or identical data identifiers are coupled in the PIDs used in the acquisition of SPG or DPG, with the identifiers previously loaded by the controller 115. The coupling function can be performed either inside the unit 80, or by means of the 115. The process for acquiring the program guide information is explained in greater detail in the description of Figures 4 to 6.

The information SPG, DPG, and IPG acquired by the controller 115 is merged by the processor 25 to form a program guide to be displayed, which incorporates selection options that allow a User to initiate functions of electronic mail, telephone, Internet access , fax, and videophone. In the fusion of the data, the information SPG, DPG, and IPG acquired, is checked in two levels of hierarchy called topic and topic, and the redundant program guide information is eliminated. A theme, for example, may include categories such as movies, sports, weather, arts, documentaries, news, and so on. A topic is a category within a topic, for example, a movie subject category can have topics, including comedy, suspense, horror, science fiction, romance, adult entertainment, and so on. Different or additional levels of hierarchies can be used in the collation of SPG, DPG, and acquired IPG information, involving criteria such as ownership of the viewer's age, the establishment of the period, for example contemporary or historical, reviewers' evaluations, and so on. A number of problems are presented in the comparison of the SPG, DPG, and IPG information. Information SPG, DPG, and IPG, "which is from different sources, can categorize programs by different topics and topics, and can use a different classification hierarchy.In addition, SPG, DPG, and IPG data can use conflicting PIDs , redundant, or • incompatible, or other data identifiers to identify individual data items that comprise a particular content of channels or program guides The controller 115 creates a master set of topics and topics that map information SPG, DPG, and IPG in a corresponding category of the master set. "For example, the master set may contain a topic-topic that encompasses 'movies - comedy' where both the a) topic-theme DPG of 'movies-parodies', as b) the topic-topic of Internet IPG of 'movies-index of synopsis' (an index of web pages). In the comparison of the information in the guide, the controller 115 determines the categories of topics and topics of the data in SPG, DPG, and IPG based on previously determined topic-topic codes. SPG, DPG, and IPG topic and topic codes, along with equivalence mapping information to convert codes from one service provider, to those from another, are acquired from the SPG or from the entry of data defined by the User to the processor 25, or are previously stored in the internal memory inside the controller 115. The controller 115 assembles the SPG, DPG, and IPG packets collated according to the categories defined by the master set of topics and topical The SPG data, Assembled DPG, and IPG are stored by the controller 115 in the internal memory for use in forming a composite program guide for display. The controller 115 also forms the non-displayed information compatible with MPEG, associated with the composite program guide displayed. Information not displayed includes the composite program map, conditional access, and network information. This non-displayed information is required to support the identification, assembly, and decoding of the packages comprising the composite program guide and the associated program content. The conditional access information governs the access to the programs based on the right of the User. The network information defines the physical parameters of the network, such as the frequencies of the satellite transmission channel and the transponder channels, for example. The controller 115 forms the composite program map information for the composite program guide that maps the topics and topics of SPG, DPG, and IPG into the master set of topics and topics. The composite program map also associates the data identifiers (for example, the PID values) with the data streams in individual packets that constitute the programs listed in the composite program guide. The composite program map information may also include a dedicated indicator to denote that a particular program has information from associated Internet web pages available. In the formation of the composite program map information, the controller 115 examines the information of SPG, DPG, and IPG for omissions, redundancies, and conflicts of the data identifiers. The controller 115 renumbolds the existing data identifiers, and creates new data identifiers, as required, to produce the MPEG-compatible program map information, both for the program guide information checked and the program content. associated . The controller 115 also forms conditional access information compatible with MPEG and the network information from the corresponding information received in the SPG, DPG, and IPG data. The conditional access information includes data such as cryptic codes that govern access to • programs that depend on the right of the User. The network information defines the physical parameters of the network, such as the frequencies of the satellite transmission channel, the transponder channels, and the Internet access parameters associated with the composite program guide for display. The composite program map, the conditional access, and the network information support the assembly, decode, and display the content of programs available from the satellite, storage, and Internet server sources, as well as the guide composite programs. The controller 115 also includes additional link data in the composite program map not shown, conditional access, and network information. The additional link data supports the functions selectable by the User, such as the functions of electronic mail, telephone, Internet access, fax, video-telephone, channel tuning, recording programs, and home control. The home control functions can support the user's control of lighting, air conditioning, heating, and burglar alarm operation, for example. The additional link data associates the access data, both with the data identifiers (for example, PIDs) of the requested data, and with the options of the menu selectable by the User in the composite program guide displayed. include identification codes, communication protocol codes, conditional access codes, Internet access codes, for example URL codes for the website and access to email, as well as telephone and fax numbers. The access data makes it possible for the processor 25 to communicate with external devices. In order to generate the composite program guide for visual display, the controller 115 retrieves the previously assembled and collated SPG, DPG, and IPG packet data stored in the internal memory. The controller 115 converts the retrieved data to pixel data, and formats the converted data for storage in the pixel representative memory map contained in the visual display processor 70. In addition, the controller 115 creates selectable menu options by the User (for the selection by the User of email, fax, etc.) in the form of pixel data to be incorporated into the pixel memory map of the unit 70. The controller 115 stores the pixel data SPG, DPG, and IPG formatted, together with the pixel data of the option generated in the pixel map of unit 70, to form the composite program guide for its visual display. The composite program guide, combining the SPG, DPG, and IPG data, and the options selectable by the User, is formatted to be compatible with the link data in the program guide information not shown. For example, an option selectable by the User of the guide displayed (for example, for a telephone function) is associated, both with the access data for the function (for example, a telephone number), and the data identifiers (for example, the PIDs for the data packets of the messages). The visual display processor 70 converts the stored and formatted program guide data into conventional luminance and chrominance components.The luminance and chrominance components, together with the time data provided by the controller 115, are processed by the processor 70 in a conventional manner to form an NTSC signal to be displayed on the NTSC 75 compliant image playback device, eg, a television or video monitor.The processor 70, in another embodiment, can provide the RGB output data to be displayed by a RGB-compatible playback device or a high-definition television. r 115, in conjunction with the processor 55, forms a MPEG compliant data stream of compressed video and audio data containing the composite program guide and the program content. The processor 55 separates the system information, including time, error, and synchronization information from the data stream from the unit 45, and bypasses it to be used by the controller 115. The controller 115 applies the system information in the control processor 55, to provide program guide data and matched, co-synchronized composite programs, together with synchronization and error indication information, to be used in the following decompression of program content data by the decoder. The composite program guide data provided by the processor 55, combines the SPG, DPG, and IPG data and the selectable options by the User, in a manner compatible with the program map link information as described above. The program content data provided by the processor 55, are decompressed by the MPEG decoder 65, to provide video pixel data and audio output data to the processor 70. The visual display processor 70 processes the video pixel data. and the audio output data to be suitable to be reproduced by unit 75 as described above. Figure 2 shows a composite program guide shown as an example. The features of the 833-850 menu show the services and functions of the program. The features of menu 833 and 835 show the program channels that can be invoked and displayed by highlighting the corresponding menu feature using a User selection control, such as a cursor directed to remote control. If a User enhances the feature 833 with the cursor, that is, selects the menu option 833, for example, the processor 25 tunes to the television channel 107 (A &EMR), and displays it in the unit-75, using the information of the program guide not shown in the composite to determine the activated function and the associated tuning information (channel frequencies, etc.). In a similar manner, if a User enhances feature 837, processor 25 tunes to receive FM radio channel 13 for audio output in unit 75. By enhancing features 840-850, corresponding to e-mail functions , telephone, fax, and DVD recording / playback, respectively, come to display specific menus of additional functions, providing additional selection options for the User. These function-specific menus can provide a User with the ability to edit, store, and delete access information, including, for example, telephone numbers, email addresses, Internet addresses, credit card numbers., and additional conditional access data. If a User enhances the characteristics of the 860-870 menu, specific function tasks are initiated. "After a User has highlighted the 860 feature, for example, an additional menu is displayed, asking the User to enter a 'mail message. electronic mail to be sent to John Smith at home, by means of an Internet email address retrieved from the information of the non-exhibited composite program guide In a similar manner, in response to a User enhancing feature 865, by example, the controller 115 (Figure 1) retrieves the phone number of Jean's home from the internal memory, using the information from the program guide not shown, In addition, the controller 115 establishes telephone communication, by means of the modem 80, with Jean at home, dialing the phone number of Jean's home Also, after a User has highlighted feature 870, for example, it goes back to exh I went to the movie 'Star Wars' (Star Wars ™) from the DVD 90 unit (Figure 1). The communication between the processor 25 and the DVD unit 90 is established with the access data retrieved from the memory inside the controller 115, using the information of the program guide not shown. In addition, the program guide may include one or more icons, such as icon 873 (Figure 2) that illustrates a home, for example, to indicate whether Internet information is available, such as a 'home page' for a particular program. In addition, icon 873 of Figure 2 may change color, for example, from white to green, to indicate that Internet information is available for a particular program. Alternatively, the 873 icon may be an icon that pops up, which appears as an indication that Internet information is available for a particular program. The displayed program guide can be formed to enable a User to request Internet information about a particular program by enhancing the program followed by the highlighting of the jump icon, for example. The home page icons that are present when the Internet information is available can also be located inside or adjacent to the program icons, for example the 859 icon. -In addition, the home page icon may change color after that the User selects the information by highlighting the home page icon. Although Internet information can be retrieved by highlighting a web page icon, such as icon 857 in Figure 2, this is for example only. The recovery of Internet information can also be initiated in a variety of other ways. A User can retrieve "the available Internet information related to a program by highlighting a program icon, such as Seinfeld ™, using the 859 icon, followed by the enhancement of the Internet 810 icon, for example. a function of the composite program guide, the controller 115 (Figure 1) determines and applies the access data associated with both the request and response operations involved in the selected function, the controller 115 determines the access data required for the request and response operations from the previously-formed composite program map, conditional access, and network information The processor 25 acquires information, such as the data from the web page, in response to a request from the User, in a number of ways, including, for example: a) in a first configuration, the processor 25 has access to the data of the web page that Since they are transmitted continuously in the satellite transmission received from the decoder 30, ~ b) in a second configuration, the processor 25 acquires the data of the web page that is transmitted in the satellite transmission received from the decoder., in response to a request for information from a service provider via the telephone line, and c) in a third configuration, the processor 25 requests the information and receives the response information in the same communication link, for example, in the telephone link with the server 83.

First Processor Configuration 25 _,. In the first configuration, the data of the web page selected by a User by means of the program guide displayed, is continuously transmitted inside the transport data stream introduced to the processor 25 from the decoder 30. In this configuration, the information of the composite program map contains previously determined PID values for the requested web page. Accordingly, the data of the requested web page is retrieved from the incoming transport stream using the composite program map information without the need for the controller 115 to communicate with a service provider via the 80 modem. configuration, information, web available to a User is limited to the specific information that a service provider continuously transmits to the processor 25 using the dedicated transmission bandwidth. However, this configuration is simple and offers quick access to the web page (because the web data can be stored locally in the encoder by the service provider).

This configuration also minimizes the service provider's burden of data acquisition, and eliminates the need for the processor 25 to communicate the web page request information to a service provider. The information on the web page, encoded in HTMLMR and JavaMR, is put into packets, and is formatted in an encoder by the service provider to be incorporated into the MPEG transport data stream for transmission. Figure 3 shows a data format, according to the invention, for packetizing Internet data to be transmitted inside a data stream compatible with MPEG. The encoder forms a sequence of HTMLMR / JavaMR web pages (705-720 of Figure 3), in non-compressed packages, with auxiliary information and HTMLMR / JavaMR data (725). The auxiliary information includes PID values, a packet count value, and the size of the individual web page (e.g., number of bytes or pixel size of the image). The auxiliary information may also include: an indicator to indicate that a particular transport packet contains information from the web page; a start code; a web page identification code; an error correction code, and an appropriate time parameter to synchronize the Internet information of the web page with an associated video or audio program. The web page indicator can be used to facilitate the identification and separation of the web page information from compressed video data in MPEG. In addition, one or more elements of the auxiliary data of the web page may be included within the user-definable elements of the MPEG transport syntax, such as within the transport header, or may be included together with the information of the web page in the MPEG transport data payload. The response web page information, including the previously determined PID value, is incorporated into the MPEG compatible transport data stream introduced to the processor 25 (Figure 1) by the "service provider." The previously determined PID value of the channel The response is also previously stored in the internal memory of the controller 115, and is incorporated into the composite program map information As an alternative, the PID value of response data and associated program map data can be encoded, for example, in a Channel Information Table (CIT), in a high-definition television (HDTV) signal encoded in accordance with the Digi Tel evisión Standard for HDTV Broadcast of April 12, 1995, prepared by the United States Advanced Television Systems Committee (ATSC, Committee of Advanced Television Systems of the United States)., you can designate one or more specific pre-determined program channels to "transport the response information of the web page. In addition, the PID values of the program channels can be transported in a CIT in the composite program map information, For example, the controller 115 derives the previously determined PID value corresponding to the requested web page response information, from the information "of the stored composite program map, and loads it into the control registers inside the unit 45. The unit 45 couples the PIDs of the input packets of the response data of the web page in the transport data stream from the decoder 30, with the PID value previously loaded in the control registers of the unit 45. packets with PID values that match the previously determined web response PLD value are identified as response data on the page to web, and are provided by the unit 45 to a dedicated buffer area in the decoder 55. The dedicated buffer zone in the transport decoder 55 contains the response data to be decoded by the processor 60.

The processor 55 derives the system information, including the time, error, and synchronization information, from the data stream from the unit 45, and provides it to the controller 115. The controller 115 applies the system information in the address processor 55, to provide resynchronized web page response data from the dedicated buffer zone in the decoder 55, to the HTMLMR / j avaMR 60 processor. The processor 60 decodes the encoded web response information in HTMLMR and JavaMR, and provides the representative pixel data of the web page image for storage in the memory inside the controller 115. Although the processor 60 is shown as a separate processor in Figure 1, it can also be implemented inside the software of the controller 115. The processor 60 comprises the processing functions of a special web browser, including JPEG decompression and decoding. Java, such as the one involved in the operation of the Netscape Navigator1, for example. The program content data, for example, a television program channel selected by the User, within the transport data stream compatible with MPEG from the decoder 30, are also decoded into pixel representative data by the processor 25, in addition to the web page response data. For this purpose, the controller 115 determines the PID value of the program of the selected television channel from the information of the composite program map, and loads it into the control registers inside the unit 45. The unit 45"couples the PIDs of the input packets of the program data of the selected television channel in the transport data stream from the decoder 30 with the PID value previously loaded in the control registers of the unit 45. The packets with PID values matching the the PID value of the program of the previously selected television channel determined, are identified and are provided by the unit 45 to a dedicated application buffer area in the decoder 55. As described above for the web page response data, the processor 55 derives the system information, including time, error, and synchronization information, starting with the data stream from the unit 45, and provides it to the controller 115. The controller 115 applies the system information in the address processor 55, to provide the content data of the resynchronized program channel, from the buffer zone of application in the decoder 55, to the MPEG decoder 65. The program content contents of the MPEG-compatible program are decompressed by the MPEG decoder 65 to provide video pixel data and output data He audio to the visual display processor 70. The video pixel data _ from the decoder 65 is stored in a representative pixel memory contained in the visual display processor 70. The controller 115 retrieves the pixel data of the web page image from the internal memory, and format them to be stored as an overlay in the representative memory of pixels contained in the visual display processor 7-0. As such, a merged visual display is formed which combines the web page response data and the content of the program channel into the memory of "processor 70 pixels." The relative proportions and sizes of the web page image and the The image of the content of the channel inside the resulting composite image, formed in the memory of pixels of the processor 70, can be varied by the controller 115 in response to an internal programmed instruction or to an external command, for example from the User. may vary, such that the web page image or the image of the channel content contributes between 0 and 100 percent of the resulting composite image, in order to adjust the proportion of the composite image contributed by the data of web page, the controller 115 scales the pixel data of the web page image by a conventional interpolation process. Alternatively, the data can be scaled by a separate video processing integrated circuit that operates in conjunction with the controller 115. The resulting scaled web page image is stored inside the pixel memory of the processor 70 via the controller 115 The stored web page image represents a superimposed image with respect to the content image of the program channel. In order to adjust the location of the data of the web page image inside the composite image, the controller 115 determines the addresses corresponding to the desired memory locations, from the data of the internal memory map, and stores the scaled web page image data in the desired locations of the memory. As explained above, the visual de-display processor 70 converts the composite image data formatted into conventional luminance and chrominance components. In addition, the processor - "70" processes the luminance and chrominance components, along with the time data provided by the controller 115, in a conventional manner, to form an NTSC signal to be displayed on the image reproduction device compatible with NTSC 75 .

Second Processor Configuration 25 In the second configuration, the processor 25 of Figure I acquires web page data that is transmitted in the satellite transmission received from the decoder 30, in response to a request for information from a service provider by means of of a telephone line. After a User requests web page data, for example by highlighting the web page icon 857 in Figure 2, the controller 115 (Figure 1) uses the access data of the request (telephone number, web page identifier code) requested (for example, URL), and conditional access data), in order to establish communication with the satellite transmission service provider. Before establishing communication with the service provider, the controller 115 determines, based on the conditional access information, s is authorized access to the requested web page information. The authorization may be determined directly from the conditional access information of the program guide, or indirectly from a User's right device, such as a smart card (not shown to simplify the drawing) inside the processor 25. If access is authorized, the controller 115 establishes telephone communication with the satellite transmission service provider, dialing a telephone number by means of the modem 80, and transmitting the request transmission, for example the requested website identifier code (such as as a URL), and the User's right code. The service provider incorporates the requested web page information into the transport data stream transmitted to the processor 25 via the antenna 10, the processor 20, and the decoder 30. The controller 115 uses the response access data (PIDs). of the web page data, response program channel number, and transponder number), to identify and assemble the web page packets in the transport stream, as described for the first configuration of the processor 25. The PID values of the response web page information and the corresponding program map information, can be communicated between the service provider and the processor 25 in a variety of ways and in a variety of data formats. The PID values and the program map information may be transported, for example, according to the proprietary or custom requirements of a particular system, such as within the data elements defined by the MPEG User, or within data that are not MPEG, such as within the vertical blanking interval (over-scan region) of a broadcast television signal. In addition, the PID values assigned to the web information may also be transmitted to the processor 25 in the complementary program guide information. As another alternative, the PID values to be used for the response data can be determined by a service provider from the information transmitted from the processor 25.

Third Configuration of the Processor 25 In a third configuration, the processor 25 requests information and receives response information in the same communication link, for example, in the telephone link with the server 83 or the connection service 87, by means of the modem 80. In this configuration, the controller 115 requests the information from the Internet web page by highlighting the icon 857 (Figure 2), for example. On which, the controller 115 (Figure 1) uses the request access data (telephone number and URL code, and conditional access data), to establish the Internet access and the data of the request web page at the address URL, using the modem 80 and the server 83. The controller 115 determines whether the requested Internet access is authorized from the conditional access or from the right information of the user of the smart card, as described in connection with the second configuration of the processor 25. If authorized, the controller 115 establishes telephone communication with a service provider via the server 83, dialing a telephone number using the 80 modem, and transmitting the address code Internet URL and the User's right code, for example, as described above. The controller 115 uses the response access data (including the Transmission Control Protocol / Internet Protocol (TCP / IP) identification data determined from the composite program map information, to identify and assemble the packets TCP / IP of the web page containing the HTML data of the associated web page and Java (and other data, for example data of type JPEG, GIF, TIF) in the response data stream from the server 83. _ The TCP / IP packets from the response web page are placed in the buffer area inside the modem 80, and the HTMLMR 60 processor is provided under the command of the controller 115. The processor 60 decodes the web response information encoded in HTMLMR and Java1 ^, and provides the representative pixel data of the web page image for storage in the memory inside the controller 115. The controller 115 retrieves the pixel data from the page image. to web from the internal memory, and format them for storage as an overlay in the representative pixel memory contained in the visual display processor 70 for reproduction by the unit 75 as a fused visual display, as described above. In this configuration, the processor 25 supports full access to the Internet via the server 83, using the program guide displayed. For example, when a User enhances the icon 810, followed by the icon 830 (Figure 2), the controller 115 (Figure 1) executes the functions of the web page finder, and displays a customized web page browser, or a Visual display of standard browser, such as the Netscape Navigator ™, through which Internet access is available. In an alternative way, in the third configuration, the processor 25 can support a limited Internet service. In this case, access to the Internet network through the server 83 is under the control of a service provider that allows only indirect access to the Internet. The service provider provides collated web page information for visual display compatible with the composite program guide displayed. The service provider stores a limited number of web pages locally within the server 83, which are accessible by the processor 25 using the composite program map information, which provides an index for the available web pages and their corresponding pre-determined PIDs. Alternatively, the service provider may alter the selection of the web pages available from the server 83, and periodically provide updated compatible companion program guide information to the processor 25 by means of the satellite transmission data stream. The complementary program guide information makes it possible for the processor 25 to form an updated display guide along with a compatible program map, and other access information, which enable a user to access the updated web-information. By storing Internet information from the web page locally on server 83, the service provider retains control of the Internet content available to a "User, and may bill the User for the material-provided. Local information on the web page on server 83 provides a User with more "quick" access to information without the full delay associated with normal Internet access., the load on the processor 25 is minimized by communicating the information requests to external devices, in which only a limited amount of Internet information can be requested, and the processor 25 only needs to communicate with the local servers, such as the server 83 It should be noted that the modem 80 can also be a broadband amplitude communication modem, such as a cable modem. In which case, the processor 25 can decode both the web page data and the transmission video program data to be displayed from a cable program source via the modem 80. The controller 115 employs the method shown in Figure 4 for produce a program guide displayed, through the processing and mapping of the received program guide information that includes options of the User selection menu. The process of Figure 4 does not require the processor 25 to form the options of the User selection menu, and may be employed by the processor 25 in its first configuration, for example. In step 205, following the start in step 200, the processor 25 receives a transport data stream from the 3D decoder, which incorporates the user selectable menu options to be displayed as part of the displayed program guide. . The options selectable by the -User support the initiation by the User of communication functions such as e-mail, telephone, Internet access, fax, video-telephone, channel tuning, program recording, and control functions. The data received in step 205 also includes additional link data in the program guide information.The additional link data comprises program map, conditional access and network information, and associates the access data with the options of the menu selectable by the User in the program guide displayed Access data include identification codes, communication protocol codes, conditional access codes, Internet access codes, for example URL codes for web page and access to mail electronic, as well as telephone and fax numbers. Additional link data makes it possible for processor 25 to assemble, decode, and display the program content information and program guide in the transport stream from the decoder 30. The access data makes it possible for the processor 25 to communicate with external devices, and include different representative codes of address corresponding to the addresses of different sources of information. In step 210, the controller 115 uses the PID values of the previously determined link data in the internal memory to direct the processor 25 in order to identify and capture the link and access data from the guide information of programs received. The captured link data is assembled, formatted, and stored by the controller 115 in the internal memory in step 215. Also, in step 210, a User may enter additional link data, such as Internet or e-mail addresses. , or telephone numbers, by means of an input device, such as a remote control unit, and the additional data are incorporated into the link data received by the controller 115. The program guide information containing the options selectable by the User , is formatted to be displayed by the controller 115 in conjunction with the visual display processor 70 inside the processor 25 in step 220, as described above in connection with Figure 1. In step 225, the visual display processor 70 converts program guide data stored and formatted into conventional luminance and chrominance components. The luminance and chrominance components, together with the time data provided by the controller 115, are processed by the processor 70 to be displayed on the playback device 75. The process of Figure 4 ends at step 230. The controller 115 (Figure 1) employs the method shown in Figure 5 to produce a program guide in a video decoder from the information received from a plurality of sources. The formed guide supports the communication functions selectable by the User, for example Internet access, e-mail, fax, etcetera. In step 305, following the start in step 300, the controller 115 acquires the satellite program guide (SPG) information from the satellite transmission transport stream received by the processor 25 from the decoder 30. In at step 310, the controller 115 acquires the information of the DVD program guide (DPG) from the storage device 90 via the interface 95. The controller 115 acquires, collates, and formats the SPG and the DPG, giving access and assembling the respective data packets to produce the representative pixel data of SPG and DPG for storage as a composite program guide in the pixel map of the unit 70, as described above in relation to Figure 1. The SPG information and DPG includes link and access data in the form of a program map, conditional access, and network information. In other configurations, processor 25 applies the principles detailed herein to form a composite program guide, including program guide information derived from a source such as a terrestrial transmission source, a cable transmission source, a computer source, a radio transmission source, and a source accessed through telephone lines. In step 315, the controller 115 creates the menu options selectable by the User to be displayed (for the User's selection of Internet access, email, fax, etc.) in the form of pixel data, to be incorporated into the pixel memory map of the unit 70. In step 315, the controller 115 also creates menu options determinable by the User, which make it possible for a User to tailor his program guide to include an icon that performs a function specific- -requested by the User, for example, a User may require an icon that gives access to a specific Internet site, or that results in a visual display of all received messages. The controller 115 responds to the commands entered by means of a data input device, for example a remote control unit or a keyboard, in the creation of the menu option determined by the User, in disagreement with program instructions. The controller 115, in step 320, examines the SPG and DPG information for the omissions and conflicts of the data identifiers (e.g., PID). In step 325, the controller 115 renumbers the existing data identifiers, and allocates new data identifiers, as required, to produce compatible program map information for both the program guide information checked and the content of the program. associated programs. In step 330, the controller 115 forms the composite program map, the conditional access, and the network information for the composite program guide, in the manner described in relation to Figure 1. The composite program map is formed to enable the processor 25 to perform the selectable communication functions by means of the composite program guide. For this purpose, the composite program map associates a communication function PID and menu option (for example, web page, email, fax icon) with the different representative address codes corresponding to the addresses of the different sources of information. information. In step 330, the controller 115 also incorporates the data entered by the user into the composite program map, conditional access, and network information. These may include items such as an electronic mail address, a telephone / fax number, an Internet website link address, a credit card number, and so on. The User enters this data into the processor 25 by means of a device, such as a remote control or a keyboard. The controller 115, in step 335, formats the pixel data SPG and DPG, together with the pixel data of menu options in the pixel map of the unit 70 created in step 315, to form a composite program guide for its visual display. The information of the composite program guide, which contains the selectable menu options by the User, is formatted to be displayed in step 340, and is produced in step 345, as described above in relation to Figure 1. The process of Figure 5 ends in step 350. Controller 115 (Figure 1) employs the process of Figure 6 to automatically acquire and collate program guide information from a plurality of sources, in order to form a guide of composite programs for visual display. In step 405, following the start in step 400, the controller 115 acquires and stores the satellite program guide (SPG) information from the satellite transmission transport stream received by the processor 25 from the decoder 30. The controller 115, in step 415, automatically initiates communication with the DVD storage device 90 (Figure 1), via the interface 95. The communication is initiated when the processor 25 is energized in response to the configuration information of the previously stored hardware, which defines the peripheral devices that are attached to the processor 25, and the associated communication protocols. This information may be contained within the received program guide information, or it may be stored inside the processor 25 at the factory, or it may be determined locally by the processor 25, or it may be determined through a combination of these methods. The local determination of the hardware configuration by means of the processor 25 can be performed either by peripheral interrogation initiated by the controller 115, or by the user entering the hardware configuration data. In alternative modalities, communication can be initiated automatically on conditions such as, a) the command by the User by means of an option selection of the program guide, for example, b) the peripheral interrogation initiated by the controller 115 on a periodic or intermittent basis, or c) the detection of a new or changed electrical connection from the processor 25 to a peripheral device, such as a DVD device.

The IH controller 5 initiates communication with the DVD unit 90 by means of the interface 95, using the communication protocol codes, the identification codes, the right codes, and the conditional access codes retrieved from the access data inside the received program guide information. In step 420, the controller 115 directs the processor 25 to acquire and assemble the DVD program guide information (DPG) derived from the DVD storage device 90 via the interface 95, in the manner previously described in connection with Figure 1. In step 425, the controller 115 collates the SPG and DPG information by topic and topic, mapping the SPG and DPG information into the corresponding subject-and topic categories in a master set, also as described in connection with Figure 1. Further, in step 425, the controller 115 collates the SPG and DPG information by source, and assigns a different color attribute - programs and program icons from different sources. In addition, the controller 115 creates menu options, which allow a User to sort by font and color. Figure 7 shows a black and white representation of a visual display format of the Color Program Guide, according to the invention, showing the menu options created by the controller 115, which allow a User to compare the programs by font and color attribute. Source icons 905-925 are associated with off-air transmission, cable, radio, satellite, and storage (for example, the DVD source 90 - (Figure 1), respectively. The font icons 930-950 are associated with the sources of e-mail, telephone, video-telephone, fax, and Internet, respectively.When a User enhances the source icon 905, for example, a program guide is displayed that shows off-air broadcast programs and associated icons In a similar way, when a User enhances the font icon 930, for example, a program guide is displayed that shows the email icons by means of which a User can activate the menus to start the composition and sending e-mail messages, and reading and deleting received messages The 900 icon is a "rainbow" selection icon showing a spectrum of separated color blocks represented s by shades of gray in the illustration of the black and white program guide of Figure 7. The color choices of the 900 icon can be alternatively configured as a continuous color spectrum, or a range of colors selected in a single or a number _of separate color blocks. When a User enhances a particular color inside the 900 icon, the programs are displayed from the source attributed with that particular color. For example, assuming, in step 425, that the controller 115 attributes the purple color to the source device _DVD 90, then, when a User enhances the purple color inside the icon 900, the available movies of the DVD 90 device are displayed as a program guide. Alternatively, the color matching scheme can be used to identify programs by other criteria than the source. You can use color as an attribute to identify programs by topic or topic, for example, in which case, you can identify a visual display of movies available to view from all sources by highlighting a red color inside the 900 icon, for example. In addition, the program guide data can be checked for different color attributes. For example, programs of different sources can be attributed different types of nuance or different nuances and geometries of icons. Continuing with the process of Figure 6, in step 430, the controller 115 forms a composite program guide to be displayed, from the SPG and DPG information collated, in a manner similar to that described in relation to Figure 1. The controller 115 also, in step 425, creates the associated user selectable menu options to be displayed, including the program guide options selectable by the user to be classified by font and color. The created menu options are incorporated by the controller 115 in step 430, into a composite program guide for display, as exemplified in Figure 7. In step 435, the controller 115 formats the composite program guide information for displaying as described above in relation to Figure 1. The process of Figure 6 ends at step 440. Controller 115 (Figure 1) uses the process of Figure 8 to acquire the information from the web page requested by a User of the video receiver, by means of a selection made from the options in a program guide displayed. In step 505, following the start in step 500, the controller 115 retrieves the access data in the form of a telephone number and an Internet URL code, for example, from the memory, in response to a selection by the party of the User of a web page made by means of a program guide displayed. The access data associated with the particular selection of the User, are determined from a program guide database, using the program map information that links all the data associated with a program or function of the program guide, particular. In step 515, the controller 115 directs the processor 25 to establish a request communication link with the server 83, dialing the retrieved telephone number, using the modem 80. Also, in step 515, the processor 25 encodes and transmits the Additional access data, such as the Internet URL code, using the protocol required for communication over the request communication link. The required protocol is determined from the program map information. In step 520, the controller 115 directs the processor 25 to receive and decode an input signal received on a response communication link. The controller 115 directs the processor 25 in identifying and retrieving the information from the response web page, from the input signal in steps 525 and 530. The processor 25 employs different methods to retrieve the response data from the input signal in steps 525 and 530. The selected method depends on whether or not the response communication link is the same link used for the web page data request. The methods used to identify and recover the response data are similar to those previously described in relation to the three configurations of the processor 25. The controller 115 applies the appropriate configuration method in the identification of the web page data response in the signal of input, in step 525. For this purpose, the controller 115 uses data identifiers determined from the information of the program map, which associates the identifiers with the selection of the user's program guide. The controller 115, in step 535, formats the response web page information to be displayed, and ends the process of FIG. 8 in step 540. The controller 115 (FIG. 1) employs the process of FIG. 9 to decode both Input Internet information such as compressed video data to form a composite video output for display. Following the start in step 600, the controller 115, in step 605, determines the packet identifiers for the Internet data requested by the User and the compressed image data from the program map information. In step 607, the controller 115 determines whether access to compressed video data and data is authorized. Internet requested from the conditional access or from the right information of the Smart Card User, as described above in connection with the third configuration of the processor 25. If access is authorized, the controller 115, in step 610, identifies the TCP / IP web page packets containing the web page data in a stream of response data from the server 83. In a similar manner, if access is authorized, the controller 115, in step 615, identifies compressed video data packets containing a video program selected by the User in a stream of input transport from the decoder 30 to the processor 25. The controller 115 identifies the web page and compressed video data packets in a manner similar to that described in the relation to Figure 1. In step 617, the controller 115 it directs the processor 25 (Figure 1) to cryptically decode Internet or compressed video data if they are cryptically encoded. The controller 115, in step 620, directs the processor 25 in the decoding of the identified Internet web page data using the HTMLMR processor 60. The controller 115, in step 625, directs the processor 25 in the decompression "of the compressed video data identified, using the MPEG decoder 65. The resulting decoded web page data and the decompressed video data are merged, formatted, and displayed in the unit 75 using the visual display processor 70, under the address of the controller 115 in step 630. The process of Figure 9 ends in step 640. The architecture of Figure 1 is not exclusive, other architectures may be derived according to the principles of the invention, to carry out the In addition, the functions of the elements of the processor 25 of Figure 1, and the process steps of Figures 4 through 6, 8 and 9, may be implemented "in whole or in part within the as instructions programs of a microprocessor.

In addition, the principles of the invention apply to any form of electronic program guide compatible with MPEG or not compatible with MPEG. In addition, the principles of the invention apply to communication in any form of communication link, including by means of cable, infrared, radio, microwave, and by means of a computer network. In addition, it should be noted that the information of the composite program guide, as described herein, can be made at a remote location of a video receiver, and can be accessed by the receiver via a communication network. .

Claims (9)

1. A composite data format that includes MPEG compatible video data and image information Internet, suitable for transporting data from packet video programs and associated web image information, which comprises: MPEG system data that includes: (a) a first transport packet with a header containing a first data identifier (PID) ) to identify the video program data in a payload of the first transport packet; (b) a second transport packet containing: a second data identifier (PID) to identify Internet information, this Internet information being contained in a payload of the second transport package; and auxiliary data containing the second data identifier, and which support the identification and decoding of the Internet information.

2. A data format according to claim 1, wherein: the auxiliary data includes at least one of: (a) a web image data start code; (b) a packet count; (c) the length of the package; (d) the link data of the package; (e) an indicator indicator of data of the web image; (f) a time parameter for synchronizing the information of the web image with a video or audio program; (g) the size of the web image; and (h) error correction data. ~~ A data format according to claim 2, wherein: - at least one element of the auxiliary data is contained in the header of the second transport packet; and at least one element of the auxiliary data is contained in the payload of the second transport packet. . A data format according to claim 1, wherein: the second data identifier is contained in a header of the second transport packet. 5. A data format according to claim 1, wherein: the auxiliary data is contained in the payload of the second transport packet. 6. A data format according to claim 1, wherein: the MPEG system data includes program map information pa to associate the Internet information and the video program. - 7. A data format according to claim 6, wherein: the program map information associates the information of the Internet, the first data identifier, and the second data identifier. 8. A data format according to claim 1, wherein: the video program data is compressed video data compatible with MPEG, and the Internet information is data not compatible with MPEG. 9. A data format according to claim 8, wherein: the Internet information comprises uncompressed video data. 10. A method for decoding a data stream containing data from the packaged video program and associated web image information, which comprises the steps of: identifying the video program data in a payload of a first transport packet , using a first data identifier (PID) contained in a header of the first transport packet; deriving a second data identifier (PID) from the auxiliary data that supports the identification and decoding of the Internet information in a second transport packet; identify the Internet information in a payload of the second transport packet using the second data identifier; and assemble the Internet information in an output data stream using the auxiliary data. A method according to claim 10, wherein, in the assembly step: the Internet information is assembled in the output data stream, using at least one of: (a) a data start code of web image; (b) a packet count; (c) the length of the package; (d) the package link data; (e) an indicator of the web image data indication; (f) a time parameter for synchronizing the information of the web image with a video or audio program; and (g) error correction data. 12. A method according to claim 10, which includes the steps of: decoding the assembled Internet information using a first method to provide a first decoded output; decoding the video program data using a second method to provide a second decoded output. 1

3. A method according to claim 12, wherein: the first method decodes the information from Internet not compatible with MPEG, and the second method decompresses compressed video data compatible with MPEG. 1

4. A method according to claim 10, wherein, in the step of deriving: the second data identifier is derived from the program map information associating the second data identifier with the Internet information. 1

5. A method according to claim 10, which includes the step of: deriving the first data identifier from the program map information associating the first data identifier with the data of the video program. 1

6. A method for decoding a data stream containing data from the packaged video program and associated web image information, which comprises the steps of: identifying the video program data in a payload of a first transport packet , using a first data identifier contained in a header of the first transport packet; deriving "a second data identifier from the auxiliary data that supports the identification and decoding of the Internet information in a second transport packet; identifying the Internet information in a payload of the second transport packet, using the second identifier of data, and processing the Internet information using the auxiliary data to form a composite image with the video program 1

7. A method according to claim 16, which further includes the steps of: synchronizing the video program with the Internet information, identifying the data of the audio program, and synchronizing the audio data with the Internet information 1

8. A method according to claim 16, wherein: the auxiliary data includes at least one of: (a) a start code for web image data, and (b) a packet count, (c) the packet length, (d) packet link data, e; (e) a web image data indication indicator; (f) a time parameter for synchronizing the information of the web image with a video or audio program; (g) the size of the web image; and (h) error correction data. "1

9. A method for decoding a data stream containing data from the video program in transmission packets, and auxiliary data provided by a transmission source of the video program, which comprises the steps of - identifying the data they represent a transmission video program in a packet payload of the data stream, using a first data identifier, examining the auxiliary data in the data stream from the transmission source, for an indication of information availability Web page associated with the identified transmission video program, acquire the information from the web page in response to the availability indication, and process the Internet information using the auxiliary data, to form a composite image with the video program. A method according to claim 19, which includes the step of: ordering a decoder • e video that acquires and processes the information on the web page from an Internet data source, in response to the indication of availability received from the transmission source. 21. A method according to claim 20, wherein, in the step of acquiring: the information of the web page is acquired from one of: (a) an Internet server, and (b) a transmission source. of the video program. 22. A method according to claim 19, wherein the processing step processes at least one of: (a) a web image data start code; (b) a packet count; (c) the length of the package; (d) the link data of the package; (e) a web image data indication indicator; (f) a time parameter for synchronizing the information of the web image with a video or audio program; (g) the size of the web image; and (h) error correction data. «* - '* 63 SUMMARY A data format includes video data compatible with MPEG, and Internet image information 5 suitable for transporting the video program data in packets and the information of the associated web image. The data format comprises MPEG system data that includes a first transport packet with a header containing a first data identifier (PID) to identify (605, 615) 10 the video program data in a payload of the first transport package. The MPEG system data also includes a second transport packet containing a second data identifier (PID) for identifying (605, 610) the Internet information contained in a payload of the 15 second transport package. The MPEG system data also includes ancillary data that supports the identification and decoding (620, 625) of the Internet information, and that contains the second data identifier. The Internet data in the composite data format is 20 decode and synchronize with the data of the video program by applying the auxiliary data in the identification, decoding, and assembly (630) of the Internet information. 25 • k ie -k -k ic