WO2002007368A2 - Systeme et procede de modulation-demodulation de donnees a compatibilite descendante mettant en oeuvre une integration de donnees dans des signaux de television - Google Patents

Systeme et procede de modulation-demodulation de donnees a compatibilite descendante mettant en oeuvre une integration de donnees dans des signaux de television Download PDF

Info

Publication number
WO2002007368A2
WO2002007368A2 PCT/US2001/040997 US0140997W WO0207368A2 WO 2002007368 A2 WO2002007368 A2 WO 2002007368A2 US 0140997 W US0140997 W US 0140997W WO 0207368 A2 WO0207368 A2 WO 0207368A2
Authority
WO
WIPO (PCT)
Prior art keywords
signal
signals
data
user
host
Prior art date
Application number
PCT/US2001/040997
Other languages
English (en)
Other versions
WO2002007368A3 (fr
Inventor
Brian Chen
Gregory W. Wornell
Original Assignee
Chinook Communications, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chinook Communications, Inc. filed Critical Chinook Communications, Inc.
Priority to AU7358601A priority Critical patent/AU7358601A/xx
Publication of WO2002007368A2 publication Critical patent/WO2002007368A2/fr
Publication of WO2002007368A3 publication Critical patent/WO2002007368A3/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2385—Channel allocation; Bandwidth allocation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6118—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving cable transmission, e.g. using a cable modem
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6156—Network physical structure; Signal processing specially adapted to the upstream path of the transmission network
    • H04N21/6168—Network physical structure; Signal processing specially adapted to the upstream path of the transmission network involving cable transmission, e.g. using a cable modem
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
    • H04N7/087—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division with signal insertion during the vertical blanking interval only
    • H04N7/088—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division with signal insertion during the vertical blanking interval only the inserted signal being digital
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/10—Adaptations for transmission by electrical cable
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/10—Adaptations for transmission by electrical cable
    • H04N7/106—Adaptations for transmission by electrical cable for domestic distribution

Definitions

  • the present invention relates generally to the transmission of data in television signals and, more particularly, to the embedding of data in television signals using digital watermarking techniques.
  • a variety of commercial applications exist for providing data to a user through communication channels used for transmitting television signals. For example, closed captioning and teletext systems are employed to display textual data that are associated with a television program. Additional applications include sending telephony, Internet, video- enhancement, video-on-demand, video-streaming, or audio-streaming data over television communications channels. These channels include those associated with broadcast "over-the- air" from ground-based antennas, from satellites, and over cable networks.
  • Cable networks typically are referred to as having a "head end” from which the cable television signals are transmitted.
  • the communication channels through which the transmissions occur typically include fiber optic cables and coaxial wire cables, as well as a variety of switches, relays, and other conventional network components.
  • Public switched or other telephone networks may also constitute, or be included in, the cable network.
  • these communication channels are sometimes referred to herein simply as "cables.”
  • the television signals are received at what are referred to herein as "user ends.” For example, a cable-network customer receives the television signals at a user end where the signals may be coupled to television receivers, video cassette recorders, computers, and/or other devices.
  • a variety of sources of television signals are coupled to the head end so that the television signals may be transmitted over the cable network.
  • These television sources may include, for example, various commercial or public broadcast systems or organizations.
  • Television signals typically include both video signals and associated audio signals, and also may include data signals.
  • the television signals typically are multiplexed at the head end into what is referred to herein as “head-end multiplexed signals,” meaning a group of television signals assembled at various carrier frequencies across a band of frequencies.
  • head-end multiplexed signals meaning a group of television signals assembled at various carrier frequencies across a band of frequencies.
  • the organizational scheme according to which these signals are assembled at the head end is commonly referred to as a "cable plant.”
  • the organization of a typical conventional cable plant, referred to as conventional cable plant 169 is graphically represented in Figure IB.
  • Frequency axis 160 of Figure IB is not shown to scale.
  • the portion of cable plant 169 between zero and 50 Megahertz (MHz) is referred to as the "return channel” and is reserved for carrying data from the user ends back to the head end.
  • Current systems use either the range of 5 to 39 MHz or 5 to 42 MHz.
  • Examples of the data transmitted over the return channel include user selections of video-on-demand services or requests for other download services.
  • the portion of cable plant 169 between 50 MHz and 550 MHz is used to transmit conventional analog television signals in television channels having a bandwidth of 6 MHz each. Examples of these channels are labeled 168A-C, generally and collectively referred to hereafter as analog television channels 168. For instance, an analog television signal provided by one television network or station may occupy channel 168A, an analog television signal provided by another television network or station may occupy channel 168C, and so on.
  • the portion of cable plant 169 between 550 MHz and 750 MHz is used to transmit conventional digital television signals.
  • the television channels in this range also have a bandwidth of 6 MHz, into which one high definition television (HDTV) signal may be placed.
  • HDTV high definition television
  • SDTV standard definition television signals
  • Both HDTV and SDTV employ digital signals.
  • An example of a digital television channel is labeled 164 A, and digital television channels may hereafter be generally and collectively referred to as digital television channels 164.
  • a portion of cable plant 169 between 550 and 750 MHz may be dedicated to carrying conventional data signals from the head end to the user ends.
  • DOCSIS Data Over Cable Service Interface Specification
  • these data signals may include captioning, teletext, telephony, Internet, television-enhancement, video-on- demand, video-streaming, audio-streaming, or other types of data.
  • user-end multiplexed signals are provided to users in accordance with what is referred to as a "multi-drop" system.
  • FIG 9A shows a conventional multi-drop system in which a common cable provides the same user-end multiplexed signals 91 OX to all of the users in what is referred to for convenience herein as a "neighborhood.”
  • a portion of the users in an illustrative neighborhood X are represented by homes 901 A-E (hereafter, "homes 901").
  • the word "homes” is used herein for convenience, but it will be understood that homes 901 need not be residences. Rather, any of them could be a business, school, or any other facility, place, or user that constitutes a user end of the cable network.
  • Homes 901 typically are in the same geographic area.
  • Homes located in another neighborhood, for example, "neighborhood Y” typically receive user-end multiplexed signals from another cable that is common to all of the homes in that other neighborhood.
  • the number of homes in a typical cable neighborhood may be 500 to 2,000.
  • each of homes 901 may access the same television and data signals as provided by multiplexed signals 91 OX (assuming that each home has the necessary equipment to unscramble or otherwise enable each of the signals).
  • data may be provided in the portion of conventional cable plant 169 represented by conventional data channel 166 of Figure IB.
  • the data provided to homes 901 in multiplexed signals 91 OX may thus be referred to for convenience as conventional data signals 166X.
  • the bandwidth of conventional data signals 166X is limited; thus the rate at which data may be transmitted to homes 901 in this portion of multiplexed signals 90 IX is also limited. In accordance with the bandwidth specified in the DOCSIS standard, this maximum data rate is about 27 million bits per second (Mbps). A variety of conventional techniques are employed to distribute these 27 Mbps among homes 901. For example, addressable data packets may be used so that home 901 A is allowed exclusive access to data packets addressed to it, home 90 IB is allowed exclusive access to data packets addressed to it, and so on.
  • Some applications typically involve relatively high rates of data transmission to users.
  • so-called "broadband" access to data downloads from the Internet such as is generally desirable for streaming video and other uses, currently involves data transfer rates on the order of 1 Mbps.
  • this rate as a typical one for illustrative purposes, the entire capacity of conventional data signals 166X is required to service 27 homes in neighborhood X that concurrently seek to download Internet data at a rate of 1 Mbps. If additional users in neighborhood X concurrently seek to access data, then either they must be denied access, current data users must be eliminated, and/or a rationing scheme must be imposed.
  • Cable companies typically ration the 27 Mbps so that all subscribers in a neighborhood may be served during periods of high demand. For example, if 54 homes in neighborhood X concurrently seek broadband Internet access (and assuming in this example no other concurrent data uses in the neighborhood), each home may be limited to a rate of 0.5 Mbps. Thus, rationing schemes result in degradation of data service (in the form of slower data rates) to some or all users. Degradation of data service may not be unusual during peak demand periods since, as noted, 500 or more homes may share the same 27 Mbps of data capacity. Degradation of Internet service often is of particular concern to the cable company because high-speed Internet access is advertised as an advantage of subscribing.
  • FIG. 9B One approach, graphically illustrated in Figure 9B, is simply to reduce the number of homes in a cable neighborhood. Alternatively stated, additional cable neighborhoods may be created, each associated with its own common cable. Thus, in Figure 9B, homes 901A, B, and C are served by multiplexed signals 910X' so that an illustrative three homes share the 27 Mbps data capacity of conventional data signals 166X' rather than the illustrative five homes that shared this capacity in the configuration of Figure 9 A. The other two cable users, homes 90 ID and 90 IE, now share a separate cable that provides conventional data signals 166Y in multiplexed signals 910Y.
  • Homes 90 ID and 90 IE thus share an additional 27 Mbps of data capacity provided by conventional data signals 166Y.
  • a disadvantage of this approach is the significant additional expense to the cable company of providing the additional cable from the head end to the users in neighborhood Y.
  • Other approaches to increasing data capacity are applicable not only to cable systems, but also to other forms of television broadcasting such as over-the-air or satellite broadcasting.
  • a reason to apply these approaches in non-cable systems is to increase opportunities to provide a variety of data services.
  • One of these approaches is to replace one or more television signals with data signals.
  • a cable operator could replace the television signals transmitted over one or more of analog television channels 168, and/or over digital television channels 164, with data only.
  • a disadvantage of this approach is that the elimination of television signals typically reduces revenues and also reduces the attractiveness of the cable service to users because of the reduced choice of television signals.
  • a third conventional approach to increasing the data capacity of cable networks, or of other television broadcasting systems, is to transmit the data with one or more analog television signals according to certain approved conventional methods.
  • the Federal Communications Commission FCC
  • FCC Federal Communications Commission
  • NTSC National Television System Committee
  • the VBI is a portion of the NTSC broadcast television signal that has no viewable content, i.e., it contains no video signal.
  • the reason for creating this blank portion is to allow time for the electron gun of the television receiver's cathode ray tube to move from the bottom to the top of the screen after scanning an image across the screen.
  • the VBI has been used to transmit such data as closed captioning and HTML- formatted information.
  • CNN broadcasts links to its Internet pages to provide additional information related to its television programs.
  • the Henderson patent also describes a similar technique of using a "black region," which is a portion of the video signal that is blanked out to allow the cathode ray tube's electron beam to retrace from the end of one horizontal line to the start of the next one.
  • Other conventional techniques exploit under-utilized portions of television signals and insert data into these portions.
  • Takahiko Fukinuki and Yasuhiro Hirano "Extended Definition TV Fully Compatible with Existing Standards," IEEE Transaction on Communications (Vol. Com-32, No. 8; August 1984), describes opportunities for inserting data used to increase video signal resolution into "vacant frequency bands . . . in those areas in the first and third quadrants that conjugate with the modulated color components in the second and fourth quadrants when the signal is analyzed in the temporal-vertical frequency domain.”
  • data replaces a portion of the video signal that is not normally seen by television viewers.
  • Yes! Entertainment uses the extreme left edge of the picture, and other methods use the first line of active video (after the VBI) at the top of the picture. In many television receivers, these edges are blocked from viewing by the television cabinet.
  • Overscan systems are capable of transmitting data at relatively low rates, on the order of 15 to 20 kilobits per second.
  • the sub-video technique takes advantage of portions of the 6-MHz bandwidth of a television signal that are typically filtered out by a television receiver. In other words, these are "blank" frequencies. Because the blank frequencies typically are not used to transmit either the video or audio portion of the television signal, data may be inserted into them without interfering with either the picture or sound presented to the viewer. These techniques allow data rates on the order of 300 to 500 kilobits per second. The restricted data rates are due to the fact that the blank frequencies constitute a small portion of the full 6-MHz bandwidth.
  • abatement signals may be required to ameliorate distortion to the video signal that would otherwise occur in certain television receivers.
  • This technique is said to permit data transmissions of 3.0 Mbps. Additional data capacity of 1.5 Mbps may be achieved, according to the authors of these articles, by amplitude modulation of the aural carrier of the NTSC television format. Amplitude modulation generally results, however, in a signal that occupies as much bandwidth as the sum of the bandwidths of the modulating signal and the aural signal.
  • Yet another conventional technique, as described in the Henderson patent referred to above, is to transmit data by modulating the vestigial sideband of one or more cable television signals. This technique may be employed with quadrature amplitude modulation, phase shift key modulation, frequency shift key modulation, or another type of modulation.
  • the present invention addresses the need to provide additional capacity for transmitting data over television communication channels.
  • the invention addresses this need in the context of cable networks.
  • the invention is not so limited and may be implemented in connection with any other type of system used for broadcasting or otherwise delivering television signals, including over-the-air, satellite, or telephone systems.
  • aspects of the present invention overcome disadvantages of conventional systems for providing data over television communication channels.
  • aspects of the present invention are not limited to application in the Vertical Blanking Interval of a television signal, other blanked portions of the signal, particular blanked frequencies of the television signal, or to particular portions (e.g., the edges) of the nominally perceptible television picture.
  • aspects of the present invention are not limited to transmission of data in phase- quadrature with the video signal but, rather, encompass data transmission in-phase with the video signal.
  • data-transmission rates higher than those obtainable by conventional methods may be achieved.
  • data transmission is achieved without the need for pre-shaping or filtering, as practiced by some conventional methods.
  • a backward-compatible cable modem system enables a user to receive data over a television cable network using either an information extractor that extracts data that has been embedded into a television signal using information-embedding techniques described below, or by using a conventional cable demodulator.
  • the system includes, on the modulation side (the head end), an information embedder that uses an information-embedding technique to embed data into one or more selected host television signals to generate composite signals.
  • the composite signals are watermarked versions of the host television signals.
  • the composite signals and data are multiplexed together, and also multiplexed with television signals that have not been embedded with the data (referred to as "non-host" signals).
  • the multiplexed signals are then transmitted over the cable network to the user.
  • the composite signals are selected and then provided to an information extractor.
  • the extractor extracts information from the composite signals in order to reproduce the embedded data.
  • the data multiplexed with the composite signals and the non-host signals at the head end are demultiplexed on the user end using the conventional cable demodulator.
  • Transformers may be included at the head end and/or the user end to transform video signals between source format and broadcast format and/or between base band and broadcast band.
  • an information-embedding modem system includes an information-embedding modulator that has a host signals selector that selects a first host signal from a plurality of television signals.
  • the modulator also has an information embedder that embeds a first data signal into the first host signal, thereby generating a first composite signal that comprises a watermarked version of the first host signal.
  • the information-embedding modulator may be coupled to a cable network.
  • the information-embedding modulator may also have a format transformer that transforms the first composite signal into a broadcast format, thereby generating a first broadcast-formatted composite signal.
  • the broadcast format may be selected from the group consisting of an NTSC format, a PAL format, a SECAM format, a PAL-M format, a PAL-N format, or a MESECAM format.
  • the plurality of television signals may include a first non-host signal that is in a source format and is not the same signal as the first host signal.
  • the format transformer further may transform the first non-host signal into a broadcast format, thereby generating a first broadcast-formatted non-host signal.
  • the information-embedding modulator also may include a multiplexer that multiplexes at least the first broadcast-formatted composite signal and the first broadcast-formatted non- host signal.
  • the multiplexer further is constructed and arranged to transform the first broadcast-formatted composite signal and the first broadcast-formatted non-host signal into a broadcast band, thereby generating a first set of head-end multiplexed signals.
  • the multiplexer may be coupled to a cable network to provide to it the first set of head-end multiplexed signals.
  • the cable network includes a cable communication channel having a head end and a plurality of user ends. The network transmits the first set of head-end multiplexed signals from the head end to provide at a first user end a first set of user-end multiplexed signals corresponding to the first set of head-end multiplexed signals.
  • the first set of user-end multiplexed signals may include a first channel-noise component.
  • the system may include a first information-embedding demodulator that receives the first set of user-end multiplexed signals.
  • the demodulator has a composite signals selector and splitter that selects a first received broadcast-band composite signal corresponding to the first host signal from the first set of user-end multiplexed signals.
  • the composite signals selector and splitter may split the first received broadcast-band composite signal from the first set of user-end multiplexed signals.
  • the demodulator also has a broadcast-band to base-band transformer that transforms the first received broadcast-band composite signal to a base band, thereby generating a first base-band broadcast-formatted received composite signal.
  • the demodulator Also included in the demodulator is a broadcast-format to source-format transformer that transforms the first base-band broadcast- formatted received composite signal to a source format, thereby generating a first base-band source-formatted received composite signal. Further, the demodulator has an information extractor that extracts from the first source-formatted received composite signal a first extracted data signal corresponding to the first data signal.
  • the first data signal may include one or more data signals selected from the group consisting of telephony data signal, computer-service data signal, Internet data signal, audio data signal, video data signal, or video-enhancement data signal.
  • the information extractor is coupled to a data receiver to provide to it the first extracted data signal, wherein the data receiver is selected from the group consisting of one or more of a telephone receiver, computer, Internet receiver, audio receiver, or video receiver.
  • information-embedding demodulator includes: (a) a composite signals selector and splitter that selects a first received broadcast-band composite signal corresponding to the first host signal from the first set of user-end multiplexed signals, and (b) an information extractor that extracts from the first received broadcast-band composite signal a first extracted data signal corresponding to the first data signal.
  • the composite signals selector and splitter may also split the first received broadcast-band composite signal from the first set of user-end multiplexed signals.
  • the first host signal and the first composite signal are in a broadcast format.
  • the broadcast format may be selected from the group consisting of an NTSC format, a PAL format, a SECAM format, a PAL-M format, a PAL-N format, or a MESECAM format.
  • the plurality of television signals includes a first non-host signal that is in a broadcast format and is not the same signal as the first host signal.
  • the information- embedding modulator includes a multiplexer that multiplexes at least the first composite signal and the first non-host signal, thereby generating a first set of head-end multiplexed signals.
  • the multiplexer may be coupled to a cable network to provide to it the first set of head-end multiplexed signals.
  • the cable network may have a cable communication channel, having a head end and a plurality of user ends, that transmits the first set of head-end multiplexed signals from the head end to provide at a first user end a first set of user-end multiplexed signals corresponding to the first set of head-end multiplexed signals.
  • the system in some aspects, includes a first information-embedding demodulator coupled to the first user end to receive the first set of user-end multiplexed signals.
  • the demodulator has a composite signals selector and splitter that selects a first received broadcast-band composite signal corresponding to the first host signal from the first set of user-end multiplexed signals.
  • It also has a broadcast-band to base-band transformer that transforms the first received broadcast-band composite signal to a base band, thereby generating a first base-band broadcast-formatted received composite signal. Also included in the demodulator is an information extractor that extracts from the first base-band broadcast-formatted received composite signal a first extracted data signal corresponding to the first data signal.
  • the composite signals selector and splitter may split the first received broadcast-band composite signal from the first set of user- end multiplexed signals.
  • the information embedder includes a quantization index modulator.
  • the information extractor includes a quantization index demodulator.
  • the information embedder may include a low-bit modulator.
  • the information embedder may include an additive spread-spectrum modulator, which may be a weighted-additive spread-spectrum modulator.
  • the first host signal may be in a digital video format, or it may be in an analog video format.
  • an information-embedding (IE) demodulator for use with an information-embedding modulator.
  • the modulator (i) embeds a first data signal into a first host signal of a plurality of television signals, thereby generating a first composite signal that comprises a watermarked version of the first host signal, and (ii) provides the first composite signal in a first set of head-end multiplexed signals for transmission over a cable network.
  • the cable network has a plurality of user ends and transmits the first set of head-end multiplexed signals to provide at a first user end a first set of user-end multiplexed signals corresponding to the first set of head-end multiplexed signals.
  • the information-embedding demodulator includes: (a) a composite signals selector and splitter that selects a first received composite signal corresponding to the first host signal from the first set of user-end multiplexed signals, and (b) an information extractor that extracts from the first received composite signal a first extracted data signal corresponding to the first data signal.
  • a backward-compatible modem system for use with a cable network.
  • the network has a head end and a plurality of user ends coupled to the head end through a cable communication channel.
  • the system includes a backward- compatible modulator that has: (a) an information embedder that embeds a first data signal into a first host signal of a plurality of television signals, thereby generating a first composite signal that comprises a watermarked version of the first host signal, and (b) a multiplexer that multiplexes at least the first composite signal, a first non-host signal of the plurality of television signals, and a second data signal, thereby generating a first set of backward-compatible head-end multiplexed signals.
  • the first and second data signals may be the same data signal.
  • the backward-compatible modulator may also include (c) a host signals selector that selects the first host signal from the plurality of television signals.
  • the multiplexer may be coupled to the head end of the cable network to provide to it the first set of backward-compatible head-end multiplexed signals for transmission over the cable communication channel to at least a first user end of the plurality of user ends, thereby providing at the first user end a first set of backward-compatible user-end multiplexed signals corresponding to the first set of backward-compatible head-end multiplexed signals.
  • the backward-compatible modem system also includes a first backward-compatible demodulator coupled to the first user end to receive the first set of backward-compatible user-end multiplexed signals.
  • the first backward-compatible demodulator includes: (a) a composite signals selector and splitter that selects a first received composite signal corresponding to the first host signal from the first set of backward- compatible user-end multiplexed signals, (b) an information extractor that extracts from the first received composite signal a first extracted data signal corresponding to the first data signal, and (c) a conventional cable demodulator that demultiplexes from the first set of backward-compatible user-end multiplexed signals a first demultiplexed data signal corresponding to the second data signal.
  • the first backward-compatible demodulator includes (a) a composite signals selector and splitter that selects a first received composite signal corresponding to the first host signal from the first set of backward-compatible user-end multiplexed signals, (b) a transformer coupled to the composite signals selector and splitter that performs one or more transforaiations on the first received composite signal, thereby generating a first transformed composite signal; (c) an information extractor that extracts from the first transformed composite signal a first extracted data signal corresponding to the first data signal, and (d) a conventional cable demodulator that demultiplexes from the first set of backward-compatible user-end multiplexed signals a first demultiplexed data signal corresponding to the second data signal.
  • the transformer may perform one or more transformations selected from the group consisting of format transformation or carrier band transformation.
  • a backward-compatible demodulator for use with a backward-compatible modulator.
  • the backward-compatible modulator (i) embeds a first data signal into a first host signal of a plurality of television signals, thereby generating a first composite signal that comprises a watermarked version of the first host signal, and (ii) provides the first composite signal, a first non-host signal of the plurality of television signals, and a second data signal in a first set of backward-compatible head-end multiplexed signals for transmission over a cable network.
  • the cable network has a plurality of user ends and transmits the first set of backward-compatible head-end multiplexed signals to provide at a first user end a first set of backward-compatible user-end multiplexed signals corresponding to the first set of backward-compatible head-end multiplexed signals.
  • the backward-compatible demodulator includes a composite signals selector and splitter that selects a first received composite signal corresponding to the first host signal from the first set of backward-compatible user-end multiplexed signals.
  • the backward-compatible demodulator also includes a transformer that performs one or more transformations on the first received composite signal, thereby generating a first transformed composite signal.
  • an information extractor that extracts from the first transformed composite signal a first extracted data signal corresponding to the first data signal, and a conventional cable demodulator that demultiplexes from the first set of backward-compatible user-end multiplexed signals a first demultiplexed data signal corresponding to the second data signal.
  • the first and second data signals may be the same data signal.
  • a backward-compatible demodulator for use with a backward-compatible modulator.
  • the modulator (i) embeds a first data signal into a first host signal of a plurality of television signals, thereby generating a first composite signal that comprises a watermarked version of the first host signal, and (ii) provides the first composite signal, a first non-host signal of the plurality of television signals, and a second data signal in a first set of backward-compatible head-end multiplexed signals for transmission over a cable network.
  • the cable network has a plurality of user ends and transmits the first set of backward-compatible head-end multiplexed signals to provide at a first user end a first set of backward-compatible user-end multiplexed signals corresponding to the first set of backward-compatible head-end multiplexed signals.
  • the backward-compatible demodulator has a composite signals selector and splitter that selects a first received composite signal corresponding to the first host signal from the first set of backward-compatible user-end multiplexed signals.
  • It also has an information extractor that extracts from the first received composite signal a first extracted data signal corresponding to the first data signal, and a conventional cable demodulator that demultiplexes from the first set of backward-compatible user-end multiplexed signals a first demultiplexed data signal corresponding to the second data signal.
  • the first and second data signals may be the same data signal.
  • a method for modulation including the steps of: (1) selecting a first host signal from a plurality of television signals; and (2) embedding a first data signal into the first host signal, thereby generating a first composite signal that comprises a watermarked version of the first host signal.
  • the method may include the further step (3) transmitting the first composite signal over a cable network.
  • a method for demodulation of a first set of user-end multiplexed signals that is provided at a first user end of a cable network.
  • the first set of user-end multiplexed signals corresponds to a first set of head-end multiplexed signals transmitted over the cable network.
  • the first set of head-end multiplexed signals includes a first composite signal comprising a watermarked version of a first host signal of a plurality of television signals generated by embedding a first data signal into the first host signal.
  • the method includes the steps of: (1) selecting a first received composite signal corresponding to the first host signal from the first set of user-end multiplexed signals; and (2) extracting from the first received composite signal a first extracted data signal corresponding to the first data signal.
  • the first received composite signal may be in a broadcast band; and the method in these implementations may include the step of (3) transforming the first received composite signal to a base band.
  • the first received composite signal is in a broadcast format; and the method includes the step of (3) transforming the first received composite signal to a source format.
  • a method for backward-compatible modulation that includes the steps of: (1) embedding a first data signal into a first host signal of a plurality of television signals, thereby generating a first composite signal that comprises a watermarked version of the first host signal, and (2) multiplexing at least the first composite signal, a first non-host signal of the plurality of television signals that is not the same signal as the first host signal, and a second data signal, thereby generating a first set of backward- compatible head-end multiplexed signals.
  • This method may include the step (3) of, prior to step (1), selecting the first host signal from the plurality of television signals.
  • a method for backward-compatible demodulation of a first set of backward-compatible user-end multiplexed signals that is provided at a first user end of a cable network.
  • the first set of backward-compatible user-end multiplexed signals corresponds to a first set of backward-compatible head-end multiplexed signals transmitted over the cable network.
  • the first set of backward-compatible head-end multiplexed signals includes a first composite signal comprising a watermarked version of a first host signal of a plurality of television signals generated by embedding a first data signal into the first host signal and also includes a second data signal.
  • the method includes the steps of: (1) selecting a first received composite signal corresponding to the first host signal from the first set of backward-compatible user-end multiplexed signals; (2) performing one or more transformations on the first received composite signal, thereby generating a first transformed composite signal; (3) extracting from the first transformed composite signal a first extracted data signal corresponding to the first data signal; and (4) demultiplexing from the first set of backward-compatible user-end multiplexed signals a first demultiplexed data signal corresponding to the second data signal.
  • the first set of backward-compatible user-end multiplexed signals corresponds to a first set of backward- compatible head-end multiplexed signals transmitted over the cable network.
  • the first set of backward-compatible head-end multiplexed signals includes a first composite signal comprising a watermarked version of a first host signal of a plurality of television signals generated by embedding the first data signal into the first host signal and also includes a second data signal.
  • the method includes the steps of: (1) selecting a first received composite signal corresponding to the first host signal from the first set of backward-compatible user-end multiplexed signals; (2) extracting from the first received composite signal a first extracted data signal corresponding to the first data signal; and (3) demultiplexing from the first set of backward-compatible user-end multiplexed signals a first demultiplexed data signal corresponding to the second data signal.
  • the above aspects and implementations of the present invention are not necessarily inclusive or exclusive of each other and may be combined in any manner that is non- conflicting and otherwise possible, whether they be presented in association with a same, or a different, aspect or implementation of the invention.
  • the description of one aspect is not intended to be limiting with respect to other aspects.
  • any one or more function, step, operation, or technique described elsewhere in this specification may, in alternative aspects, be combined with any one or more function, step, operation, or technique described in the summary.
  • the above aspects are illustrative rather than limiting.
  • Figure 1A is a functional block diagram of one embodiment of an information- embedding modem system, including an information-embedding modulator that is coupled to the head end of a cable network and a plurality of information-embedding demodulators coupled to user ends of the cable network;
  • Figure IB is a graphical representation of a conventional cable plant;
  • Figure 1C is a graphical representation of a cable plant such as may be provided by the information-embedding modulator of Figure 1 A to the head end of the cable network;
  • Figure 2 is a functional block diagram including one embodiment of the information- embedding modulator of Figure 1A and one embodiment of an illustrative one of the information-embedding demodulators of Figure 1A;
  • Figure 3 is a functional block diagram including another embodiment of the information-embedding modulator of Figure 1A and another embodiment of an illustrative one of the information-embedding demodulators of Figure 1A;
  • Figures 4A-4C are functional block diagrams of illustrative embodiments of data sources that may provide data signals to the information-embedding modulator of Figure 1 A;
  • Figure 5 is a functional block diagram of one embodiment of television sources that may provide television signals to the information-embedding modulator of Figure 1A;
  • Figure 6A is a functional block diagram of one embodiment of the information- embedding demodulator of Figure 1A;
  • Figure 6B is a functional block diagram of another embodiment of the information- embedding demodulator of Figure 1A;
  • Figure 6C is a functional block diagram of one embodiment of the information- embedding demodulator of Figure 1 A providing extracted data to illustrative embodiments of data and television receivers;
  • Figure 7 is a functional block diagram of one embodiment of a backward-compatible modem system
  • Figure 8 is a flow chart of one embodiment of method steps and decision elements of backward-compatible modulation and demodulation
  • Figure 9A is a simplified graphical representation of a single neighborhood of a conventional multi-drop cable system
  • Figure 9B is a simplified graphical representation of two neighborhoods of a conventional multi-drop cable system
  • Figure 10A is a simplified graphical representation of a neighborhood served by virtual-node cable distribution
  • Figure 1 OB is a graphical representation of a cable plant including one embodiment of virtual nodes of the virtual-node cable distribution of Figure 10 A.
  • a processor such as a special-purpose microprocessor or digital signal processor, program-logic controller, or by the central processing unit (CPU) of a computer system.
  • FIG. 1 A is a functional block diagram of one embodiment of an information- embedding (IE) modem system, referred to as IE modem system 100.
  • IE modem system 100 modulates and demodulates television signals so that data may respectively be embedded in and extracted from those signals using techniques commonly referred to as "digital watermarking," "information hiding,” “data hiding,” or “steganography.” For convenience, these techniques are hereafter simply referred to as “IE techniques” and the functions performed according to these techniques are referred to as “IE embedding” or “IE extracting.” Systems that implement these techniques or functions may be referred to as “IE systems.”
  • a key aspect of IE techniques is that data, in the form of components of one or more “wateraiark” signals, are embedded in one or more "host” signals by changing the values of components of the host signals.
  • the host signals are not changed enough to be noticeable to a user or to otherwise interfere with their use.
  • the video portion of a television signal may be a host signal.
  • the components of this host signal could correspond, for example, to the pixels of each field of a video image.
  • the values of the components in this example could be the values of the pixels as measured by intensity, hue, and/or any other of their characteristics.
  • Data may be embedded in this host signal by changing the characteristics of selected components.
  • the result is what is referred to herein as a "composite" signal, meaning a signal that corresponds to the host signal, but with perturbations in the values of some host-signal components due to the embedding of the watermark signal in them.
  • the composite signal is to be transmitted, transmission generally does not require more bandwidth than would be required for the host signal. That is, using an example of embedding a digital watermark signal in a digital host signal, the quantity of data in the composite signal is the same as the quantity of data in the host signal, although the values of some data have been changed by the embedding process. Moreover, the embedding of data does not eliminate or replace the host signal to the extent that the essential information in the host signal is lost. The essential information of the host signal is present, although it has been altered, generally in imperceptible ways, to form the composite signal.
  • the watermark signal is extracted from the composite signal by determining how the composite-signal components differ from the values of the host signal components that would be expected if embedding had not been done. The difference typically is assumed to be due to a combination of the perturbations introduced by the embedding process and the effects of noise that has been added in transmission or at various points in the embedding or extracting processes.
  • QIM quantization index modulation
  • extracting and grammatical variations thereof, are sometimes used to describe techniques that are not IE techniques as commonly understood by those of ordinary skill in the art of information embedding, and as generally described above.
  • Those references to “embed[ding]” and “extracting” are to the VBI, overscan, and sub-video techniques described above.
  • these techniques involve inserting data into unused or visually inaccessible portions of a video signal or unused frequencies of a television channel, or replacing a portion of a video signal with data. They are not IE techniques, in which a watermark signal is embedded into a host signal.
  • the words “embedding,” “extracting,” and grammatical variations thereof will be used only in the sense they are used in relation to IE techniques or IE systems, such as, for example, “embedding” a watermark signal in a host signal to form a composite signal, and “extracting” a received data signal corresponding to the original watermark signal from the composite signal.
  • the word “watermark,” and grammatical variations thereof will be understood to refer to the function of embedding watermark signals in a host signal in accordance with any of the variety of presently known IE techniques, or IE techniques that may be developed in the future.
  • an information embedder that is said to embed a data signal into a host signal to generate a composite signal comprising a watermarked version of the host signal will be understood to have performed this embedding function in accordance with any conventionally known or future IE techniques or IE systems.
  • the illustrated IE modem system 100 provides both modulation and demodulation, the invention is not so limited. Rather, aspects of the invention may be implemented in which only modulation, or only demodulation, functions are performed.
  • IE modem system 100 of Figure 1 A includes both IE modulator 110 and IE demodulators 120A-N (generally and collectively referred to as IE demodulators 120), an aspect of the invention could be IE modulator 110 without IE demodulators 120, or one or more of demodulators 120 without IE modulator 110.
  • input to IE modulator 110 includes television signals 162 and data signals 172.
  • IE modulator 110 selects one or more of television signals 162 to be host signals and modulates them by embedding in them one or more of data signals 172, thereby generating composite signals.
  • IE modulator 110 also typically multiplexes the composite signals with those of television signals 162 that have not been watermarked (referred to herein as "non-host signals") so that the multiplexed signals may be transmitted over a cable network in accordance with conventional techniques.
  • head-end multiplexed signals 112X and 112Y are shown in Figure 1 A as being provided by IE modulator 110 to cable network 199.
  • head-end multiplexed signals are typically provided over a common cable to a neighborhood served by the cable network.
  • head-end multiplexed signals 112X are transmitted over a cable X (not shown) to serve neighborhood X
  • head-end multiplexed signals 112Y are transmitted over a cable Y (not shown) to serve neighborhood Y.
  • head-end multiplexed signals 112 may be provided to the cable network, typically to serve that number of neighborhoods.
  • the head end of a cable network typically comprises a "cable modem termination system (CMTS)."
  • CMTS transmits the head-end multiplexed signals to their corresponding neighborhoods over appropriate cables.
  • the CMTS also may receive information back from the users by means of data transmitted over the return channel (such as return channel 161 of Figure IB).
  • return channel 161 of Figure IB return channel 161 of Figure IB
  • user information may also be transmitted back to the CMTS in portions of the conventional cable plant other than the return channel. Examples of these proposals are described in the Henderson patent referred to above and in U.S. Patent No.
  • Cable network 199 is graphically represented in simplified form in Figure 1 A.
  • CMTS 130 of cable network 199 receives head-end multiplexed signals 112 and routes and transmits them over cables corresponding to their respective intended neighborhoods.
  • IE modulator 110 may be used with a virtual node distribution system, or with a distribution system combining conventional multi-drop, as well as virtual node, approaches.
  • the multiplexed signals transmitted over cable communication channel 140 to neighborhoods X and Y are represented by signals 132X and 132Y, respectively.
  • Cable communication channel includes cables X and Y.
  • Cable network 199 typically also includes various channel noise sources 150 that introduce channel noise components 152 into channel 140.
  • Channel noise components 152 generally are added to signals 132X and 132Y in ways known to those skilled in the relevant art.
  • Channel noise components 152 may be introduced into the network from external sources, such as power lines or other electromagnetic sources in the external environment, or from fiber optic and/or coaxial wire cables, switches, relays, or other components of cable network 199.
  • the transmitted multiplexed signals are coupled to the user ends. Examples are user- end multiplexed signals 142X and 142Y, representing what are generally and collectively referred to as user-end multiplexed signals 142.
  • IE demodulator 120 A is shown as receiving user-end multiplexed signals 142X, indicating that it is served by cable X and thus is in neighborhood X.
  • IE demodulator 120N is shown as receiving user-end multiplexed signals 142Y, indicating that it is served by cable Y and thus is in neighborhood Y.
  • IE demodulators 120A and N could have been shown as being served by the same cable, and thus by the same one of user-end multiplexed signals 142, such as 142X or 142Y.
  • IE demodulators 120 provide at their outputs television signals 122 and extracted data signals 124.
  • Television signals 122 are typically provided to one or more television receiver 180.
  • Extracted data signals 124 are typically provided to one or more data receiver 190, such as a computer.
  • Extracted data signals 124 correspond to data signals 172 that were embedded by IE modulator 110 into host television signals.
  • Television signals 122 correspond to these host television signals, as well as to other of television signals 162 that were not hosts to embedding (i.e., non-host signals).
  • the operations by which IE modulator 110 and IE demodulators 120 accomplish these operations in two illustrative embodiments are now described with respect to the systems of Figures 2 and 3.
  • FIG. 2 is a functional block diagram of one implementation of IE modulator 110 connected through cable network 199 to one implementation of IE demodulator 120A at one illustrative user end.
  • IE modulator 110 of Figure 2 includes a host signals selector and optional de-multiplexer 210 (hereafter, simply selector 210) that selects one or more of television signals 162 to be host signals, referred to as host signals 212.
  • selector 210 selectively directs for further processing host signals 212 and those of television signals 162 that were not selected to be host signals, referred to as non-host signals 216.
  • Selector 210 also optionally de-multiplexes television signals 162 when they are received in multiplexed form.
  • IE modulator 110 Another element of IE modulator 110 is information embedder 220 that receives host signals 212 from selector 210 and uses any known or future IE technique to embed one or more of data signals 172 into the host signals, thereby generating composite signals 222.
  • IE modulator 110 includes data rate selector 225 that selects a data rate and provides this information to information embedder 220 so that it may embed data at the selected data rates.
  • IE modulator 110 further includes broadcast format transformer 240 that, in the illustrated implementation, receives composite signals 222 from information embedder 220 and non-host signals 216 from selector 210 and transforms signals 222 and 216 into a broadcast format.
  • IE modulator 110 Also included in the illustrated implementation of IE modulator 110 is multiplexer and broadcast-band transformer 230 (hereafter, simply multiplexer 230). Multiplexer 230 multiplexes signals received from broadcast format transformer 240 and may also transform them into a broadcast band. The functions of each of these elements of IE modulator 110 are now described in greater detail.
  • Selector 210 As noted, selector 210 of the illustrated implementation optionally de- multiplexes television signals 162, selects one or more of television signals 162 to be host signals, and, in the illustrated implementation, selectively directs the host and non-host signals for further processing.
  • Figure 5 is a functional block diagram that illustrates some of the various ways in which television signals 162 may be made available to IE modulator 110 and thus operated upon by selector 210. In one configuration, individual ones of television signals 162 are separately coupled to IE modulator 110 and thus to selector 210.
  • individual television signals 162 A, B and N from television sources 160A, B, and N, respectively, may be provided to IE modulator 110 and thus to selector 210 as indicated in Figure 2 by the data-flow line labeled television signals 162.
  • optional de-multiplexing is not undertaken because the signals are not multiplexed.
  • one or more of television signals 162 may be provided to IE modulator 110 in multiplexed form. This alternative is illustrated in Figure 5 by the dotted lines representing multiplexer 550 and by the dotted-line multiplexed television signals 162 A, B & N that are provided by multiplexer 550 to IE modulator 110.
  • selector 210 de- multiplexes them, i.e., separates them into individual signals, for further processing.
  • some of television signals 162 may be provided to IE modulator 110 in multiplexed form and others of television signals 162 as individual signals. In these configurations, it also typically is convenient for selector 210 to de-multiplex the multiplexed signals.
  • one or more of television signals 162 may itself have been modulated by a modulator that may, but need not, be an IE modulator.
  • modulator 510 may be an IE modulator that generates television signal 162 A by embedding data 520 into the video and/or audio portion of television signal 512.
  • Data 520 may be, for example, enhanced or interactive television data.
  • data 522 could be extracted using an IE demodulator, e.g., as described below with reference to IE demodulator 120 A, to enable a television receiver to enhance the video signal.
  • data 522 could be data intended to be displayed to a user in response to a user command or selection.
  • This user-display data may also be extracted in accordance with the operations of, for example, IE demodulator 120A.
  • Data 522 may be any other kind of data, and modulator 510 may be a modulator that does not use IE techniques, such as one that inserts data into the VBI of the video portion of television signal 512. It generally is not material to the operations of IE modulator 110 or IE demodulator 120 A whether one or more of television signals 162 has already been modulated as noted with respect to television signal 162A.
  • IE modulator 110 generally may use television signal 162A as a host signal into which to embed data in the same manner as it may use any other of television signals 162, and IE demodulator 120 A generally may extract data from a composite signal corresponding to television signal 162A in the same manner as it may extract data from any other host signal.
  • Selector 210 selects one or more of television signals 162 to be host signals into which to embed one or more of data signals 172 in any combination. For example, one data signal, or a portion thereof, may be embedded into one or more host signals; or two or more data signals, or portions thereof, may be embedded into one host signal. These selection functions correspond to method step 805 and decision elements 815 and 817 as represented in Figure 8.
  • Figure 8 is a flow chart of one embodiment of method steps and decision elements of backward-compatible modulation and demodulation. Aspects of the operations of the system of Figure 2 also correspond to method steps and decision elements of Figure 8. These corresponding steps and elements hereafter will simply be referred to parenthetically. Selector 210 may employ a variety of criteria to select the one or more host signals.
  • Some criteria may be related to the operation of a "virtual node” system of data distribution at the user ends of cable network 199, as shown in the simplified illustrative embodiments of Figures 10A and 10B.
  • a "virtual node” approach may be implemented in some aspects by the association of particular user ends with particular host signals so that some users served by a common cable on a multi-drop cable network obtain data by extraction from one or more host signals, while other users served by the same common cable obtain data by extraction from one or more other host signals.
  • homes 901 A-E must share the approximately 27 Mbps data capacity of the common cable that serves their "neighborhood X.”
  • This capacity may be greatly expanded by employing IE techniques such that, for example, data to be transmitted to homes 901 A and 901C are embedded in a first host signal of television signals 162, data to be transmitted to homes 90 IB and 90 ID are embedded in a second host signal of television signals 162, and data to be transmitted to home 901E are embedded in a third host signal of television signals 162.
  • homes 901 A and 901C are in one virtual neighborhood served by a first virtual node 1050A
  • homes 901B and 90 ID are in another virtual neighborhood served by a second virtual node 1050B
  • home 901E is in another virtual neighborhood served by a third virtual node 1050C.
  • three virtual nodes or neighborhoods, corresponding to the three host signals are created based on television signals transmitted over a single cable.
  • Figure 10B is a graphical representation of an illustrative cable plant along frequency axis 1090 in which virtual node 1050 A corresponds to a host signal in channel 172A, virtual node 1050B corresponds to a host signal in channel 172B, and virtual node 1050C corresponds to a host signal in channel 174A.
  • a virtual node or neighborhood need not be associated with only one host signal. Rather, two or more host signals may be used for embedding data to be transmitted to a particular group of homes.
  • selector 210 selects a host signal based on an existing association between a user end and a host signal. That is, the existing association may be "predetermined” in that it has been established or determined by a person (e.g., it may be "user-selected"), by a system, or by a method operating externally to IE modulator 110. Data representing this predetermined association may be included, for example, in user information 174. In other implementations, the data could be stored in a data storage medium (not shown) included in IE modulator 110.
  • user information 174 includes an association between home 901 A and one of television signals 162. Because a television signal is typically multiplexed into a television channel as shown in Figures IB and 1C, a channel reference may sometimes hereafter be used for convenience to identify a particular television signal in this context. For instance, it is illustratively assumed that home 901 A is associated with analog television channel with embedded data 172 A (hereafter, simply "analog channel 172A") of Figure lC. This association may be established in accordance with any of a variety of known techniques, such as by entries in a record of a data base (not shown) maintained in one of data sources 170 that includes, for example, a computer system.
  • This data base may be accessed by selector 210, the entries may be conveyed to selector 210 from data sources 170, or other known techniques may be used to maintain and update the association.
  • the association between a user end, and a signal to be used as a host signal for embedding data intended for that user end, may further be refined.
  • home 901 A may be associated with the video signal portion of the television signal transmitted in analog channel 172A or, alternatively or in addition, with the audio signal portion of that television signal.
  • home 901 A may be associated with particular segments of those video and/or audio signal portions.
  • home 901 A may be associated with one or more data signals in conventional data channel 166; that is, a data signal that typically is multiplexed to be located in channel 166 may serve as a host signal into which one or more of data signals 172 intended for transmission to home 901 A may be embedded.
  • Data signals 172 may themselves be the data signals that are multiplexed into data channel 166.
  • a data signal of data signals 172 therefore may be embedded into another (or the same) data signal of data signals 172.
  • television signals 162 may be considered also to include one or more of data signals 172 in some implementations.
  • associations between user ends and host signals may be initially established, and thereafter followed, by selector 210 based on one or more criteria, and/or they may be dynamically changed based on a variety of factors.
  • information embedder 220 employs a particular IE embedding technique that embeds 10 Mbps of data in any selected one of analog channels 172 of Figure 1C and 20 Mbps of data in any selected one of digital television channels with embedded data 174 (hereafter, simply "digital channels 174" of Figure lC.
  • selector 210 either randomly associated home 901 A with analog channel 172 A or that this association had otherwise been initially established and communicated to selector 210 via user information 174. It further is assumed that home 901C also has been initially associated with analog channel 172 A. Homes 901 A and 901C may thus for convenience be said to be receiving data over virtual node 1050A, as shown in Figure 10A. As another example, homes 90 IB and 90 ID may be assumed to be receiving data intended for them (and distinguished from each other using packets or other conventional data distribution techniques) over analog channel 172B. Thus, homes 901B and 901D may be said to be receiving data over virtual node 1050B.
  • Homes 901 A and 901C may each concurrently be engaged in downloading information, e.g., data signals 172 from Internet data sources of data sources 170, at rates of 4 Mbps.
  • the combined data usage of 8 Mbps is within the assumed 10 Mbps data capacity of virtual node 1050A.
  • selector 210 may change the association of home 901A with virtual node A and, for example, associate it with virtual node 1050B.
  • This change of association may be accomplished in accordance with any of a variety of known techniques, such as by changing data entries in the data base referred to above or by changing pointers in a data base.
  • a change of association between a user end and a host signal, or the establishment of an association in substantially real time may be referred to hereafter as "dynamic association.” Assuming that other homes that already are associated with virtual node 1050B are not consuming a combined data capacity of more than 3 Mbps, then home 901 A' s request for data capacity of 7 Mbps may be honored under this new association.
  • selector 210 may dynamically associate home 901C with another virtual node (i.e., another one or more host signals, or portions thereof) so that it is no longer associated with virtual node 1050A, thus leaving sufficient capacity on analog channel 172A to serve home 901 A' s request.
  • another virtual node i.e., another one or more host signals, or portions thereof
  • selector 210 may dynamically associate home 901 A with one of digital channels 174 A, having an assumed capacity of 20 Mbps, so that the request may be fulfilled.
  • selector 210 may dynamically associate home 901 A with both of analog channels 172A and 172B (or with any other combination of analog channels 172 and/or digital channels 174) so that a portion of the data to be transmitted to home 901 A is embedded in, for example, the video signal present in analog channel 172A and another portion is embedded in the video signal present in analog channel 172B.
  • home 901 A is associated with virtual nodes 1050A and 1050B.
  • selector 210 may employ in assigning a user end to a virtual node (i.e., in selecting a host signal to be associated with that user end, or, as in the present example, with one of homes 901) is the anticipated and/or determined signal-to-noise ratio of user-end multiplexed signals 142 as received at that user end.
  • Signals 142 received at user ends that are closer to the head end of cable network 199 typically have higher signal-to-noise ratios than signals 142 received at user ends situated further away, even though all of these user ends may be in the same neighborhood, i.e., they may be served by what has been referred to above as a common cable. The reason is that there typically is less path loss over a shorter length of cable.
  • an IE embedder typically may embed more information in a signal having a high received signal-to- noise ratio than one having a lower received signal-to-noise ratio.
  • a higher rate of embedding data (hereafter, simply a higher "data rate”) may be employed to transmit embedded data to a user end that receives user-end multiplexed signals 142 with a high signal- to-noise ratio than to a user end that receives user-end multiplexed signals 142 with a low signal-to-noise ratio. Therefore, it may be advantageous for selector 210 to consider signal-to- noise ratio as a factor in assigning user ends to virtual nodes.
  • a "weak-link" affect may be avoided by assigning user ends to host signals based on similarity of signal-to-noise ratios of user-end multiplexed signals 142. For example, it is assumed that user-end multiplexed signals 142X are received at home 901 A with a high signal-to-noise ratio and that home 90 IB receives user-end multiplexed signals 142X with a low signal-to-noise ratio. If homes 901 A and 901B are both associated with the same virtual node, e.g., the same host signal, then the data rate for that virtual node is constrained by the lower signal-to-noise ratio applicable to home 901B.
  • data rate selector 225 and data rate analyzer 295 A For purposes of the operations of selector 210, it is sufficient to state that data regarding data rates of particular user ends (hereafter, "data-rate data") may be provided to selector 210 as components of data information 174 and/or they may be received over a return channel of cable network 199 as transmitted from the user ends (e.g., from data rate analyzer 295 A of illustrative IE demodulator 120A).
  • selector 210 may initially and/or dynamically associate any of homes 901 with any data signals in data channel 166.
  • selector 210 in "selecting" a host signal may thus, in some aspects, comprise the just-described operation of associating a user end with a television signal.
  • selector 210 may be said to have selected the video portion of the television signal in analog channel 172A to be the host signal in which data intended for home 901A is to be embedded by information embedder 220.
  • Other types of selection are also possible, however.
  • selector 210 may select a host signal for a particular user end based on sequential, random, or other assignment from among available television signals.
  • selector 210 may select a host signal based in part or in whole on a user selection.
  • selector 210 may select a host signal based at least in part on a predetermined assignment of a host signal to a user end.
  • selector 210 may select a host signal based on characteristics of that signal. For example, selector 210 may determine from a look-up table based on prior analysis, by realtime signal analysis, or in accordance with various other known techniques, that a particular audio, video, or data signal of television signals 162 is particularly well suited for embedding certain types of data or for embedding data at a particular rate. For example, a video signal having frequency components in a certain range, or having a certain combination of frequency components, may be particularly well suited for embedding data. This advantage may be due, for example, to characteristics of the human visual or auditory systems that enable data to be embedded at greater densities, or with greater robustness in the presence of noise, at certain frequencies or in the presence of certain frequency combinations.
  • host signals are provided to information embedder 220 and non-host signals are provided to broadcast format transfonner 240 based on the selection of host signals made by selector 210.
  • selector 210 may notify information embedder 220 of which one or more of the video, audio, and/or data portions of television signals 162 are to be the host signal for data to be transmitted to a particular user end. This notification may be accomplished in accordance with any of a variety of known techniques, such as by passing arguments in a subroutine or procedure call, changing variables in a data base, and so on.
  • television signals 162 are provided to IE modulator 110 in a source format and in a base band.
  • Alternative illustrative assumptions i.e., that television signals 162 are in a broadcast format and in a broadcast band, are described below in relation to the configuration of IE modulator 110 shown in Figure 3.
  • the term "broadcast format" is used herein to mean that television signals 162 are in a format now used for television broadcast systems, such as the NTSC, PAL, SECAM, PAL-M, PAL-N, or MESECAM formats, or in any future format that may be adopted for television broadcast systems.
  • RGB format such as may apply to the video portion of television signals provided by a video or television camera.
  • a television signal originating in a source fonnat typically is transformed to a broadcast format for broadcast to television receivers over any type of broadcast system including over-the-air, satellite, or cable system.
  • broadcast band as applied to television signals 162 means that those signals have been transformed from a "base band,” i.e. , not modulated with a carrier signal, to various carrier frequencies depending on the modulation of each television signal with a different carrier frequency.
  • Television signals 162 in a broadcast band thus typically are organized in a range of carrier frequencies such as the range of 50 MHz to 750 MHz shown with respect to conventional cable plant 169 of Figure IB. Because television signals 162 are assumed in this example to be in a base band and in a source format, the ones selected by selector 210 to be host signals are referred to as base-band source-formatted host signals 212. The ones of television signals 162 not so chosen are similarly referred to as baseband source-formatted non-host signals 216.
  • Information Embedder 220 embeds data signals 172 into base-band source-formatted host signals 212 as selected by selector 210.
  • Data signals 172 may include data in any form.
  • data signals 172 may include digital data, which may have been converted to digital form from analog data.
  • data signals 172 may include sampled data of an analog video signal.
  • data signals 172 need not be in digital form; e.g., they may include an analog signal.
  • data signals 172 may include telephony data 412 such as are carried in a public switched telephone network, represented in Figure 4A by telephone network 410.
  • data signals 172 may include Internet data 422 such as HTML documents; audio, picture, or video files; text, data, or program files; and so on.
  • FIG. 4C Yet another example is illustrated in Figure 4C, in which a user 435 causes user-request data 437 to be sent to television server 430, as may occur, for example, over return channel 161.
  • This request may be to view a television program, such as a movie or an archived episode of a television series.
  • a request of this type may be referred to as "video-on- demand," although it will be understood that the request may be to download audio as well as video data, or it may be to download other types of data.
  • user-request data 437 specifies that television server 430, employing known techniques, download to user 435 a television program represented by television data 432.
  • Television data 432 may be digital television data, or it may be analog television data and, in either case, is included in data signals 172 of the illustrated example.
  • information embedder 220 embeds one or more of data signals 172 into one or more of host signals 212 using any IE technique, or on any IE system, now known or that may be developed in the future.
  • Conventional IE techniques typically do not change either the band or formatting of the host signals.
  • the embedding function performed by information embedder 220 is indicated in the illustrated example as resulting in composite signals that are in a base band and in a source format, referred to as base-band source- formatted composite signals 222.
  • embedding a data signal into a host signal by IE techniques may be said to produce a composite signal that is a watermarked version of the host signal.
  • Data rate selector 225 selects data rates 227 for embedding data into host signals based on the presumed and/or determined signal-to-noise ratios over the cables of cable network 199. (See method step 803.) In addition, or in the alternative, selector 225 may select data rates 227 based on presumed or user-defined acceptable levels of distortion.
  • Data rate selector 225 provides data rates 227 to information embedder 220 so that it may embed data at the selected rates.
  • Embedder 220 adjusts the rate at which it embeds one or more of data signals 172 into one or more of host signals 212 in accordance with known IE techniques. For example, with respect to the QIM technique referred to above, embedder 220 may increase the number of "watermark signal components," i.e., components of data signals 172, that are embedded within a given number of host signal components. Examples of "components" of watermark and host signals are one or more bits of a binary number representing a value (such as gray-scale value) of a pixel in the watermark or host signal.
  • data rate selector 225 selects a data rate for each of data signals 172 that is to be transmitted to one of IE demodulators 120. That is, for example, a first of data signals 172 is illustratively assumed to be intended to be transmitted to IE demodulator 120A and a second to IE demodulator 120B. Data rate selector 225 thus selects a first data rate 227 (hereafter, data rate 227A) at which embedder 220 embeds the first of data signals 172 into a host signal selected by selector 210 to be associated with IE demodulator 120A.
  • Selector 225 selects a second data rate 227 (hereafter, data rate 227B) at which embedder 220 embeds the second of data signals 172 into a host signal selected by selector 210 to be associated with IE demodulator 120B.
  • data rates 227A and 227B may be based on presumed and/or determined signal-to-noise ratios. For example, these ratios may initially be presumed based on known characteristics of cable network 199 or other factors. For instance, as noted above, the signal- to-noise ratio generally decreases in proportion to the length of the cable from the head end of cable network 199 to the user end.
  • the approximate distance from the head end of cable network 199 to IE demodulator 120A typically is known, or may be determined by known techniques, and thus an initial estimate of the signal-to-noise ratio of user-end multiplexed signals 142X received at IE demodulator 120 A may be made in accordance with known techniques. This estimate may be an absolute one, or may be a relative one as compared to the length of cable serving other user ends, such as the user end at which IE demodulator 120B is located. A variety of factors other than length of cable, such as electromagnetic interference from sources external to cable network 199, may also contribute to the signal-to-noise ratio.
  • Known techniques may be employed to predict, detect, and/or measure these factors and alter the presumed signal-to-noise ratios accordingly.
  • these presumed signal-to-noise ratios may be stored by a user in a data base (not shown) and communicated to selector 225 as a portion of user information 174.
  • selector 225 may also take into account presumed or user-defined acceptable levels of distortion. For example, if these acceptable levels of distortion are high with respect to reception of user-end multiplexed signals 142X by IE demodulator 120A, then selector 225 may select a higher value for data rate 227A than might otherwise be selected. This relationship obtains because, in accordance with some IE techniques, greater reliability of data extraction may be realized, even at higher data rates, by introducing greater distortion due to the embedding process. Thus, acceptance of greater distortion may be traded off for increased data transmission in appropriate applications (such as, for example, where distortions are already present in television signals 162 or where a user or cable operator chooses to trade off distortion for increased data rates).
  • the initial and any subsequent values of data rate 227A are used by information extractor 290A of IE demodulator 120A in performing its information extraction function.
  • information extractor 290 A is provided with access to an initial rate 227 A- 1 at which data is embedded and to any new rate 227 A-2 thereafter selected by data rate selector 225.
  • Initial rate 227A-1 may be included in optional selection data 214A so that rate 227A-1 is available to information extractor 290 A, as described below with respect to the operations of composite signals selector and splitter 250 A.
  • a default value of initial rate 227 A- 1 may be predetermined and accessed in accordance with known techniques by both information embedder 220 and information extractor 290 A.
  • any other of a variety of known techniques may be used to establish initial rate 227 A- 1 and to communicate this information to IE demodulator 120 A.
  • infonnation about changes in data rate 227A may be included by information embedder 220 in the data that it embeds for transmission to IE demodulator 120A.
  • new rate 227 A-2 may be embedded by information embedder 220A into the host signal associated with IE demodulator 120.
  • information extractor 290A extracts extracted data signals 124 A corresponding to data signals 172, as described below, it also extracts the value of new data rate 227 A.
  • Information extractor 290 A may then apply new data rate 227 A to subsequent extractions, or it may optionally engage in any of a variety of known synchronization procedures, using for example a return channel of cable network 199, to confirm that the new rate has been received and to provide a reliable transition from one value of data rate 227 to another.
  • data rate analyzer 295 A may select a new data rate and communicate that selection to data rate selector 225 over cable network 199 as part of data-rate data 297 A.
  • Selector 225 may adjust data rates 227A based on information such as the signal-to- noise ratio measured or otherwise determined with respect to the communication channels. This information is represented by received data-rate data 298 A of Figure 2, corresponding to transmitted data-rate data 297 A.
  • transmitted data-rate data 297 A is transmitted from IE demodulator 120 A to the head end of cable network 199 over a return channel. Any of a variety of other known techniques may be employed in other implementations in order to communicate transmitted data-rate data 297A.
  • Transmitted data- rate data 297 A is determined by data rate analyzer 295 A of IE demodulator 120 A in accordance with operations described below.
  • Data rate selector 225 need not be implemented in other implementations.
  • the rate at which information embedder 220 embeds data may be a predetermined constant value.
  • advantages may be obtained by including selector 225 so that it may select data rates based on various factors such as the signal-to-noise ratio anticipated and/or experienced with respect to a particular communication channel.
  • the larger the signal-to-noise ratio the greater the rate at which data may be embedded by information embedder 220 without increasing the likelihood of error.
  • data rate analyzer 295 A may detect a decrease in channel noise components 152 as received in user-end multiplexed signals 142X and increase the value of transmitted data-rate data 297A accordingly.
  • data rate selector 225 may select a higher value for data rate 227A so that the amount of data transmitted to IE demodulator 120A is increased.
  • an increase in channel noise detected by data rate analyzer 295A may result in a lower value for data rate 227 A and a decrease in the amount of data transmitted to IE demodulator 120 A.
  • selector 210 may associate IE demodulator 120A to another virtual node, thereby avoiding the "weak-link" affect noted above.
  • Transformer 240 applies any known transformation technique, or one that may be developed in the future, to transform base-band source-formatted non-host signals 216 and base-band source-formatted composite signals 222 into a broadcast format. (See decision element 820 and method step 822.) For example, signals 216 and 222 may be transformed into the NTSC format. In the illustrated embodiment, transformer 240 provides the transformed signals, referred to as base-band broadcast-formatted non-host signals 217 and base-band broadcast-formatted composite signals 223, to multiplexer and broadcast- band transformer 230.
  • Transformer 230 applies any known transformation technique, or one that may be developed in the future, to transform base-band broadcast-formatted non-host signals 217 and base-band broadcast-formatted composite signals 223 into a broadcast band. (See decision element 824 and method step 826.) Also in accordance with known or future techniques, signals 217 and 223 are typically multiplexed. (See decision element 827 and method step 830.) The resulting multiplexed and transformed signals are referred to hereafter for convenience as "head-end multiplexed signals," such as represented in Figure 2 by head-end multiplexed signals for neighborhood X 112X (hereafter, simply head-end multiplexed signals 112X).
  • transformers 240 and 230 may be performed in various combinations or orders and/or may be represented as being performed by a single processor.
  • the multiplexing function of transformer 230 may be performed by an additional functional element, i.e., a multiplexer, that may, but need not, be included in IE modulator 110.
  • IE demodulator 120 A is an illustrative one of IE demodulators 120.
  • IE demodulator 120 A is coupled to a user end of cable network 199 to receive user-end multiplexed signals 142X, which correspond to head-end multiplexed signals 112X plus any channel noise components 152 that may have been introduced. (See method step 835.)
  • user-end multiplexed signals 142X which correspond to head-end multiplexed signals 112X plus any channel noise components 152 that may have been introduced.
  • IE demodulator 120A includes composite signals selector and splitter 250A that splits signals 142X into two paths, selects received broadcast-band composite signals 252 A from user-end multiplexed signals 142X, and separates signals 252A from signals 142X for further processing, all in accordance with known techniques.
  • Composite signals 252A correspond to those of host signals 212 that are associated by selector 210 with IE demodulator 120 A; that is, the host signals into which data intended for IE demodulator 120 A are embedded.
  • IE demodulator 120 A of the illustrated embodiment is broadcast- band to base-band transformer 270A that transforms received broadcast-band composite signals 252A to a base band, thereby generating base-band broadcast-formatted received composite signals 272A.
  • broadcast-format to source-format transformer 280A also is included in IE demodulator 120 A to transform base-band broadcast- formatted received composite signals 272A to a source format, thereby generating base-band source-formatted received composite signals 282A.
  • Information extractor 290A of IE demodulator 120 A employs IE techniques to extract extracted data signals 124 A from source- formatted received composite signals 282A.
  • Extracted data signals 124A correspond to one or more of data signals 172 that were intended to be transmitted to IE demodulator 120A (i.e., to the user end at which IE demodulator 120A is located).
  • Data rate analyzer 295 A of IE demodulator 120 A analyzes data signals extracted by information extractor 290 A in order to determine a rate for embedding data.
  • Yet another functional element that optionally may be included in IE demodulator 120A is television signal processor 285 A that may apply any of a number of known processes to prepare signals for use by a television receiver. In some implementations, any one or more of these processes may be performed by functional elements that are not included in IE demodulator 120 A. For example, they may be performed by television receiver 180A.
  • IE demodulator 120 A may, in alternative implementations, be performed in other orders, e.g., the operations of transformer 280A may be performed before those of transformer 270 A. Functions may be combined to be performed by fewer functional elements, or separated to be performed by additional functional elements. Also, the transformations of transformers 270A and/or 280A need not be performed in some implementations so that information extractor 290A operates on untransformed, or partially transformed, signals. The operations of the illustrative functional elements shown in Figure 2 are now described in greater detail.
  • Composite signals selector and splitter 250A selects received broadcast-band composite signals 252A from user-end multiplexed signals 142X. (See method step 840 and decision element 845.) That is, in the illustrated implementation, selector and splitter 250A identifies the particular one or more of host signals 212 associated with IE demodulator 120 A and thereby identifies the received broadcast-band composite signals 252A that correspond to those host signals. Selector and splitter 250A optionally separates signals 252A from others of user-end multiplexed signals 142X so that signals 252 A may be further processed by transformers 270A and 280 A and by information extractor 290A. Selector and splitter 250A performs these functions in accordance with any of a variety of known or future techniques for identifying signals and splitting or demultiplexing them.
  • the identification function may be performed in accordance with a variety of known techniques for synchronizing and maintaining information in a distributed data base or generally among nodes of a network.
  • each video and audio signal of television channels 168 and 164, as well as the one or more data signals in data channel 166 has a unique signal identifier.
  • Selector 210 selects host signals 212 in the manner described above. In particular, it is assumed for illustrative purposes that selector 210 associates IE demodulator 120 A with the video portion of the television signal in analog channel 172 A of Figure 1C.
  • IE demodulator 120 A (or, alternatively viewed, an associated user end, such as home 901 A for example) is associated with the signal identifier of that video signal.
  • the carrier frequencies of the video and audio portions of the television signal in analog channel 172 A are shown in Figure 1C where those video and audio signals are respectively provided the illustrative signal identifiers "NS1" and "AS1.”
  • the signal identifier VS1 therefore is associated with IE demodulator 120A.
  • This association may be maintained in a database or in accordance with other known or future techniques.
  • selection data 214 of the illustrated implementation include data that associates each user end with one or more host signals into which data to be transmitted to that user end is embedded.
  • data 214 includes information that associates IE demodulator 120 A with signal identifier VS1. This association indicates that data intended to be transmitted to IE demodulator 120A is embedded in the host signal identified by the signal identifier VS1.
  • data 214 may also include information about the rate at which data intended to be transmitted to IE demodulator 120A is embedded.
  • data 214 may be provided by selector 210 to information embedder 220 and/or optionally (as indicated by dotted data-flow line 214A) to cable network 199. More specifically with respect to the latter option, selector 210 provides data 214A to CMTS 130 of cable network 199.
  • CMTS 130 in accordance with known techniques such as handshaking techniques, transmits data 214A over cable network 199 to IE demodulators 120.
  • a handshaking procedure may be performed that informs selector and splitter 250A that, for example, the signal having the signal identifier VSl is the host signal for embedding data intended for IE demodulator 120 A.
  • Selector and splitter 250A may then employ any of a variety of known techniques to select received broadcast-band composite signals 252A from user-end multiplexed signals 142X.
  • the signal identifier VSl may be associated using hardware, firmware, software, or any combination thereof with a multiplexed signal having a particular carrier frequency.
  • this association may be predetermined so that, for instance, VSl refers to the video signal in the analog television channel referred to in Figure 1C as analog channel 172 A.
  • the arrangement of multiplexed signals in user-end multiplexed signals 142X is the same as the arrangement of multiplexed signals in head-end multiplexed signals 112X.
  • the signal identifier VSl indicates to selector and splitter 250A that composite signals 252 A in the present example includes the video signal in the channel of user-end multiplexed signals 142X corresponding to analog channel 172 A of head-end multiplexed signals 112X.
  • selector and splitter 250A may initially select composite signals 252A having embedded data intended for IE demodulator 120A.
  • a particular video, audio, or data signal of television signals 162, or any combination of one or more of them or portions thereof may be predetermined to be the host signal into which data is embedded for the user end at which IE demodulator 120 A is located.
  • IE demodulator 120 A is associated with the audio signal having the signal identifier AS1 and that signal AS1 is multiplexed so as to have a predetermined carrier frequency. This predetermined association may be established or changed in accordance with any of a variety of known or future techniques.
  • selector and splitter 250A may initially select composite signals 252A.
  • a particular video, audio, or data signal of television signals 162, or any combination of one or more of them or portions thereof, may be predetermined to be embedded with selection data 214.
  • information embedder 220 embeds selection data 214 into a predetermined one or more signals multiplexed into conventional data channel 166.
  • selector and splitter 250A selects and splits this predetermined signal so that it optionally is transformed by transformers 270 A and 280A (i.e., one or both transformations may not be performed in some embodiments) and is provided to information extractor 290A, as shown in Figure 2 and further described below.
  • extractor 290A extracts selection data 292A and provides this information to selector and splitter 250A.
  • Selection data 292A may indicate, for example, that IE demodulator 120 A is associated initially with the host signal identified by signal identifier VSl.
  • selector and splitter 250A selects received broadcast-band composite signals 252 A to be the one of user-end multiplexed signals 142X having a carrier frequency identified by the signal identifier VSl.
  • selector 210 may determine that the association of IE demodulator 120 A with one or more of host signals 212 should be changed. This change may be undertaken, for example, to change the virtual node with which IE demodulator 120 A is associated so that the amount of data provided to IE demodulator 120 A may be increased, or for other reasons such as those described above with respect to the operations of selector 210.
  • selector 210 modifies selection data 214 to indicate this change of host signals for IE demodulator 120 A. Selection data 214 is provided by selector 210 to information embedder 220.
  • Infonnation indicating the change of host signals for IE demodulator 120 A therefore is embedded in received broadcast-band composite signals 252 A and extracted by information extractor 290A as herein described.
  • Information extractor 290A provides this revised selection data 292A to selector and splitter 250A that therefore performs its selection and splitting functions, in accordance with known techniques such as demultiplexing techniques, to select a different received broadcast-band composite signals 252A.
  • this technique for changing host signals i.e., in some implementations, for changing virtual nodes
  • signals 252A consist of a received broadcast-band composite signal corresponding to host signal VSl.
  • Embedder 220 subsequently embeds into host signal VSl a portion of selection data 214 indicating that selector 210 has changed the association of host signals for IE demodulator 120 A so that host signal AS1 is the new host signal into which data intended for IE demodulator 120 A will be embedded.
  • selector and splitter 250A selects the initial signals 252A consisting of a received broadcast-band composite signal corresponding to host signal VSl and provides that composite signal for optional processing by transformers 270A and 280A and by extractor 290A. Extractor 290A extracts the information that the corresponding host signal has been changed from VSl to AS1 and, as indicated by selection data 292 A, informs selector and splitter 250 A of this change in accordance with known techniques.
  • selector and splitter 250A henceforth selects composite signals 252A consisting of a received broadcast- band composite signal corresponding to host signal AS1.
  • a handshaking procedure may be employed prior to implementing the change of host signals from VSl to AS1 so that IE demodulator 120 A confirms with selector 210 that the change of host signals has been accurately received.
  • selector and splitter 250 A may cause this confirming information to be transmitted via return channel 161 over the coupling between IE demodulator 120A and its user end of cable network 199.
  • a further change of host signal may be implemented by, for example, including the further change in the portion of selection data 214 embedded into host signal AS1. This process, with or without confirmation, may be repeated indefinitely.
  • Transformers 270A and 280A As noted with respect to the illustrated embodiment, broadcast-band to base-band transformer 270A transforms received broadcast-band composite signals 252A to a base band, thereby generating base-band broadcast-formatted received composite signals 272A. Broadcast-format to source-format transformer 280A receives baseband broadcast-formatted received composite signals 272A from transformer 270A and transforms them to a source format, thereby generating base-band source-formatted received composite signals 282A. Typically, the source format is the same source format in which base-band source-formatted host signals 212 were formatted. Any of a variety of known techniques, or ones to be developed in the future, may be employed by transformers 270A and 280A to perform these functions. (See corresponding decision element 847 and method step 850 of Figure 8.) As also noted, the functions of transformers 270A and 280A may be performed in a different order, combined, or otherwise implemented in accordance with known or future techniques.
  • Information Extractor 290A receives base-band source-formatted received composite signals 282A from transformer 280A.
  • extractor 290A may operate on signals provided by transformer 270A or selector and splitter 250A, that is, as noted, either or both of the functions of transformers 270A and 280A may be omitted.
  • Information extractor 290A employs any known or future IE technique to extract extracted data signals 124 A from, in the illustrated implementation, source-formatted received composite signals 282A.
  • Extracted data signals 124 A corresponding to those of data signals 172 that were intended to be transmitted to IE demodulator 120 A, are provided by extractor 290 A to data receiver 190 A and to data rate analyzer 295 A.
  • Figure 6C is a functional block diagram that shows some illustrative examples of couplings that may be made to various types of data receiver 190A.
  • IE demodulator 120 A may be coupled to two personal computers, PCI and PC2, that are shown as data receivers 190A-1 and 190A-2.
  • information extractor 290 A provides to data receivers 190A-1 and 190 A-2 extracted data signals 124A-1 and 124A-2, which may be data in any form such as text, image, video, audio, HTML, or application files.
  • telephony data 124A-3 that, as indicated by data receiver 190A-3, may be provided to a telephone receiver, answering machine, voice mail system, or other telephony device.
  • data receiver 190A-4 for receiving stereo audio data 124A-4.
  • Extracted data signals 124A may also be video and audio signals of one or more television signals. That is, one or more of television signals 162 may be embedded into one or more host signals. Data corresponding to those embedded television signals may be extracted by IE demodulator 120 A to yield extracted data signals 124A-5 corresponding to the embedded television signals. (Extracted data signals 124A-5 are shown as a dotted line in Figure 2 to indicate that none of television signals 162 need be embedded; i.e., there need not be any extracted data signals 124A-5.) Extracted data signals 124A-5 in some implementations may be provided directly to a television receiver.
  • extracted data signals 124A-5 may be additionally processed in any one, or combination, of a variety of known ways such as by demultiplexing, converting digital television data to an analog television signal, selecting and/or blocking television signals according to a user's subscription to the cable service, applying enhancement tecliniques to the video or audio portions, and so on. Any one or more of these functions are represented in Figure 2 by television signal processor 285A.
  • television signal processor 285A may be employed to similarly process any or all of user-end multiplexed signals 142X and provide the processed signals, represented in Figures 1 and 2 by television signals 122 A, to television receiver 180A.
  • user-end multiplexed signals 142X and television signals 122A may be the same signals; i.e., user-end multiplexed signals 142X may be provided directly to television receiver 180A.
  • television signals 122A correspond with television signals 162 and include both non-host signals and composite signals as received at the user end.
  • Figures 6A-6C apply to any implementation of IE demodulator 120 A, for example the implementation of Figure 3, as well as the implementation of Figure 2.
  • Figure 6A a generalized form of the process as just described with respect to IE demodulator 120 A of Figure 2 is shown.
  • selector and splitter 650A selects those of user-end multiplexed signals 142X that are received composite signals 652A. That is, selector and splitter 650A selects the multiplexed signals that have been embedded with data intended for use by IE demodulator 120 A.
  • Information extractor 670 A extracts data signals 124A from received composite signals 652 A and provides them to data receiver 190A.
  • Selector and splitter 650A also provides user-end multiplexed signals 142X to television signal processor 655 A that performs functions such as those noted above with respect to television signal processor 285 A.
  • Processor 655 A provides television signals 122A, corresponding with those of user-end multiplexed signals 142X that are composite signals and those that are not, to television receiver 180A.
  • all of television signals 122A may be extracted from composite signals and, optionally, further processed by television processor 675 A, which performs functions as noted above with respect to processors 655A and 285A.
  • television signal processor 685A (corresponding to processors 675 A, 655A, and 285A) may be external to IE demodulator 120A. Extracted data signals 124A-5 in this implementation are processed by processor 685A and then provided, as one or more of television signals 122 A, to television receiver 180 A. As noted, one or more of the functions of processor 685 A may also be performed instead by television receiver 180A in alternative implementations.
  • Data Rate Analyzer 295 A analyzes extracted data signals 124A in order to determine, or to provide information for data rate selector 225 to determine, a rate at which IE modulator 110 may embed data. (See method step 857.) Analyzer 295A transmits information to IE modulator 110 relating to the determined rate, as represented by transmitted data-rate data 297 A. This transmission may be accomplished over a return channel of cable network 199 or in accordance with other known techniques, or future ones. Any of a variety of conventional techniques may be employed so that analyzer 295 A may analyze extracted data signals 124 A.
  • information embedder 220 may embed a predetermined test signal in a host signal associated with IE demodulator 120 A at an initial, or default, data rate.
  • Analyzer 295A analyzes the test signal in accordance with any known error-detection and quantification technique to determine the error rate. If the error rate is lower than a nominal value based, for example, on the signal-to-noise ratio expected in view of the distance from the head end of cable network 199 to IE demodulator 120A, then analyzer 295A may indicate by transmitted data-rate data 297A that the data rate may be increased.
  • analyzer 295 A may indicate by transmitted data-rate data 297 A that the data rate may be decreased so that, for example, error-detection and/or error correction information may be added to the embedded data.
  • analyzer 295 A of the illustrated implementation continues to monitor error-detection information included with embedded data to determine when the rate of errors has increased.
  • Analyzer 295 A may apply any of a variety of criteria to determine when the data rate should be adjusted. For example, analyzer 295A may calculate an average error rate over any one or more time periods and implement an adjustment when the average rate increases above a threshold value.
  • Analyzer 295A may employ known data storage and computational devices and techniques to determine the error rate and adjusted data rate and provide the adjusted data rate information to data rate selector 225. Alternatively or in addition, and also in accordance with known devices and techniques, it may provide information regarding extracted data signals 124 A and/or the error rate of those signals to data rate selector 225 so that data rate selector 225 may determine whether, and to what value, the data rate should be adjusted. That is, determinations of error rate and data rate may be made either by data rate analyzer analyzer 295A, data rate selector 225, or both in various implementations.
  • the System of Figure 3 Generally, the functional elements of the system of Figure 3 perform the same functions, in the same manner, as those functional elements of Figure 2 having like reference numbers except for the left-most numeral (which is "2" for elements of Figure 2 and "3" for elements of Figure 3).
  • host signals selector and optional de-multiplexers 210 and 310 perform like functions in like manners; data rate analyzers 295 A and 395 A perform like functions in like manners, and so on.
  • the system of Figure 3 differs from that of Figure 2, however, in that it is assumed for illustrative purposes that television signals 162 as provided in Figure 3 are in a broadcast band and in a broadcast format.
  • Information embedder 320 may embed data into host signals 312 selected by selector 310 in the broadcast band. However, depending on the IE techniques being used and/or other factors, such as the availability of appropriate hardware and its costs, it may also be convenient that this embedding take place in a base band. Thus, information embedder 320 optionally includes a band converter and deconverter so that host signals in a broadcast band are selected and then converted to a base band, information is embedded in the base band, and the composite signal with embedded information is converted again to the broadcast band.
  • IE demodulator 120 A typically includes broadcast-band to base-band transformer 370A so that information extractor 390 A may extract information from received composite signals in the base band. That is, since information was embedded in the base band, it is typically convenient to extract it in the base band. However, it typically is not required that IE demodulator 120 A of Figure 3 also include a broadcast-format to source- format transformer, such as element 280A of Figure 2.
  • the System of Figure 7 Generally, the functional elements of the system of Figure 7 perform the same functions, in the same manner, as those functional elements of Figures 2 or 3 having like reference numbers except for the left-most numeral (which is "2" or “3" for elements of Figures 2 and 3, respectively, and "7" for elements of Figure 7). However, for purposes of clarity of illustration only, some optional elements shown in Figures 2 and 3 have been omitted from Figure 7. For example, elements corresponding to data rate selectors 225 and 325 and data rate analyzers 295A and 395A have been omitted from Figure 7. It will be understood that these optional elements may be included in the system of Figure 7 and perform functions similar to those shown in Figures 2 and/or 3.
  • backward compatible The system of Figure 7 is referred to as being "backward compatible.”
  • This term means that the signals provided to user ends in accordance with this system may be processed by an IE demodulator employing IE techniques such as IE demodulator 120A of Figures 2 or 3, by a conventional cable demodulator that does not employ IE techniques, or by a demodulator such as backward-compatible demodulators 704 (represented by demodulators 704A and 704N) that are capable of employing conventional demodulation and/or demodulation in accordance with IE techniques.
  • backward-compatible modem system 700 includes a backward- compatible modulator 702 at ahead end of cable network 199 and any number "N" of backward-compatible demodulators 704 at user ends of cable network 199.
  • some or all of the user ends of cable network 199 may be coupled to backward-compatible demodulators 704, to IE demodulators 120 described with respect to Figures 2 or 3, and/or to conventional cable demodulators.
  • Modulator 702 includes host signals selector 710 that selects and optionally de-multiplexes television signals 162 as described above with respect to the operations of selectors 210 and 310. Selector 710 provides selected host signals 712 to information embedder 720 for embedding and non-host signals 716 to multiplexer 730 for multiplexing.
  • Modulator 702 also includes information embedder 720 that employs IE techniques for embedding data signals 172 into host signals 712 to form composite signals 722, and performs further functions as described above with respect to information embedders 220 and/or 320.
  • information embedder 720 may also include an optional band converter and/or band deconverter as described with respect to the operations of information embedder 320.
  • Another element of modulator 702 is multiplexer 730 that performs functions such as those described with respect to multiplexer and transformer 230 and/or multiplexer 330.
  • multiplexer 730 multiplexes data signals 172 into a conventional data channel such as conventional data channel 166 of the cable plant of Figure lC.
  • modulator 702 provides backward compatibility with respect to demodulators that operate on data carried in a conventional data channel.
  • data signals 172 are also embedded into composite signals that also are multiplexed by multiplexer 730, the multiplexed signal may be utilized by demodulators employing IE techniques. That is, multiplexer 730 generates backward-compatible head-end multiplexed signals 732 that are transmitted by the head end of cable network 199 to various neighborhoods as described above with respect to the transmission of head-end multiplexed signals 112.
  • a cable “X” (not shown) carries backward-compatible head-end multiplexed signals 732X to a neighborhood "X" that includes a user end at which backward-compatible demodulator 704A is located
  • a cable “Y” (also not shown) carries backward-compatible head-end multiplexed signals 732Y to a neighborhood "Y” that includes a user end at which backward-compatible demodulator 704N is located.
  • Backward-compatible demodulator 704A receives backward-compatible user-end multiplexed signals 742X that correspond with backward-compatible head-end multiplexed signals 732X. Signals 742X are selected and split by composite signals selector and splitter 750A in a manner similar to that described above with respect to the operations of splitters 250A and 350A. Splitter 750A also provides signals 742X to conventional cable demodulator 755 A that operates in accordance with known techniques to provide appropriate signals to television receiver 180A and to data receiver 190A. In particular, in one implementation, demodulator 755 A demultiplexes the signals associated with conventional data channel 166 of signals 742X, thereby generating demultiplexed data signals 757 A that are provided to data receiver 190A.
  • Demodulator 755A provides other of signals 742X, such as those associated with analog television channels 172 and/or digital television channels 174, to television receiver 180A or, optionally, to TV signal processor 785 A that performs functions similar to those described above with respect to TV signal processors 285A and/or 385A.
  • splitter 750 A may split, or demultiplex, the data signals associated with conventional data channel 166 from signals 742X and provide them to data receiver 190A rather than to demodulator 755 A.
  • Splitter 750A selects and splits received composite signals 754A, corresponding to host signals 712, in a manner similar to that described above with respect to splitters 250A and 350A.
  • Signals 754A may be transformed as described with respect to transformers 270A, 280 A, or 370 A, as appropriate with respect to bands and formats as noted above.
  • information extractor 760A operates on transformed composite signals 772A provided by transformer 770A in order to extract data corresponding to those of data signals 172 intended for backward-compatible demodulator 704A.
  • Information extractor 760A provides the resulting extracted data signals 124A to data receiver 190 A.
  • selected data rates may be provided by a return channel of the cable network as contrasted with the illustrated implementation in which data rate data is provided that enables data rate selector 225 to make this selection.
  • the functions ascribed above to TV signal processors 285, 385, and/or 785 may be carried out in alternative implementations by TV receiver 180, by demodulator 755, and/or by splitters 250, 350, and/or 750.
  • functions performed by elements of the illustrated systems may be performed by external elements in alternative implementations.
  • conventional cable demodulator 755 may be external to backward-compatible demodulator 704 so that, for example, demodulator 755 is housed in a separate box or enclosure from demodulator 704.
  • host signal selectors 210, 310, and/or 710 may, as described above, associate host signals with user ends based on signal-to-noise ratio or other characteristics of the signals received by the user ends. Also, host signal selectors 210, 310, and/or 710 may associate host signals with user ends based on data-rate usage or other factors. In some implementations, a human and/or machine, not necessarily included in IE modulator 110, may make one or more of these and other selections attributed in the illustrated embodiments to selectors 210, 310, and/or 710.
  • data rate selectors 225 or 325 may be carried out in whole or in part by humans and/or machines and the selected data rates may then be communicated to elements of IE modulator 110 as described above with respect to the illustrated implementations of data rate selectors 225 or 325.

Abstract

L'invention concerne un système de modem câble à compatibilité descendante, qui permet à des usagers de recevoir des données par un réseau de télévision câblé, au moyen d'un extracteur de données qui extraie des données d'un signal de télévision, ou d'un démodulateur à câble classique. Le système comprend, sur le côté modulation (tête de ligne), un intégrateur de données qui intégre un premier ensemble de données en tant que signaux hôtes sélectionnés afin de produire des signaux composites. Les signaux composites sont des versions filigranées des signaux hôtes. Les signaux composites et un deuxième ensemble de données sont multiplexés ensemble, puis multiplexés avec des signaux de télévision non intégrés au premier ensemble de données (signaux non hôtes). Les signaux multiplexés sont ensuite transmis par le réseau câblé à l'usager. Du côté de l'usager, les signaux composites sont sélectionnés puis transmis à un extracteur de données, lequel extraie des signaux composites des données servant à reconstituer le premier ensemble de données intégré. De plus, le deuxième ensemble de données multiplexé avec les signaux composites et les signaux non hôtes, au niveau de la tête de ligne, sont démultiplexés du côté de l'usager au moyen d'un démodulateur à câble classique. Des transformateurs peuvent être inclus au niveau de la tête de ligne et/ou du côté de l'usager afin de convertir les signaux de télévision entre format source et format de radiodiffusion et/ou entre bande de base et bande de radiodiffusion. Le premier et le deuxième ensembles de données peuvent être constitués totalement ou partiellement des mêmes données.
PCT/US2001/040997 2000-07-14 2001-06-14 Systeme et procede de modulation-demodulation de donnees a compatibilite descendante mettant en oeuvre une integration de donnees dans des signaux de television WO2002007368A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU7358601A AU7358601A (en) 2000-07-14 2001-06-14 System and method for backward-compatible modulation and demodulation of data using information embedding in television signals

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US61629900A 2000-07-14 2000-07-14
US09/616,299 2000-07-14

Publications (2)

Publication Number Publication Date
WO2002007368A2 true WO2002007368A2 (fr) 2002-01-24
WO2002007368A3 WO2002007368A3 (fr) 2002-07-04

Family

ID=24468848

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/040997 WO2002007368A2 (fr) 2000-07-14 2001-06-14 Systeme et procede de modulation-demodulation de donnees a compatibilite descendante mettant en oeuvre une integration de donnees dans des signaux de television

Country Status (2)

Country Link
AU (1) AU7358601A (fr)
WO (1) WO2002007368A2 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9929887B1 (en) 2016-09-28 2018-03-27 The Mitre Corporation Backward-compatible signal variations for data augmentation

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5793892A (en) * 1995-06-27 1998-08-11 Motorola, Inc. Method and system for compressing a pixel map signal using dynamic quantization
US5930369A (en) * 1995-09-28 1999-07-27 Nec Research Institute, Inc. Secure spread spectrum watermarking for multimedia data
US5960081A (en) * 1997-06-05 1999-09-28 Cray Research, Inc. Embedding a digital signature in a video sequence
US5991426A (en) * 1998-12-18 1999-11-23 Signafy, Inc. Field-based watermark insertion and detection

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5793892A (en) * 1995-06-27 1998-08-11 Motorola, Inc. Method and system for compressing a pixel map signal using dynamic quantization
US5930369A (en) * 1995-09-28 1999-07-27 Nec Research Institute, Inc. Secure spread spectrum watermarking for multimedia data
US5960081A (en) * 1997-06-05 1999-09-28 Cray Research, Inc. Embedding a digital signature in a video sequence
US5991426A (en) * 1998-12-18 1999-11-23 Signafy, Inc. Field-based watermark insertion and detection

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9929887B1 (en) 2016-09-28 2018-03-27 The Mitre Corporation Backward-compatible signal variations for data augmentation
US10313166B2 (en) 2016-09-28 2019-06-04 The Mitre Corporation Backward-compatible signal variations for data augmentation

Also Published As

Publication number Publication date
AU7358601A (en) 2002-01-30
WO2002007368A3 (fr) 2002-07-04

Similar Documents

Publication Publication Date Title
US11102532B2 (en) High definition television signal compatibility verification
US6622304B1 (en) Interface system for computing apparatus and communications stations
CA2221099C (fr) Systeme asymetrique de communication de donnees
US5812665A (en) Switched channel system
EP1550306B1 (fr) Systeme de television par cable et procede de mise a jour de la largeur de bande compatible au moyen de canaux numeriques encastres
US7667775B2 (en) Digital cable TV receiver, diagnostic method for the digital cable TV receiver, and data structure of DVI status report
EP1377054A1 (fr) Information de découverte pour IP multdiffusion
KR100689507B1 (ko) 픽쳐 인 픽쳐 기능을 수행하는 멀티미디어 신호 정합시스템 및 방법
AU2005306877A1 (en) Communicating content streams to a remote unit
KR101193534B1 (ko) 비디오 콘텐츠에 워터마크를 삽입하는 워터마킹 장치 및 방법
WO2002007425A2 (fr) Systeme et procede de modulation et demodulation de donnees a debit variable a l'aide d'informations incorporees a des signaux de television
WO2002007442A1 (fr) Systeme et procede de distribution de noeuds virtuels de donnees integrees dans des signaux de television
US20030033611A1 (en) Embedded information modulation and demodulation using spectrum control orthogonal filter banks
WO2002007368A2 (fr) Systeme et procede de modulation-demodulation de donnees a compatibilite descendante mettant en oeuvre une integration de donnees dans des signaux de television
KR101419818B1 (ko) 복수 채널의 실시간 시청이 가능한 ｉｐｔｖ 케이블 모뎀 구동시스템 및 구동방법
US20080186400A1 (en) Apparatus and method for converting multimedia content, and multimedia content distribution system
KR20080049947A (ko) 방송 시스템, 인터페이스 방법, 및 데이터 구조
KR20070113002A (ko) 방송 시스템, 채널 정보 처리 방법, 및 데이터 구조
CA2569723C (fr) Systeme asymetrique de communication de donnees permettant une interaction d'abonne
JP2005151582A (ja) 放送信号処理装置及びその方法
KR20070113001A (ko) 방송 시스템, 채널 정보 처리 방법, 및 데이터 구조
KR20010002202A (ko) 디지털 텔레비젼의 부가 데이터 표시장치
MXPA97003915A (es) Sistema de television multicanal con video y audio seleccionables por el televidente
Netravali et al. High Definition Television

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 69(1) EPC, F1205A DATED 07.05.03

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase in:

Ref country code: JP