EP1025695A1 - Method for embedding links to a networked resource in a transmission medium - Google Patents

Abstract

A method for providing a link between an information signal (98, 100) (such as a broadcast and cable television and/or radio signals) and networked resources (such as the Internet) comprising the steps of embedding access information in a transmission medium, the access information adapted to provide access to content of the networked resource relevant to content of the information signal, transmitting the information signal and the access information (98, 100), receiving the information signal and the access information at a user terminal, extracting the access information from the transmission medium, utilizing the access information to access the networked resource with an access signal (102, 104), and displaying content of the networked resource on the user terminal corresponding to the access information. Embodiments are provided wherein the information signal (98, 100) is provided by the networked resource provider or a distinct audio/video signal content provider (94) via wired (98) and wireless (100) means.

Description

METHOD FOR EMBEDDING LINKS TO A NETWORKED RESOURCE IN A

TRANSMISSION MEDIUM

CROSS-REFERENCE TO RELATED APPLICATIONS This patent application claims priority of co- pending United States Provisional Application serial no. 60/046,038, which was filed on May 9, 1997 and is hereby incorporated by reference.

TECHNICAL FIELD

This invention relates to a method for providing access to networked resources, and in particular to linking the information content of an audio/video information signal to networked resources via under-utilized resources of A transmission medium.

BACKGROUND ART

Networked data sources, such as those found on the Internet, are a rich and important means of information retrieval and distribution and, increasingly, electronic commerce. However, there are problems finding the information desired m this increasingly complex and changing network of data sources. Recently introduced Internet "search engines" , such as Yahoo on the World-Wide Web (WWW) , help by allowing a user to search networked indices of information sources, and even full source text, for relevant key words and phrases related to their topic of interest, but even carefully structured queries by experienced users often results m hundreds and even thousands of possible "hits" which are not sufficiently specific to preclude further manual search which is both data resource inefficient and time consuming. Because of these inefficiencies, as well as general lack of familiarity with search engines and their syntax, users sometimes rely on broadcast media to identify source addresses (e.g., Uniform Resource Locators ("URLs")) for web sites and other online information of interest.

However, URL's, are particularly difficult to manually enter m software programs, such as "web browsers", due to their length and use of complex and unfamiliar symbols. If the characters m an address are not entered exactly, retrieval is prevented or, m a limited number of cases, a legal but incorrect source is accessed. This is especially true when URLs incorporate foreign languages and/or complex query instructions to networked databases, as is increasingly frequent in most web sites. In addition, the inability to type or otherwise manually enter symbolic address information due to either disability or lack of training complicates use of networked information resources such as the Internet for millions of individuals.

It is widely anticipated that Internet access will increasingly be provided through interactive cable television via web-ready television receivers and set-top boxes used m conjunction with conventional television receivers. The so-called web—ready television is a television that can receive and display conventional broadcast television signals, which has means for allowing a user to access the WWW by providing a modem and appropriately programmed microprocessor based control circuitry. A software module such as a web browser is used to allow the user to dial-up an Internet service provider (ISP) and request files from host servers on the Internet. The downloaded Web pages may be displayed via the browser on a portion of the TV screen (i.e. via picture-m-picture (PIP)) . Thus, the user can both watch TV and "surf the Web", as independent functions, with one piece of equipment. A set-top converter is used m con unction with a conventional TV to accomplish the same effect; for example, SONY markets such a device as a "WebTV" product.

In this home entertainment environment, it is difficult to use keyboards for URL address entry m the Web browser due to both lack of typing skill and the cumbersome placement of these components. Therefore, a method which would eliminate typing and allow users to directly link broadcast media options to electronic information sources by choosing amongst a number of relevant URL's provided by the broadcaster would be highly desirable.

A problem arises during the broadcast of URL's or other links to networked resources within standard broadcast media m that the duration of time m which the link can be displayed is limited to typically 5-10 seconds. Such a short duration does not provide enough time for the viewing audience to copy anything other than the name of the server. This forces advertisers and other content providers to either direct viewers to generic home pages, or to create additional domain names for specific products, which becomes both expensive and time consuming due to the necessity and procedures associated with registration of domain names.

Therefore, it would be advantageous if links to networked resources such as URL's could be displayed to viewers for a sufficient amount of t me to enable them to either copy the entire link or access the link via automatic or selective means. Applications for a direct and efficient link between broadcast media and networked resources are potentially limitless with the following representing only a small sample:

1. sporting events with simultaneous access to networked player statistics, commercial sale of team related goods, books, video recordings of the game, and advance ticket sales;

2. travel shows with simultaneous access to networked details regarding the region discussed, commercial sale of travel arrangements, maps, books, guides, suitable clothing, and luggage;

3. educational shows with simultaneous access to networked primary, high school, and college equivalency courses, tutoring m particular subjects, commercial purchase of books, compact discs, examinations taken networked with real-time results, which is of particular applicability to the handicapped, temporarily injured, gifted or those with special needs;

4. prime time viewing w th simultaneous access to networked schedules of guest appearances of actors and actresses, commercial purchase of books and tapes written by or about the program or players;

5. telethons and publicly supported channels with simultaneous option to make charitable contributions via secure electronic currency; 6. soap operas with simultaneous access to networked prior episodes m summary or detail, background of characters and actors playing each character, contact information regarding fan clubs;

7. game shows with simultaneous option to participate m a networked version of the same game being conducted m parallel with broadcast version;

8. nature shows with simultaneous option to contribute to wildlife/restoration funds using secure electronic currency, and information regarding conservation of and travel to the regions being filmed;

9. movies with the simultaneous ability to purchase relevant books and videos, participate m trivia quizzes, access information regarding special appearances of actors and fan clubs;

10. talk shows with simultaneous ability to reply to and participate m discussions with the audience;

In addition schedule information, and less expensive commercials, which would otherwise occupy costly broadcast time could be relocated to networked resources. Therefore, there is a need for an efficient link between audio and video based media and networked resources which is user friendly to the majority of television users m order to satisfy both commercial and informational enterprises.

Information comprising audio and/or video content such as that found m radio broadcasts, television broadcasts, audio and video tapes, audio/video and interactive compact discs (CD's), and audio and video signals transceived via cable and satellite are often closely related to a wide variety of networked resources. Multiplexed audio such as multiple language simulcasting (MTS) provides yet another means by which a provider may gain valuable information about potential users with which the provider can then tailor those choices of networked resources made available to the user. Such a relationship may be in the form of commercial sales of relevant merchandise, additional sources of complementary information, and a host of networked resources designed to interest a potential listener to the particular audio content .

Therefore, there is a distinct need for a link between media comprising audio content information and pertinent networked resources.

One of the problems faced by providers of networked resources is that they receive little if any feedback from those that access their site. Information which would be useful to a provider includes both demographic data regarding the user as well as viewing and listening data which details the programs watched or listened to, and the time, date and duration (i.e., temporal information) for which this is done.

Therefore, it would be advantageous to provide a means whereby the networked provider could access feedback information comprising user demographics and viewing and listening data either in real-time or subsequent to the broadcast directly or through an intermediary (e.g. clearing house) . It would also be extremely advantageous if such information could be cross-correlated to achieve "Nielsen Ratings" type information.

International Application No. WO 97/38529, submitted under the Patent Cooperation Treaty and hereby incorporated by reference, discloses an interactive system and method for accessing an information source such as the Internet through an existing cable television distribution system and headend distribution equipment m conjunction with a plurality of televisions with settop converters. The user inputs an upstream command intended for the information source via a remote control unit or keyboard. The information source responds by providing display information to the headend distribution equipment, which is then inserted into blank intervals such as the vertical or horizontal blanking intervals of the television transmission on a downstream channel by the headend distribution equipment. The display information represents sequential picture data, which is extracted by the settop converter and displayed to the user on the television. Thus, this reference discloses a relatively complex method of two-way communication between a user and an information source, which provides the user with access to such services as the Internet. However, this method requires that the protocol used to transmit user commands upstream and display information downstream include addressing information that identifies the specific user issuing the command and receiving the display information. In addition, since the sole connection to the information source is via the headend distribution equipment, complete display information must be transmitted back to the user which is generally continuous and rather lengthy. Therefore, it would be advantageous to provide a simple and efficient means of linking audio/video information with relevant content from an information source such as that found on the Internet without requiring the inclusion of addressing information which identifies the particular user requesting access to the information source. In addition, it would be advantageous if access information enabling the user to link to the information source would not be required to include complete display information which induce delays m the response time perceived by the user to his requests for access. In addition, it would be advantageous if such a system could be adapted for use in broadcast television and/or radio.

Another system very similar to that disclosed m the '38529 application is described on the Internet (htt : //connectedpc . co /1awweb/Intercast /whatis/infoOl .htm) and called Intercast^""'1 Technology. However, this system uses a personal computer with a video capture card which enables the personal computer to receive and display cable television signals. Web pages which may contain hyperlinks to additional web pages are embedded within the vertical blanking interval of the cable television signal. The personal computer displays a composite picture including the cable television signal, the web page, a list of downloaded web pages, a television channel selection area and a web page selection area. While a particular television channel is displayed the user can select one of a number of related web pages for display m the web page area of the screen as well as selecting another television channel and corresponding related web pages. Unlike the system disclosed m the '38529 patent, this technology requires that the user have a separate connection to the Internet. However, like the '38539 patent this technology discloses the transmission of complete web pages for display to the user, which adds a significant amount of information to be transmitted within the limited resources of the vertical blanking interval .

Therefore, it would be advantageous if a system could provide access to networked resources to the user by only sending a minimal amount of information to link the user to the networked resource.

DISCLOSURE OF THE INVENTION

In accordance with the present invention, a method for providing a link between an information signal and networked resources is provided comprising the steps of embedding access information m a transmission medium, the access information adapted to provide access to content of a networked resource relevant to content of the information signal, transmitting the information signal and the access information, receiving the information signal and the access information at a user terminal, extracting the access information from the transmission medium, utilizing the access information to access the networked resource with an access signal, and displaying content of the networked resource on the user terminal corresponding to the access information. The step of embedding the access information may further comprise the step of embedding the access information within a vertical or horizontal blanking interval of the information signal, bandwidth not used by the information signal, a sideband of the information signal, a header of an internet message packet and/or a subcarπer m the transmission medium. In further accordance with the present invention, the step of embedding the access information may further comprise the step of overlaying the access information with the information signal, the step of transmitting may further comprise the step of transmitting the information signal and access information using spread spectrum transmission techniques, and the step of receiving may further comprise the step of receiving the information signal and access information using spread spectrum reception techniques. The step of embedding the access information may further comprise the steps of embedding the access information within a channel comprising access information corresponding to a plurality of information signals, and extracting access information from the channel corresponding to the information signal currently being received. The access information may be synchronized to a predetermined portion of the information signal.

In still further accordance with the present invention, the information signal may comprise audio and/or video content. The step of displaying the content of the networked resource may further comprise the step of displaying the transmitted networked resource m a picture in a picture (PIP) on the user terminal, and/or the step of displaying indicia indicating availability of the link to the content of the networked resource and displaying the transmitted networked resource to the user m response to selection of the indicia.

In accordance with the present invention, the method for providing a link between an information signal and networked resources may further comprise the steps of compressing the access information prior to embedding the access information m the transmission medium, decompressing the access information by the user terminal, encoding the access information prior to embedding the access information m the transmission medium, decoding the access information by the user terminal, embedding the user information into the access signal, compressing the user information prior to embedding the access information into the access signal, encrypting the user information prior to embedding the access information into the access signal, embedding access information to additional networked resources m the content of the networked resource, encoding the access information to additional networked resources prior to embedding the access information to additional networked resources m the content of the networked resource, and compressing the access information to additional networked resources prior to embedding the access information to additional networked resources m the content of the networked resource.

In further accordance with the present invention, the method for providing a link between an information signal and networked resources may further comprise the steps of assigning an index corresponding to each of a plurality of networked resources, selecting one of the indices corresponding to the plurality of networked resources, utilizing the index to determine which of the plurality of networked resources to access, and providing a summarized content for the index, the summarized content representative of the content of the corresponding networked resource .

In still further accordance with the present invention, the step of embedding the access information may further comprise the step of embedding a link to the networked resource m the transmission medium, or embedding a URL m the transmission medium, and recording the user information and optional temporal information by the networked resource. The step of displaying content may further comprise the step of automatically displaying the content without user intervention, or selectively displaying the content m response to user intervention.

In accordance with the present invention, the user terminal may be a portable personal computer, personal computer or television, adapted for reception of television signals and/or radio signals, access to the Internet and wireless access to the networked resources. The transmission medium may be free space, a wire, or the Internet. The step of embedding access information may further comprise the step of utilizing user information to determine access to content of the networked resource. The step of utilizing the access information may further comprise the step of transmitting user information to the networked resource.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other objects and features of the invention shall now be described m relation to the drawings.

Fig. 1 illustrates one embodiment of an apparatus providing user access to embedded links within an audio/video signal to networked resources of the present invention. Fig.2 is a flowchart illustrating a method for providing an automatic link between the audio/video signal and networked resources of the present invention.

Fig.3 is a flowchart illustrating a method for providing a plurality of selectable links between the audio/video signal and a plurality of networked resources of the present invention.

Fig. 4 illustrates a relational flowchart illustrating the tasks to be performed by an audio/video signal provider, the networked resource provider and the user .

Fig. 5 illustrates the concept of interlaced scanning of the prior art .

Fig. 6 illustrates an apparatus for providing both automatic and user selectable links between the audio/video signal and networked resources of the present invention.

Fig. 6A illustrates the spectral components of an NTSC signal of the prior art.

Fig. 7 illustrates a top level block diagram of a first embodiment of the apparatus for providing both automatic and user selectable links between the audio/video signal and networked resources of the present invention wherein the audio video signal is made available to the user by an entity separate from the networked resource provider.

Fig. 8 illustrates a top level block diagram of a second embodiment of the apparatus for providing both automatic and user selectable links between the audio/video signal and networked resources of the present invention wherein the audio video signal is made available to the user by the networked resource provider.

BEST MODE FOR CARRYING OUT THE INVENTION

Fig.l illustrates one embodiment of an apparatus 10 which is adapted to provide access to embedded links between audio/video signals such as broadcast and cable television and radio signals and networked resources such as the Internet, local databases, remote databases, and other depositaries of information well known in the art. In the example illustrated, a baseball game is displayed in a primary viewing area 12 of a web-ready television 14. The web-ready television 14 could equivalently be a standard television receiver, cable decoder box, web television transceiver (which comprises a set top plug- in card incorporating television receiver components and Internet access functionality), VCR's or a digital disk (e.g. DVDI) while still being within the scope of the present invention.

A user (not shown) is given a choice of networked resources 16 relevant to the baseball game superimposed on the primary viewing area 12 (e.g., such as statistics of the current player, team schedule, and options to purchase team related products) in the lower left corner. The user may access any of the networked or on-line resources 16 by depressing one of a set of buttons on a remote control unit 18 corresponding to an indexing scheme which references the on-screen selection of networked resources 16. In the example illustrated in Fig. 1, a dedicated button (i.e., 1, 2, 3) is provided for each of the networked resources 16 while in practice this could be accomplished by depression of the same button m rapid succession or other means well known to those skilled m the art . Depression of the button or buttons on the remote control unit 18 initiates a transmission of an infrared signal from the remote control unit 18 to the web-ready television 14 by means well known m the art. Upon receipt and decoding of the infrared signal a web browser within the web-ready television 14 will use decoded information to gam access to a specific site or sites on the networked resource or Internet . Access to the networked resources 16 is then be displayed a picture in a picture (PIP) 20, an auxiliary display or equivalent means by methods well known m the art.

Access to the networked resources 16 could also be provided via a logo or other indicia, for instance, overlayed m the corner of the television screen. The logo could read "Active Content Available" or an equivalent phrase indicating that the link was available for accessing the networked resource without displaying the actual content. The content of the networked resource could then be displayed m response to selection of the logo by the viewer either m a PIP or full-screen mode. If a similar logo were provided m the display of the networked resource m full-screen mode then the viewer could toggle between displaying the networked resource and displaying the audio/video signal .

As the content of the audio/video signal changes so might the choice of networked resources 16 offered to the user order to maintain synchronization and relevancy between the networked resources provided to the user and the information content of the audio/video signal . The synchronized choice of networked resources could be adapted for dialogue between the information content of the audio/video signal and the selection indicia for a particular networked resource. For example, the user could be given the choice of purchasing the same dress worn by an actress simultaneously appearing on the television screen, or a list of current appearances for a singer simultaneously performing on a radio station.

Similarly, Fig. 2 illustrates a method of the present invention which provides an automatic link between the audio/video signal and networked or on-line resources. A decision is made by the audio/video signal provider as to which networked resources are to be linked to a particular signal and the synchronization and duration of each choice. For example, the producer of a television show may have knowledge of a plurality of Web sites relevant to the content of the program which he may synchronize to particular segments of the audio/video signal. Access information (typically a URL) pertinent to the chosen networked resources is chosen by the provider and optionally encoded 32 prior to being embedded 34 within the audio/video signal. In the audio/video signal provider may use information such as user demographics, viewing and listening data, and data which has been analyzed off-line order to determine the suitability of networked resources to be offered to the user. Such data may be obtained from the user or third party sources (e.g., clearing houses) via both m-band and out-band 32A techniques (e.g., via cable, modem, satellite, sideband RF, paging channels, etc.) . A particularly useful application of this information would be in obtaining "Neilson Rating" type information which monitors the programs watched and listened to by a large cross-section of users whose demographic information is known and available for cross-correlation. This information could then be used by potential advertisers m determining market shares, efficacy of particular timeslots, and realtime response to a multitude of programming and advertising content .

Compression of the encoded information 33 may be advisable due to the quantity of useful data which can be appended to the networked resource access information and the limits imposed by the method used to insert this information into the transmission medium. A method of compression described a co-pending United States Provisional Patent Application Serial Nos. 60/037,988 and 09/023,918 which are hereby incorporated by reference, may be utilized the present invention. Briefly, the method encodes a network address of the target server computer and a target file index pointer as opposed to a more lengthy URL address m providing access information which points to specific networked resources. Alternative methods of compression could be used which are well known the art.

The optionally compressed information is embedded 34 during a horizontal and/or vertical blanking interval of the audio/video signal (such as a broadcast or cable television or radio signal) since it is here that there exists a residue of unused resources or bandwidth. U.S. Pat. No. 5,497,187 discloses such a method for insertion of information the vertical blanking interval of television signals, which is hereby incorporated by reference. Such information could also be encoded m sidebands, subcarπers or alternative means that utilize unused resources for transferring additional information audio and/or video signals well known to those skilled the art. U.S. Pat. Nos. 5,621,471 and 5,657,088 disclose methods of embedding and recovering additional information within a video signal, which are hereby incorporated by reference.

The resulting audio/video signal is then transmitted 36 by the provider and received 38 by the user using means well known the art. Access information is then extracted or separated 40 from the received audio/video signal and decoded 42 and decompressed, if necessary, via means substantially complementary to those used to encode 32 and compress 33 the information. A request for the particular networked resource corresponding to the access information is then transmitted 42A (such as by modem, ISDN link, wireless, TI or other equivalent means well known in the art) to the networked resource provider. The networked resource provider receives the access information 42D and transmits 44 the desired networked resource to the user. The networked resource can optionally record the user demographics, index, viewing/listening data as well as temporal information such as the data and time for future use, resale and/or analysis. The networked resource is then automatically received and displayed 46 by the user's hardware and software without user intervention or input. Optionally, user demographic information and viewing and listening data may be encrypted 42B by the user, and optionally compressed 42C prior to transmission 42A of both the request for the particular networked resource and the appended user demographic information and viewing and listening data.

Following receipt 42D of the networked resource access information and optional user demographics and viewing/listening data, the provider may encode 42E additional networked resource access information utilizing user demographics, and viewing/listening data, compress 42F the encoded information, and embed 42G the compressed information 42G onto the signal providing the user with the designated networked resource. In this way, nesting of accesses to networked resources may be accomplished via under-utilized resources of the transmission medium guided both by the user's prior choice of networked resources as well as user demographics and viewing/listening data. The desired networked resource is transmitted 44 to the user who then receives and displays 46 the networked resource. The user may receive access to the networked resources via a number of techniques including conventional modem, cable modem, satellite, sideband RF, and paging channels.

A modification of the above method is provided Fig. 3 which illustrates a method of the present invention that provides a user selectable link between an audio/video signal and a plurality of networked resources 30A wherein the user is provided a choice of different networked resources to access as shown Figure 1. This differs from the automatic system of Figure 2 m that the networked resource is not automatically accessed. A decision is made by the audio/video signal provider as to which of the plurality of networked resources will be made available to the user during a specified duration of the audio/video signal using optional additional sources of information such as user demographics, viewing/listening data and data which has been analyzed off-line and obtained via m-band or out- band techniques 32AA. The access information pertinent to the plurality of networked resources chosen is then encoded 32A prior to being embedded 34A withm the audio/video signal. Just as the embodiment illustrated m Fig. 2, this information may be embedded 34A during a horizontal and/or blanking interval of the audio/video signal, within the sidebands or subcarπers of the signal or alternative methods utilizing unused resources for the transfer of additional information m audio and/or video signals well known m the art. The resulting signal is processed using substantially the same steps as the automatic method illustrated m Fig.2, which the exception that following decoding 42AA of the access information, descriptive information or summarized contents of each choice of networked resources available is provided to the user 42AB with indicia corresponding to each choice of networked resource. The user selects 42AC a particular index and transmits 42AD that index. The index is received 42AE and the corresponding networked resource is transmitted 44A using the decoded access information previously extracted from the audio/video signal . The networked resource can optionally record the user demographics, index, viewing/listening data as well as temporal information such as the data and time for future use, resale and/or analysis. The networked resource is then displayed 46A to the user. Alternatively, following selection of the index 42AC the user's hardware and/or software may encrypt 42AF the index along with user demographics and viewing/listening data and optionally compress 42AG the encrypted mfromation m order to enable the provider to gam access to further information useful m determining potential additional choices of networked resources to offer the user. The additional choices of networked resources may optionally be encoded 42AH, compressed 42AI and embedded 42AJ onto the audio/video signal comprising access to the networked resource originally chosen by the user prior to being transmitted 44A by the provider and displayed 46A to the user. The steps illustrated m the method of Fig. 3 are listed under the corresponding entity that performs them m Fig. 4. Optional steps are included m Fig. 4 m the order most likely performed, however, this is not intended as a limitation that the steps may be performed in a number of different sequences withm the scope of the present invention.

The following represents a summary of color television technology provided m order to enhance understanding of the block diagram of an apparatus that performs the present invention which follows. While the following summary primarily describes the functionality of television reception with respect to National Television

Systems Committee (NTSC) standards, the present invention is also intended to be applicable to alternative standards comprising Sequential Color with AVEC Memory (SECAM) , Phase Alternation each Line (PAL) and the various forms of High Definition Television (HDTV) as well. Each of the aforementioned standards are described m detail m K. Benson, The Television Engineering Handbook chapters 21, 23- 24 (1992), which is hereby incorporated by reference.

Electronic transmission and reception of visual images m the form of video signals is, like motion pictures, based upon the phenomenon that a series of successive images is seen as a continuous picture due to the persistence of human vision. Through the use of interlaced scanning 30 images can be broadcast per second without providing noticeable flicker. A television transmitter samples segments of the image for brightness with respect to three colors (red, green and blue) and transmits the sampled information sequence. The image is scanned by an electron beam just as an Optical Character Recognition (OCR) reader scans a page of printed type- -character by character and line by line. This results the flow of an electric current with an instantaneous magnitude proportional to the brightness of the segment scanned. A television receiver reproduces each segment of the image transmitted from the broadcast video with its proper position, brightness and color. An electron beam the picture tube of the receiver is modulated m intensity by the incoming video signal as the beam scans the picture tube synchronism with the scanner of the transmitter. The light is emitted from the photoelectric surface of the picture tube on the viewable side of the picture tube m proportion to the intensity of the electron beam which strikes it. Therefore, the original image scanned is reproduced having its original position, brightness and color.

An image is transduced by scanning it according to a fine structure of parallel nearly horizontal lines called scanning rasters . The complete raster is rectangular m shape. Scanning may be done conventionally by starting at the upper left-hand corner along the first line and moving toward the right at constant speed. At the end of the first line a quick return s made to the left-hand side to start the scanning of the second line, again moving towards the right. When all lines have been scanned m this way, from top to bottom, the process is repeated by returning quickly to the upper left-hand corner where the first line is located. If all the lines are scanned m the sequence described above, the process is called sequential scanning. In accordance with standards in the United States (NTSC) , each frame comprises 525 scan or raster lines which in turn comprise several hundred picture elements. Each line is scanned and transmitted to the receiver which enables 30 frames to be received per second. At the end of each line the pickup tube output of the transmitter is blanked during which time the scanning beam is redirected to the next line. This time is commonly referred to as horizontal blanking and is used to transmit synchronizing signals which synchronize the scanning process at the receiver to that of the transmitter. Similarly, after completion of the last line of the frame the picture is blanked during that time the electron beam is retraced to the first line of the image, typically referred to as vertical blanking. If the output of the electron beam were not suppressed or blanked during the horizontal and vertical blanking intervals there would be objectionable lines on the received image tracing the movement of the electron beam as it retraces. Charge coupled imaging devices do not require complex deflection or blanking circuits since they are scanned by using address accessing and retrieval techniques. Pulse counters, divider chains and memory provide the correct sequential readout of the charge coupled device array so that an image is recovered from the individual outputs of the photodiodes from the charge coupled device without the need to compensate for the retracing of the electron beam.

A process referred to as interlaced scanning represents a variation of sequential scanning and is used to conserve bandwidth in the transmission system without introducing noticeable flicker. Flicker is a function of the raster coverage repetition rate as well as duty cycle, luminance and the decay characteristic of the picture tube. With interlaced scanning, alternate (odd) lines, shown as dashed lines m Fig. 5, are scanned first and the remaining (even) lines, shown as solid lines in Fig. 5, are scanned next. The entire raster area is covered or scanned twice. Therefore, the repetition rate for interlaced scanning is twice that of sequential scanning, which is at the same velocity along each line, which results in a corresponding reduction m flicker. The entire raster is covered 30 times per second, thereby permitting the frame to be scanned 60 times per second.

Interlaced scanning is illustrated in Fig. 5. The number of raster lines pictured is intended for illustration only and not intended to represent the actual number used in practice. The first raster line 60 begins at the top center of the image. The beam then proceeds for a half line to the right edge. Horizontal retracing (horizontal blanking) to the left occurs, and the third line follows 62. At the right end of the third line, one and a half lines have been scanned. The fifth line 64 and successive odd-numbered lines are scanned for a total of 241.5 lines, ending at the lower right corner. Twenty-one lines elapse during the vertical retrace interval (vertical blanking) during which the scanning beam is moved to the upper left corner, placing it in position to start scanning the second line. This completes one full field. Then 241.5 successive even lines are scanned, ending at the middle bottom of the image. Again 21 lines elapse for vertical retrace (vertical blanking) , during which time the scanning beam is returned to the top center of the image. This completes the second field and thus a full frame 66. The sequence then repeats. According to standards m the United States 15,750 lines are required to be scanned per second. With a vertical scanning rate of 30 times per second, there are 525 lines allocated to each frame and 262.5 lines per field. Each line has a duration of 63.49 microseconds. A finite period of time is required to return the scanning electron beam to the left edge of the image for the next line. This horizontal blanking period requires 16-18% of the total line time, or 10.16-11.43 microseconds. Similarly, 7.5-8% of the vertical blanking period, or 1250-1333 microseconds, is required m vertical blanking to enable the scanning beam to return to the top of the picture. This is the equivalent of about 21 scanning lines. Blanking circuits prevent the transmission of brightness variations during both the horizontal and vertical retrace intervals.

Fig. 6 illustrates an apparatus for linking to networked resources embedded withm broadcast or cable television signals 70 of the present invention. National Television System Committee (NTSC) and other broadcast television transmission standards comprise additional bandwidth at the end of each field (m the case of interlaced scanning described above) and frame which is used to reduce screen distortion m receivers with aged or intolerant components. This additional bandwidth is also used to transmit video frame relevant information, generally by means of an error corrected transmission protocol (such as the North American Broadcast Teletext Standard (NABTS) ) for subsequent retrieval and use broadcast enhancing functions, such as data for closed captionmg systems. The present invention seeks to embed access information to networked resources withm an audio/video signal making it possible for devices such as web-ready television, set-top conversion units, cable decoder boxes, WebTV transceivers, VCR's, and digital disks (particularly DVDI) to link to networked resources such as the World Wide Web and access other networked sites relevant to the information content the audio/video signal .

The block diagram of a color television receiver 72, illustrated in Fig. 6, receives a video signal from an antenna 74 or cable. The signal could equivalently be provided via conventional modem, cable modem, satellite, sideband RF, paging channels or other equivalent means well known m the art. The video signal is encoded with access information corresponding to networked resources during the vertical blanking and/or horizontal blanking intervals or equivalent means well known m the art as discussed above. It is anticipated that the audio/video signal provider will have made the decision as to which access information will be encoded onto the video signal prior to transmission and that such decisions will be dynamically updated m order to retain synchronization between the choice of networked resources provided to the user and the particular information content of the signal presented to the user. It is also anticipated that the user may optionally be given a choice of networked resources during various segments of the signal.

Subsequent to the video signal being input and applied to a video detector 76 of the television receiver 72, the networked resource access information encoded the vertical and/or horizontal blanking intervals, sidebands, subcarrier or alternative means well known the art will be separated from the detected video signal via a networked resource access information separator 78 by means well known m the art. The networked resource access information is then provided to either a web-ready television, set-top conversion unit, cable decoder box, VCR or equivalent system well known m the art 80. The networked resource access information is also provided to a color cathode ray tube display 82 order to display (e.g., by superimposing on the primary image, on the full -screen, or a Picture withm a Picture (PIP) ) the potential options of networked resources to enable the user to choose amongst them as also shown m Fig. 1. The networked resource access information provided to the color cathode ray tube display 82 may be provided m terms of descriptive summaries of the content of each networked resource option coupled with an index m order to enable the user to input his choice via the remote control unit 18 or other equivalent entry devices (e.g., keyboard) well known m the art. The networked resource access information provided to the video display device 80 typically represents a set of addresses (such as URL's) pointing to networked resources chosen by the audio/video signal provider that correspond to the options provided to the user. In the case of the Internet being the networked resource, a web browser 84 then accesses one of the addresses specified by the user through a network interface 86 and provides the user with a display of the networked resource on either the video display device 80, an auxiliary display (not shown) , the full-screen of the display, or a (PIP) on the color cathode ray tube 82.

An additional embodiment is possible using the concepts illustrated m Fig. 6 and the method illustrated m Fig. 2, wherein the user is not provided a choice of networked resources but rather a particular networked resource is accessed automatically upon receipt by the web browser 84 of the extracted networked resource access information. The remote control 18 would either be non- essential or its input ignored m this embodiment while the controller 88 would be required to proceed with networked accesses automatically without intervention by the user via the remote control unit 18.

As described above, the link or access information to the networked resource could also be embedded withm an unused sideband or subcarrier of the audio/video signal. Each television signal consists of a video signal and an audio signal . The NTSC prescribed signal has a bandwidth of approximately 6.00MHz and is modulated onto a predefined carrier frequency according to the channel to be transmitted on. For instance VHF channel four has channel limits between 61-68Mhz, a video carrier frequency of 62.25MHz and an audio carrier frequency of 67.75MHz. The area between channels reduces interference between channels.

The frequency spectrum of the NTSC signal is illustrated m Fig. 6A. The video signal consists of a luminance signal 108 and a chrominance signal 110. The luminance signal 108 provides the signal intensity for both black-and-white and color television signals. The luminance signal 108 has spectral peaks 112 every 15.75kHz, which correspond to the horizontal frequency m the television. The amplitude of the luminance spectral peaks 112 decreases up to 4.2MHz. The video signal is suppressed above 4.20MHz to provide for the audio signal 114, which is modulated with a 4.50MHz carrier. The chrominance signal 110 starts at approximately 2.08MHz m the spectrum and is modulated at a frequency of 3.58MHz. The chrominance signal 110 has spectral peaks 116 , which are also spaced 15.75kHz apart. A detailed discussion of these and related concepts is provided m K. Benson, The Television Engineering (1992) , which is hereby incorporated by reference.

The access information of the present invention could be modulated on a subcarrier between 4.20MHz and 4.50MHz, or between 4.50MHz and the upper limit of the bandwidth, which is approximately 6.00MHz, by means well known m the art. Likewise, a subcarrier could be used to provide access information for AM and FM radio broadcast signals by means well known m the art. In addition, since during the modulation of NTSC signals onto the broadcast carrier, one sideband of the modulated signal is filtered out to reduce bandwidth requirements, the unused bandwidth could be used to transmit access information by means well known m the art .

In order to provide an understanding of the Internet and on-line resource concepts used m the present invention a brief discussion of the relevant technology will be provided. The World Wide Web is a distributed hypermedia repository of information that is accessed with an interactive browser. A browser displays a page of information and allows the user to move to another page by making a selection using a pointing device such as a mouse.

Web documents are written m the Hyper-Text Markup Language (HTML) . In addition to text, a document contains tags that specify document layout and formatting. Some tags cause an immediate change, while others are used m pairs to apply an action to multiple items. Because an HTML document uses a textual representation, images are not included directly in a document. Instead, a tag is placed m the document to specify the place at which an image should be inserted and the source of the image .

The anchor tag is used to specify those items in an HTML document which correspond to an external reference. When a browser displays the document, the browser marks the reference to obtain a new document . Because an anchor can include arbitrary items, a selection can correspond to a picture or an icon as easily as to text.

External references are given m the form of a Universal Resource Locator (URL) . A browser extracts from the URL the protocol used to access the item, the name of the computer on which the item resides, and the name of the item. A URL that begins with http : // specifies that a browser should use the Hyper-Text Transport Protocol (HTTP) to access the item; a browser can also use other services such as File Transfer Protocol (FTP) .

Although HTML includes many features used to describe the contents and format of a document, the feature that distinguishes HTML from conventional document formatting languages is its ability to include hypertext references. Each hypertext reference is a passive pointer to another document. Unlike providing the URL directly to the browser, as performed by the present invention, the technique used by Intercast™ technology to include hypertext references does not cause an immediate action. Instead, a browser turns the hypertext reference into a selectable item when displaying the document. If the user selects the item, the browser follows the reference, retrieves the document to which it refers, and replaces the current display with the new document . HTML allows any item to be designated as a hypertext reference. Thus, a single word, a phrase, an entire paragraph, or an image can refer to another document. If an entire image is designated as a hypertext reference, the user can select the reference by placing the cursor at any position m the image and clicking a mouse button. Similarly, if an entire paragraph is designated as a hypertext reference, clicking on any character the paragraph causes the browser to follow the reference. Further details regarding hypertext can be found m D. Comer, Computer Networks and Internets (1997) , which is hereby incorporated by reference.

A browser consists of a controller, one or more clients used to access documents, and one or more interpreters used to display documents. Each browser must contain an HTML client to retrieve Web pages and an HTML interpreter to display them. In addition, a browser can include clients that permit access to services such as file transfer or electronic mail, and interpreters that display documents that use representations other than HTML.

To make document retrieval efficient, a browser uses caching. The browser places a copy of each document or image that a user views on the local disk. Whenever a document is needed, the browser checks that cache before requesting the document from a server on the network. Most browsers allow users to control the length of time documents are kept the cache as well as other controlling parameters . When a browser interacts with a Web server, the two programs follow the HTTP. In principle, HTTP is straightforward: it allows a browser to request a specific item, which the server then returns . To ensure that browsers and servers can mteroperate unambiguously, HTTP defines the exact format of requests sent from a browser to a server as well as the format of replies that the server returns .

Web browsers have a more complex structure than

Web servers . A server performs a straightforward task repeatedly: the server waits for a browser to open a connection and requests a specific page. The server then sends a copy of the requested item, closes the connection, and waits for the next connection. A browser handles most of the details of document access and display. Consequently, a browser contains several large software components that work together to provide the illusion of a seamless service. The conceptual organization of the web browser 84 of the prior art is illustrated m Fig. 6. Data paths from clients to interpreters are not shown.

Conceptually, the web browser 84 comprises a set of clients, a set of interpreters, and a controller that manages them. A controller 88 forms the central piece of the web browser 84. It interprets inputs from the remote control 18, and calls other components to perform operations specified by a user. For example, when a URL is entered by the networked resource access information separator 78, the controller 88 calls a client to fetch the requested document from the remote server on which it resides, and an interpreter to display the document for the user. Each web browser 84 must contain an HTML interpreter 90 to display documents. Other interpreters are optional. Input to the HTML interpreter 90 consists of a document that conforms to the HTML syntax. The output of the HTML interpreter 90 consists of a formatted version of the document on the color cathode ray tube or user display 82. The HTML interpreter 90 handles layout details by translating HTML specifications into commands that are appropriate for the user's display 82. For example, if it encounter a heading tag m the document, the HTML interpreter 90 changes the size of the text used to display the heading. Similarly, if it encounters a break tag, the HTML interpreter 90 begins a new line of output.

A more complete discussion of the Internet and computer network theory is provided m the following references hereby incorporated by reference :

1. D. Comer, The Internet (1995) .

2. D. Comer, Computer Networks and Internets (1997) .

Fig. 7 illustrates a top level block diagram showing the embodiment described above wherein the web ready television 14 or equivalent system capable of receiving audio/video signals and accessing networked resources such as the Internet receives the audio/video signal via wired 98 or wireless 100 means from the audio video signal provider 94. The television 14 then extracts and utilizes the access information provided m the transmission medium to access the networked resource via cable, modem, wireless or alternative means well known m the art. This embodiment could be implemented using a personal computer 96 capable of receiving the audio/video signal and accessing networked resources such as the Internet. The personal computer 96 extracts the access information from the transmission medium and uses it to access the networked resource via cable, modem, wireless or alternative means well known the art. The requested resource is then provided to the personal computer 96 or television 14 via wired 101 or wireless 103 means .

One commercially viable application of the embodiments illustrated m Fig. 7 is realized withm an automobile equipped with a radio receiver, display and computer capable of accessing the Internet via wireless means well known in the art. Access information linking the user to specific sites on the Internet is transmitted with the audio signal or via a dedicated data channel and received by the radio. An implementation for the transmission of auxiliary information to automobile radios, is found m the Radio Data System (RDS) available m the Volvo C70 audio system, the technical specifications and description of which are hereby incorporated by reference.

Radio stations transmit a separate band of information that, with the RDS system, can be adapted using the concepts set forth m the present invention to permit the user to access sites on the Internet. Upon receipt of the signal the computer uses links or URL's with the transmitted access information to access specific sites on the Internet. These sites are then displayed to the user either automatically or m response to user intervention and/or selection as a screen saver type of display or alternative means well known in the art. A subset or other modification of the Windows^® 95 operating system such as Window CE^{^}, currently used in palmtop personal computers, could be used to control operation of the computer m the automobile, thereby reducing the hardware and size requirements of such a computer .

Thus, while listening to the radio, the user and/or passengers m the automobile could view a number of sites of interest such as the following:

1. location, representative prices, hours and directions to points of interest including restaurants, historic sites, gas stations, rest stops, airports, bus terminals, lodging accommodations, etc.;

2. advertisements for stores, malls, eating establishments, concerts, etc. (i.e. "Virtual Billboards");

3. roadmaps ;

4. traffic conditions and alternate routes displayed on maps; and

5. weather conditions and snow emergency routes displayed on maps.

The choice of sites could be linked to the content of the audio signal the user is currently tuned to, such as displaying weather maps while the user is listening to the weather on a news channel. The choice of sites could alternatively be linked to the broadcast range or area of the audio signal rather than or m addition to the content of the audio signal, such as providing a site which lists the locations and ratings of restaurants withm the broadcast range of the audio signal. The access information can be transmitted with the audio signal or as a dedicated signal, which carries access information exclusively. Fig. 8 illustrates additional embodiments of the present invention wherein the audio/video signal is provided in digital format by a networked resource or audio/video content provider. The audio/video content provider comprises, for instance, a file server which embeds links such as URL's into a streaming media digital data stream. The web browser within the personal computer 96 or the television 14 then uses the embedded links to access further sites related or unrelated to the content of the audio/video signal. The user selects a requested resource from the embedded links and the requested resource is transmitted to the personal computer 96 or television 14 via wired 101 or wireless 103 means. In these embodiments the television and/or personal computer need only be capable of access to the networked resource since the information or audio/video signal and access information flow to and from networked resources without the need for a distinct audio/video signal provider. Technologies available on the Internet, such as streaming media comprising streaming audio and/or streaming video, represent potential implementations for the audio/video signal of these embodiments.

Advances in streaming audio technology make it possible to listen to any audio recording as the sound file is delivered to the personal computer. Streaming audio differs from downloadable audio files in that you can begin to hear and work with the file before it is completely downloaded to the personal computer. A description of streaming audio technology can be found in C. Shipley and M. Fish, How the World Wide Web Works (1996), which is hereby incorporated by reference. In each of the embodiments described above and illustrated in Figs. 7 and 8, the access information corresponding to audio/video signals transmitted through the air, free space or alternative wireless means well known in the art could be inserted within the vertical and/or horizontal blanking intervals, sidebands, or additional channels dedicated to transmission of access information for one or a plurality of broadcast channels. Such dedicated access information channels could be demultiplexed using the current channel being viewed as a selector to determine the relevant access information , to extract at any given time. For audio/video signals transmitted via cable, modem or alternative hardwired means, the access information could be transmitted as additional digital information in headers and/or auxiliary data packets by means well known in the art. Additional channels dedicated to transmission of access information for one or a plurality of audio/video signals transmitted via hardwired means could also be utilized. In each of the embodiments discussed above, access to the networked resource could be made via wired means 102, such as modem, TI , and cable, or wireless means 104 by techniques well known in the art. In addition, in each of the embodiments described above the access information could be transmitted via a sub carrier channel or using spread spectrum techniques well known in the art. A description of spread spectrum technology is provided in the following references, hereby incorporated by reference:

1. R.E. Ziemer and R.L. Peterson, Digital Communications and Spread Spectrum

Systems (1985) . 2. M.K. Simon, J.K. Omura, R.A. Scholtz, and B.K. Levitt, Spread Spectrum Communications Handbook (1994) .

Claims

CLAIMS ;

1. A method for providing a link between an information signal and networked resources comprising the steps of : embedding access information m a transmission medium, said access information adapted to provide access to content of a networked resource relevant to content of said information signal; transmitting said information signal and said access information; receiving said information signal and said access information at a user terminal; extracting said access information from said transmission medium; utilizing said access information to access said networked resource with an access signal; and displaying content of said networked resource on said user terminal corresponding to said access information.

2. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information withm a vertical blanking interval of said information signal .

3. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information withm a horizontal blanking interval of said information signal .

4. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information within bandwidth not used by said information signal .

5. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information within a sideband of said information signal.

6. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information within a header of an internet message packet.

7. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding said access information within a subcarrier in said transmission medium.

8. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of overlaying said access information with said information signal, said step of transmitting further comprises the step of transmitting said information signal and access information using spread spectrum transmission techniques, and said step of receiving further comprising the step of receiving said information signal and access information using spread spectrum reception techniques .

9. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the steps of embedding said access information within a channel comprising access information corresponding to a plurality of information signals, and extracting access information from said channel corresponding to said information signal currently being received.

10. The method for providing a link between an information signal and networked resources of claim 1, further comprising the step of synchronizing said access information to a predetermined portion of said information signal .

11. The method for providing a link between an information signal and networked resources of claim 1, wherein said information signal further comprises video content .

12. The method for providing a link between an information signal and networked resources of claim 1, wherein said information signal further comprises audio content .

13. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of displaying said content of said networked resource further comprises the step of displaying said transmitted networked resource in a picture in a picture (PIP) on said user terminal.

14. The method for providing a link between an information signal and networked resources of claim 1, further comprising the steps of compressing said access information prior to embedding said access information in said transmission medium, and decompressing said access information by said user terminal .

15. The method for providing a link between an information signal and networked resources of claim 1, further comprising the steps of encoding said access information prior to embedding said access information in said transmission medium, and decoding said access information by said user terminal .

16. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of utilizing said access information further comprises the step of embedding said user information into said access signal.

17. The method for providing a link between an information signal and networked resources of claim 16, further comprising the step of compressing said user information prior to embedding said access information nto said access signal.

18. The method for providing a link between an information signal and networked resources of claim 16, further comprising the step of encrypting said user information prior to embedding said access information into said access signal.

19. The method for providing a link between an information signal and networked resources of claim 1, further comprising the step of embedding access information to additional networked resources m said content of said networked resource.

20. The method for providing a link between an information signal and networked resources of claim 1, further comprising the step of encoding said access information to additional networked resources prior to embedding said access information to additional networked resources said content of said networked resource .

21. The method for providing a link between an information signal and networked resources of claim 1, further comprising the step of compressing said access information to additional networked resources prior to embedding said access information to additional networked resources said content of said networked resource.

22. The method for providing a link between an information signal and networked resources of claim 1 further comprising the steps of: assigning an index corresponding to each of a plurality of networked resources; selecting one of said indices corresponding to said plurality of networked resources; and utilizing said index to determine which of said plurality of networked resources to access.

23. The method for providing a link between an information signal and networked resources of claim 22, further comprising the step of providing a summarized content for said index, said summarized content representative of said content of said corresponding networked resource.

24. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding a link to said networked resource m said transmission medium.

25. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of embedding said access information further comprises the step of embedding a URL m said transmission medium.

26. The method for providing a link between an information signal and networked resources of claim 1, further comprising the step of recording said user information and optional temporal information by said networked resource.

27. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of displaying content further comprises the step of automatically displaying said content without user intervention.

28. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of displaying content further comprises the step of selectively displaying said content in response to user intervention.

29. The method for providing a link between an information signal and networked resources of claim 1, wherein said user terminal is a personal computer.

30. The method for providing a link between an information signal and networked resources of claim 29, wherein said personal computer is adapted for reception of television signals.

31. The method for providing a link between an information signal and networked resources of claim 29, wherein said personal computer is adapted for reception of radio signals.

32. The method for providing a link between an information signal and networked resources of claim 1, wherein said user terminal is a television.

33. The method for providing a link between an information signal and networked resources of claim 32, wherein said television is adapted for access to the Internet .

34. The method for providing a link between an information signal and networked resources of claim 32, wherein said television is adapted for reception of radio signals .

35. The method for providing a link between an information signal and networked resources of claim 1, wherein said user terminal is a portable personal computer adapted for wireless access to said networked resources.

36. The method for providing a link between an information signal and networked resources of claim 1, wherein said transmission medium is free space.

37. The method for providing a link between an information signal and networked resources of claim 1, wherein said transmission medium is the Internet.

38. The method for providing a link between and information signal and networked resources of claim 1, wherein said step of embedding access information further comprises the step of utilizing user information to determine access to content of the networked resource.

39. The method for providing a link between and information signal and networked resources of claim 1, wherein said step of utilizing said access information further comprises the step of transmitting user information to said networked resource .

40. The method for providing a link between an information signal and networked resources of claim 1, wherein said step of displaying indicia indicating availability of said link to said content of said networked resource and displaying said transmitted networked resource to said user in response to selection of said indicia.