WO2002035822A2

WO2002035822A2 - System and method for the automatic insertion of data into a television signal in connection with interactive tv

Info

Publication number: WO2002035822A2
Application number: PCT/US2001/032520
Authority: WO
Inventors: Drake Smith; Samuel Barone, Jr.; David Davis; Kelly King
Original assignee: Mixed Signals Technologies, Inc.
Priority date: 2000-10-23
Filing date: 2001-10-15
Publication date: 2002-05-02
Also published as: WO2002035822A3; AU2002213375A1; EP1352514A4; GB0309428D0; EP1352514A2

Abstract

A system and method are disclosed for automatically inserting ITV-related data into a video signal based on the detection of certain events occurring during the show. According to the invention, certain components on the studio set are monitored for the occurence of corresponding events. Upon detecting one or more such events, a detection signal is output by a monitoring device (34), and a data encoder (38) then inserts corresponding ITV-related data into the video signal (40). In this manner, ITV-related data is automatically inserted into the TV program.

Description

SYSTEM AND METHOD FOR THE AUTOMATIC INSERTION OF DATA INTO A TELEVISION SIGNAL TN CONNECTION WITH INTERACTIVE TV

FIELD OF THE INVENTION

The present invention relates to techniques for the provision of interactive television (ITV) content associated with a television program. More particularly, the invention relates to the automatic or semi-automatic provision of ITV content in connection with a TV program.

BACKGROUND OF THE INVENTION

Interactive television ("ITV") combines conventional television with additional content ("interactive content") to present a viewer with an enhanced version of a television program or commercial. Typically, the interactive content is in some way related to the television program being viewed, such as biographical information about one of the actors in the program, additional information about a topic covered in the program, and the like. In connection with a TV game show, the interactive content often allows the viewer to play along with the game, by answering the same questions as the contestants on the game show.

In order to experience interactive TV, a viewer must own an ITV receiver (for example, a "set-top box", or a TV receiver that has built-in ITV receiver capabilities) that receives specially prepared video signals which include ITV data in the form of Uniform Resource Locators (URLs), interactive content, triggers (e.g., Java-script program calls or other data that triggers an action in the ITV receiver), and/or other commands, as is well known to those skilled in the art (collectively referred to herein as "ITV data"). The ITV receiver receives and decodes the ITV data, which may then be used to access the interactive content from a remote location, or may be a command that controls the ITV receiver. Alternatively, .the ITV receiver may receive interactive content data directly from the TV signal, in which case the ITV receiver processes the data and displays the processed data in the form of interactive content.

Today, interactive television depends on World Wide Web ("Web") technology for delivering and viewing the enhanced content. Specific web sites, addressed with URLs, are created and maintained as ITV sites. The content in these sites may be viewed with ITV receivers in the same way a computer can browse a web site. ITV receivers include web browsers, and can display downloaded content along with TV video on a conventional television set. ITV receivers typically obtain the majority, if not all, of the ITV web content via one of the ITV web sites, typically over a telephone line. Which sites are accessed, and how content is displayed, is determined by the interactive data contained in the video portion of the television program. One method for encoding ITV links and triggers is specified in EIA-746: Transport of

Internet Uniform Resource Locator Information Using Text-2 Service.

FIG 1. illustrates the overall signal and data flow for a conventional interactive TV system. During the production phase of a TV program or commercial, the program is edited from one or more master recordings 10, and certain URL links and command triggers are embedded, by means of a data encoder 12, into the program, for example, in the vertical blanking interval (VBI) (also known as "line 21") of the video portion of the program. The modified program is recorded by a data recorder 14 for subsequent broadcast.

At the appropriate time the TV program is broadcast, along with the embedded URLs and/or command triggers, by means of a data player 16 and broadcast station 18. These URLs and triggers cause an ITV receiver 20 in the viewer's home to retrieve enhanced content from the Internet 21 by way of a telephone interface 22. The telephone interface provides two way communication between the viewer and an ITV server 23 at a content provider. Currently, the telephone interface provides the majority of the interactive content as the bandwidth reserved for ITV data in today's TV transmissions is very low. The TV program, along with the retrieved content, is displayed on a television or other suitable display, such as a computer display.

Typically, when a television program with available interactive TV content is first received, the viewer is given an option to receive the enhanced experience. If the viewer chooses the enhancements, the ITV receiver will establish a telephone connection to the Internet (if a connection is not already made), find the ITV web site based on a URL embedded in the television program, and then receive the content that produces the enhanced experience.

In a prerecorded ITV game show program, the ITV participants must follow the game play that occurs on-air. For example, if the game play requires a contestant to answer questions, the viewer at home should not be allowed to respond after the on-air contestant correctly answers the question. To prevent those untimely responses, a special command code (e.g., a trigger) is transmitted in the ITV data channel to control the ITV receivers so that they do not accept any subsequent responses from the viewers. In order to provide such commands in the broadcasted TV program, an ITV producer must manually watch the show and find all occurrences in the show that require those commands. One method currently performed is for the ITV producer to shuttle a video tape of the show back and forth to home in on the exact times the commands are required. When the producer finds a spot in the program that requires a command, they control an ITV data encoder to insert a corresponding command into the selected location of the video signal. Such a method is tedious and requires relatively large amounts of the producer's time.

Thus, it would be desirable to have a system and method whereby this process (or at least a portion thereof) is automatically performed, thereby at least reducing the complete reliance on an ITV producer. The present invention addresses this desirable feature. SUMMARY OF THE INVENTION

Briefly, the present invention is directed to a system and method for automatically inserting ITV-related data into a video signal based on detected events occurring during the show.

According to the invention, certain components of the recording studio are monitored for the occurrence of corresponding events. Upon detecting one or more such events, a corresponding detection signal is generated. The detection signal is processed, and corresponding ITV-related data is then inserted into the video signal, h this manner, ITV-related data is automatically inserted into the TV program.

Thus, in one illustrative embodiment, the present invention is directed to a method of automatically inserting ITV-related data into a TV program, including sensing the occurrence of a particular event, generating a corresponding detection signal, processing the detection signal, and inserting corresponding ITV-related data into the TV program.

In another embodiment, the invention further includes processing the ITV-related data during a subsequent stage to determine the contents of the ITV-related data, comparing the ITV- related data with a table of such data, and inserting corresponding triggers or other ITV data into the TV program. hi yet another embodiment, the invention is directed to a system for automatically inserting ITV-related data into a TV program, including at least one event-detecting device that is operative to generate a detection signal in response to detecting the occurrence of a particular event, aprocessor connected to the event-detecting device and programmed inresponse to receipt of a detection signal to generate a corresponding command signal, and a data encoder connected to the processor and operative in response to receipt of the command signal to insert corresponding ITV-related data into the TV program.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG.1 schematically illustrates a standard interactive TV system; FIG. 2 is a schematic diagram which illustrates a system according to one illustrative embodiment of the invention;

FIG. 3 schematically depicts a line of the video signal into which ITV-related data may be recorded according to one illustrative embodiment of the present invention;

FIG.4 is a schematic diagram that illustrates additional components that maybe included in the system of FIG. 2;

FIG. 5 is a flow chart of the operational steps involved in connection with the system of FIG. 2; and FIG. 6 is a flow chart of the operational steps involved in connection with another illustrative embodiment of the invention. DETAILED DESCRIPTION OF THE INVENTION

Referring to FIGS. 2 through 5, a novel interactive system 30 is disclosed according to one illustrative embodiment of the invention. The system 30 also provides novel and unobvious functionality that is the subject of one embodiment of the present invention. In particular, and in one illustrative embodiment, system 30 is designed to automatically insert ITV-related data into a television program as it is recorded. The ITV-related data is inserted into selected frames of the TV signal based on the detection of particular events that occur during the taping of the television program. For example, in the case of a television game show, system 30. may monitor one or more components of the television studio to detect the occurrence of certain events. One such component may be a scoreboard, with system 30 monitoring the scoreboard for any updates to the scoring which would indicate that one of the contestants correctly answered a question. It will be apparent that once one of the contestants correctly answers a question, it is desirable to prevent the viewers playing at home from answering the question. Thus, upon detecting an update to the scores, system 30 is operative to insert appropriate ITV-related data into the television signal, as is described in more detail below.

It will also be apparent to those skilled in the art that the particular event or events being monitored will vary depending on the particular television program being recorded. Even in the case of game shows, the event or events being monitored may vary depending on the nature of the game show. The event may be a particular sound being generated, closing of a contact switch, or virtually any physical event that can be sensed.

Referring now primarily to FIG. 2, system 30 according to one illustrative embodiment of the invention is described in more detail. System 30 includes at least one event-detecting device 32 that monitors the television studio or set for the occurrence of some real-time event, h one embodiment, the event-detecting device includes a monitoring device 34 and an interface apparatus 36. While only one device 34 is shown, it will be understood that one or more devices

34 may be connected to interface apparatus 36.

Monitoring device 34 monitors for the occurrence of some event, such as activation of a buzzer (e.g., when a timer has run out), closing of a contact switch, an audible signal, or a signal being transmitted between components on the studio set. Thus, monitoring device 34 may take many different forms, including a line connected to a contact switch, a sensor to sense some physical occurrence, a device that is interfaced to the studio electronics to monitor signals being transmitted by the studio electronics, and the like. Thus, the monitoring device 34 can be any device or component that can detect some physical occurrence.

Thus, in one illustrative embodiment, monitoring device 34 functions as atransducer and senses a first type of signal (e.g., acoustic) and outputs a second type of signal (e.g., electrical), which is received by interface apparatus 36. Interface apparatus 36 receives the signal output by the monitoring device 34, and generates a corresponding output signal for delivery to one or more data encoders 38, which then insert the data in the output signal into the video signal.

In one embodiment, the output of interface apparatus 36 is a simple trigger pulse to indicate that an event has been detected. The trigger pulse may conform to an industry practice known as General Purpose Interface (GPI), or may take any other suitable form. Alternatively, interface apparatus may produce a coded output, such as an RS-232 data signal. For example, in the case of multiple monitoring devices 34, each may be coded with a unique identification number, with that number being part of the output signal transmitted to the data encoder(s). hi yet another embodiment, interface apparatus 36 may retrieve appropriate ITV-related data depending on the particular event sensed. For example, one of the monitoring devices 34 may monitor for an update in a game scoreboard, which indicates that one of the contestants has correctly answered a question. When the scoreboard is updated, that monitoring device 34 transmits a corresponding detection signal, which is received by interface apparatus 36. In this illustrative embodiment, interface apparatus 36 retrieves the appropriate ITV-related data, such as a trigger or other command, and forwards that data to encoder(s) 38 for insertion into the television signal. In one embodiment, data encoder(s) 38 comprise DV2000 encoders available from Mixed Signals Technologies, Inc.

Thus, the ITV-related data that is inserted into the television signal can take many different forms. In one embodiment, the data can simply be an indication that an event was sensed. In another embodiment, the data may serve to identify the monitoring device 34 that sensed an event. In still another embodiment, the data maybe actual ITV data in the form of a trigger or the like.

In an alternative embodiment, the event-detecting device 32 may simply include one or more monitoring devices 34, whose outputs are transmitted to the encoder(s) 38. h the case of multiple sensors, each may be designed such that it generates a unique output signal that may be distinguished by system 30.

System 30 further includes one or more data encoders 38. hi the illustrative embodiment shown in FIG. 2, system 30 includes two such encoders, one for each camera 40. However, it will be understood that system 30 may include one or more encoders. Each encoder 38 is connected to interface apparatus 36 to receive the signal output by interface apparatus 36, and to insert the received data into the video portion of the television signal being output by each camera 40. The television signal with the inserted ITV-related data is then stored on a data recorder 42, for example, a video tape recorder.

Referring now to FIG. 3, in one illustrative embodiment the ITV-related data is inserted into video scan line 21, which constitutes the first line of active video. The ITV-related data is only inserted into the odd video fields in the embodiment shown in FIG. 3; however, both odd and even fields could be used.. Currently, each field allocates two bytes of data to line 21. Thus, the 16 bits may contain two EIA-608 control code bytes, or they may contain a single identifying byte together with an 8 bit counting sequence. Also, the first byte may be allocated to sensor identification data, with the second byte being allocated to a counting sequence. Thus, any combination of one or more of fixed ID byte, sensor ID, and counting sequence may be used in this embodiment where the ITV-related data that is inserted into the television signal consists of event records.

Preferably, the ITV-related data is limited to 16 bits, thereby ensuring that it is inserted into a single field, h this manner, during editing the ITV-related data cannot be truncated, hi addition, both the odd and even fields of a single video frame can be used, thereby providing up to 32 bits for the ITV-related data without the fear of truncating the ITV-related data during any subsequent editing of the television signal.

As is well known in the art, a typical program is created from a plurality of master recordings. Often, two or more cameras record the show from different perspectives, and those multiple recordings are then used to create the single program. Conventionally, the single program contains a time code track that records the time of the show in hours, minutes, seconds, and video frames. System 30 also inserts the ITV-related data into the video signal for each master recording, which is then automatically included in the single program.

Referring now to FIG. 4, a system 44 for processing the single program is disclosed. System 44 includes a video playback device 45 that receives the single program and plays the data contained in the single program. System 44 also includes a data decoder 46 and a computer 47 or other suitable processor. Data decoder 46 receives the television signal and extracts the time code information and ITV-related data from the signal. Data decoder 46 then passes the time code information and ITV-related data to computer 47. Computer 47 includes appropriate software and is programmed to receive the incoming data and time code information and to build a database with entries consisting of the ITV-related data and the corresponding time code information. The database may then be used by an ITV producer to find the locations in the television signal where events occur, and to insert corresponding ITV data.

Referring now to FIG. 5, operation of the system 30 according to one illustrative embodiment is described. Operation begins at step 50, with an event occurring during taping of the television program, with such event causing the generation of a corresponding detection signal. As described above, the particular event can take virtually any form, such as a contestant pressing a contact switch, or a scoreboard being updated, an audible buzzer being actuated, or the like, hi any event, a corresponding monitoring device 34 monitors the appropriate equipment for such an event, and when the event occurs, the monitoring device 34 generates a corresponding detection signal as an output signal. At step 52, the detection signal is received, in one embodiment, by the interface apparatus 36, which processes the incoming signal and generates a corresponding output signal. As described above, the output signal generated by interface apparatus 36 can take many different forms. It can simply be data to indicate that some event was sensed (especially in the case where only a single monitoring device 34 is being used). It can also be data indicating the identity of the monitoring device 34 that observed the event. Or, the data can be ITV data as selected by the interface apparatus 36 based on the signal from monitoring device 34. Thus, the processing of the detection signal can be as simple as passing the detection signal on to data encoder(s) 38 to serve as a marker, or the processing can entail retrieving corresponding ITV-related data based on some identifying characteristic of the detection signal.

Thus, interface apparatus 36 can simply condition the signal from monitoring device 34, or can serve as a processor that maintains an association table or other database, and that receives a detection signal and selects appropriate ITV-related data for insertion into the television signal.

At step 54, the output signal is received by the encoder(s) 38, and the encoder(s) 38 insert the received data into the video portion of the television signal, for example, in the vertical blanking interval ("VBI"). At step 56, the television signal is then recorded to one or more data recorders 42, depending on the number of cameras 40.

At step 58, the video data is played back in video playback device 45 during a subsequent processing stage, for example, after editing of the master recordings to create a single program from the multiple recordings. The resulting single television signal is delivered to data decoder 46, which extracts the encoded ITV-related data from the signal. The ITV-related data is then saved to a database in computer 47, along with corresponding time code data for that event, at step 60.

Thus, the database of events may be used by an ITV producer to fast forward the television signal to the point in the program where each event took place. The ITV producer may then select and encode appropriate ITV data in the program. It will be apparent that the database facilitates navigation through the program to find the ITV-related events within that program.

Referring now to FIG. 6, an alternate method is shown and described in detail.

According to the alternate method, system 30 is fully automatic, and is operative to insert ITV- related data into the television signal when an appropriate event is detected. Operation of this alternate method begins at step 70, when an event is detected by monitoring device 34, and a corresponding detection signal is generated and transmitted by device 34. At step 72, the detection signal is received and processed by a processor, either a processor incorporated into data encoder 38, or a separate processor, for example, a processor incorporated into interface apparatus 36, or in computer 37. The processor is programmed to determine the source of the detection signal, and to determine the appropriate ITV-related data based on the source of the detection signal. For example, if the source of the detection signal is the monitoring device 34 that monitors for updates to the scoreboard, then the processor is programmed to retrieve ITV-related data in the form of a trigger to control the ITV receivers 20 so that they do not accept any further inputs from the viewers, hi that example, the trigger functions as a blocking code, as is well known in the art. As described above, each monitoring device 34 may be designed to output a unique signal, or the processor may simply keep track of which monitoring device transmitted a detection signal, through a suitable interface or the like. Then, at step 74, in one illustrative embodiment, the processor compares the detection signal data with a table of event data and corresponding ITV-related data, and retrieves the appropriate ITV-related data, hi one embodiment, the processor maintains an association table that links detection signals from particular monitoring devices 34 with corresponding ITV-related data. Thus, depending on the source of the detection signal, different ITV-related data may be retrieved. The association table may also link monitoring device ID information with corresponding ITV data.

Then, at step 76, data encoder 38 receives the ITV-related data from the processor and inserts it into the television signal. In this manner, the process of inserting ITV-related data based on the occurrence of events during recording of the show is automated. As used herein, the term "ITV receiver" is intended to refer to set-top boxes, digital cable boxes, or any other suitable device which has web browsing capabilities.

As used herein, the term "ITV-related data" is intended to refer to 1) actual ITV data, such as a URL, a simple trigger or other command, or the like; and 2) data that may be subsequently used (either automatically o by an ITV producer) to insert the appropriate ITV data, such as event data, monitoring device identification data, a simple marker, and the like. In one embodiment, the ITV-related data is embedded in the vertical blanking interval ("VBI") channel of the program. However, it will be apparent to those skilled in the art that the ITV-related data can be inserted in any suitable manner into the TV signal, such as in any supplemental data channel in the frame. While the above description contains many specific features of the invention, these should not be construed as limitations on the scope of the invention, but rather as one exemplary embodiment thereof. Many other variations are possible. Accordingly, the scope of the invention should be determined not by the embodiments illustrated, but by the appended claims and their legal equivalents.

Claims

What is claimed is:

1. In an interactive television system, a method of inserting ITV-related data into a television signal, comprising: generating a detection signal upon sensing the occurrence of aparticular event during the recording of the television signal; processing the detection signal; and inserting corresponding ITV-related data into the television signal.

2. The method of claim 1 , wherein inserting ITV-related data comprises inserting ITV data into the television signal.

3. The method of claim 1 , wherein inserting I V-related data comprises inserting an event record into the television signal.

4. The method of claim 2, wherein inserting the ITV data comprises inserting a URL into the TV signal.

5. The method of claim 2, wherein inserting the ITV data comprises inserting a trigger into the TV signal.

6. The method of claim 1, further including: processing the ITV-related data during a subsequent stage to determine the contents of the ITV-related data; and inserting corresponding ITV data into the TV signal based on the contents of the ITV- related data.

7. The method of claim 6, wherein inserting ITV data comprises inserting a URL.

8. The method of claim 6, wherein inserting ITV data comprises inserting a trigger.

9. The method of claim 1, wherein sensing comprises sensing a contact switch.

10. The method of claim 1, wherein sensing comprises sensing an update signal transmitted to a scoreboard.

11. The method of claim 1 , wherein processing the detection signal is performed by an

ITV data encoder.

12. The method of claim 1, wherein processing the detection signal is performed by a processor.

13. The method of claim 1, wherein processing the detection signal comprises determining the source of the detection signal.

14. The method of claim 1, wherein processing the detection signal comprises determining the contents of the detection signal.

15. hi an interactive television system, a method of inserting ITV-related data into a television signal, comprising: sensing the occurrence of a particular event and generating a corresponding detection signal upon sensing the event; processing the detection signal; inserting corresponding ITV-related data into the television signal; recording the television signal; processing the ITV-related data in the television signal during a subsequent processing stage; and

. inserting corresponding ITV data into the television signal.

16. The method of claim 15, wherein inserting ITV-related data comprises inserting an event record into the television signal.

17. The method of claim 15, wherein sensing comprises sensing a contact switch closure.

18. The method of claim 15, wherein sensing comprises sensing an update signal transmitted to a scoreboard.

19. The method of claim 15, wherein processing the detection signal is performed by an ITV data encoder.

20. The method of claim 15, wherein processing the detection signal is performed by a processor.

21. The method of claim 15, wherein processing the detection signal comprises determining the source of the detection signal.

22. The method of claim 15, wherein processing the detection signal comprises determining the contents of the detection signal.

23. The method of claim 15, wherein processing the ITV-related data comprises determining the contents of the ITV-related data.

24. A system for inserting ITV-related data into a television signal, comprising: at least one event-detecting device that is operative to generate an output signal upon detecting a particular event on a studio set; a processor connected to the event-detecting device and programmed to process an incoming output signal and to generate a corresponding signal containing ITV-related data; and a data encoder connected to the processor and operative in response to receipt of the signal from the processor to insert the ITV-related data into the television signal.

25. The system of claim 24, wherein the output signal comprises a trigger pulse.

26. The system of claim 24, wherein the signal from the processor identifies particular ITV data for insertion into the television signal, and the data encoder is operative in response to receipt of the signal to retrieve the ITV data and to insert the ITV data into the television signal.

27. The system of claim 24, wherein the processor and data encoder are included in a single device.

28. The system of claim 24, wherein the event-detecting device comprises a sensor.

29. The system of claim 24, wherein the event-detecting device is connected to a contact switch to sense closure of the switch.

30. The system of claim 24, wherein the event-detecting device comprises a sound sensor.

31. A system for inserting ITV-related data into a television signal, comprising: means for detecting an occurrence of a particular event on a studio set and for generating a corresponding output signal; and means for inserting particular ITV-related data into the television signal based on the output signal received.

32. The system of claim 31 , wherein the means for inserting comprises aprocessor that is programmed to process an incoming output signal and to generate a corresponding command signal, and a data encoder connected to the processor and operative in response to receipt of the command signal to insert corresponding ITV-related data into the television signal.

33. The system of claim 31 , wherein the output signal comprises a trigger pulse.

34. The system of claim 32, wherein the command signal includes ITV-related data for insertion into the television signal.

35. The system of claim 32, wherein the command signal identifies particular ITV- related data for insertion into the television signal, and the data encoder is operative in response to receipt of the command signal to retrieve corresponding ITV-related data and to insert the ITV-related data into the television signal.

36. The system ofclaim 32, wherein the processor and data encoder are included in a single device.

37. The system of claim 31 , wherein the means for detecting comprises a sensor.

38. The system of claim 31, wherein the means for detecting comprises a line connected to a contact switch.

39. The system ofclaim 31 , wherein the means for detecting comprises a sound sensor.