JP2005522922A - Improved utilization of data broadcasting technology with portable control devices - Google Patents

Abstract

  The television entertainment system (FIG. 2) allows two-way communication with a portable remote device (20) that accesses an external information source (32). The television entertainment system receives a television related (42) suitable for receiving television program content, receives program related information on a broadcast channel, and communicates program related information to a portable remote device (20). And a television set top box (36) suitable for the above. The portable remote device (20) visually displays information received on the broadcast channel, and synchronizes the provision of program related information with the provision of related information from an external information source (32) by means of a synchronization engine (34). It is suitable for.

Description

The present invention relates to handling of supplementary data contained in a television broadcast signal such as a VBI (vertical blanking interval) for analog television broadcasting or a transport stream for digital broadcasting. More specifically, the present invention discloses a method for communicating digital information using supplemental data and a method for providing an interactive interface to a user.
[Background Art and Disclosure of Invention]

  The present invention realizes a portable control device that optimally presents to a user data transmitted in a television broadcast signal such as a VBI in an analog broadcast or a transport stream in a digital broadcast. Broadcasters embed supplemental information (also referred to as digital data or metadata) in broadcast signals. Examples of supplementary information include triggers, EPG (electronic program guides), and interactive games in cooperation with ongoing programs. Since supplementary information is normally transmitted in synchronization with a television program, the available bandwidth is limited. Therefore, only a limited amount of data can be transmitted.

  As a result of the limited bandwidth available in television broadcasts, the transmission of data to users is often slow and meaningless. Although digital broadcasting can provide a sufficiently high bandwidth, as with analog broadcasting, once supplementary information is accepted at the headend, the drawback remains that the content cannot be easily changed. It is necessary to transmit more up-to-date information (such as EPG and weather) to the user. The present invention overcomes the inherent limitations for embedding data in both analog and digital broadcasts. In the present embodiment, the portable control device includes a metadata manager that cooperates with a data decoder and a data parser, and receives data embedded in a broadcast signal. And by using the application which operate | moves inside a portable control apparatus, the user can utilize metadata more efficiently and can access optimal information early. Data can be used for application activation on mobile devices (data synchronization with external sources such as data cards and the Internet) and data content such as EPG can be searched through user input. Including, but not limited to, use for User input includes, but is not limited to, handwriting input, a keyboard, or a user interface.

  Further areas of application in the present invention will become apparent from the following detailed description. It should be noted that the detailed description and specific examples merely represent a preferred embodiment of the present invention and are not intended to limit the scope of the present invention to that description.

  The following description of the preferred embodiments merely illustrates the essence and is not intended to limit the invention, its application, or its use.

  FIG. 1 shows an embodiment of a portable control device embodying the present invention. The control apparatus generally includes a box assembly 10, a user interface 12, and a display screen 14. The user interacts with the control device via the user interface 12. User interface 12 may comprise a keyboard or keypad, function buttons or switches, a touch screen, or a combination thereof. As the user interface 12, not only conventional interaction with an electronic device such as a television, a video cassette recorder (VCR), a digital video disk (DVD) player, or other home appliances, but also the application or data can be transmitted by the control device itself. Means for operating may be provided. Furthermore, the user may interact with the control device by directly contacting the display screen 14 with a contact element such as a stylus pen. The portable control device also includes communication means 18 for transmitting and receiving wireless data.

  In one embodiment, the portable control device is a personal data assistant (PDA).

  In another embodiment, the portable control device includes a PDA stylus pen for handwriting input.

  In another embodiment, the portable control device comprises additional communication means 18 for uploading and downloading data to a personal computer.

  In yet another embodiment, the portable control device includes additional communication means for transmitting and receiving wireless data including (but not limited to) wireless internet data.

  In yet another embodiment, the portable control device includes an external peripheral device such as an SD (secure digital) memory card that stores additional data.

  FIG. 2 illustrates one embodiment of a system architecture. The portable device 20 includes a data manager 22 that operates as the data parser and metadata database, a data request command processor, a synchronization engine 34, a handwriting interpreter 24, a GUI (graphical user interface) application 26, and other necessary applications 28. And a wireless interface 29A (IEEE802.11b or Bluetooth interface). The portable device may also include one or more infrared (IR) interfaces 30.

  The data manager 22 operates as a metadata database that stores data downloaded from the television set top box (STB) 36. By storing data in the portable device, the user can quickly retrieve information. This information is displayed to the user by the GUI application 26 on the portable device. Because the data is stored on the portable device, the user can view the information at any time, regardless of whether the television is displayed. In order to facilitate data transfer between the device and various content from the service provider, the data is stored in a portable device in a conventional format such as XML (extensible markup language). The data parser translates the downloaded data and transmits it to the mobile device.

  In the system architecture as shown in FIG. 2, a data request processor is further included in the data manager 22 and is used to download data to the portable device based on user demand. This functionality eliminates the need for the portable device to continuously poll data from the STB 36. As a result, CPU (central processing unit) resources are not consumed. When there is an input request from the user on the portable device GUI application 26, data related to the program or commercial being viewed is downloaded to the portable device. The data request processor receives an input request from the user and relays the request to the STB 36 through the radio interfaces 29A and 29B. Further, the user request can be used to control the function of an electronic device such as a television, VCR or DVD player. In the present embodiment, the request message uses the XML format, but other message formats can also be used. Also, in this embodiment, UDP (user datagram protocol), TCP (transmission control protocol), and / or IP (Internet protocol) are used to send request messages, but other communication protocols are used. It is also possible.

  Still referring to FIG. 2, the remote device may further comprise a handwriting interpreter 24. The interpreter 24 receives a handwriting request from a user, performs handwriting recognition, and performs a search function with enhanced information browsing and search capability according to the present invention by utilizing existing technology. In some embodiments, a small handwriting input area is provided on the display screen for a user to input by hand with a stylus pen. In another embodiment, a handwriting input area is provided at another location of the mobile device.

  In one embodiment of the handwriting interpreter 24, describing the channel mnemonics in the appropriate area allows the user to request specific channel control functions, or channel information. This mnemonic may be a default name of a channel recognized by the mobile device or a name assigned by the user. If a situation occurs where the search engine cannot accurately recognize the user's handwriting request, the GUI application 26 may provide a list of channels that can be received, thereby allowing the user to select the correct channel.

  The GUI application 26 in the portable device provides a lot of interaction to the user. The GUI application 26 displays data for allowing the user to visually recognize or operate. Using the GUI application 26, the user can request information such as EPG (electronic program guides), supplemental program information, advertising or product information, news highlights, or sports event scores and statistics tables. In addition, the GUI application 26 may provide the user with games related to what is being viewed, such as trivia, coupon opportunities, and the ability to synchronize with the progress of the game. Good. Note that the GUI application 26 or other resident application 28 may communicate with other external data sources 32 such as home devices, telephones, or other home appliances.

  The portable device may also implement a synchronization engine 34. The synchronization engine 34 synchronizes data downloaded from the Internet or other information sources (SD card, compact flash, and similar information sources) and data. This functionality allows the user to receive real-time supplementary program listings and program-related information being viewed. In one embodiment, a user may request information about an advertising product, request a product coupon, or purchase a product online. As another embodiment, a more detailed information request about a program, which is not included in data downloaded from a broadcast channel, can be considered.

  In FIG. 2, the portable device communicates with the STB 36 through the wireless interfaces 29A and 29B. In the present embodiment, this wireless communication uses IEEE 802.11b or a Bluetooth interface protocol. Note that wireless communication can be realized with other protocols. The portable device 20 and the STB 36 include communication interfaces 29A and 29B that can be adapted to the selected wireless protocol.

  The STB 36 includes a television signal tuner 38, a demodulator 40, a metadata decoder 42, an STB data parser 44, a data buffer 46, a data formatter 48, and a user command processor 50. The STB unit 36 decrypts the data and caches it. The STB 36 may be a unit separated from the television 52 as shown in FIG. 2 or may be built in the television 52.

  Broadcast television signal 54 is sent through tuner 38 and demodulator 40 and then to both television 52 and STB decoder 42. The decoder 42 is a hardware device that can receive a broadcast signal and decode transmission data in the broadcast signal, such as a VBI decoder in analog broadcasting or a section filter in digital broadcasting.

  Since data is sent only for a certain time interval, it is not immediately available for user requests. Therefore, an STB data buffer 46 used in connection with the decoder 42 may be provided, and data stored in the data buffer 46 may be collected continuously. The data is time-stamped and channel-stamped. The presence of the STB parser 44 allows the user to retrieve data from the data buffer 46 immediately. When the STB 36 receives a request regarding a specific channel and time from the portable device 20, the data buffer 46 contains desired data. In this way, the data is immediately available for the request and the user appears to be receiving a response in real time. In another embodiment, the data may be continuously communicated from the decoder 42 to the mobile device 20 and made available to the user's request rather than in an external buffer.

  The data buffer 46 can store different classes of data in different periods. The buffer 46 may store EPG data endlessly, but may store individual specific programs or program content data for a limited period. The storage period may be fixed or customized by the user. In one embodiment, EPG or program data is stored endlessly until deleted by the user. In another embodiment, EPG data is erased upon receipt of a predetermined trigger (such as a time limit or power down). Storage of program data may be realized in the same manner or by adding functions. In one embodiment, program data is erased from buffer 46 upon termination of the program. In another embodiment, the program data is erased when the user selects another broadcast channel. Note that many embodiments of the behavior of the data buffer are conceivable, and the present invention is not limited to the above-described several embodiments.

  Before data is transferred to the portable device 20 through the wireless interfaces 29A and 29B (eg, Bluetooth or IEEE 802.11b), the data may pass through the data formatter 48. Data formatter 48 reformats the data to match different types of media and communicates the results. The data formatter 48 allows the mobile device to use a wider variety of media formats.

  The user command processor 50 processes commands and requests from the portable device 20. The command processor 50 receives commands from the radio interfaces 29A and 29B. When the processor 50 receives a command requesting data, the correct data is retrieved from the data buffer 46 and retransmitted to the portable device 20 through the wireless interfaces 29A and 29B. When processor 50 receives a command to control a television, VCR, or DVD player, the appropriate command is sent to an infrared (IR) transmitter 60.

  The IR transfer device 60 allows the portable device to control the functions of the television, VCR, DVD player, and other devices. The IR transmitter 60 is provided at a place where it can efficiently communicate with any desired electronic device. Although IR transmitters have relatively inconvenient constraints, by providing IR transmitters, not only applications, but also users can use any of the constraints within the constraints of wireless interfaces 29A and 29B (Bluetooth or IEEE 802.11b). Commands and requests can be sent to the electronic device even from a location.

  Data can be received from analog or digital broadcast channels. Another embodiment described below relates in particular to the handling of analog broadcasts or VBI data. One skilled in the art will recognize the application of data handling in many cases.

  FIG. 3 shows another embodiment according to the present invention. Existing closed caption (CC) devices are extended to extract all VBI data to form an integrated CC / VBI decoder 62. The integrated decoder 62 can transmit the decoded CC / VBI data from the television 52 to an external device through a general purpose data port (GPDP) 64. FIG. 3 shows this embodiment in which the external device is illustrated as STB 36. Note that another external device may be used as the STB 36. In one embodiment, the unified decoder 62 transmits data directly to the mobile device 20 according to the present invention.

  FIG. 4 shows another embodiment of the unified decoder 62. The unified decoder 62 transmits data to one or more media bridges 66 through the GPDP 64. The media bridge 66 includes a data formatter 68 and a media interface 70. Data formatter 68 reformats the data stream received from unified decoder 62 and adapts it to the desired media interface 70. Once reformatted to the desired media type, the data is transmitted to the desired external device through the media interface 70.

  FIG. 5 shows an STB 36 incorporating a CC / VBI decoder. The STB 36 functions substantially the same as that shown in FIG. 2, but a switch 72 is incorporated. The switch 72 can receive data from either the VBI decoder 42 and the GPDP 64 in the television or other external device. The GPDP 64 sends data to the STB switch 72 that can transmit data to the VBI data buffer 46. In one embodiment, the switch 72 is controlled by the user through a command on the mobile device 20. In another embodiment, the switch 72 can determine what type of data is to be received and operates automatically according to its content. In any embodiment, switch 72 may be automatic or manual, and may be implemented using software, hardware, an external switch, or any combination thereof.

  Note that the tuner 38, the demodulator 40, and the CC / VBI decoder 42 may be constantly incorporated in the STB 36, or may be arbitrarily removable plug-in cards or modules. In one embodiment, multiple modules may be used in each separation module that includes separate independent elements (such as a tuner, demodulator, GPDP interface or decoder).

  FIG. 6 shows the STB 36 and the portable device 20 according to the second embodiment. The second embodiment is similar to the first embodiment shown in FIG. 2, but the second embodiment specifically handles digital broadcast signals. The STB 36 includes a digital tuner 74, a demodulator 76 that outputs a transport stream (TS) from a digital broadcast signal, and a TS decoder 78 that separates the transport stream into a data section and an audiovisual (A / V) section. ing. The data section obtained from the transport stream is cached in the data buffer 86. The A / V section obtained from the TS decoder 78 can be decoded using the AV decoder 80. Digital A / V data obtained from the AV decoder 80 is transmitted to the digital TV set 84 through a standard digital port such as DVI (digital visual interface) or HDMI (hight definition multimedia interface). Alternatively, the A / V data obtained from the AV decoder 80 is encoded by the NTSC / PAL encoder 82, and the encoded analog signal is transmitted to the analog TV.

  The second embodiment also includes a data buffer 86, a data parser 88, a command processor 94, a data formatter 90, an IR transfer device 96, and a wireless interface 92. Once the data is input to the data buffer 86, the data operation and the process of transmitting the data to the portable device 20 are performed as shown in FIG. The portable device 20 according to the second embodiment is the same as that according to the first embodiment.

  Note that all the functions (including redundant ones) are realized on the portable device, but may be realized on a separate device. In one embodiment, the portable device includes a user interface, a wireless interface, and a display. All non-GUI applications, data management, and decoding capabilities are on a separate device such as STB 36. In another embodiment, all non-GUI applications, data management, and decoding capabilities are built into the television and the portable device operates only as a means of displaying data to the user. In such a system, any function of the STB 36 is incorporated in the television. In yet another embodiment, the mobile device comprises an Internet gateway and all supplemental data related functionality resides elsewhere. Many combinations of function assignments within the system architecture are possible, and the present invention is not limited to that described above.

  In the present invention, supplementary data is used, and in addition, VBI data or TS data is used. Data in such a format is information that is embedded in the video signal itself and transmitted along with the video signal. As such a method of embedding supplemental data in a video signal, the technique disclosed by Broughton et al. In US Pat. No. 4,807,031 is currently known. Another way to supply supplemental data is to transmit supplemental data simultaneously on different channels. This method is also known.

  The description of the invention is merely exemplary in nature. Accordingly, variations that do not depart from the essence of the invention are within the scope of the invention, and such variations do not depart from the essence and scope of the invention.

FIG. 1 is a diagram showing an embodiment of a portable control device according to the present invention. FIG. 2 is a diagram illustrating an embodiment of a system architecture according to the present invention. FIG. 3 is a diagram showing an integrated closed caption device capable of extracting all VBI data in analog broadcasting and displaying the VBI data on an external device through a general purpose data port. FIG. 4 is a diagram illustrating an integrated data formatter that reformats data from a general purpose data port and is compatible with various media interfaces. FIG. 5 is a diagram illustrating a set top box capable of processing both data from an integrated VBI decoder and extended closed caption data obtained from an external source through a general purpose data port. FIG. 6 is a block diagram illustrating the detailed operation of the portable device and the set top box of FIG. 2 according to the second embodiment of the present invention.

Claims (30)

A television entertainment system capable of two-way communication with a portable remote device accessing an external information source,
A television receiver for receiving television program content;
A television set top box for receiving program related information through a broadcast channel and transferring the program related information to the portable remote device;
A television entertainment system characterized in that the portable remote device visually indicates information received through a broadcast channel and synchronizes the provision of the program related information and the provision of related information from the external information source. . The television entertainment system of claim 1.
The television set top box is
A television entertainment system comprising a VBI data formatter that reformats VBI (vertical blanking interval) data to accommodate different media formats and the portable remote device to accommodate various media formats. The television entertainment system of claim 1.
The television set top box is
A command processor that receives a command requesting VBI data, retrieves the requested data from the VBI data buffer, and transfers the data to the portable remote device through a wireless interface;
The television entertainment system, wherein the processor receives a command for controlling a remotely controllable device and sends an appropriate command to the infrared transmitter. The television entertainment system of claim 1.
The television set top box is
A television entertainment system comprising a tuner tuned to a specific channel of a television broadcast signal. The television entertainment system of claim 1.
The television set top box is
A television entertainment system comprising a demodulator for demodulating a channel of a television broadcast signal. The television entertainment system of claim 1.
The television set top box is
A television entertainment system comprising a VBI decoder for receiving a television channel and decoding VBI data transmitted in the channel. The television entertainment system of claim 1.
The television set top box is
A television entertainment system comprising a VBI parser that continuously collects VBI data and stores it in a VBI data buffer. The television entertainment system of claim 1.
The television set top box is
A television entertainment system comprising a pluggable tuner and a decoder module. The television entertainment system of claim 1.
The television set top box is
A television entertainment system comprising a switch for sending VBI data between a VBI data buffer and a media device. The television entertainment system of claim 1.
The television set top box is
A media bridge having a data formatter and a media interface, wherein the data formatter reformats a data stream received from a unified decoder to conform to the media interface;
A television entertainment system, wherein once the data is reformatted into a predetermined media format, the data is transferred to an external device through the media interface. The television entertainment system of claim 1.
The portable remote device is:
A television entertainment system comprising a VBI buffer manager that governs interaction between the portable remote device and a remotely controllable device. The television entertainment system of claim 11.
The buffer manager
VBI parser,
A VBI buffer containing the time and channel recorded content;
(A) a fixed duration,
(B) user customizable duration,
(C) Data erase command issued by the user,
(D) data erasure due to channel switching,
(E) data erasure due to the end of the television program, and
(F) Data deletion due to trigger input,
A television entertainment system for forcibly removing data from the buffer based on at least one of the following: The television entertainment system of claim 1.
The portable remote device is:
A first input for receiving information from an external source;
A second input unit for receiving program-related information;
A user interface application that receives user input;
The apparatus retrieves the program information in response to a request from a user. The television entertainment system of claim 1.
The portable remote device is:
A synchronization engine that synchronizes VBI data with the content downloaded from the external information source;
A television entertainment system characterized in that it allows a user to receive information relating to a real-time supplemental program listing and the program being viewed. The television entertainment system of claim 1.
The set top box is
With digital tuners,
A demodulator that outputs a transport stream from a digital broadcast signal;
A television entertainment system comprising a transport stream decoder for dividing the transport stream into a data section and an audiovisual section. The television entertainment system of claim 15.
The set top box is
A television entertainment system comprising a data buffer for caching the transport stream. The television entertainment system of claim 15.
The set top box is
A television entertainment system comprising an audiovisual decoder for decoding the audiovisual section. The television entertainment system of claim 17.
The set top box is
A television entertainment system comprising a digital port for transmitting the audiovisual section to a digital television. The television entertainment system according to claim 17.
The set top box is
A television entertainment system comprising a digital-to-analog encoder that encodes the audiovisual section and communicates the section to an analog television. A method for providing information to a television viewer through a portable device, comprising:
Receiving program information retrieved from a television broadcast channel;
Accessing additional information through external sources;
Identifying related information from the additional information based on the program information;
And providing the program information and the related information to a user at the same time. The information providing method according to claim 20,
An information providing method comprising the step of receiving the television broadcast signal. The information providing method according to claim 20, wherein
An information providing method comprising the step of extracting program information from a channel of the television broadcast signal. The information providing method according to claim 20, wherein
An information providing method comprising: transmitting the program information from a set-top box to a portable device that accesses the external information source. The information providing method according to claim 20, wherein
Continuously decoding VBI data;
And a step of buffering the VBI data as the program information. The information providing method according to claim 20, wherein
An information providing method comprising a step of formatting VBI data and making it correspond to various formats of additional data. The information providing method according to claim 20, wherein
An information providing method comprising a step of sending VBI data between a VBI data source and a media device. The information providing method according to claim 20, wherein
An information providing method comprising a step of extracting a transport stream from a digital broadcast signal. The information providing method according to claim 27,
An information providing method comprising a step of dividing a transport stream into a data section and an audiovisual section. The information providing method according to claim 28, wherein:
An information providing method comprising: caching the audiovisual section. The information providing method according to claim 27,
An information providing method comprising the step of decoding the audiovisual section.

Images