TW518890B - System and method for automatic content enhancement of multimedia output device - Google Patents

Abstract

A media display system enhances content by recognizing patterns in the media signal and modifying the media signal responsively to the recognized patterns. For example, in a television broadcast environment, the media signal could be a television program. At one instant, the television could include a logo of a car company. The system would recognize the logo and correlate it with enhanced content stored locally or by using additional input. Based on user preferences (e.g., whether the user is interested in that particular car company) and the correlated enhanced content, the system would modify the broadcast signal in appropriate way. For example, the enhanced content could be a commercial video clip or the phone number of a local car dealer. The modification to the broadcast signal could, in such a case, include overlaying the local car dealer's number on the video signal or buffering the broadcast signal and playing the commercial video clip to perform content enhancement.

Description

518890

V. Description of the invention (1) The scope of the present invention The present invention relates to a video system for identifying patterns in digital images, especially doramin and alpha, isolation symbols or continuous symbols (for example, text characters in a video data stream and / or Trademarks) and display information or play back the system of the day of the symbol μ β u ^ a ^ m DING Guanzhi according to user preferences. The present invention also relates to a system for preparing audio input, such as lines, music, or other sounds used to process audio input, such as lines, music, or other sounds. To respond to audio input.

Those skilled in the art ρwai A, > Know the text recognition in this document. Fu jealousy can be identified by similar techniques.今 # ^ rnrp. „^ P ^ ^ Document readers and associated Optical Character Recognition (OCR) software have been widely used, _, t. Darwin is known to all. However, for text in video frames The detection and recognition of θ ^ ^ ^ ^ and other characters is still a unique problem, and it is completely different from the oblique < method. The squared text of the "Πί" detection and recognition in printed documents, and In the single-hearted, L /, and -three-way threshold algorithm that separates text from the moon on a -through background (pure paper). In contrast, f, // X ,, in small video images The symbol will encounter a variety of cloth floods, including lighting conditions that are not exaggerated, and that the background is often shifted, and the number may not be ... etc. + 冋Color, size, orientation, font style, etc. Φ The background of the invention provides viewers with educational arts including: a few examples of real-time broadcasts, similar value video sources, or repetitions that cause viewers to listen to 4 temples = bands and digital video. These sources can be Informed BMW® dealers 4 or products that might arouse viewers to the performance of BMW⑧ cars Interested. For example, 'Video Day

518890 V. Description of Invention (2) Interested or interested in the location of local or domestic BM W⑰ authorized distributor. Viewers may have only a brief interest and soon forget it. Viewers may be reluctant to take action on recent interest, especially if action would interrupt the enjoyment of the current show. For example, displaying the Coca-Cola logo sparked interest in the calories in a 12-ounce can of Coca-Cola, but it was not enough to stimulate viewers to find a piece of Coca-Cola to find this information and satisfy their interest. If you don't start immediately, you will soon forget. SUMMARY OF THE INVENTION Briefly, the present invention discloses a multimedia display system for enhancing content by identifying a pattern in a multimedia signal and modifying the multimedia signal in response to the identified pattern. For example, in a television broadcast environment, the multimedia signal may be a television program. Occasionally, a television may include a trademark of a car company. The system recognizes trademarks and associates them with enhancements stored locally. Based on user preferences (for example, users interested in a particular car company) and associated enhanced content, the system can modify the broadcast signal in an appropriate way. For example, enhanced content might be a commercial or a phone number of a local car dealer. In this case, modifying the broadcast signal may include superimposing the phone number of the local car dealer on the video signal, or buffering the broadcast signal and playing a commercial commercial video. The present invention identifies patterns in video and / or audio, and retrieves and outputs additional information based on the identified patterns. Patterns can be identified using any of a variety of known signal processing techniques. The method of the present invention classifies the patterns, queries the identification categories of the signals in the database, and outputs the corresponding categories.

Page 7 518890 5. The additional content of the invention description (3) and the current video / audio signal to enhance the content. For example, if a car company's trademark is identified in the video stream and its corresponding category is found in the database, the system will find additional information corresponding to the trademark, such as the name and address of a local dealer, and This data is output as overlay text on the video data stream. The system's response can be automated based on user preferences. For example, although a database of symbol categories used by the system may be used to categorize car company trademarks, users may not be interested in cars and will close some general start-ups, so content enhancements will not occur. The user-specific preference setting data can be formed by using a separate database in conjunction with the general classification database. The general classification database contains a large number of symbolic classification data, which contains data that the user is not interested in. Alternatively, a user's personal data can be used to create a database of symbol classifications, so that only the categories of interest to specific users can be stored in the database. The latter item has the advantage of reducing the amount of data stored on the unit. U.S. Patent Application Nos. 0 9/3 7 0, 9 3 1, 0 9/44 1,94 3, and 0 9/44 1,949 published to categorize symbols in video streams (especially text) And text blocks). The aforementioned U.S. patent application numbers will be incorporated herein by reference, as if fully set forth herein. For the purposes of implementing the present invention, the same method of identifying symbols in a video stream or any other suitable method may be employed. Speech recognition is a mature technology area that is constantly improving. Speech-recognizing software has been fully developed to recognize various lines, especially trademark sounds or sounds with well-known features, such as the famous sound of the tiger Tony associated with 榖 breakfast. The same basic technology used for speech recognition is also applicable to classify other sounds. Therefore, it can be divided

Page 8 V. Description of the invention (4) Acceleration sounds of automobile types, content enhancement, jingle of advertising, etc. Knot, and as a picture Dou Guang form. For example, the Internet user can be called to indicate the Internet ^ = sign or synthesized speech dictionaries, etc., in order to provide the system with the permission to use it. Then, Lee Play, such as Web-TV®, and the identified pole = immediately call the linked support. Alternatively, the system can do this by using the < related sound compilation. The system can operate automatically, and the system recognizes the character ^ = The system directly displays the information once, in response to the system identifying the lines and phrases U $ array. Programs can also be used to design the ^ two active modes including all the instructions or ^ day τ automatic response. For example, identifiable musical notes. Displayed ^: Θ The words, trademarks, or a series of textual information, sounds, and sounds may be related to the identified pattern (sound, visual, etc. ^ objects, faces, pictures, or any media can form information Overlaid on :: Other poor news. Content and simultaneous receiving amount ::; The death, so that the audience can continue to receive corruption news stored inside and outside the program. Or, it may automatically buffer the storage of spades and machines so that the extra content will not interfere with the use Those who enjoy continuous acting footage. US Patent Application No. 5, 418, 576 title "Television Receiver with Perceived Contrast — reduction in a Predetermined Area of a Picture where Text is Superimposed" has been published on the day Detailed description of the method. The same technique can be used to insert other visual information, such as pictures, deformations of existing visual information (for example, reliefs of existing visual range on images). The following is an example of the system processing method of the present invention.

518890 V. Description of Invention (5) 1. The audience watched the Mercedes Benz⑧ commercial advertisement on the TV screen. The system uses the video input to identify the Merce c d e s trademark, and displays the latest Merce c d e s car-related information by means of heavy information on the TV screen. 2. The system receives a video input with the text character rMartifl Luther K 1 ng "at the bottom right. The system recognized these characters as names of civil rights leaders and played a sound clip of their "I have a dream" speech. 3. The system receives and processes audio input to identify specific lines, words, or sounds. In one example, processing Inte; [； c〇rp〇rati〇n's trademark soundtrack can trigger the system to capture the names of Intel board members. When voice recognition is converted, the audio input Μ 丨 c 〇 〇 〇 f t⑱ will trigger the system to extract personal information about Wi i 1 1 i a m G a t e s I I I. 4 · Another example is that the system can recognize the face of E i n s t e i n and automatically obtain a link to the website of Physics Web. 5. For example, the source of enhanced content may be Web Uniform Resource Locators (URLs), web pages, movie databases, stock exchange databases, online shopping catalogs, museum information, online bookstores, dictionaries or encyclopedias. According to the user's preference settings, the program can be used to design the display information and different modes to be identified by the system.纟 In some cases, t can be limited to the number of f-modes, so that viewers will not constantly see the poor news that they are not interested in. Such restrictions can be used to limit the number of responses per set time range, or only respond to the specific mode selected. In a specific embodiment, the recognizable pattern ^ = corresponding information stored can be downloaded from the Internet. In this way, you can regularly update the information from external sources to provide viewers with updated information. Available programs

518890 V. Description of Invention (6) To design the system to require users to respond and to enhance the content or update personal information. Alternatively, the system can be programmed to allow users to explicitly set parameters during the installation process. The system can also incorporate software switches that turn this feature off or the login feature so that the system can operate according to the preferences of the currently logged in user. When more than one set of information is available in the single recognition mode, the user can also choose the type of display information to be rotated in each mode. For example, if the system has the identified location information and stock price information of the T f f any, s mode, the system can display one of the available information or both of them according to the user's preference settings. In addition to providing viewers with useful information, for advertisers, the system also has the advantage of showing ads directly to interested users. Therefore, direct advertising information may include special prices for products or services related to the identified patterns. The Internet can be used to manage the content that advertisers pass to the user's Set Top Box through the system. Users dynamically update new content to the video converter. • System service providers can allow dynamic updates by content advertisers and certain display rules. Depending on the season of the season (for example, winter will not store local barbecue contents, ...

And in the summer, the content of the snow removal service is not stored locally), the local content is dynamically controlled according to the advertiser's ongoing advertising campaigns, etc., and according to the user's local preference settings. The system can be changed or the program can be designed to trigger on video or audio input intentionally. Response example Vision 1 / Audio input supplier can provide programs that emphasize recognizable patterns. For example, place the expected

518890 V. Video mode of invention description (7). It can be used as a clickable link to identify enhanced items, that is, items stored locally, connections stored online, and so on. This feature may be affected by the type of display or some other parameter (for example, time, channel, etc.), so it does not appear all the time. For example, when people in an interview program wear designer clothes designed by a particular designer, they can show where to buy the designer ’s goods, or use other links to get relevant information. The invention will be explained by means of preferred exemplary embodiments thereof with reference to the accompanying drawings in order to make the invention more fully understood. Regarding the drawings, it is emphasized that the particular items shown are merely examples and diagrams illustrating the preferred embodiments of the present invention, and are provided to provide the most useful examples and to make it easier to understand the description and Paradigm presented by conceptual point of view. In this regard, no attempt has been made to provide the structural details of the present invention required for a fundamental understanding of the present invention in more detail. The illustrations using the drawings as examples can make those skilled in the art understand that several forms of the present invention can be practically embodied. Brief Description of the Drawings Figure 1 shows a drawing that illustrates components that can be used to implement the invention. … FIG. 2 shows a block diagram of functional elements used to implement the present invention according to a specific embodiment of the present invention. FIG. 3 shows a flowchart of a basic content enhancement method according to a specific embodiment of the present invention. Figure 4 shows a symbolic display image of two identifiable symbols that can trigger content enhancement.

Page 12 518890 V. Description of the invention (8) Figure 5 shows a method for enhancing the display of the content, which is used to display the video on the video without interruption / interruption. Show more like a web site. Figure 6 shows another way to enhance the display of the internal media display, which is used to display a picture-in-picture picture on the video screen. Day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, day, month, month, month, month, month, month, month, month, month, month, month, month, month, month, month, month, month, month, day to day, day to day of the 7th member of the Hiroichi. . ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, During, Up, and Designing the Symbolic Schematic Diagram of the 7Fweb Site, Figure 1, can be used in conjunction with the Internet-enabled power invention. In the example shown in FIG. 1, Xiong Mu 1, Bian, J, and Hongbei, the computer 24 0 transmits the program data Λ to the TV 2 3 0. The computer 240 can receive video signals 270, control them, and provide Internet browser functions. Commands can be downloaded via the magnetic disk 22, remote control 21Q (connected to 215 妾 via infrared (IR)) or the keyboard 212, or via a network connection, and the commands can be entered into the brain 24G. The data link 26G provides an Internet connection, while the antenna, power, 'line or satellite link 270 provides audio and / or video data. This may be a telephone line connected to an Internet service provider or some other suitable lean connection. Please note that data link 260 and audio / video link 270 may include the same physical channel. The computer 240 preferably has a large number of storage devices 2 3 2 (e.g., a ' hard disk drive) for storing program schedule information, application programs, ' and other information. Poor information about user preferences and other data can be uploaded to a computer 2 4 0 via removable media such as a memory card or disk 2 2 0. Please note that there are many alternatives to the previous exemplary hardware environment, and the alternatives described in (5) of 518890 can be used with video converters with processing functions. ^: From use. The computer may have memory instead of a mass storage device. Memory or non-volatile data. In fact, it can be stored locally or remotely to replace the entire computer 24. These, D. . The server operating in the station mode is different from the physical frequency of the video transmission. It is transparent—transmitting commands through the data channel 2 60 (possibly instead of using the remote control 21 ° or the key channel), 2 4 0 . It can be transmitted by cable, satellite, 〃 ^ ° 卩, to the computer channel, or from mass storage, 1RF) or any other physical communication27. Or other content. Can be used or can be: swappable storage media to carry video channels, exchangeable entities such as ATM virtual other networks to carry video 270 or other content. Type 2 and allows missing information, so you can use modern _ 疋 疋 non-other two. The line content that can be used to receive programming content may be audio, chat data, web sites or any other kind of content that may make various choices. . Data can be received through channels other than separate data links 26. For example, data can be received through the same physical channel as video or other content. It is even possible to provide data through a removable data storage device such as a memory card or magnetic disk 22. The remote control 2 1 0 can be replaced with a keyboard, voice command interface, 3D mouse, joystick or any other suitable input device. The choice can be made by moving highlighted indicators, identifying symbolic choices (for example, by name or number), or by data transfer or by batch formation of removable media. In the latter case, one or more of the selected content may be stored in some form or 518890. 5. The description of the invention (ίο) is transmitted to the computer 240, and the display screen is completely ignored. For example, batch data can come from portable storage devices (for example, personal digital assistants, memory cards or smart cards or downloads). Many of these devices may have preferences stored in them to customize the computer equipment to be used. In the specific embodiment of FIG. 1, the advertiser user interface provides data to the host server 75 using the formation of the advertiser client processing sequence 170. The main server sends data to the computer 24 0 for 175, and the computer selectively stores the data on the local data storage, such as disk 2 35. Advertiser client-side processing sequence 170 can be implemented through the operation phase of the Liu browser. During this period, advertisers who want to provide enhanced content through direct-effect advertising channels provided by a specific embodiment of the present invention can upload multimedia content. Content and various control information. The uploaded data is stored on the service master server 75, which is used to control and regularly update the audience system 2000. Qing Cang examines Figure 2 'Some sources 3 丨 〇 will supply video, audio and / or other media shell materials to the output device 3 50. Hard disk video recorder, rewritable video and audio, DVD player (DVD-RW) or WebTV converter or multimedia output combiner / exchange port / ,, 爰 ☆ / Client (Media 〇utpUt c〇mbiner / Switch / Buf / er / Client) 3 9 0 will modify, replace, and / or store multimedia signal functions. $ The video converter (not shown in the figure) connected to the computer 24 0 can provide the latter power. The pay number is classified as 3 3 0 Receives media data and analyzes signals to search for recognizable elements of f. These elements may be graphic images, images, audio sequences, voiceprints, or any other classified signal. The symbol classifier 3 3 0 outputs the category identification item to the enhanced content processor 3 6 0. The user profile database 3 2 0 stores user preferences regarding displayable enhanced multimedia content. example

Page 15 518890 V. INTRODUCTION TO THE INVENTION (11) For example, 'user profile may contain instructions indicating that the user is interested in sports cars and does not mind interrupting the broadcast media in order to receive enhanced content from advertisers involved in sports cars. The enhanced content processor 3 6 0 transmits the category identification items from the symbol classifier to the category / enhanced content relevance database 3 7 0 to find an index of the multimedia content contained in the enhanced content database 3 4 0. The category identifier and the multimedia content indicators included in the enhanced content database 3 4 0 will be combined with the user personal data from the user personal database 3 2 0 to determine whether content enhancement should be performed. This is where the enhanced content processor 36 is responsible for performing the decision and generating the control number ′ to refer to the content and instructions of the enhanced content and the media data to be transmitted to the enhanced content output controller 3 95. Next, the enhanced content output controller 395 uses the enhanced content from the enhanced content database 340 to generate a multimedia output combiner / exchanger 39, which responds to instructions from the enhanced content processor and from Enter a command for device 35 5. Then, the enhanced content output controller 3 9 5 outputs the command of the selected media version of the inner valley and the multimedia output combiner / exchanger M 0, and changes the media data stream before displaying the media on the output device 350 = 2 The user input device 355 also allows updating the user profile in the user profile database 320. … — :? The classifier can use any suitable mechanism to classify media data signals. For example, the US 0 9/3 70, 9 3 1, 0q / 441 n, moon wood “41,94 3 and 0 9/4 4 1,94 9 in the application can be used to divide = = t; the method of symbols (especially text and text blocks), 虻 '$ ^ neutral network methods and systems published in patent applications. g identification is a mature technology field that continuously strives for excellence. Recognizable

Page 16 518890 V. Description of the invention (12) The software for speech has been fully developed to recognize various lines. The symbol classifier 3 3 0 can use the same or related signal processing techniques, for example, a voiceprint technique that can be used to identify particular voices. The category may be a trademark sound or a sound with a well-known feature ' such as the name of a tiger τ ο n y associated with a cereal breakfast. You can also define categories of sounds such as car acceleration, commercial clink, and so on. The user personal database 3 2 0 may contain any one of various user-modifiable parameters that can be used to inform the control processing sequence used in the specific embodiment shown in FIG. 2. The user profile may include any of the following or other applicable parameters. 1) Enhancement technology applicable to various enhanced content types such as web site commercials, text or sound effects editing, for example, personal data may indicate a) whether media data should be buffered and display content changed to call corresponding Web site with multimedia elements; b) when the web site display screen is displayed on the video image, the video image should be made into a background image and be played continuously (see the description of Figure 5); c) then, it should be Place selectable links on the display (for example, using a pointer and buttons on the remote control 2 10); ― 'd) Daytime display (see description for Figure 6) can display additional content, such as business Advertising, web sites, etc. e) Text is best superimposed on high-bandwidth items, such as commercials or interviews 2) Storage options that allow enhanced content to be bookmarked for future display0

Page 17 518890 V. Description of the invention (13) 3) How should the classified items be identified, such as applying a negative filter to a part of the video display and pausing (and buffering the video display, increasing the contrast or Switch to another view. 4) The type of content the user is interested in, such as sports car, beer, wedding, business, technology, literature, weather, etc. a) This may include different levels of interest. For example, users themselves are usually not particularly interested in the weather, and the users may indicate that they will be interested in receiving enhanced content only if the user's local weather report is published. 5) What data sources can be used to capture additional user personal information, for example, a video converter for viewing enhanced electronic program guide information on a TV can store information about program type, time of day, favorite channels and programs, etc. User preferences of, so it can be used to provide data to the user profile 3 2 0. The category / enhanced content relevance database 3 7 0 may be a lookup table data to indicate the correspondence between the identified category and the enhanced content that can be output. The category / enhancement content database 3 7 0 may also include downloading data from the service client server 1 7 5 that originated from the advertiser client process 1 7 0 to indicate certain specific instructions regarding the content, Such as the deadline for the competition, weather conditions should be obtained before the content is turned on (for example, ads for snow removal services will only be displayed when it snows), and so on. The category / enhancement content database 3 70 is responsible for storing data and in this way points to specific items of the enhanced content database 3 40. The enhanced content processor 360 uses instructions from the user's personal data and the category identification items provided by the symbol classifier 360. Enhanced content

Page 18 518890 V. Description of the invention U4) The processor obtains the vector needed to find relevant content data, and provides the vector and control information to the enhanced content output controller 3 9 5. Please refer to Figs. 2 to 6. In step A-1 ', the symbol classifier 3 3 0 is responsible for sampling and processing the media data. At step A-2, the symbol classifier 3 3 0 attempts to classify all or part of the media data 'directly to identify and classify the pattern. In steps A-3, the category identification item is provided to the enhanced content processor 360. Next, in step ^ 4, the enhanced content processor 3 600 applies the user's personal data and category / enhanced content provider data (eg, advertisers) data stored in the enhanced content relevance database 370. Conditions and rules' α decision Is there and what exact content should be used to enhance the media stream. In step A-5, if the right-click-coffee-wide merger control is passed to step A-6, the content is enhanced by the office and the content output controller is controlled by the multimedia output combiner / exchange core and internal output controller 3 9 5 Responsible for controlling the instruction to enhance the multimedia signal client 39 °, so as to identify and supply the enhanced content processor 3 6 0 according to the car company in the media materials. Π ... will identify the category identification items / enhance the content relevance database and approve users ’personal data bases 3 2 0 and the category can be Web site overlap 3 25. Or depending on the rules obtained, the weather warning message 315 that can be obtained as a result, the whole screen of the daytime Kui Erguo displays a mosaic pattern, the weather information web site or the web site can be used to display 330 can indicate that you can switch to Extra content. Not another broadcast channel, let viewers please note that, as mentioned above, the concept of augmented, can provide additional multimedia content: the concept can include additional graphics data stream additional options or may be directly in the original media distributor Shima's phone number in response to Fu J :: Can Overlapping Ford's Local Business Advertising or Trademark. Therefore, increase

518890 V. Description of the invention (15) The concept of strong content can include interactive elements, allowing users to control the time selection, content, category, etc. of enhanced content through interactive elements $, in response to the classification of multimedia elements. Therefore, for example, the user can decide whether or not to link to additional weather information by selecting a short link (ριρWindow 33〇) or, = slightly link. Compared with users ignoring the link, if the user chooses ^ knot, more multimedia content will be displayed. In addition, if the link is an online web site, media content will not be provided through the enhanced content database 34. The enhanced content output controller 3 95 will respond to the control parameters provided by the enhanced content processor 36. The control parameters may include the basic processing sequence, followed by = strong content output controller 3 9 5 and a set of indicators to point to specific content items in the enhanced content library 34 0. For example, the basic processing sequence can be reversed == a specific area of the curtain for a specified time to define the optional k 2 on the display, and then touch aweb in the area selected via the input device 3 55 °° = multimedia content may be muscle , Video clips, sounds or a -ii word content together with the details used to modify the media data stream 39, the multimedia output combiner / switcher / buffer / client comes from the debate inside the six strong buffers to the client 39 〇root tf. Buffer media:,; Issue the command of the controller 395, execute the overlapping file ΛΑ for a month, and be used for Internet client service, and the instruction of Tian κ. Scholars, and stand up and serve for 5 weeks. Use the web site to understand μ, Mingsi's enhanced content output controller 395 may pass the above instructions and the media is jealous. This is a group that produces web connections and connections.口 ～ 皇 于田 ° In the initial enhancement content stage, the carving time M will only transmit the materials and instructions used to define the overlapping distance M 1 & After receiving ^ ^ & Μ 内 and the connected media received via the input device 355 518890 V. Invention Description (16), then further content such as UR L is output to the multimedia output combiner / exchanger / Buffer / user end 3 9 0. Please note that the present invention can be implemented using various input and output devices. The input device 3 5 5 may be a light pen, a TV-type remote control, a keyboard, a mouse, or any other suitable device for generating commands. Output device 350 may be a television, monitor, video wall, broadcast or multicast channel, chat client, Internet console, or any other suitable device. Media data can include any type of information content, including text, video, audio, live data from CCTV systems, chat data, IP packets, and more. The output device 350 may also include more than one physical device. For example, there may be multiple monitors, one of which is used to output enhanced content and the other is used to output raw media material. Please note that the Enhanced Content Processor 360 can use other materials 332 to make decisions. For example, electronic program guide material may indicate the program type of a media stream (for example, a comedy television broadcast). Other materials that may be relevant to the decision to supply enhanced content can include the time of day, the days of the month, the current weather, the name of the advertising item appearing in the multimedia signal, and so on. Note that processing of video or other on-demand information can be performed as a post-processing sequence rather than on the client (for example, a remote terminal or a television video converter near the viewer). In this type of implementation, only the control information needs to be transmitted to the client process, and processing and storage capacity can be reduced. That is, all possible symbol classes and information used to classify the original data can be stored on the back-end processor. Only the data necessary to produce content enhancements need to be transmitted. Any suitable processing sequence can be used, such as

Page 21 518890 V. Description of the invention (17) Video watermarking and interpolation enhancement as embedded MPEG-7 and ATSC (meta) standards to convey the details of skilled artisans' implementation and integration, without losing sight. The scope of the present invention is as shown in the attached application. Therefore, all changes of the present invention are possible. Data into vertical blanking intervals, etc.) to transmit content control information. It is also possible to relay control data via XML or other media data packets such as DVB, etc. It should be understood that the present invention is not limited to the specific embodiments described above and it should be understood that the invention may take other specific forms to depart from the spirit or essential characteristics of the invention. Therefore, the embodiments should be regarded as illustrative rather than limiting. The patent scope of the present invention is shown instead of the foregoing description. The invention includes the same meaning and scope as the scope of patent application. #

Page 22

Claims (1)

518890 Patent Application Steps: A method for enhancing the content of video output, the method includes the following steps: responding to the connection class stream to generate an output 2. If an application identifies a graphic 3. If the application is attached to correspond to See or listen 4. If yes, please recognize the voice. 5 · One kind of use includes: an output, a signal, a signal, and a user's data; a server (175) stores the data of the enhanced content; a strong inner valley shell is loaded into the _user system (2 4 0, labor 7 5); a portion of a media data stream to the client system is used as the person data and the enhanced content data to modify the enhanced media data of the media data; and the enhanced media data stream. The method of item 1 of the patent scope, wherein the classification step includes a pattern (3 1 0, 3 1 5). The method of item 1 of the patent scope, wherein the modifying step includes at least one of the optional links or one of the elements of the web site (325). The method of item 1 of the patent, wherein the classification step includes a system for enhancing the content of the broadcast media data stream, the system package device (230); modification device (2 40, 17 5) is connected to use a media To the output device and used to receive the broadcast data stream; or a personal database (175, 235) to store a user's media content database (175, 235) to store media content items Page 24 518890 VI. Application scope a; a controller connected to the user's personal database and the multimedia content database, and programmed to identify a part of the broadcast data stream; the controller is Programming to control the signal modification device in response to the user's personal data and the media content items. 6. If the system of claim 5 is applied, the broadcast media data stream includes a video data stream, the media content items include text, and the controller is programmed to control the signal modification device for use in the An image corresponding to the text is superimposed on the video data stream. 7. The system as claimed in claim 5, wherein the output device is a television (230). 8. The system of claim 5 in which the broadcast media stream is a television broadcast signal, and the portion includes a portion of the television signal that is usually displayed as a visual element. 9. If the system of claim 5, the output device includes at least two separate video displays, and the multimedia content items are output on at least one of the at least two separate video displays. ... and output the broadcast data stream on the other of the at least two separate video displays. 1 0. A method for enhancing the content of video output, the method includes the following steps: classifying a portion of a media data stream that can be passed to a client system; Page 25 518890 VI. Classification of patent media features in the media data stream; Generate control signals to respond to the classification steps; Modify the media data stream to respond to these control signals and define personal data preferences of user categories ; Output the result of this modification step. 1 1. The method according to item 10 of the scope of patent application, wherein at least one of the control signals is generated on a server (175), and is embedded in the media data stream to pass $ to the user end. 12. A device for displaying media content on a device (23 0), the device includes: Y a pattern classifier, which is connected to receive a media broadcast signal and output a category identification item in response to the media Patterns identified in the broadcast signal; a media content database (175, 2 3 5) containing the media content; a user personal database (175, 2 3 5) to save user preferences Setting data; a controller (240, 175) can be programmed to output the selected part of the media content on the output device in response to the user's personal data and the category identification item. ~ 1 3. The device according to item 12 of the scope of patent application, wherein the controller can be programmed to combine the selected part of the media with the broadcast signal to generate a combined output signal and output to the output device. Page 26