CN101566990A - Search method and search system embedded into video - Google Patents
Search method and search system embedded into video Download PDFInfo
- Publication number
- CN101566990A CN101566990A CNA2008100942888A CN200810094288A CN101566990A CN 101566990 A CN101566990 A CN 101566990A CN A2008100942888 A CNA2008100942888 A CN A2008100942888A CN 200810094288 A CN200810094288 A CN 200810094288A CN 101566990 A CN101566990 A CN 101566990A
- Authority
- CN
- China
- Prior art keywords
- video
- search
- ferret out
- ferret
- embedded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention belongs to the field of picture communication and relates to a search method and a search system embedded into video. In the invention, a search function is embedded into video and television programs to allow the audience watching the television to search information of objects or events in the programs by using a search engine. When the audience is interested in an object or event in a television program and wants to search the information related to the object or event, the audience only needs to click the picture or adopt the voice mode to select a search target and trigger a search request. The search system embedded into video can query the search engine by using proper search keywords to show search results and advertisements aiming at the search target and the search keywords.
Description
Technical field
The invention belongs to field of picture communication, relate to a kind of searching method and system thereof that is embedded in video.
Background technology
Along with universal day by day with broadband access network of developing rapidly of Internet technology, people can be with the powerful various information of the search engine inquiry based on the internet.The interactive television system of Chu Xianing particularly based on the television system (IPTV) of internet, not only can allow spectators watch program in recent years, can also allow they and program interaction.Can buy the commodity that occur in the program by telepilot such as spectators, perhaps check the data of certain athletes.If but when spectators want to search for more information about the object that occurs in the program or incident, also do not have a kind of technology can allow them now in the search engine inquiry information needed that need not to interrupt to use quickly and easily under the condition of program viewing based on the internet.Spectators need be interrupted program or after program finishes, be opened the search of computer internet usage at present.More crucial is, spectators can not describe their interested object or the incident of making that they see definitely in program under many circumstances, so also can't search for search engine with appropriate keyword.
Another deficiency of existing television system is that the effect of present television advertising is not fine.No matter be traditional commercial breaks, be superimposed upon the display advertising on the screen, still emerging interactive type advertisement all can not attract spectators' notice effectively, and frequent advertisement meeting causes spectators' dislike.
Summary of the invention
The objective of the invention is at the deficiencies in the prior art, a kind of searching method that is embedded in video and system thereof that makes video and the better combination of network is provided.When spectators interested in and want to search for it for information about the time certain object in the TV programme or incident, they only need with clicking picture or selecting ferret out and trigger searching request with voice mode, the search system that is embedded in video of the present invention is used appropriate searching key word query search engine, display of search results and at the advertisement of ferret out and searching key word.
The searching method that is embedded in video of the present invention comprises the steps:
(1) video that will play is carried out pre-service,
(2) ferret out is selected: spectators select ferret out in watching the process of program, trigger searching request,
(3) ferret out is confirmed: system determines the ferret out that spectators select, and distinguishes a plurality of ferret outs where necessary,
(4) system is with appropriate searching key word query search engine, display of search results and at the advertisement of ferret out and searching key word.
The aforesaid searching method that is embedded in video, wherein, step (1) carries out comprising in the pre-service to the video that will play
(1.1) definition ferret out,
(1.2) be ferret out definition searching key word.
The aforesaid searching method that is embedded in video, wherein, the employing of step (1.1) definition ferret out is carried out based on the mode that ferret out appears at the position on the screen.
The aforesaid searching method that is embedded in video, wherein, step (1.1) definition ferret out adopts the mode of the period that occurs in video frequency program based on ferret out to carry out.
The aforesaid searching method that is embedded in video, wherein, step (1.1) definition ferret out adopts based on the mode that shows the ferret out snapshot on screen and carries out.
The aforesaid searching method that is embedded in video, wherein, step (1.1) definition ferret out adopts and carries out based on the mode of speech recognition.
The aforesaid searching method that is embedded in video, wherein, step (2) ferret out is selected and step (3) ferret out affirmation employing is carried out based on the mode that ferret out appears at the position on the screen.
The aforesaid searching method that is embedded in video, wherein, step (2) ferret out is selected and step (3) ferret out confirms to adopt the mode of the period that occurs in video frequency program based on ferret out to carry out.
The aforesaid searching method that is embedded in video, wherein, step (2) ferret out is selected and step (3) ferret out confirms to adopt the mode based on show the ferret out snapshot on screen to carry out.
The aforesaid searching method that is embedded in video, wherein, step (2) ferret out is selected and step (3) ferret out affirmation employing is carried out based on the mode of speech recognition.
The aforesaid searching method that is embedded in video, wherein, step (3) ferret out confirms that employing mode of display menu on screen is distinguished a plurality of ferret outs where necessary.
The search system that is embedded in video of the present invention comprises display device, input equipment and interdynamic video server.Comprise video processing module in the interdynamic video server, database module, input processing module and search server module; Wherein video processing module is used for the formation of encoding and decoding of video and figure, and the image information of formation shows by display device; Database module is used for the information of stored search target; Input processing module is used to handle the input information of input equipment; The search server module is used for sending searching request and handling the Search Results that returns to search engine.
The aforesaid search system that is embedded in video wherein, also comprises the part that is used for processed voice input and speech recognition in the input processing module.
The aforesaid search system that is embedded in video, wherein, the interdynamic video server is connected with search engine by network.
The aforesaid search system that is embedded in video, wherein, the interdynamic video server is connected with Advertisement Server by network.
Use effect of the present invention to be: function of search is incorporated in video and the TV programme, allow spectators when watching TV with the object in the search engine searches program or the information of incident, make the spectators can be better and program interaction, also can allow spectators carry out program request or search more easily.
Description of drawings
Fig. 1 is the structural representation that is embedded in the search system of video provided by the invention;
Fig. 2 is the schematic flow sheet that is embedded in the searching method of video provided by the invention;
Fig. 3 is the picture that has certain personage in the TV programme;
Fig. 4 is to having the picture of display result after the personage searches among Fig. 3;
Fig. 5 is a tv programme picture that has Search Results;
Fig. 6 is one and has the tv programme picture that can search for the object snapshot in the lower left corner;
Fig. 7 is the picture that certain personage wears dress ornament in the TV programme;
Fig. 8 is the picture that has display result after the dress ornament that occurs among Fig. 7 is searched for;
Fig. 9 is one and has a plurality of tv programme pictures of searching for object;
Figure 10 is a tv programme picture that has search column and dummy keyboard.
Among the figure: 1. display device, 2. input equipment, 3. interdynamic video server, 4. search engine, 5. Advertisement Server, 6. video processing module, 7. database module, 8. input processing module, 9. search server module
Embodiment
Describe in further detail implementing the present invention below in conjunction with accompanying drawing.
The interdynamic video system that contains embedded search engine as shown in Figure 1 comprises a display device 1, one or more input equipments 2 and an interdynamic video server 3.Wherein display device 1 can be any display monitoring of a televisor, computer monitor, touch-screen or other system, input equipment 2 can be a dummy keyboard on mouse, telepilot, common keyboard or the screen, be connected with speech recognition system and can accept the microphone of spectators' voice, or integrated demonstration/input equipment such as touch-screen, interdynamic video server 3 can be a computer, top box of digital machine, digital video recorder (DVR) or other any equipment that can handle interactive television signal.Interdynamic video server 3 is connected to a search engine 4 and an Advertisement Server 5 by a wired or wireless network.Search engine 4 can be selected the general search engine, and the special search engine of databases such as retailer stock or publisher's catalogue also can be selected to be used to search for by for example Google (Google) or Baidu (Baidu).The effect of Advertisement Server 5 is to add ad content in the information that searches.Advertisement Server 5 is used to produce the ad content that need be presented on the display device 1, it is not an essential equipment among the present invention, because the large-scale search engine as the Google has had and the similar function of Advertisement Server efficiently, it can dynamically generate the advertisement at searching key word.When using Google or search engine similar with it, the advertisement that can directly they be generated is presented on the screen with Search Results, need not to set up specially an Advertisement Server in this case.Above-mentioned parts can be combined into one or more equipment; Such as display device 1, input equipment 2 and interdynamic video server 3 can be combined into an equipment, for example multimedia computer, mobile phone or Digital Television of new generation.
Aforesaid interdynamic video server 3 comprises video processing module 6 at least, database module 7, input processing module 8 and search server module 9; Wherein video processing module 6 is used for the formation of encoding and decoding of video and figure; Database module 7 is used to store the information (this paper can search for object or incident is referred to as ferret out) that can search for object or incident, comprise the position that they occur on screen, time, searching key word of their correspondences and the synonym phrase that is used for speech recognition, and their snapshot; Input processing module 8 is used to handle spectators' input information, and input processing module 8 can also comprise the part that is used to discern spectators' phonetic entry when in the input equipment voice-input device being arranged; Search server module 9 is used for sending searching request and handling the Search Results that returns to search engine 4.Video processing module 6 is common computers, set-top box, or the standardized component in the digital video recorder.Database module 7 is made up of a plurality of image data bases and text database.Text database can be a SQL database, also can be plaintext form.The part of identification spectators phonetic entry can be used commercial speech recognition software in the input processing module 8, perhaps discloses source code software.
As mentioned above, database module 7 is used for the relevant information of stored search target.Wherein, the position that on screen, occurs of image data base memory search target and their snapshot.The searching key word of text database memory search target correspondence and be used for the synonym phrase of speech recognition, and time of on screen, occurring of ferret out.After sending the order of selecting ferret out by certain input equipment as spectators, system uses the Relational database in spectators' the input information data query library module 7, and then the ferret out selected of definite spectators.For example, appearing at based on ferret out in the method for the position on the screen, after spectators clicked screen, system determined at first spectators have clicked which pixel in which frame picture, inquire about the database of memory search target position on screen then, thereby determine the ferret out that spectators select; In the method for the period that in video frequency program, occurs based on ferret out, after spectators click screen, system determines at first spectators have clicked which frame picture (both having clicked the time of generation), inquire about the database of the time that the memory search target occurs then on screen, thereby determine the ferret out that spectators select; In based on the method that shows the ferret out snapshot, after spectators had clicked the snapshot on the screen, the database of memory search target snapshot can be inquired about by system, thereby determined the ferret out that spectators select; In the method based on speech recognition, system at first discerns spectators' phonetic entry, and the inquiry storage is used for the database of the synonym phrase of speech recognition then, determines the ferret out that spectators select.In case the ferret out that spectators select is determined, system can extract searching key word corresponding with selected target and then query search engine from the database of memory search keyword.
When this system works, meeting displaying video content on display device 1, as shown in Figure 3.When the object that in spectators seek out about program, occurs or the more information of incident, can select this object or Event triggered searching requirement with input equipment 2, for example can be with this object of click, trigger a succession of system response thus: at first, input processing module 8 in the interdynamic video server 3 is handled spectators' input, the clicked object of identification in database module 7, and from database module 7, take out and the corresponding default search keyword of this object; Interdynamic video server 3 submits to this keyword to search for by search server module 9 to search engine then; At last, interdynamic video server 3 is presented in the current video window with stacked system or is presented in another window with Search Results and at the advertisement of clicked object and searching key word.Spectators can select immediately navigate search results or temporarily preserve Search Results so that browse in the future.For example the personage among Fig. 3 is defined as one in advance and can searches for object, and when spectators clicked this personage, interdynamic video server 3 can use predefined searching key word to submit searching request to search engine.Fig. 4 has shown Search Results and the advertisement that is superimposed on the current video window.(what show in Ben Tu and the following texts and pictures all is English Search Results that obtains from the Google website and the advertisement that occurs with " Sponsored Links " form.Television image only is an illustrative purpose among the figure.The copyright of all television images, the trade mark that occurs in the right of signature and the picture, brand all belongs to its corresponding owner.)
A kind of searching method that is embedded in video as shown in Figure 2 comprises the steps
(1) all videos that will play are carried out pre-service, this step comprises again
(1.1) definition ferret out
In order to allow spectators when watching TV, select ferret out to search for, before video program play, need in advance ferret out to be defined.This definition can be to be finished by the professional, also can be finished by spectators oneself, is perhaps made then by the professional earlier and is replenished by spectators, also can finish by some software or program.Which kind of can searchedly be not limited to them as for target.Ferret out can be a material object, such as certain performer or product; Or a non-material object, such as incident, menu or geographic position; Also can be not occur on the TV screen but the things that in program, is mentioned.But the example of search events comprises natural event (such as snowstorm), competitive sports (such as the rugby supercup), or political event (such as presidential election).
The process of a ferret out of definition comprises from video frequency program some relevant informations of extracting this target, then in the database module 7 of these information storage in Fig. 1.The method of definition ferret out can be divided into variety classes as described below again.
(1.1.1) appear at position on the screen based on ferret out.The position that occurs in a ferret out each frame picture in whole program all needs to go on record.Specific practice is: to be incorporated into be a zone to all pixels corresponding with this ferret out in each frame picture, and be stored in the image data base.After disposing, this image data base is writing down the zone (pixel) of each ferret out correspondence in each frame.When spectators clicked any pixel in certain zone, the ferret out corresponding with it can be confirmed to be the target that spectators select.
(1.1.2) period that in video frequency program, occurs based on ferret out.The period that each ferret out occurs in program is noted, and the form which frame is this information occur in this target is deposited in the database.Appear on the screen in 60 seconds that program begins such as a ferret out, (supposing that the TV programme per second has 30 frames) just appears in this target in the 1st frame to the 1800 frames so always.The method is applicable to the ferret out limited amount, occurs the less program of possibility of two above ferret outs in the same picture.Because the method need not the position of record searching target on screen, spectators can search for and be mentioned in program but do not appear at the information of the ferret out on the screen, also can search for the information of many other types.Can search for background information relevant in the news program such as spectators, or search for the more information of recommended certain menu in the cook-in with certain bar news, or the more information at certain sight spot that is mentioned in the search tourism program.Fig. 5 has shown the example of this type of search.It is the picture that intercepts from the news program of report Asia tsunami in 2004, and this tsunami is defined as a ferret out.Shown among the figure with " Tsunami " (name of tsunami) and done Search Results and the advertisement that keyword obtains.
(1.1.3) based on the snapshot of ferret out.Very little or mobile very soon on screen when the ferret out in the TV programme, when perhaps screen change was very fast, spectators were difficult to follow the tracks of and click ferret out with the click mode.In case ferret out disappears from screen, spectators just can not click again.For addressing these problems, this step allows spectators any time in watching the video frequency program process select ferret out with the mode of the snapshot that shows ferret out.In the video program production process, the snapshot of ferret out (snapshot can be a representational frame picture that intercepts from program) is concentrated to be stored in the image data base.In the playing programs process, the snapshot of ferret out and one group of corresponding with it searching key word are displayed in little browse window of bottom of screen.Spectators can browse all snapshots soon with telepilot or mouse, click the corresponding with it searching key word search respective objects of snapshot or certain then.For example Fig. 6 is a picture that intercepts from certain TV play, and the actor among the figure is defined as a ferret out.The browse window in the screen lower left corner has shown this actor's snapshot and the searching key word corresponding with him " Tony Soprano " (name of actor in TV play) and " James Gandolfini " (name of playing the part of the performer of " Tony Soprano ").
(1.1.4) based on the phonetic entry of discerning spectators.The present invention also incorporates speech recognition technology in the interactive television system, allows spectators use voice command selection ferret out.In the program making process, each ferret out and one group of nearly adopted word or phrase are mapped, and are stored in the database.Such as the ferret out among Fig. 4 " Tony Soprano " (name of actor in TV play) corresponding to four near synonym: " Tony Soprano ", " Tony ", " Soprano " and " James Gandolfini " (name of playing the part of the performer of " Tony Soprano ").When spectators say any one word or phrase, be the near synonym corresponding if speech recognition engine can be confirmed spectators' phonetic entry with certain ferret out, this ferret out can be confirmed as the target that spectators select.
(1.2) be ferret out definition searching key word
After step (1.1) definition ferret out is finished, also to be each ferret out definition last set keyword, and be stored in the database in the database module 7.Different spectators may want to inquire about the information of the different aspect of a ferret out, therefore need be for a ferret out define several different searching key words, and one of them is defined as the acquiescence keyword.The ferret out in Fig. 7 for example, what the actor in the prospect wore has a plurality of searching key words a cover western-style clothes, comprises " in men's style western-style clothes ", " Italian western-style clothes ", " customized western-style clothes ", " black western-style clothes " and acquiescence keyword " Armani western-style clothes ".After spectators selected this target, the acquiescence keyword " Armani western-style clothes " that system uses it began search.Other searching key word can be presented on the screen with the form of menu, so that spectators further search for, this demonstration can automatically be carried out, and also can carry out under spectators require.Spectators also can the search column on screen in the searching key word of input oneself.The target that interdynamic video server 3 meeting track record spectators select, the keyword of use and the new search keyword of spectators' input.The keyword of spectators' input can be added into the initial key dictionary that defines when replenishing the TV programme pre-service in the database, and the keyword that frequency of utilization is the highest can replace initial acquiescence keyword.The synonym of using in the method based on speech recognition also can be added in the keyword database.
(2) ferret out is selected
Spectators can send the order of selecting ferret out by certain input, described input can be undertaken by pointing-input device, as mouse, telepilot, or touch-screen (using optional equipment and software can also allow spectators select ferret out) with the luminous point that laser bar sends; Also can be undertaken, as microphone by voice-input device.With the selection of preceding similar search target a plurality of approach are arranged also:
(2.1) appear at position on the screen based on object.Spectators click with mouse or telepilot can search for object, or directly clicks the touch-screen of broadcast program with finger.Interdynamic video server 3 among Fig. 1 can determine which zone (pixel) in which frame picture and the picture is clicked, determines the selected object searched for thus.In practice of the present invention, when spectators move on to one can search on the object time with the cursor of mouse, system can highlight this object with special color, and its searching key word is listed on the screen.Spectators can click this object or its any one searching key word triggers search.
(2.2) period that in program, occurs based on ferret out.Spectators can directly click screen and select ferret out.Interdynamic video server 3 can be determined which frame picture clicked (just clicking the period of taking place), and then determines selected ferret out.
(2.3) mode with the snapshot that shows ferret out allows spectators select ferret out.Spectators need not to wait until that ferret out appears on the screen, and can select in any time in the playing programs process.Spectators can click corresponding snapshot and select ferret out then with the snapshot of mouse or telepilot fast browsing ferret out.Interdynamic video server 3 can be confirmed this target.In practice of the present invention, the method can be combined based on the period that ferret out occurs in program with step (2.2), show the snapshot of the ferret out that occurs in the current screen at the snapshot browser window.Like this, but spectators can know that object or incident on the current screen are ferret outs.
(2.4) based on speech recognition.Spectators can select ferret out in any time in the playing programs process, and do not need pointing devices such as mouse or telepilot.Title or synonym that spectators can say ferret out start search.Microphone can be caught spectators' voice and voice signal is imported speech recognition part in the input processing module 8 among Fig. 1.If the voice signal of input is identified as the synonym of certain ferret out, this target promptly is confirmed to be the selection that spectators make.In practice of the present invention, can allow spectators select ferret out to combine with the mode of the snapshot that shows ferret out the method and (2.3), circulation shows the snapshot of ferret out and their searching key word lentamente in the Photo Browser window.When spectators saw the snapshot of interested ferret out, available voice command triggered search.
(3) ferret out is confirmed, and distinguishes a plurality of ferret outs where necessary
After spectators had selected ferret out, system need confirm the target that spectators select, and this process is described in detail in step (2) ferret out is selected.Under the method for the above-mentioned period that occurs in program based on ferret out, if comprise two or more ferret outs in the picture that spectators click, which target what interdynamic video server 3 can't judge that spectators select is.For addressing this problem, interdynamic video server 3 can show might target title and point out spectators to click selected target.Shown a width of cloth picture in certain TV play such as Fig. 9, comprising two can search for object: two personages in the play: " Tony Soprano " and " Christopher Moltisanti ".When spectators clicked this picture, which personage that interdynamic video server 3 can't judge that spectators select was, so listed file names with two names on screen.Spectators can click one of them and trigger search.Similarly, under method based on speech recognition, when the word of saying as spectators is the synonym of two or more ferret outs, interdynamic video server 3 can show might target title and point out spectators to read selected target.In addition, interdynamic video server 3 can also show might target snapshot, make things convenient for spectators to specify selected target.
(4) query search engine and display of search results
In case the ferret out that spectators select is identified, the search server module 9 among Fig. 1 will use the default search keyword to one or more search engines, as Google (Google) and Baidu (Baidu), submits searching request to.The default search keyword can be presented in the status bar on the screen, shows that system searches for.Search Results and can show in many ways at the advertisement of ferret out and searching key word such as being presented in the new window, or be presented in the wicket in the current video window, or translucent mode is superimposed upon in the current video window.Spectators can select navigate search results and advertisement immediately, or preserve and to browse after Search Results and advertisement are provided with.Because interest or purpose that ferret out that spectators select and used searching key word have disclosed them are therefore very targeted based on the advertisement of these ferret outs and keyword, very effective.And this series advertisements only shows with Search Results when spectators search for, so they generally can not cause spectators' dislike.If selecteed ferret out is other searching key word except that the acquiescence keyword in addition, these keywords can be advised as search automatically or through being presented at after the viewer request on the screen.Spectators can click any one search suggestion of listing and further search for.System can also comprise that a search column allows spectators to use common keyboard or on-screen virtual keyboard inputted search keyword, as shown in figure 10.Fig. 7 has shown the width of cloth picture in certain TV play.The object searched in the picture is the western-style clothes that the role wore in the prospect.When spectators clicked this western-style clothes, interdynamic video server 3 can use default search keyword " Armani western-style clothes " to search for, and this keyword is displayed in the status bar of screen below.Search result corresponding and advertisement and relevant search suggestion are displayed in the stack window on the screen, as shown in Figure 8.
Large-scale search engine as Google (Google) can be searched for and comprise the general internet page or leaf, image, video, news, map, or plurality of kinds of contents such as product.In a kind of practice of the present invention, search server 9 can be searched for plurality of kinds of contents automatically and the best search result in the various contents be made up (for example, search server 9 can return first Search Results in every kind of content and combine as total Search Results).In another kind of practice, in step (1) video preprocessor was handled, the defined object of searching for can be divided into different types with incident, such as news category, and position class, product class etc.Search server 9 can be searched for content corresponding according to the type of selecteed object or incident in Google (Google).Such as spectators want to search for news program in the relevant report of certain bar news, search will be pointed to Google (Google) news.Spectators want to search for the position in the dining room of mentioning in certain program for another example, and search will be pointed to Google (Google) map.Search server 9 also can be submitted inquiry to special search engine according to selecteed type of searching for object.Selected certain these books of mentioning in the program such as spectators, search server 9 just can be submitted searching request to online books retail merchant's inquiring stock system.
Claims (17)
1. a searching method that is embedded in video comprises the steps
(1) video that will play is carried out pre-service,
(2) ferret out is selected: spectators select ferret out in watching the process of program, trigger searching request,
(3) ferret out is confirmed: system determines the ferret out that spectators select, and distinguishes a plurality of ferret outs where necessary,
(4) system is with appropriate searching key word query search engine, display of search results and at the advertisement of ferret out and searching key word.
2. a kind of searching method that is embedded in video as claimed in claim 1 is characterized in that: step (1) carries out comprising in the pre-service to the video that will play
(1.1) definition ferret out,
(1.2) be ferret out definition searching key word.
3. a kind of searching method that is embedded in video as claimed in claim 2 is characterized in that: the employing of step (1.1) definition ferret out is carried out based on the mode that ferret out appears at the position on the screen.
4. a kind of searching method that is embedded in video as claimed in claim 2 is characterized in that: step (1.1) definition ferret out adopts the mode of the period that occurs in video frequency program based on ferret out to carry out.
5. a kind of searching method that is embedded in video as claimed in claim 2 is characterized in that: step (1.1) definition ferret out adopts based on the mode that shows the ferret out snapshot on screen and carries out.
6. a kind of searching method that is embedded in video as claimed in claim 2 is characterized in that: step (1.1) definition ferret out adopts and carries out based on the mode of speech recognition.
7. as claim 1 or 3 described a kind of searching methods that are embedded in video, it is characterized in that: step (2) ferret out is selected and step (3) ferret out affirmation employing is carried out based on the mode that ferret out appears at the position on the screen.
8. as claim 1 or 4 described a kind of searching methods that are embedded in video, it is characterized in that: step (2) ferret out is selected and step (3) ferret out confirms to adopt the mode of the period that occurs in video frequency program based on ferret out to carry out.
9. as claim 1 or 5 described a kind of searching methods that are embedded in video, it is characterized in that: step (2) ferret out is selected and step (3) ferret out confirms to adopt the mode based on show the ferret out snapshot on screen to carry out.
10. as claim 1 or 6 described a kind of searching methods that are embedded in video, it is characterized in that: step (2) ferret out is selected and step (3) ferret out affirmation employing is carried out based on the mode of speech recognition.
11. as the described searching method that is embedded in video of any claim in the claim 1～10, it is characterized in that: step (3) ferret out confirms that employing mode of display menu on screen is distinguished a plurality of ferret outs where necessary.
12. the searching method that is embedded in video as claimed in claim 1 is characterized in that: also comprise the step of generation in the step (4) at the advertisement of ferret out and searching key word.
13. the searching method that is embedded in video as claimed in claim 12 is characterized in that: described advertisement is copy or display advertising or animated advertising or audio advertisement or video ads.
14. a search system that is embedded in video comprises display device (1), input equipment (2) is characterized in that: this system also comprises interdynamic video server (3).Comprise video processing module (6) in the interdynamic video server (3), database module (7), input processing module (8) and search server module (9); Wherein video processing module (6) is used for the formation of encoding and decoding of video and figure, and the image information of formation shows by display device (1); Database module (7) is used for the information of stored search target; Input processing module (8) is used to handle the input information of input equipment (2); Search server module (9) is used for sending searching request and handling the Search Results that returns to search engine (4).
15. a kind of search system that is embedded in video as claimed in claim 14 is characterized in that: also comprise the part that is used for processed voice input and speech recognition in the input processing module (8).
16. as claim 14 or 15 described a kind of search systems that are embedded in video, it is characterized in that: interdynamic video server (3) is connected with search engine (4) by network.
17. a kind of search system that is embedded in video as claimed in claim 16 is characterized in that: interdynamic video server (3) is connected with Advertisement Server (5) by network.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008100942888A CN101566990A (en) | 2008-04-25 | 2008-04-25 | Search method and search system embedded into video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008100942888A CN101566990A (en) | 2008-04-25 | 2008-04-25 | Search method and search system embedded into video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101566990A true CN101566990A (en) | 2009-10-28 |
Family
ID=41283145
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2008100942888A Pending CN101566990A (en) | 2008-04-25 | 2008-04-25 | Search method and search system embedded into video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101566990A (en) |
Cited By (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101883230A (en) * | 2010-05-31 | 2010-11-10 | 中山大学 | Digital television actor retrieval method and system |
| CN101950578A (en) * | 2010-09-21 | 2011-01-19 | 北京奇艺世纪科技有限公司 | Method and device for adding video information and method and device for displaying video information |
| CN102158732A (en) * | 2011-04-22 | 2011-08-17 | 深圳创维－Rgb电子有限公司 | Information search method based on television pictures and system |
| CN102232220A (en) * | 2010-10-29 | 2011-11-02 | 华为技术有限公司 | Method and system for extracting and correlating video interested objects |
| CN102779155A (en) * | 2012-05-31 | 2012-11-14 | 新奥特（北京）视频技术有限公司 | Method for quickly positioning broadcasting information |
| WO2013037081A1 (en) * | 2011-09-12 | 2013-03-21 | Intel Corporation (A Corporation Of Delaware) | Using multimedia search to identify products |
| CN102999489A (en) * | 2011-09-08 | 2013-03-27 | 腾讯科技（深圳）有限公司 | Method and system for image search of community website page |
| CN103051934A (en) * | 2011-10-14 | 2013-04-17 | 中国科学院计算技术研究所 | Intelligent television human-machine interaction method, device and system |
| CN103080935A (en) * | 2010-07-01 | 2013-05-01 | Sk普兰尼特有限公司 | Content search service system and content search service method |
| CN103081497A (en) * | 2010-07-26 | 2013-05-01 | Lg电子株式会社 | Method for operating image display apparatus |
| CN103137043A (en) * | 2011-11-23 | 2013-06-05 | 财团法人资讯工业策进会 | Advertisement display system and advertisement display method in combination with search engine service |
| CN103207862A (en) * | 2012-01-13 | 2013-07-17 | 阿尔卡特朗讯公司 | Method and device for injecting additional information in video |
| CN103235678A (en) * | 2013-03-22 | 2013-08-07 | 东莞宇龙通信科技有限公司 | Display method for background information of specific target in video and video terminal |
| CN103501464A (en) * | 2013-09-24 | 2014-01-08 | 深圳市同洲电子股份有限公司 | Method, terminal, server and system for pushing advertisement |
| CN103533396A (en) * | 2013-09-29 | 2014-01-22 | 乐视网信息技术（北京）股份有限公司 | Video content interaction method, device and system |
| CN103702211A (en) * | 2013-12-09 | 2014-04-02 | Tcl集团股份有限公司 | Television playing content-based advertisement serving method and system |
| CN103823898A (en) * | 2014-03-14 | 2014-05-28 | 联想(北京)有限公司 | Data processing method, device and electronic equipment |
| CN104246755A (en) * | 2012-04-13 | 2014-12-24 | 电子湾有限公司 | Method and system to provide video-based search results |
| CN104618807A (en) * | 2014-03-31 | 2015-05-13 | 腾讯科技（北京）有限公司 | Multimedia playing method, device and system |
| CN105229584A (en) * | 2013-05-29 | 2016-01-06 | 三菱电机株式会社 | Information display device |
| CN105446642A (en) * | 2015-11-13 | 2016-03-30 | 上海斐讯数据通信技术有限公司 | Automatic video content searching method and system and electronic device with touch screen |
| CN105874454A (en) * | 2013-12-31 | 2016-08-17 | 谷歌公司 | Methods, systems, and media for generating search results based on contextual information |
| WO2016179967A1 (en) * | 2015-05-14 | 2016-11-17 | 中兴通讯股份有限公司 | Method and device for searching output image content of videos from set-top box |
| CN106210908A (en) * | 2016-09-12 | 2016-12-07 | 天脉聚源(北京)传媒科技有限公司 | A kind of advertisement sending method and device |
| CN106303640A (en) * | 2016-08-15 | 2017-01-04 | 张伟 | Interaction method of remote controller and smart television |
| CN106570100A (en) * | 2016-10-31 | 2017-04-19 | 腾讯科技（深圳）有限公司 | Information search method and device |
| WO2017084306A1 (en) * | 2015-11-20 | 2017-05-26 | 乐视控股（北京）有限公司 | Method and apparatus for playing key information of video in browser of mobile device |
| CN107203568A (en) * | 2016-03-18 | 2017-09-26 | 百度在线网络技术（北京）有限公司 | The switching method and device of a kind of file playing function and function of search |
| CN107507627A (en) * | 2016-06-14 | 2017-12-22 | 科大讯飞股份有限公司 | Speech data temperature analysis method and system |
| WO2018019028A1 (en) * | 2016-07-26 | 2018-02-01 | 中兴通讯股份有限公司 | Advertisement information pushing method and apparatus, and set-top box |
| CN108184143A (en) * | 2016-12-08 | 2018-06-19 | 腾讯科技（深圳）有限公司 | Obtain the method and device of resource |
| CN108985862A (en) * | 2018-08-24 | 2018-12-11 | 深圳艺达文化传媒有限公司 | The querying method and Related product of elevator card |
| CN109151599A (en) * | 2018-08-30 | 2019-01-04 | 百度在线网络技术（北京）有限公司 | Method for processing video frequency and device |
| CN109697245A (en) * | 2018-12-05 | 2019-04-30 | 百度在线网络技术（北京）有限公司 | Voice search method and device based on video web page |
| CN110909192A (en) * | 2019-11-20 | 2020-03-24 | 腾讯科技（深圳）有限公司 | Instant searching method, device, terminal and storage medium |
| US10984038B2 (en) | 2015-04-14 | 2021-04-20 | Google Llc | Methods, systems, and media for processing queries relating to presented media content |
| US10992993B2 (en) | 2013-12-31 | 2021-04-27 | Google Llc | Methods, systems, and media for presenting supplemental information corresponding to on-demand media content |
| CN117235306A (en) * | 2023-11-13 | 2023-12-15 | 北京师范大学 | Man-machine interactive education video accurate pushing method and system based on artificial intelligence |
-
2008
- 2008-04-25 CN CNA2008100942888A patent/CN101566990A/en active Pending
Cited By (56)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101883230A (en) * | 2010-05-31 | 2010-11-10 | 中山大学 | Digital television actor retrieval method and system |
| CN103080935A (en) * | 2010-07-01 | 2013-05-01 | Sk普兰尼特有限公司 | Content search service system and content search service method |
| CN103080935B (en) * | 2010-07-01 | 2015-07-08 | Sk普兰尼特有限公司 | Content search service system and content search service method |
| CN103081497A (en) * | 2010-07-26 | 2013-05-01 | Lg电子株式会社 | Method for operating image display apparatus |
| CN101950578B (en) * | 2010-09-21 | 2012-11-07 | 北京奇艺世纪科技有限公司 | Method and device for adding video information |
| WO2012037813A1 (en) * | 2010-09-21 | 2012-03-29 | 北京奇艺世纪科技有限公司 | Method and device for adding video information, method and device for displaying video information |
| CN101950578A (en) * | 2010-09-21 | 2011-01-19 | 北京奇艺世纪科技有限公司 | Method and device for adding video information and method and device for displaying video information |
| CN102232220B (en) * | 2010-10-29 | 2014-04-30 | 华为技术有限公司 | Method and system for extracting and correlating video interested objects |
| CN102232220A (en) * | 2010-10-29 | 2011-11-02 | 华为技术有限公司 | Method and system for extracting and correlating video interested objects |
| CN102158732A (en) * | 2011-04-22 | 2011-08-17 | 深圳创维－Rgb电子有限公司 | Information search method based on television pictures and system |
| CN102999489A (en) * | 2011-09-08 | 2013-03-27 | 腾讯科技（深圳）有限公司 | Method and system for image search of community website page |
| CN102999489B (en) * | 2011-09-08 | 2016-08-03 | 腾讯科技（深圳）有限公司 | The picture retrieval method of a kind of community website page and system |
| CN103827859A (en) * | 2011-09-12 | 2014-05-28 | 英特尔公司 | Using multimedia search to identify products |
| WO2013037081A1 (en) * | 2011-09-12 | 2013-03-21 | Intel Corporation (A Corporation Of Delaware) | Using multimedia search to identify products |
| CN103051934A (en) * | 2011-10-14 | 2013-04-17 | 中国科学院计算技术研究所 | Intelligent television human-machine interaction method, device and system |
| CN103137043A (en) * | 2011-11-23 | 2013-06-05 | 财团法人资讯工业策进会 | Advertisement display system and advertisement display method in combination with search engine service |
| CN103207862A (en) * | 2012-01-13 | 2013-07-17 | 阿尔卡特朗讯公司 | Method and device for injecting additional information in video |
| US10791375B2 (en) | 2012-04-13 | 2020-09-29 | Ebay Inc. | Method and system to provide video-based search results |
| CN104246755A (en) * | 2012-04-13 | 2014-12-24 | 电子湾有限公司 | Method and system to provide video-based search results |
| CN102779155A (en) * | 2012-05-31 | 2012-11-14 | 新奥特（北京）视频技术有限公司 | Method for quickly positioning broadcasting information |
| CN103235678B (en) * | 2013-03-22 | 2016-05-04 | 东莞宇龙通信科技有限公司 | The display methods of special object background information and video terminal in video |
| CN103235678A (en) * | 2013-03-22 | 2013-08-07 | 东莞宇龙通信科技有限公司 | Display method for background information of specific target in video and video terminal |
| CN105229584A (en) * | 2013-05-29 | 2016-01-06 | 三菱电机株式会社 | Information display device |
| CN103501464A (en) * | 2013-09-24 | 2014-01-08 | 深圳市同洲电子股份有限公司 | Method, terminal, server and system for pushing advertisement |
| WO2015043415A1 (en) * | 2013-09-29 | 2015-04-02 | 乐视网信息技术（北京）股份有限公司 | Method, device and system for video content interaction |
| CN103533396B (en) * | 2013-09-29 | 2017-03-08 | 乐视网信息技术（北京）股份有限公司 | A kind of video content interaction, apparatus and system |
| CN103533396A (en) * | 2013-09-29 | 2014-01-22 | 乐视网信息技术（北京）股份有限公司 | Video content interaction method, device and system |
| CN103702211A (en) * | 2013-12-09 | 2014-04-02 | Tcl集团股份有限公司 | Television playing content-based advertisement serving method and system |
| CN105874454A (en) * | 2013-12-31 | 2016-08-17 | 谷歌公司 | Methods, systems, and media for generating search results based on contextual information |
| US11941046B2 (en) | 2013-12-31 | 2024-03-26 | Google Llc | Methods, systems, and media for generating search results based on contextual information |
| US10997235B2 (en) | 2013-12-31 | 2021-05-04 | Google Llc | Methods, systems, and media for generating search results based on contextual information |
| US10992993B2 (en) | 2013-12-31 | 2021-04-27 | Google Llc | Methods, systems, and media for presenting supplemental information corresponding to on-demand media content |
| CN103823898A (en) * | 2014-03-14 | 2014-05-28 | 联想(北京)有限公司 | Data processing method, device and electronic equipment |
| CN104618807A (en) * | 2014-03-31 | 2015-05-13 | 腾讯科技（北京）有限公司 | Multimedia playing method, device and system |
| CN104618807B (en) * | 2014-03-31 | 2017-11-17 | 腾讯科技（北京）有限公司 | Multi-medium play method, apparatus and system |
| US10984038B2 (en) | 2015-04-14 | 2021-04-20 | Google Llc | Methods, systems, and media for processing queries relating to presented media content |
| WO2016179967A1 (en) * | 2015-05-14 | 2016-11-17 | 中兴通讯股份有限公司 | Method and device for searching output image content of videos from set-top box |
| CN106294354A (en) * | 2015-05-14 | 2017-01-04 | 中兴通讯股份有限公司 | The searching method of a kind of set-top box video output picture material and device |
| CN105446642A (en) * | 2015-11-13 | 2016-03-30 | 上海斐讯数据通信技术有限公司 | Automatic video content searching method and system and electronic device with touch screen |
| WO2017084306A1 (en) * | 2015-11-20 | 2017-05-26 | 乐视控股（北京）有限公司 | Method and apparatus for playing key information of video in browser of mobile device |
| CN107203568A (en) * | 2016-03-18 | 2017-09-26 | 百度在线网络技术（北京）有限公司 | The switching method and device of a kind of file playing function and function of search |
| CN107507627B (en) * | 2016-06-14 | 2021-02-02 | 科大讯飞股份有限公司 | Voice data heat analysis method and system |
| CN107507627A (en) * | 2016-06-14 | 2017-12-22 | 科大讯飞股份有限公司 | Speech data temperature analysis method and system |
| WO2018019028A1 (en) * | 2016-07-26 | 2018-02-01 | 中兴通讯股份有限公司 | Advertisement information pushing method and apparatus, and set-top box |
| CN106303640A (en) * | 2016-08-15 | 2017-01-04 | 张伟 | Interaction method of remote controller and smart television |
| CN106210908A (en) * | 2016-09-12 | 2016-12-07 | 天脉聚源(北京)传媒科技有限公司 | A kind of advertisement sending method and device |
| CN106570100B (en) * | 2016-10-31 | 2019-02-26 | 腾讯科技（深圳）有限公司 | Information search method and device |
| CN106570100A (en) * | 2016-10-31 | 2017-04-19 | 腾讯科技（深圳）有限公司 | Information search method and device |
| CN108184143A (en) * | 2016-12-08 | 2018-06-19 | 腾讯科技（深圳）有限公司 | Obtain the method and device of resource |
| CN108184143B (en) * | 2016-12-08 | 2020-12-11 | 腾讯科技（深圳）有限公司 | Method and device for acquiring resources |
| CN108985862A (en) * | 2018-08-24 | 2018-12-11 | 深圳艺达文化传媒有限公司 | The querying method and Related product of elevator card |
| CN109151599B (en) * | 2018-08-30 | 2020-10-09 | 百度在线网络技术（北京）有限公司 | Video processing method and device |
| CN109151599A (en) * | 2018-08-30 | 2019-01-04 | 百度在线网络技术（北京）有限公司 | Method for processing video frequency and device |
| CN109697245A (en) * | 2018-12-05 | 2019-04-30 | 百度在线网络技术（北京）有限公司 | Voice search method and device based on video web page |
| CN110909192A (en) * | 2019-11-20 | 2020-03-24 | 腾讯科技（深圳）有限公司 | Instant searching method, device, terminal and storage medium |
| CN117235306A (en) * | 2023-11-13 | 2023-12-15 | 北京师范大学 | Man-machine interactive education video accurate pushing method and system based on artificial intelligence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101566990A (en) | Search method and search system embedded into video | |
| US20180152767A1 (en) | Providing related objects during playback of video data | |
| JP4062908B2 (en) | Server device and image display device | |
| US8355949B1 (en) | Enhanced hyperlink feature for web pages | |
| US20090113475A1 (en) | Systems and methods for integrating search capability in interactive video | |
| US20120167146A1 (en) | Method and apparatus for providing or utilizing interactive video with tagged objects | |
| US20080209480A1 (en) | Method for enhanced video programming system for integrating internet data for on-demand interactive retrieval | |
| US20090019039A1 (en) | Layered augmentation for web content | |
| US9043828B1 (en) | Placing sponsored-content based on images in video content | |
| US9990394B2 (en) | Visual search and recommendation user interface and apparatus | |
| US8156001B1 (en) | Facilitating bidding on images | |
| US20170213248A1 (en) | Placing sponsored-content associated with an image | |
| CN104145265A (en) | Systems and methods involving features of seach and/or search integration | |
| CN104685899A (en) | Dynamic media segment pricing | |
| US20170287000A1 (en) | Dynamically generating video / animation, in real-time, in a display or electronic advertisement based on user data | |
| KR101140318B1 (en) | Keyword Advertising Method and System Based on Meta Information of Multimedia Contents Information like Ccommercial Tags etc. | |
| EP4260565A1 (en) | Virtual product placement | |
| KR20110043568A (en) | Keyword Advertising Method and System Based on Meta Information of Multimedia Contents Information like Ccommercial Tags etc. | |
| US20140236721A1 (en) | Apparatus, system and method for disambiguating a request for a media enhancement | |
| JP2007317217A (en) | Method for relating information, terminal device, server device, and program | |
| JP6139617B2 (en) | Information providing system, information providing server, information providing method, and program for information providing system | |
| KR20090110764A (en) | Keyword Advertising Method and System Based on Meta Information of Multimedia Contents Information | |
| KR101021655B1 (en) | Time Delaying Keyword Advertisement Contents Provding Method | |
| WO2017149321A1 (en) | Method and system for influencing digital content or access to content | |
| KR101179958B1 (en) | Method on Information Processing of Multimedia Contents Service System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20091028 |