Summary of the invention
Embodiment of the invention technical problem to be solved is, a kind of display packing, Apparatus and system of television image related information is provided.Under the situation of picture normal play of televising, can get access to user's interest television image related information in real time and in portable terminal, show, simple and convenient, improved user's experience.
In order to solve the problems of the technologies described above, the embodiment of the invention provides a kind of display packing of television image related information, comprising:
From televising picture, synchronous demonstration obtains current quiet frame picture;
Obtain corresponding quiet frame picture recognition result according to the described current quiet frame picture that gets access to;
Obtain corresponding television image related information according to described quiet frame picture recognition result, and show the described television image related information that gets access to.
Wherein, described obtaining from picture is televised in synchronous demonstration comprises before the current quiet frame picture:
Set up synchronous the broadcast with related television set and communicate to connect, and show the picture of televising synchronously.
Wherein, describedly obtain corresponding quiet frame picture recognition result according to the described current quiet frame picture that gets access to and comprise:
The described current quiet frame picture that gets access to is sent to server;
Receive the quiet frame picture recognition result that described server returns according to the described quiet frame picture that receives.
Wherein, describedly obtain corresponding television image related information according to described quiet frame picture recognition result and comprise:
From default related information database, find the television image related information of described quiet frame picture recognition result correspondence; Or
Arrive corresponding television image related information according to described quiet frame picture recognition result by internet hunt.
A kind of display packing of television image related information comprises:
The current quiet frame picture that from picture is televised in synchronous demonstration, gets access to that mobile terminal receive sends;
Resolve the described quiet frame picture that receives and obtain quiet frame picture recognition result;
Described quiet frame picture recognition result is sent to described portable terminal, so that described portable terminal obtains corresponding television image related information according to the described described quiet frame picture recognition result that receives, and show the described television image related information that gets access to.
Wherein, described quiet frame picture recognition result comprises: the literal recognition result;
The described quiet frame picture that receives of described parsing obtains quiet frame picture recognition result and comprises:
Obtain the Word message in the described quiet frame picture that receives;
The described Word message that gets access to is carried out the statement word segmentation processing and extracts keyword, obtain described literal recognition result.
Wherein, described quiet frame picture recognition result also comprises: the figure recognition result;
The described quiet frame picture that receives of described parsing obtains quiet frame picture recognition result and also comprises:
Obtain the pictorial information in the described quiet frame picture that receives;
Resolve the described pictorial information that gets access to and obtain the graph outline data;
Picture outline data coupling graph of a correspondence beacon information according to described parsing obtains obtains described figure recognition result.
Correspondingly, the embodiment of the invention also provides a kind of display unit of television image related information, comprising:
Quiet frame picture acquisition module obtains current quiet frame picture for the picture of televising from synchronous demonstration;
The recognition result acquisition module is used for obtaining corresponding quiet frame picture recognition result according to the described current quiet frame picture that gets access to;
The related information processing module is used for obtaining corresponding television image related information according to described quiet frame picture recognition result, and shows the described television image related information that gets access to.
Wherein, described device also comprises:
Display module is used for setting up synchronous the broadcast with related television set and communicates to connect, and shows the described picture of televising synchronously synchronously.
Wherein, described recognition result acquisition module comprises:
Quiet frame picture transmitting element is used for the described current quiet frame picture that gets access to is sent to server;
The recognition result receiving element is used for receiving the quiet frame picture recognition result that described server returns according to the described quiet frame picture that receives.
Wherein, described related information processing module comprises:
Related information first acquiring unit is for the television image related information that finds described quiet frame picture recognition result correspondence from default related information database;
The related information second acquisition unit is used for according to described quiet frame picture recognition result by the television image related information of internet hunt to correspondence.
A kind of display unit of television image related information comprises:
Quiet frame picture receiver module, be used for that mobile terminal receive sends from the synchronous demonstration current quiet frame picture that picture gets access to of televising;
Parsing module is used for resolving the described quiet frame picture that receives and obtains quiet frame picture recognition result;
The recognition result sending module, be used for described quiet frame picture recognition result is sent to described portable terminal, so that described portable terminal obtains corresponding television image related information according to the described described quiet frame picture recognition result that receives, and show the described television image related information that gets access to.
Wherein, described quiet frame picture recognition result comprises: the literal recognition result;
Described parsing module comprises:
The Word message acquiring unit is for the Word message that obtains the described quiet frame picture that receives;
The Word message resolution unit is used for the described Word message that gets access to is carried out the statement word segmentation processing and extracts keyword, obtains described literal recognition result.
Wherein, described quiet frame picture recognition result also comprises: the figure recognition result;
Described parsing module also comprises:
The pictorial information acquiring unit is for the pictorial information that obtains the described quiet frame picture that receives;
The pictorial information resolution unit is used for resolving the described pictorial information that gets access to and obtains the graph outline data;
Graphic information matches unit, the picture outline data that is used for obtaining according to described parsing mates the graph of a correspondence beacon information, obtains described figure recognition result.
Correspondingly, the embodiment of the invention also provides a kind of display system of television image related information, comprising: portable terminal, server and related television set;
Described portable terminal, as above-mentioned device, obtain current quiet frame picture for the picture of televising from synchronous demonstration, obtain corresponding television image related information according to the described current quiet frame picture that gets access to, and show the described television image related information that gets access to;
Described server as above-mentioned device, is used for receiving the current quiet frame picture that described portable terminal sends, and resolves the described quiet frame picture that receives and obtains quiet frame picture recognition result, and described quiet frame picture recognition result is sent to described portable terminal.
Implement the embodiment of the invention, has following beneficial effect: can show the interface of televising synchronously at portable terminal, obtain current quiet frame picture and show corresponding television image related information, under the situation of picture normal play of televising, can get access to user's interest television image related information in real time and in portable terminal, show, can in the multi-screen interaction, show the television image related information, simple and convenient, improved user's experience.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.
See also Fig. 1, Fig. 1 is the flow chart of a kind of display packing of television image related information in the embodiment of the invention, the embodiment of the invention can be implemented in as mobile phone, PDA(Personal Digital Assistant, personal digital assistant, have another name called palmtop PC), iPad (internet Personal access device, panel computer) etc. in the portable terminal, the display packing of television image related information can comprise at least in the present embodiment as shown in the figure:
Step S101 obtains current quiet frame picture from picture is televised in synchronous demonstration.In the specific implementation, portable terminal is set up to play synchronously with related television set in advance and is communicated to connect, and the synchronous picture of televising that shows, when the user is interested in one of them picture of televising, the mobile related touch-control request that receives the user, thereby related touch-control request for example touch-control mobile terminal screen suspends current playing frames, perhaps corresponding physical button or virtual key on the touch-control portable terminal.For example, icon 1 appears in the interface A of televising, the user thinks further to understand the concrete connotation of icon 1, pause button in user's touch-control portable terminal, at this moment, portable terminal is play the interface A of televising synchronously, and then portable terminal obtains current quiet frame picture from picture is televised in synchronous demonstration.
Step S102 obtains corresponding quiet frame picture recognition result according to the described current quiet frame picture that gets access to.In the specific implementation, obtaining corresponding quiet frame picture recognition result according to the described current quiet frame picture that gets access to can comprise: the described current quiet frame picture that gets access to is sent to server; Receive the quiet frame picture recognition result that described server returns according to the described quiet frame picture that receives.The current quiet frame picture that portable terminal will get access to sends to server, and server receives the back it is identified parsing, obtains quiet frame picture recognition result, and quiet frame picture recognition result is including, but not limited to literal recognition result and figure recognition result.For example, to the icon 1 in the interface A of televising, the quiet frame picture recognition result that server returns is: vehicle emblem A, portable terminal receive this quiet frame picture recognition result and are: vehicle emblem A.
Step S103 obtains corresponding television image related information according to described quiet frame picture recognition result, and shows the described television image related information that gets access to.In the specific implementation, obtaining corresponding television image related information according to described quiet frame picture recognition result can comprise: the television image related information that finds described quiet frame picture recognition result correspondence from default related information database; Or according to described quiet frame picture recognition result by internet hunt to corresponding television image related information.Wherein, the television image related information comprises: one or more in Word message, pictorial information, audio-frequency information, video information, the webpage.Wherein, it is the related information of typing portable terminal or high in the clouds server in advance in the default related information database, for example, at least one vehicle emblem and corresponding related explainative information, at least one film star's picture and the tourism attack strategy of brief introduction or at least one tourist attractions thereof etc. thereof.If in default related information database, do not find corresponding television image related information, connect at portable terminal under the situation of the Internet, automatically pass through the television image related information of internet hunt correspondence, for example, by internet hunt vehicle emblem A, get access to the associating web pages A of vehicle emblem A, thereby by the television image related information of internet hunt to correspondence.Portable terminal gets access to after the corresponding television image related information according to quiet frame picture recognition result, and shows the television image related information that gets access to.Under the situation that does not influence related television set continuation broadcast television image, show the television image related information at portable terminal.
The embodiment of the invention provides a kind of display packing of television image related information, can show the interface of televising synchronously at portable terminal, obtain current quiet frame picture and show corresponding television image related information, under the situation of picture normal play of televising, can get access to user's interest television image related information in real time and in portable terminal, show, can in the multi-screen interaction, show the television image related information, simple and convenient, improved user's experience.
Fig. 2 is the flow chart of the display packing of another kind of television image related information in the embodiment of the invention, and the display packing of television image related information comprises at least as shown in the figure:
Step S201, portable terminal set up to play synchronously with related television set and communicate to connect, and show the picture of televising synchronously.In the specific implementation, portable terminal is set up to play synchronously with related television set in advance and is communicated to connect, and the synchronous picture of televising that shows, for example, the user selects related play mode in related television set, related television set receives the request that the user selects related play mode, related television set sends and communicates to connect signal in portable terminal, portable terminal enters the reflection control model alternately with related television set, at this moment, portable terminal has been set up synchronous broadcast with related television set and has been communicated to connect, related television set normal play television image, related television set transmits the audio/video coding data to portable terminal, and after portable terminal received the audio/video coding data of related television set transmission, portable terminal showed the picture of televising synchronously.
Step S202, portable terminal obtain current quiet frame picture from picture is televised in synchronous demonstration.In the specific implementation, portable terminal shows the picture of televising synchronously, when the user is interested in one of them picture of televising, the mobile related touch-control request that receives the user, thereby related touch-control request for example touch-control mobile terminal screen suspends current playing frames, perhaps corresponding physical button or virtual key on the touch-control portable terminal.
Step S203, portable terminal sends to server with the described current quiet frame picture that gets access to.
Step S204, the current quiet frame picture that from picture is televised in synchronous demonstration, gets access to that the server mobile terminal receive sends.
Step S205, server obtain the Word message in the described quiet frame picture that receives.In the specific implementation, server carries out literal identification to quiet frame picture, for example, obtains the text prompt, dialogue or the roll titles that occur in the quiet frame picture.
Step S206, server carries out the statement word segmentation processing and extracts keyword the described Word message that gets access to, and obtains described literal recognition result.In the specific implementation, server carries out the statement word segmentation processing to the Word message that gets access to, and extracts keyword, for example, the roll titles in the quiet frame picture is carried out OCR identification and participle, extracts keyword A and keyword B.
Step S207, server obtain the pictorial information in the described quiet frame picture that receives.In the specific implementation, server carries out picture recognition to quiet frame picture, for example, gets access to the picture sign that occurs in the quiet frame picture, character image etc.
Step S208, the described pictorial information that gets access to of server parses obtains the graph outline data.In the specific implementation, server is resolved the pictorial information that gets access to and is obtained the graph outline data, and the graph outline data are character contour data, graph outline data etc. for example.
Step S209, server obtains described figure recognition result according to the graph outline Data Matching graph of a correspondence beacon information that described parsing obtains.In the specific implementation, the picture database that whois lookup is default judges whether to exist the graphic information of the graph outline Data Matching that obtains with parsing, and for example, graph outline data M graph of a correspondence beacon information is: commodity indicate M; Graph outline data N graph of a correspondence beacon information is: the logo of the N of enterprise.
In embodiments of the present invention, step S205~step S206, step S207~step S209 does not have the branch of sequencing, can carry out simultaneously, can carry out any one earlier yet and carry out other steps again, can also only carry out one of them and carry out other steps again.
Step S210, server sends to described portable terminal with described quiet frame picture recognition result, and described quiet frame picture recognition result comprises: described literal recognition result or described figure recognition result.In the specific implementation, quiet frame picture recognition result can include only the literal recognition result, also can include only the figure recognition result, can also comprise literal recognition result and described figure recognition result.
Step S211, portable terminal receive the quiet frame picture recognition result that described server returns.
Step S212 obtains corresponding television image related information according to described quiet frame picture recognition result, and shows the described television image related information that gets access to.In the specific implementation, obtaining corresponding television image related information according to described quiet frame picture recognition result can comprise: the television image related information that finds described quiet frame picture recognition result correspondence from default related information database; Or according to described quiet frame picture recognition result by internet hunt to corresponding television image related information.Wherein, the television image related information comprises: one or more in Word message, pictorial information, audio-frequency information, video information, the webpage.Portable terminal gets access to after the corresponding television image related information according to quiet frame picture recognition result, and shows the television image related information that gets access to.For example, according to quiet frame picture recognition result: graph outline data M graph of a correspondence beacon information is that commodity indicate M, and show that corresponding television image related information is: commodity indicate shopping guide's web interface of M correspondence etc.Under the situation that does not influence related television set continuation broadcast television image, show the television image related information at portable terminal.
The embodiment of the invention provides a kind of display packing of television image related information, can show the interface of televising synchronously at portable terminal, portable terminal obtains current quiet frame picture and issues server, server returns quiet frame picture recognition result after quiet frame picture is identified parsing, portable terminal obtains corresponding television image related information according to quiet frame picture recognition result, portable terminal shows this television image related information, realized under the situation of picture normal play of televising, can getting access to user's interest television image related information in real time and in portable terminal, showing, can in the multi-screen interaction, show the television image related information, simple and convenient, improved user's experience.
Fig. 3 is the structural representation of a kind of display unit of television image related information in the embodiment of the invention, the embodiment of the invention can be implemented in as in the portable terminals such as mobile phone, palmtop PC, panel computer, and the display unit of television image related information can comprise at least in the present embodiment as shown in the figure:
Quiet frame picture acquisition module 301 obtains current quiet frame picture for the picture of televising from synchronous demonstration.In the specific implementation, portable terminal is set up to play synchronously with related television set in advance and is communicated to connect, and the synchronous picture of televising that shows, when the user is interested in one of them picture of televising, the mobile related touch-control request that receives the user, thereby related touch-control request for example touch-control mobile terminal screen suspends current playing frames, perhaps corresponding physical button or virtual key on the touch-control portable terminal.For example, icon 1 appears in the interface A of televising, the user thinks further to understand the concrete connotation of icon 1, pause button in user's touch-control portable terminal, at this moment, portable terminal is play the interface A of televising synchronously, and then portable terminal obtains current quiet frame picture from picture is televised in synchronous demonstration.
Recognition result acquisition module 302 is used for obtaining corresponding quiet frame picture recognition result according to the described current quiet frame picture that gets access to.In the specific implementation, recognition result acquisition module 302 can comprise: quiet frame picture transmitting element and recognition result receiving element, and wherein, quiet frame picture transmitting element is used for the described current quiet frame picture that gets access to is sent to server; The recognition result receiving element is used for receiving the quiet frame picture recognition result that described server returns according to the described quiet frame picture that receives.The current quiet frame picture that portable terminal will get access to sends to server, and server receives the back it is identified parsing, obtains quiet frame picture recognition result, and quiet frame picture recognition result is including, but not limited to literal recognition result and figure recognition result.For example, to the icon 1 in the interface A of televising, the quiet frame picture recognition result that server returns is: vehicle emblem A, portable terminal receive this quiet frame picture recognition result and are: vehicle emblem A.
Related information processing module 303 is used for obtaining corresponding television image related information according to described quiet frame picture recognition result, and shows the described television image related information that gets access to.In the specific implementation, related information processing module 303 can comprise: related information first acquiring unit and related information second acquisition unit, wherein, related information first acquiring unit is for the television image related information that finds described quiet frame picture recognition result correspondence from default related information database; The related information second acquisition unit is used for according to described quiet frame picture recognition result by the television image related information of internet hunt to correspondence.Wherein, the television image related information comprises: one or more in Word message, pictorial information, audio-frequency information, video information, the webpage.Wherein, it is the related information of typing portable terminal or high in the clouds server in advance in the default related information database, for example, at least one vehicle emblem and corresponding related explainative information, at least one film star's picture and the tourism attack strategy of brief introduction or at least one tourist attractions thereof etc. thereof.If in default related information database, do not find corresponding television image related information, connect at portable terminal under the situation of the Internet, automatically pass through the television image related information of internet hunt correspondence, for example, by internet hunt vehicle emblem A, get access to the associating web pages A of vehicle emblem A, thereby by the television image related information of internet hunt to correspondence.Portable terminal gets access to after the corresponding television image related information according to quiet frame picture recognition result, and shows the television image related information that gets access to.For example, according to quiet frame picture recognition result: graph outline data M graph of a correspondence beacon information is that commodity indicate M, and show that corresponding television image related information is: commodity indicate shopping guide's web interface of M correspondence etc.Under the situation that does not influence related television set continuation broadcast television image, show the television image related information at portable terminal.
Further alternative, the device in the invention process can also comprise:
Display module 304 is used for setting up synchronous the broadcast with related television set and communicates to connect, and shows the described picture of televising synchronously synchronously.In the specific implementation, portable terminal is set up to play synchronously with related television set in advance and is communicated to connect, and the synchronous picture of televising that shows, for example, the user selects related play mode in related television set, related television set receives the request that the user selects related play mode, related television set sends and communicates to connect signal in portable terminal, portable terminal enters the reflection control model alternately with related television set, at this moment, portable terminal has been set up synchronous broadcast with related television set and has been communicated to connect, related television set normal play television image, related television set transmits the audio/video coding data to portable terminal, and after portable terminal received the audio/video coding data of related television set transmission, portable terminal showed the picture of televising synchronously.
The embodiment of the invention provides a kind of display unit of television image related information, can show the interface of televising synchronously at portable terminal, obtain current quiet frame picture and show corresponding television image related information, under the situation of picture normal play of televising, can get access to user's interest television image related information in real time and in portable terminal, show, can in the multi-screen interaction, show the television image related information, simple and convenient, improved user's experience.
Fig. 4 is the structural representation of the display unit of another kind of television image related information in the embodiment of the invention, and the embodiment of the invention can be implemented in the server, and the display unit of television image related information can comprise at least in the present embodiment as shown in the figure:
Quiet frame picture receiver module 401, be used for that mobile terminal receive sends from the synchronous demonstration current quiet frame picture that picture gets access to of televising.
Parsing module 402 is used for resolving the described quiet frame picture that receives and obtains quiet frame picture recognition result.In the specific implementation, quiet frame picture recognition result is including, but not limited to literal recognition result and figure recognition result.Further alternative, parsing module 402 can comprise: Word message acquiring unit and Word message resolution unit, and wherein, the Word message acquiring unit is for the Word message that obtains the described quiet frame picture that receives; The Word message resolution unit is used for the described Word message that gets access to is carried out the statement word segmentation processing and extracts keyword, obtains described literal recognition result.Further alternative, parsing module 402 can also comprise: pictorial information acquiring unit, pictorial information resolution unit and graphic information matches unit, and wherein, the pictorial information acquiring unit is for the pictorial information that obtains the described quiet frame picture that receives; The pictorial information resolution unit is used for resolving the described pictorial information that gets access to and obtains the graph outline data; Graphic information matches unit, the graph outline Data Matching graph of a correspondence beacon information for obtaining according to described parsing obtains described figure recognition result.Concrete, the picture database that whois lookup is default judges whether to exist the graphic information of the graph outline Data Matching that obtains with parsing, and for example, graph outline data M graph of a correspondence beacon information is: commodity indicate M; Graph outline data N graph of a correspondence beacon information is: the logo of the N of enterprise.
Recognition result sending module 403, be used for described quiet frame picture recognition result is sent to described portable terminal, so that described portable terminal obtains corresponding television image related information according to the described described quiet frame picture recognition result that receives, and show the described television image related information that gets access to.
The embodiment of the invention provides a kind of display unit of television image related information, but the current quiet frame picture that from picture is televised in synchronous demonstration, gets access to that mobile terminal receive sends, and resolve and obtain quiet frame picture recognition result, and return to portable terminal, make portable terminal under the situation of picture normal play of televising, can get access to user's interest television image related information and demonstration in real time, simple and convenient, improved user's experience.
Fig. 5 is the structural representation of a kind of display system of television image related information in the embodiment of the invention, and as shown in the figure, the display system of the television image related information in the embodiment of the invention can comprise: portable terminal 1, server 2 and related television set 3.Wherein:
Portable terminal 1, device as shown in Figure 3, obtain current quiet frame picture for the picture of televising from synchronous demonstration, obtain corresponding television image related information according to the described current quiet frame picture that gets access to, and show the described television image related information that gets access to;
Server 2, device as shown in Figure 4 is used for receiving the current quiet frame picture that described portable terminal sends, and resolves the described quiet frame picture that receives and obtains quiet frame picture recognition result, and described quiet frame picture recognition result is sent to described portable terminal.
The embodiment of the invention also discloses a kind of display system of television image related information.Can carry out related with television set portable terminal, under the situation of picture normal play of televising, can get access to user's interest television image related information in real time and in portable terminal, show, can in the multi-screen interaction, show the television image related information, simple and convenient, improved user's experience.
One of ordinary skill in the art will appreciate that all or part of flow process that realizes in above-described embodiment method, be to instruct relevant hardware to finish by computer program, described program can be stored in the computer read/write memory medium, this program can comprise the flow process as the embodiment of above-mentioned each side method when carrying out.Wherein, described storage medium can be magnetic disc, CD, read-only storage memory body (Read-Only Memory, ROM) or at random store memory body (Random Access Memory, RAM) etc.
Above disclosed is preferred embodiment of the present invention only, can not limit the present invention's interest field certainly with this, and therefore the equivalent variations of doing according to claim of the present invention still belongs to the scope that the present invention is contained.