CN101500125A - Method and apparatus for providing user interaction during displaying video on customer terminal - Google Patents
Method and apparatus for providing user interaction during displaying video on customer terminal Download PDFInfo
- Publication number
- CN101500125A CN101500125A CNA2008100334929A CN200810033492A CN101500125A CN 101500125 A CN101500125 A CN 101500125A CN A2008100334929 A CNA2008100334929 A CN A2008100334929A CN 200810033492 A CN200810033492 A CN 200810033492A CN 101500125 A CN101500125 A CN 101500125A
- Authority
- CN
- China
- Prior art keywords
- interactive
- user
- video
- information
- interactive window
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a method for providing user interaction when in video displaying on a user terminal and a device. The invention directly synthesizes interaction windows of a local user and a local terminal device or other online users with a video picture so as to generate a synthesized picture of overlapping the interaction windows on the video picture for displaying, thereby improving the convenience and flexibility of users when watching videos on line and enhancing the user experience.
Description
Technical field
The present invention relates to the video playback field, relate in particular to the function that user interactions is provided on the video pictures that user terminal is play.
Background technology
In the prior art, the user is online to be watched in the process of Internet video content, especially video window is under the full frame state time, if the user wants to watch another Internet video content, often need under current full frame video state, to withdraw from, video window becomes a window that has dwindled, then, find on user-to-network service provider's the website the link of the Internet video content desiring newly to watch, and open this link, again switch back to former video window then, full frame again this video window is to watch new video content.When the user need once more to change desire to watch video content the time, when perhaps needing repeatedly between the different video content, to switch, the repetition said process that just need not stop, therefore operation seems more loaded down with trivial details, user's Experience Degree is not high.Have again, the user full frame watch video content in, if also wish real-time link up and exchange with other people, often also need at first under full frame viewed status, to withdraw from, video window is switched to a window that has dwindled, the chat software of user's startup such as msn or QQ is to link up with other people then, sometimes may also can need the user switching back and forth between the interactive window between video window and user, very inconvenient, even with interactive window top set between the user on video window, also just a simple window covers, interactive window window and video window window are very inconsistent usually between the user, and visual effect is very undesirable, and interactive window can hide the part video pictures between common user, influence watching of user, user experience is bad.Perhaps, even watching video and online exchange can carry out in a browser simultaneously, but the reduced pocket that is presented on browser of video pictures normally, the user then specific regions of another in browser carries out the interchange of online chatting and so on, in this case, the user can't realize the full frame video content of viewing and admiring.In addition, for example in radio and television, a scroll bar below the television content picture, superpose sometimes to play some such as Word messages such as practical work news, but for the user, literal in these scroll bars all is after generating in advance again on the overlay video picture and send to each user's, therefore the Word message that each user watched is the same, and the user can not initiatively carry out the operation of dynamic literal and picture stack to realize personalized demonstration.
Summary of the invention
In view of there being the problems referred to above in the prior art, the present invention proposes a kind ofly in the method that is used for providing user interactions on the user terminal when video shows, it directly is superimposed on synthetic picture on the video pictures to generate this interactive window with interactive window between the user between user interactions window such as user and wherein dynamic chat word content, dynamic picture or Control-Menu etc. and video playback picture are synthetic.
According to a first aspect of the invention, provide a kind of in the method that is used for when video shows, providing user interactions on the user terminal, may further comprise the steps: judge that a) whether predetermined condition satisfies, described predetermined condition comprises the mutual request that receives local user's input, receive mutual request from other users, on this user terminal video player bring into operation or this user terminal on video content any in beginning to play; B) when satisfying described predetermined condition, one or more interactive window and video playback picture is synthetic, and the one or more interactive window that are used to show with generation are superimposed on the synthetic picture on the video playback picture.Alternatively, this method also comprises step m) interactive information of local user input is offered the corresponding interactive object of interactive information with described local user's input, according to the difference of interactive mode, described interactive object comprises local terminal and/or other users.
According to a second aspect of the invention, provide a kind of at the video interactive device that is used for when video shows, providing user interactions on the user terminal, wherein, comprise: judgment means, be used to judge whether predetermined condition satisfies, described predetermined condition comprises the mutual request that receives local user input, receives the mutual request from other users, on this user terminal video player bring into operation or this user terminal on video content begin to play; Synthesizer is used for when satisfying described predetermined condition, and one or more interactive window and video playback picture is synthetic, and the one or more interactive window that are used to show with generation are superimposed on the synthetic picture on the video playback picture; This video interactive device also comprises dispensing device, is used for the interactive information of local user's input is offered the corresponding interactive object of importing with described local user of interactive information, comprises local terminal and/or other users.
Adopt technical scheme provided by the present invention, the user can be when watching video content, directly mutual between the enterprising pedestrian's machine of the video pictures of being watched, user, information such as mutual dynamic literal and picture are directly synthetic to be shown in the video pictures of being watched, preferably, can also realize the transparent and translucent effect of interactive window in described synthesizing, promote visual effect and user's Experience Degree greatly.
Description of drawings
By reading the following detailed description of doing with reference to accompanying drawing to non-limiting example, other features, objects and advantages of the present invention will become more obvious.
Fig. 1 show network online watch video system block diagram;
Fig. 2 be according to a specific embodiment of the present invention at the flow chart that is used for when video shows, providing the method for user interactions on the user terminal;
Fig. 3 shows the original video picture of the interactive window that do not superpose;
Fig. 4 is synthetic picture first exemplary plot after synthetic according to the interactive window of a specific embodiment of the present invention and video pictures;
Fig. 5 is synthetic picture second exemplary plot after synthetic according to the interactive window of a specific embodiment of the present invention and video pictures;
Fig. 6 is the block diagram at the video interactive device that is used for providing user interactions on the user terminal when video shows according to a specific embodiment of the present invention
In the accompanying drawings, same or analogous Reference numeral is represented same or analogous device or steps characteristic.
Embodiment
The present invention is described in further detail below in conjunction with the drawings and specific embodiments.
Before address, technical purpose of the present invention is to generate interactive window and be superimposed on method and apparatus on the video pictures for user terminal provides, based on this goal of the invention, application scenarios of the present invention can include but not limited to the broadcast of video request program (Video on Demand), live (live) and the local media file that prestores.
Fig. 1 shows an online system block diagram of watching video of network, comprising 3 online users (being shown user terminal 1, user terminal 2 and user terminal 3) and a video server 0.Wherein, this video server 0 provides the broadcast service of video resource and video resource for user terminal 1,2,3.It will be understood by those skilled in the art that, application of the present invention is not limited to the network system of above-mentioned user terminal/server framework, the present invention is equally applicable to carry out based on the P2P agreement network system of video Data Transmission, also promptly, the video resource of being play on the user terminal 1 can derive from user terminal 2 and 3 to small part.Wherein,, use the user of this user terminal promptly to be called as the local user, use the user of other two user terminals then to be called as other user for a certain particular user terminal.
Below, be that example describes with the network video-on-demand under the user terminal/server framework with being without loss of generality.The present invention typically realizes by the mode of computer software, and for example, the Internet Service Provider website that user terminal 1,2,3 has a video server 0 by visit (for example,
Www.pplive.com) watch software (for example, to download the necessary Online Video of described program request
PPLive Player), be connected to video server 0 with the order video content by operating software then.Especially, this Online Video watches software also to be integrated with chat feature, so the user of user terminal 1 when watching video content, can also directly start chat feature and carry out real-time communication with the user with user terminal 2 and user terminal 3 in video window.And, user terminal 1 and 2,3 chat content directly are applied and are shown in the video pictures of being play on the user terminal 1, like this, the user that can guarantee user terminal 1 need not to withdraw the visual impact when having guaranteed to view and admire video content under full frame video state.In addition, the user of user terminal 1 is in watching the process of video content, also can start a man-machine interaction window by clicking the mouse or pressing modes such as keyboard function key, as, the video content menu, this video content menu is directly superposeed equally and is shown in the video pictures of being play on the user terminal 1, the user of user terminal 1 need not to withdraw under full frame video state equally, just can be by in the video content menu, clicking the link of other video content, easily the video content from current broadcast switches to described other video content that it desires to watch.
The video content of playing at synchronization on the user terminal 1,2,3 can be identical, such as same film or same competitive sports, so the user of user terminal 1,2,3 can be when watching same film or competitive sports, chat in real time to exchange impression, and mutual chat content is shown in the video pictures in the advancing of being watched by direct stack, so watch, exchange and neglect neither, promoted user's Experience Degree greatly.It will be understood by those skilled in the art that, application of the present invention is not limited in this kind situation, in other words, the video content of being play on the user terminal 1,2,3 also can be different even altogether irrelevant, though do not watch identical video content simultaneously though it will be appreciated by those skilled in the art that the user of user terminal 1,2,3, this does not hinder them to carry out alternately, in fact, the chat content between these users can relate to their interested any topic at that time.Even, can not play any video content on the user terminal 1,2,3, the user of user terminal 1,2,3 interchange of attentively chatting, this moment, Online Video watched software promptly as a chat software.
Fig. 2 for according to a specific embodiment of the present invention at the flow chart that is used for when video shows, providing the method for user interactions on the user terminal, wherein, described user interactions comprises between the user mutual and/or man-machine interaction.The present invention is described in detail below with reference to Fig. 2 and in conjunction with Fig. 1.Suppose, user terminal 1,2,3 is the online film " Die Hard 4 " that is provided on the webserver 0 of watching simultaneously, because suppositive scenario is program request, therefore, video pictures on the user terminal 1,2,3 is not quite similar, and the video pictures of supposing user terminal 1 screen display as shown in Figure 4.
As seen, when this video content of played in full screen as illustrated in fig. 4, the video pictures that the user saw with usually by windows media player or realplayer is full frame when watching film that effect is as good as.Very neatly, the present invention can start the stack that promptly begin interactive window and video pictures beginning in video playback beginning even player, preferably, the present invention superposes interactive window and current playing frames after particular event takes place detecting again, and is superimposed upon synthetic picture on the video pictures with the generation interactive window.With user terminal 1 is example, in the process of playing " Die Hard 4 ", local user's rolling mouse, the left button of clicking the mouse, press a function key, other user on the Multi-Function Keyboard send mutual request or the like all can be as the incident that triggers the above-mentioned stack on the user terminal 1, typically, which incident user terminal 1 (indicates to trigger the stack of interactive window and video pictures according to prestored information, this prestored information can be integrated in described Online Video and watch in the software), judged whether to take place to trigger the incident of described stack.More specifically, can refinement determine intercorrelation between which incident and user in the described prestored information, which incident is relevant with man-machine interaction.Thereby after detecting particular event, trigger the interactive window of respective type and the stack of video pictures, these contents will have detailed introduction hereinafter.
Referring to Fig. 2, in step S1, user terminal 1 judges whether predetermined condition is met, and preferably, in the playing process of " Die Hard 4 " this video content, described step S1 periodically carries out, and satisfies until detecting predetermined condition.In this example, the user who supposes user terminal 1 supresses a function key on the Multi-Function Keyboard, and according to prestored information, this function key can trigger the stack of a personal-machine interactive window and video pictures.Therefore, when an execution in step S1, user terminal 1 will be judged predetermined condition and satisfy.
So user terminal 1 need synthesize corresponding interactive window and video pictures, and before this, still need and determine position and the size thereof of interactive window in synthetic picture.So in step S2, user terminal 1 obtains the positional information of interactive window a, described positional information is used for indicating the display position of this interactive window a synthetic picture of gained after synthesizing with " Die Hard 4 " video pictures.Referring to Fig. 3, wherein show being the coordinate system of reference without synthetic video pictures, be example with the video pictures of resolution 1024*768, pixel coordinate span therein is that (0,0) is to (1024,768).Therefore, the coordinate of a particular point by determining interactive window a can be determined the position of this interactive window a.In actual applications, can preestablish this positional information, for example, the coordinate of setting the pixel in the upper left corner of interactive window a is (724,568) defaultly, so this window will be positioned at the corner, bottom right of synthetic picture.
In addition, user terminal 1 also needs to determine the size of this interactive window a, for example, set the pixel coordinate in the upper left corner of interactive window a defaultly is (724,568) on the basis, can be more defaultly the size of this window be set at 300*200, so, pixel of the last cell of this window just in time is superimposed upon on the pixel of original video picture last cell, thus, interactive window a can be just (transparent or semitransparent or opaquely) covers the corner, bottom right of original video picture fully.As shown in Figure 4.
Alternatively, the positional information of interactive window a and size information can be by the user in that to carry out picture definite before synthetic, for example, after in step S1, obtaining the satisfied judged result of predetermined condition, user terminal 1 synthesizes an information input window and a video pictures with default size at the default position of video pictures, and the indication user input parameter relevant with size, and then the positional information of definite interactive window a and size information with the position of its desirable interactive window a.
Alternatively, the positional information of interactive window a and size information can in the process of playing synthetic picture, be upgraded according to the information that the user further imports after determining based on above-mentioned arbitrary mode, typically, the user is by click with pull the renewal that realizes these information.
Then, in step S4, positional information and size information according to the interactive window a that obtains among step S2 and the S3, user terminal 1 is synthetic with the video pictures of a man-machine interaction window a who comprises round buttons such as " chat ", " video " and in progress " Die Hard 4 ", to generate the synthetic picture on the video pictures that this interactive window a is superimposed on " Die Hard 4 " and to be shown on the user terminal 1.Shown in lower right-most portion among Fig. 5.For simplicity's sake, wherein show other interactive window simultaneously, and corresponding detailed description will be arranged hereinafter.
Advantageously, (lower right corner of synthetic picture) is an optimum position to interactive window a in the position shown in Fig. 4.
On the one hand; because the key element of video pictures part can be arranged at the place of the close central authorities of picture or other ad-hoc location usually to adapt to people's vision inertia; place the corner portions located of synthetic picture can reduce covering as much as possible interactive window a to " Die Hard 4 " video pictures; even hide to some extent; the video pictures part that it hid also is a part more less important in the whole video picture, thereby reduces the influence that impression caused to the user.Certainly, key element in the picture not necessarily is positioned at centre position or above-mentioned other ad-hoc location of picture, at this moment, user terminal 1 can be before carrying out video pictures and interactive window synthetic, decoded frame of video is resolved, therefrom find out the position of element information, for example, carry out recognition of face, perhaps multiframe is resolved to find out pixel (those skilled in the art's understanding that interframe changes, usually the pixel that changes has carried the video information that the user is concerned about the most in this section period), thereby can in step S2 and step S3, determine position and when size of interactive window a, make its position of expressly avoiding these element informations, to guarantee impression.It will be appreciated by those skilled in the art that content of multimedia, can obtain the position of these element informations by analytical Prediction frame (having characterized the difference between a frame and the corresponding key frame) like a cork for the constituted mode that adopts key frame+predictive frame.And for the content of multimedia that only comprises key frame, the information between then can more adjacent key frame, thus therebetween difference obtained, and with its positional information as element information.
On the other hand, interactive window a appears at the operating habit that the video pictures lower right corner also relatively meets people, is the people for the right-handed operation at least.And, then interactive window a can be placed the lower left corner of video pictures for the user of left-handed operation mouse.For realizing this purpose of carrying out the window's position accommodation at user's input habit, user terminal 1 can be inquired about the operating habit that being provided with on it obtained the user of user terminal 1, such as, suppose that user terminal 1 adopts the Windows of Microsoft operating system, then the setting that can obtain " mouse " project by " control panel " to be learning that user's right-handed operation mouse still be the left-handed operation mouse, thereby interactive window a is placed the relevant position of synthesizing picture.In another kind of embodiment, when the user installation Online Video was watched software or used this software for the first time, the indication user imported the custom that oneself operates mouse, so Online Video watches software with this record, when superposeing interactive window a later on, can determine the position of video pictures in view of the above at every turn.
The specific implementation of step S4 describes in detail.Particularly, in the process of video pictures that interactive window is added to, can be synthetic by the pixel of interactive window between the user and the respective pixel on the video pictures present frame are carried out the pixel weighting, to generate synthetic picture.Preferably, adopting described pixel weighting to synthesize realizes as transparent or semitransparent effect to promote visual effect.Particularly, establish among the interactive window a coordinate for (x, the pixel value of pixel y) are M
(x, y), the pixel value of establishing respective pixel point on " Die Hard 4 " video pictures present frame is N
(x, y), with the pixel value of the new pixel on the relevant position of the synthetic back of this two pixel in synthetic picture be: R
(x, y)=aM
(x, y)+ bN
(x, y), wherein a and b are the weighted factor that is respectively interactive window pixel and video pictures current frame pixel, wherein, and 0＜=a, b＜=1 and a+b=1.Preferably, for the word segment among the interactive window a, as " chat " among Fig. 4, " video ", " circle " and " setting " etc., because it is important for the local user, therefore, can be these literal and give bigger weight, for example, for each occupied pixel of these literal, a=1, b=0, like this, these literal will hide the respective pixel point on (being different from transparent, translucent) video pictures fully, thereby clearly present to the local user.More preferably, for the sideline part among the interactive window a or the pixel of non-legible background parts, desirable a=b=0.5, like this, the sideline of interactive window a or non-legible background parts and video playback picture merge mutually, to realize translucent effect.Certainly,, can also get a=0, b=1, realizing fully transparent effect, thereby reduce covering as much as possible, guarantee user experience the background video picture for some part among the interactive window a.Certainly, a, b can also correspondingly get other values, repeat no more here.
4 round buttons such as " chat ", " video " have been comprised among the interactive window a, the user is by click " chat " button, it is the local user of user terminal 1 and the human-machine interactive information between the user terminal 1 that this clicking operation promptly is considered as, whereby, user terminal 1 can identify the user and carry out the operation of clicking the mouse with " chat " corresponding position.This clicking operation is a man-machine interactive operation that the user carries out in human-computer interaction interface a, the local user who also can be considered user terminal 1 utilizes request alternately between the user that user terminal 1 imported, and can make in the step S1 that periodically carries out that judged result is that predetermined condition satisfies, then, user terminal 1 will be determined size and position for being about to be used between the synthetic user of picture interactive window, and details are as follows:
The positional information of interactive window and size information can be to come from Online Video to watch the predefined display position default value of software itself between the described user who is obtained in step S2, S3, for example, when each user started chat feature at first, interactive window just superposeed automatically and is shown in the middle and lower part (interactive window b between user as shown in Figure 4) of video pictures between the user.Alternatively, the position of interactive window b, size information can also come from a file that prestores on the user terminal 1 between the user who is obtained among step S2, the S3, wherein writing down before last time, chat feature was closed between the user size of interactive window b and residing position in synthetic picture, so after this when the local user of user terminal 1 starts chat feature, user terminal 1 just reads position, the size information of interactive window between the user from this document, synthetic to be used for picture.Particularly, preserve with subscriber identity information by the information in the described file that this locality is prestored, user terminal 1 can place interactive window b between the user on the customized locations to customize size for each user according to the hobby of different user relatedly.Wherein, the log-on message (user name+password) that can input when the user moves this Online Video playout software or the log-on message imported in ejecting dialog box/human-computer interaction interface when activation chat feature are after this obtained this user's identity information.
Preferably, the position of interactive window b, size information also can be to come from the local user between the user who is obtained among step S2, the S3, such as, in the process of chat, the user can drag arbitrarily interactive window b between the user by mouse, perhaps interactive window between the user is carried out moving arbitrarily, interactive window between the user is placed on the desired position that appears at of user by the directionkeys on the keyboard.In addition, because video is ceaselessly being play, video pictures is in continuous change, some the time, interactive window b can cover user in the video pictures and thinks important part between the user, so the user can interactive window b moves on to minor part in its current video picture of thinking with it between the user by dragging where necessary, thereby the user is thought displaying that important part do not hidden.
More preferably, the position of interactive window b, size information also can be come to determine adaptively by user terminal 1 between the user who is obtained among step S2, the S3, and dynamically update in real time or periodically.Particularly, user terminal 1 is monitored the video pictures of being play in real time, finds out the positional information of the most less important picture in the video pictures of current broadcast by certain algorithm, such as, think the background parts of video pictures more less important; Perhaps, current broadcast frame and former frame are compared, it is important to have the part of obvious change to think, and that the part that does not change is substantially thought is more less important; Perhaps, because present a lot of video content all adopts the presentation mode of wide screen, so, the white space that certain width can occur having in the top and the bottom of video pictures (as, all the time be shown as black), then interactive window b between the user can be placed this position, or the like.
Preferably, because carrying out along with video playback, video pictures constantly changes, the position of its less important part also can change thereupon, so user terminal 1 can constantly be monitored the video playback picture, and (include but not limited between the user that interactive window b and man-machine interaction window a) upgrade its position and size for each interactive window, make it can be in less important part in the video pictures all the time, and the pith of video pictures is not caused covering, the user is watched the influence that causes thereby reduce as much as possible.Certainly, avoid to realize by reducing the weight of interactive window in the pixel weighting to the covering of important picture.
After the position of having determined interactive window b and size information, in step S4, user terminal 1 is synthetic with the video pictures of itself and in progress " Die Hard 4 ", to generate the synthetic picture on the video pictures that interactive window b is superimposed between a user " Die Hard 4 ".As shown in Figure 4.
One in this example changes in the example, the synthetic of interactive window b and video pictures can also be triggered by the special keys on the lower keyboard (as enter key) by the user between the user, that is, when the user presses enter key in video display process, will obtain the judged result that predetermined condition satisfies among the step S1.
In the another variation example of this example, user terminal 1 receives a chat request or chat content that other users send to the local user, so, in step S1, will therefore judge that predetermined condition is met, thereby start chat feature.Particularly, the chat content that user terminal 1 is sent described other user (can comprise literal, picture even multimedia messages) joins in the reception Information of interactive window b between the user who is about to be used for synthesizing, to generate the interactive window b after upgrading, be used for the synthetic of step S4.Thus, the local user can generate in S4 in the synthetic picture of also showing subsequently and see the chat content that described other user sends.
For the two-way interactive between the user is provided, interactive window also comprises the transmission Information between the user, perhaps be called the input information hurdle, the local user is in the process of importing, as step S5, its literal of importing can join between the user among the interactive window b (What You See Is What You Get) in real time, to generate interactive window b between the user who upgrades, window after this upgrades will be synthetic with current video frame in the building-up process of carrying out frame by frame, to be shown to the local user.In addition, for making other user see the interactive information that the local user imported of user terminal 1, after described local user finishes the input of passage, by " transmission " button (not being shown among Fig. 4) among the click window b or press special function keys on the lower keyboard, this clicking operation will be regarded as this local user and wish the information of its input is sent to interactive object between its user.So preferably, this method also comprises a unshowned step of Fig. 2, wherein, user terminal 1 sends to this section literal interactive object between described local user's user.
Interactive object can be local user's online good friend between described local user's user, thereby keeps up a friendship when watching video content; Interactive object also can be other online users that watch same video " Die Hard 4 " with the local user between described user, as the user of user terminal 2 and user terminal 3, to exchange the impression to film " Die Hard 4 " each other in real time; Interactive object can also be the specified any specific user of local user between described user.In addition, before above-mentioned chat begins, the process that may also need the local user to login chat server and carry out authentication, this is similar to the login authentication process of using before msn or QQ chat, and will not give unnecessary details here.
More preferably, this section literal of described local user's input can be presented in the reception Information by sending removing in the Information after being sent to each interactive object.So, shown chat conversations record between the user in the reception Information, its displaying contents is along with chat is carried out and real-time update.Certainly, receive interactive information between the user that Information can not show that also described local user sends.
According to the present invention, interactive window b not only can comprise word content between described user, can also comprise picture.Preferably, after above-mentioned chat feature started, the head portrait that user terminal 1 will participate in the online user of described chat joins the relevant position of this window, and was not shown.
Interactive window c shown in Fig. 4 preferably delivers to user side by Internet Service Provider's server push, be exemplified as the ballot guess of focus select-elite match among the figure, wherein comprise 3 competitors' photo, import Information and " affirmation ", " cancellation " button of scoring or player's numbering for the local user.
The synthetic example of another man-machine interaction window and video pictures has been shown among Fig. 5.Wherein, after the user passes through with " video " button among the click interactive window a, to judge that in step S1 predetermined condition is met, think that the user desires to check the video content inventory, so in step S4, the stack of one video content inventory interactive window is presented in the video playback picture, and its effect as shown in Figure 5.Wherein include a plurality of video content links or channel link and select for the user, the user is by clicking certain video content of desiring to watch link, and to stop the broadcast of current video, the data of downloading the new video content again are used for the local terminal and play.So, the user just can be switched between a plurality of video contents or channel in watching the process of video content easily, has promoted user's Experience Degree greatly.And, when user's mouse moves to certain video content when chaining, some relevant informations of this video content just are shown at the right-hand component of video content inventory interactive window, comprise contents such as excellent video interception, video content placard, description of contents and user comment, make the decision of whether watching this video to help the user.
According to a second aspect of the invention, provide a kind of at the video interactive device 10 that is used for when video shows, providing user interactions on the user terminal, Fig. 3 is the block diagram of this video interactive device 10, is described in detail below in conjunction with Fig. 3, and Fig. 1 and Fig. 2 are in the lump at this as a reference.Still simultaneously online the film " Die Hard 4 " that is provided on the webserver 0 is provided is that example describes with user terminal 1,2,3, and user terminal 1,2,3 is common PC.
Shown in video interactive device 10 comprise: judgment means 101, synthesizer 102, first obtains device 103, second and obtains device 104, dispensing device 10, first adding apparatus 106 and second adding apparatus 107.Particularly, described synthesizer 102 comprises that weighted factor determines device and pixel weighting synthesizer.
As seen, when this video content of played in full screen as illustrated in fig. 3, the video pictures that the user saw with usually by windows media player or realplayer is full frame when watching film that effect is as good as.Very neatly, the present invention can start the stack that promptly begin interactive window and video pictures beginning in video playback beginning even player, preferably, the present invention superposes interactive window and current playing frames after particular event takes place detecting again, and is superimposed upon synthetic picture on the video pictures with the generation interactive window.With user terminal 1 is example, in the process of playing " Die Hard 4 ", local user's rolling mouse, the left button of clicking the mouse, press a function key, other user on the Multi-Function Keyboard send mutual request or the like all can be as the incident that triggers the above-mentioned stack on the user terminal 1, typically, which incident is judgment means 101 (indicate to trigger the stack of interactive window and video pictures according to prestored information, this prestored information can be integrated in described Online Video and watch in the software), judged whether to take place to trigger the incident of described stack.More specifically, can refinement determine intercorrelation between which incident and user in the described prestored information, which incident is relevant with man-machine interaction.Thereby after detecting particular event, trigger the interactive window of respective type and the stack of video pictures, these contents will have detailed introduction hereinafter.
Referring to Fig. 6, judgment means 101 judges whether predetermined condition is met, and preferably, in the playing process of " Die Hard 4 " this video content, described judgment means 101 is periodically carried out decision operation, satisfies until detecting predetermined condition.In this example, the user who supposes user terminal 1 supresses a function key on the Multi-Function Keyboard, and according to prestored information, this function key can trigger the stack of a personal-machine interactive window and video pictures.Therefore, judgment means 101 will be judged predetermined condition and satisfy when once carrying out determining step.
So the synthesizer 102 in the user terminal 1 need synthesize corresponding interactive window and video pictures, and before this, the first acquisition device 103 and second of still needing obtains device 104 and determines position and the size thereof of interactive window in synthetic picture.So first obtains the positional information that device 103 obtains interactive window a, described positional information is used for indicating the display position of this interactive window a synthetic picture of gained after synthesizing with " Die Hard 4 " video pictures.Referring to Fig. 3, wherein show being the coordinate system of reference without synthetic video pictures, be example with the video pictures of resolution 1024*768, pixel coordinate span therein is that (0,0) is to (1024,768).Therefore, the coordinate of a particular point by determining interactive window a can be determined the position of this interactive window a.In actual applications, can preestablish this positional information, for example, the coordinate of setting the pixel in the upper left corner of interactive window a is (724,568) defaultly, so this window will be positioned at the corner, bottom right of synthetic picture.
In addition, second of user terminal 1 place obtains the size that device 104 also needs to determine this interactive window a, for example, set the pixel coordinate in the upper left corner of interactive window a defaultly is (724,568) on the basis, can be more defaultly the size of this window be set at 300*200, so, pixel of the last cell of this window just in time is superimposed upon on the pixel of original video picture last cell, thus, interactive window a can be just (transparent or semitransparent or opaquely) covers the corner, bottom right of original video picture fully.As shown in Figure 4.
Alternatively, the positional information of interactive window a and size information can be by the user in that to carry out picture definite before synthetic, for example, after judgment means 101 obtains the satisfied judged result of predetermined condition, synthesizer 102 synthesizes an information input window and a video pictures with default size at the default position of video pictures, and the indication user input parameter relevant with size, and then help the first acquisition device 103 and second to obtain positional information and size information that device 104 is determined interactive window a with the position of its desirable interactive window a.
Alternatively, the positional information of interactive window a and size information can in the process of playing synthetic picture, be upgraded according to the information that the user further imports after determining based on above-mentioned arbitrary mode, typically, the user is by click with pull the renewal that realizes these information.
Then, synthesizer 102 obtains positional information and the size information that device 103 and second obtains device 104 resulting interactive window a according to first, the video pictures of a man-machine interaction window a who comprises round buttons such as " chat ", " video " and in progress " Die Hard 4 " is synthetic, to generate the synthetic picture on the video pictures that this interactive window a is superimposed on " Die Hard 4 " and to be shown on the user terminal 1.Shown in lower right-most portion among Fig. 5.For simplicity's sake, wherein show other interactive window simultaneously, and corresponding detailed description will be arranged hereinafter.
Advantageously, (lower right corner of synthetic picture) is an optimum position to interactive window a in the position shown in Fig. 4.
On the one hand; because the key element of video pictures part can be arranged at the place of the close central authorities of picture or other ad-hoc location usually to adapt to people's vision inertia; place the corner portions located of synthetic picture can reduce covering as much as possible interactive window a to " Die Hard 4 " video pictures; even hide to some extent; the video pictures part that it hid also is a part more less important in the whole video picture, thereby reduces the influence that impression caused to the user.Certainly, key element in the picture not necessarily is positioned at centre position or above-mentioned other ad-hoc location of picture, at this moment, user terminal 1 can be before carrying out video pictures and interactive window synthetic, decoded frame of video is resolved, therefrom find out the position of element information, for example, carry out recognition of face, perhaps multiframe is resolved finding out the pixel that interframe changes (it will be appreciated by those skilled in the art that the pixel that changes has usually carried the video information that the user is concerned about the most in this section period), thus can be when the position of determining interactive window a and size, make its position of expressly avoiding these element informations, to guarantee impression.It will be appreciated by those skilled in the art that content of multimedia, can obtain the position of these element informations by analytical Prediction frame (having characterized the difference between a frame and the corresponding key frame) like a cork for the constituted mode that adopts key frame+predictive frame.And for the content of multimedia that only comprises key frame, the information between then can more adjacent key frame, thus therebetween difference obtained, and with its positional information as element information.
On the other hand, interactive window a appears at the operating habit that the video pictures lower right corner also relatively meets people, is the people for the right-handed operation at least.And, then interactive window a can be placed the lower left corner of video pictures for the user of left-handed operation mouse.For realizing this purpose of carrying out the window's position accommodation at user's input habit, user terminal 1 can be inquired about the operating habit that being provided with on it obtained the user of user terminal 1, such as, suppose that user terminal 1 adopts the Windows of Microsoft operating system, then the setting that can obtain " mouse " project by " control panel " to be learning that user's right-handed operation mouse still be the left-handed operation mouse, thereby interactive window a is placed the relevant position of synthesizing picture.In another kind of embodiment, when the user installation Online Video was watched software or used this software for the first time, the indication user imported the custom that oneself operates mouse, so Online Video watches software with this record, when superposeing interactive window a later on, can determine the position of video pictures in view of the above at every turn.
Below, the specific implementation of synthesizer 102 functions is described in detail.Particularly, in the process of video pictures that interactive window is added to, can be synthetic by the pixel of interactive window between the user and the respective pixel on the video pictures present frame are carried out the pixel weighting, to generate synthetic picture.Preferably, adopting described pixel weighting to synthesize realizes as transparent or semitransparent effect to promote visual effect.Particularly, establish among the interactive window a coordinate for (x, the pixel value of pixel y) are M
(x, y), the pixel value of establishing respective pixel point on " Die Hard 4 " video pictures present frame is N
(x, y), with the pixel value of the new pixel on the relevant position of the synthetic back of this two pixel in synthetic picture be: R
(x, y)=aM
(x, y)+ bN
(x, y), wherein a and b are that weighted factor determines that device is respectively the weighted factor of interactive window pixel and video pictures current frame pixel, wherein, and 0＜=a, b＜=1 and a+b=1.Preferably, for the word segment among the interactive window a, as " chat " among Fig. 4, " video ", " circle " and " setting " etc., because it is important for the local user, therefore, weighted factor determines that device can be these literal and gives bigger weight, for example, for each occupied pixel of these literal, a=1, b=0, like this, behind synthetic operation through pixel weighting synthesizer, these literal will hide the respective pixel point on (being different from transparent, translucent) video pictures fully, thereby clearly present to the local user.More preferably, for the sideline part among the interactive window a or the pixel of non-legible background parts, desirable a=b=0.5, like this, the sideline of interactive window a or non-legible background parts and video playback picture merge mutually, to realize translucent effect.Certainly,, can also get a=0, b=1, realizing fully transparent effect, thereby reduce covering as much as possible, guarantee user experience the background video picture for some part among the interactive window a.Certainly, a, b can also correspondingly get other values, repeat no more here.
4 round buttons such as " chat ", " video " have been comprised among the interactive window a, the user is by click " chat " button, it is the local user of user terminal 1 and the human-machine interactive information between the user terminal 1 that this clicking operation promptly is considered as, whereby, judgment means 101 can identify the user and carry out the operation of clicking the mouse with " chat " corresponding position.This clicking operation is a man-machine interactive operation that the user carries out in human-computer interaction interface a, the local user who also can be considered user terminal 1 utilizes request alternately between the user that user terminal 1 imported, and can make in the decision operation of periodically carrying out that judged result is that predetermined condition satisfies, then, user terminal 1 will be determined size and position for being about to be used between the synthetic user of picture interactive window, and details are as follows:
The positional information and the size information of interactive window can be to come from Online Video to watch the predefined display position default value of software itself between the described user that the first acquisition device 103, the second acquisition device 104 are obtained, for example, when each user started chat feature at first, interactive window just superposeed automatically and is shown in the middle and lower part (interactive window b between user as shown in Figure 4) of video pictures between the user.Alternatively, the position of interactive window b, size information can also come from a file that prestores on the user terminal 1 between the user who is obtained, wherein writing down before last time, chat feature was closed between the user size of interactive window b and residing position in synthetic picture, so after this when the local user of user terminal 1 starts chat feature, user terminal 1 just reads position, the size information of interactive window between the user from this document, synthetic to be used for picture.Particularly, preserve with subscriber identity information by the information in the described file that this locality is prestored, user terminal 1 can place interactive window b between the user on the customized locations to customize size for each user according to the hobby of different user relatedly.Wherein, the log-on message (user name+password) that can input when the user moves this Online Video playout software or the log-on message imported in ejecting dialog box/human-computer interaction interface when activation chat feature are after this obtained this user's identity information.
Preferably, the position of interactive window b, size information also can be to come from the local user between the user who is obtained, such as, in the process of chat, the user can drag arbitrarily interactive window b between the user by mouse, perhaps interactive window between the user is carried out moving arbitrarily, interactive window between the user is placed on the desired position that appears at of user by the directionkeys on the keyboard.In addition, because video is ceaselessly being play, video pictures is in continuous change, some the time, interactive window b can cover user in the video pictures and thinks important part between the user, so the user can interactive window b moves on to minor part in its current video picture of thinking with it between the user by dragging where necessary, thereby the user is thought displaying that important part do not hidden.
More preferably, the position of interactive window b, size information also can be come to determine adaptively by user terminal 1 between the user who is obtained, and dynamically update in real time or periodically.Particularly, user terminal 1 is monitored the video pictures of being play in real time, finds out the positional information of the most less important picture in the video pictures of current broadcast by certain algorithm, such as, think the background parts of video pictures more less important; Perhaps, current broadcast frame and former frame are compared, it is important to have the part of obvious change to think, and that the part that does not change is substantially thought is more less important; Perhaps, because present a lot of video content all adopts the presentation mode of wide screen, so, the white space that certain width can occur having in the top and the bottom of video pictures (as, all the time be shown as black), then interactive window b between the user can be placed this position, or the like.
Preferably, because carrying out along with video playback, video pictures constantly changes, the position of its less important part also can change thereupon, so, the first acquisition device 103 and second obtains device can constantly monitor the video playback picture, and (include but not limited between the user that interactive window b and man-machine interaction window a) upgrade its position and size for each interactive window, make it can be in less important part in the video pictures all the time, and the pith of video pictures is not caused covering, thereby reduce as much as possible the user is watched the influence that causes.Certainly, avoid to realize by reducing the weight of synthesizer 102 interactive window in the pixel weighting to the covering of important picture.
After the position of having determined interactive window b and size information, pixel weighting synthesizer determines that according to weighted factor the determined weighted factor of device is synthetic with the video pictures of interactive window b and in progress " Die Hard 4 ", to generate the synthetic picture on the video pictures that interactive window b is superimposed between a user " Die Hard 4 ".As shown in Figure 4.
One in this example changes in the example, the synthetic of interactive window b and video pictures can also be triggered by the special keys on the lower keyboard (as enter key) by the user between the user, that is, when the user presses enter key in video display process, will obtain the judged result that predetermined condition satisfies among the step S1.
In the another variation example of this example, user terminal 1 receives a chat request or chat content that other users send to the local user, so therefore judgment means 101 will judge that predetermined condition is met, thereby starts chat feature.Particularly, the chat content that first adding apparatus 106 is sent described other user (can comprise literal, picture even multimedia messages) joins in the reception Information of interactive window b between the user who is about to be used for synthesizing, to generate the interactive window b after upgrading, be used for synthesizer 102 performed synthesizing.Thus, the local user can see the chat content that described other user sends in the synthetic picture that is generated by synthesizer 102 and showed by display device subsequently.
For the two-way interactive between the user is provided, interactive window also comprises the transmission Information between the user, perhaps be called the input information hurdle, the local user is in the process of importing, its literal of importing can be joined between the user among the interactive window b (What You See Is What You Get) in real time by second adding apparatus 107, to generate interactive window b between the user who upgrades, the window after this upgrades will be synthetic with current video frame in the building-up process that synthesizer 102 is carried out frame by frame, to be shown to the local user.In addition, for making other user see the interactive information that the local user imported of user terminal 1, after described local user finishes the input of passage, by " transmission " button (not being shown among Fig. 4) among the click window b or press special function keys on the lower keyboard, this clicking operation will be regarded as this local user and wish the information of its input is sent to interactive object between its user.So preferably, this video interactive device 10 also comprises a dispensing device 105, be used for this section literal is sent to interactive object between described local user's user.
Interactive object can be local user's online good friend between described local user's user, thereby keeps up a friendship when watching video content; Interactive object also can be other online users that watch same video " Die Hard 4 " with the local user between described user, as the user of user terminal 2 and user terminal 3, to exchange the impression to film " Die Hard 4 " each other in real time; Interactive object can also be the specified any specific user of local user between described user.In addition, before above-mentioned chat begins, the process that may also need the local user to login chat server and carry out authentication, this is similar to the login authentication process of using before msn or QQ chat, and will not give unnecessary details here.
More preferably, this section literal of described local user's input can be presented in the reception Information by sending removing in the Information after being sent to each interactive object.So, shown chat conversations record between the user in the reception Information, its displaying contents is along with chat is carried out and real-time update.Certainly, receive interactive information between the user that Information can not show that also described local user sends.
According to the present invention, interactive window b not only can comprise word content between described user, can also comprise picture.Preferably, after above-mentioned chat feature started, the head portrait that user terminal 1 will participate in the online user of described chat joins the relevant position of this window, and was not shown.
Interactive window c shown in Fig. 4 preferably delivers to user side by Internet Service Provider's server push, be exemplified as the ballot guess of focus select-elite match among the figure, wherein comprise 3 competitors' photo, import Information and " affirmation ", " cancellation " button of scoring or player's numbering for the local user.
The synthetic example of another man-machine interaction window and video pictures has been shown among Fig. 5.Wherein, after the user passes through with " video " button among the click interactive window a, judgment means 101 will judge that predetermined condition is met, think that the user desires to check the video content inventory, so, synthesizer 102 is presented at video content inventory interactive window stack in the video playback picture, and its effect as shown in Figure 5.Wherein include a plurality of video content links or channel link and select for the user, the user is by clicking certain video content of desiring to watch link, and to stop the broadcast of current video, the data of downloading the new video content again are used for the local terminal and play.So, the user just can be switched between a plurality of video contents or channel in watching the process of video content easily, has promoted user's Experience Degree greatly.And, when user's mouse moves to certain video content when chaining, some relevant informations of this video content just are shown at the right-hand component of video content inventory interactive window, comprise contents such as excellent video interception, video content placard, description of contents and user comment, make the decision of whether watching this video to help the user.
More than embodiments of the invention are described, but the present invention is not limited to specific system, equipment and concrete agreement, those skilled in that art can make various distortion or modification within the scope of the appended claims.
Claims (27)
1. one kind in the method that is used for providing user interactions on the user terminal when video shows, wherein, may further comprise the steps:
A. judge whether predetermined condition satisfies;
B. when satisfying described predetermined condition, one or more interactive window and video pictures are synthetic, and the one or more interactive window that are used to show with generation are superimposed on the synthetic picture on the video pictures.
2. method according to claim 1 is characterized in that, described one or more interactive window comprise the transmission Information, and this method also comprises:
-when satisfying described predetermined condition, the interactive information of local user input is joined in the transmission Information of described one or more interactive window, to generate the interactive window after one or more renewals;
Described step b also comprises:
-interactive window after described one or more renewals and described video pictures is synthetic, the interactive window after the one or more renewals that are used to show with generation is superimposed on the synthetic picture on the described video pictures;
This method also comprises step:
M. the interactive information with described local user's input offers the corresponding interactive object of importing with described local user of interactive information.
3. method according to claim 2, it is characterized in that, the interactive information of described local user's input comprises interactive information between human-machine interactive information and/or user, wherein, when described interactive information comprises between the user interactive information, and between the user of described local user input the corresponding interactive object of interactive information comprise in the following each or appoint multinomial:
-described local user's online good friend;
-watch other users of same video with described local user;
-by the specified specific user of described local user.
4. according to each described method in the claim 1 to 3, it is characterized in that described one or more interactive window comprise the reception Information, this method also comprises:
-will join in the reception Information of described one or more interactive window from the interactive information of described local user's interactive object, to generate the interactive window after one or more renewals;
Described step b also comprises:
-interactive window after described one or more renewals and described video pictures is synthetic, the interactive window after the described one or more renewals that are used to show with generation is superimposed on the synthetic picture on the described video pictures.
5. according to each described method in the claim 1 to 4, it is characterized in that, described predetermined condition comprise in the following each or appoint multinomial:
-receive the mutual request of local user input;
-receive mutual request from other users;
Video player on-this user terminal brings into operation;
Video content begins to play on-this user terminal.
6. method according to claim 5 is characterized in that, the mutual request of described local user's input comprises the input of using in following each input equipment that arbitrary input equipment carried out:
-mouse;
-keyboard;
-sound/optical recognition device;
-handle;
Wherein, described mutual request from other users comprise in the following each or appoint multinomial:
-carry out mutual request message from being used for of described other users and described local user;
-from described other users' interaction content.
7. according to each described method in the claim 1 to 6, it is characterized in that, also comprise before the described step b:
I. obtain the positional information of described one or more interactive window, described positional information is indicated the display position of described one or more interactive window in described synthetic picture;
Described step b also comprises:
-when satisfying described predetermined condition, according to described positional information that described one or more interactive window and described video pictures is synthetic, the one or more interactive window that are used to show with generation are superimposed on the synthetic picture on the video pictures.
8. method according to claim 7 is characterized in that, described step I also comprises:
-receiving the position indication information of described local user's input, described position indication information is used for indicating the display position of described one or more interactive window at described synthetic picture;
-with received position indication information as described positional information.
9. according to each described method in the claim 1 to 8, it is characterized in that, also comprise before the described step b:
II. obtain the size information of described one or more interactive window, described size information is indicated the demonstration size of described one or more interactive window;
Described step b also comprises:
-when satisfying described predetermined condition, according to described size information that described one or more interactive window and described video pictures is synthetic, the one or more interactive window that are used to show with generation are superimposed on the synthetic picture on the video pictures.
10. method according to claim 9 is characterized in that, described Step II also comprises:
-receiving the big or small indication information of described local user's input, described big or small indication information is used to indicate the demonstration size of described one or more interactive window;
-with received big or small indication information as described size information.
11., it is characterized in that described step b comprises according to each described method in the claim 1 to 10:
-when satisfying described predetermined condition, the respective pixel on the present frame of pixel in described one or more interactive window and described video pictures is carried out pixel synthesize, to generate described synthetic picture.
12. method according to claim 11 is characterized in that, described step b also comprises:
-when satisfying predetermined condition, it is synthetic that the respective pixel on the present frame of pixel in described one or more interactive window and described video pictures is weighted pixel, to generate described synthetic picture.
13. method according to claim 12 is characterized in that, described step b also comprises:
-when satisfying predetermined condition, for the respective pixel on the present frame of pixel in described one or more interactive window and described video pictures is determined weighted factor respectively;
-according to determined weighted factor the respective pixel on the present frame of pixel in described one or more interactive window and described video pictures being weighted pixel synthesizes, to generate described synthetic picture.
14. one kind at the video interactive device that is used for providing user interactions on the user terminal when video shows, wherein, comprising:
Judgment means is used to judge whether predetermined condition satisfies;
Synthesizer, when satisfying described predetermined condition that one or more interactive window and video pictures is synthetic, the one or more interactive window that are used to show with generation are superimposed on the synthetic picture on the video pictures.
15. video interactive device according to claim 14 is characterized in that, described one or more interactive window comprise the transmission Information, wherein, also comprise:
First adding apparatus is used for when satisfying described predetermined condition, the interactive information of local user input is joined in the transmission Information of described one or more interactive window, to generate the interactive window after one or more renewals;
Described synthesizer also is used for, and the interactive window after described one or more renewals and described video pictures is synthetic, and the interactive window after the one or more renewals that are used to show with generation is superimposed on the synthetic picture on the described video pictures;
Described video interactive device also comprises:
Dispensing device is used for the interactive information of described local user's input is offered the corresponding interactive object of importing with described local user of interactive information.
16. video interactive device according to claim 15, it is characterized in that, the interactive information of described local user's input comprises interactive information between human-machine interactive information and/or user, wherein, when described interactive information comprises between the user interactive information, and between the user of described local user input the corresponding interactive object of interactive information comprise in the following each or appoint multinomial:
-described local user's online good friend;
-watch other users of same video with described local user;
-by the specified specific user of described local user.
17., it is characterized in that described one or more interactive window comprise the reception Information, wherein, also comprise according to each described video interactive device in the claim 14 to 16:
Second adding apparatus is used for the interactive information from described local user's interactive object is joined the reception Information of described one or more interactive window, to generate the interactive window after one or more renewals;
Described synthesizer also is used for, and the interactive window after described one or more renewals and described video pictures is synthetic, and the interactive window after the described one or more renewals that are used to show with generation is superimposed on the synthetic picture on the described video pictures.
18. according to each described video interactive device in the claim 14 to 17, it is characterized in that, described predetermined condition comprise in the following each or appoint multinomial:
-receive the mutual request of local user input;
-receive mutual request from other users;
Video player on-this user terminal brings into operation;
Video content begins to play on-this user terminal.
19. video interactive device according to claim 18 is characterized in that, the mutual request of described local user's input comprises the input of using in following each input equipment that arbitrary input equipment carried out:
-mouse;
-keyboard;
-sound/optical recognition device;
-handle;
Wherein, described mutual request from other users comprise in the following each or appoint multinomial:
-carry out mutual request message from being used for of described other users and described local user;
-from described other users' interaction content.
20. according to each described video interactive device in the claim 14 to 19, it is characterized in that, also comprise:
First obtains device, is used to obtain the positional information of described one or more interactive window, and described positional information is indicated the display position of described one or more interactive window in described synthetic picture;
Described synthesizer also is used for:
-when satisfying described predetermined condition, according to described positional information that described one or more interactive window and described video pictures is synthetic, the one or more interactive window that are used to show with generation are superimposed on the synthetic picture on the video pictures.
21. video interactive device according to claim 20 is characterized in that, described first obtains device also is used for:
-receiving the position indication information of described local user's input, described position indication information is used for indicating the display position of described one or more interactive window at described synthetic picture;
-with received position indication information as described positional information.
22. according to each described video interactive device in the claim 14 to 21, it is characterized in that, also comprise:
Second obtains device, is used to obtain the size information of described one or more interactive window, and described size information is indicated the demonstration size of described one or more interactive window;
Described synthesizer also is used for: 6
-when satisfying described predetermined condition, according to described size information that described one or more interactive window and described video pictures is synthetic, the one or more interactive window that are used to show with generation are superimposed on the synthetic picture on the video pictures.
23. video interactive device according to claim 22 is characterized in that, described second obtains device also is used for:
-receiving the big or small indication information of described local user's input, described big or small indication information is used to indicate the demonstration size of described one or more interactive window;
-with received big or small indication information as described size information.
24., it is characterized in that described synthesizer is used for according to each described video interactive device in the claim 14 to 23:
-when satisfying described predetermined condition, the respective pixel on the present frame of pixel in described one or more interactive window and described video pictures is carried out pixel synthesize, to generate described synthetic picture.
25. video interactive device according to claim 24 is characterized in that, described synthesizer also is used for:
-when satisfying predetermined condition, it is synthetic that the respective pixel on the present frame of pixel in described one or more interactive window and described video pictures is weighted pixel, to generate described synthetic picture.
26. video interactive device according to claim 25 is characterized in that, described synthesizer also comprises:
Weighted factor is determined device, is used for when satisfying predetermined condition, for the respective pixel on the present frame of pixel in described one or more interactive window and described video pictures is determined weighted factor respectively;
It is synthetic that pixel weighting synthesizer is weighted pixel according to determined weighted factor to the respective pixel on the present frame of pixel in described one or more interactive window and described video pictures, to generate described synthetic picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008100334929A CN101500125B (en) | 2008-02-03 | 2008-02-03 | Method and apparatus for providing user interaction during displaying video on customer terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008100334929A CN101500125B (en) | 2008-02-03 | 2008-02-03 | Method and apparatus for providing user interaction during displaying video on customer terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101500125A true CN101500125A (en) | 2009-08-05 |
| CN101500125B CN101500125B (en) | 2011-03-09 |
Family
ID=40946974
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008100334929A Expired - Fee Related CN101500125B (en) | 2008-02-03 | 2008-02-03 | Method and apparatus for providing user interaction during displaying video on customer terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101500125B (en) |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102067586A (en) * | 2008-03-05 | 2011-05-18 | 惠普开发有限公司 | Synchronizing and windowing external content in digital display systems |
| WO2012085659A1 (en) * | 2010-12-24 | 2012-06-28 | Starbucks (Hk) Limited | Improvements to interactive multimedia systems |
| CN102855053A (en) * | 2012-09-13 | 2013-01-02 | 惠州Tcl移动通信有限公司 | Mobile terminal based information contrast input method and mobile terminal |
| CN103067747A (en) * | 2011-10-20 | 2013-04-24 | 安美世纪（北京）科技有限公司 | Interactive digital TV display mode |
| WO2013127308A1 (en) * | 2012-03-02 | 2013-09-06 | 腾讯科技（深圳）有限公司 | Application display method and terminal |
| CN103518357A (en) * | 2011-03-31 | 2014-01-15 | Tivo有限公司 | Phrase-based communication system |
| CN103546816A (en) * | 2013-05-02 | 2014-01-29 | 乐视网信息技术（北京）股份有限公司 | User interface processing and video playing method and user interface system |
| CN103634690A (en) * | 2013-12-23 | 2014-03-12 | 乐视致新电子科技（天津）有限公司 | User information processing method, device and system in smart television |
| CN103634681A (en) * | 2013-11-29 | 2014-03-12 | 腾讯科技(成都)有限公司 | Method, device, client end, server and system for live broadcasting interaction |
| CN103702040A (en) * | 2013-12-31 | 2014-04-02 | 广州华多网络科技有限公司 | Real-time video graphic decoration superposing processing method and system |
| CN103914464A (en) * | 2012-12-31 | 2014-07-09 | 上海证大喜马拉雅网络科技有限公司 | Streaming media based interactive display method and system of accompanied comments |
| CN104394480A (en) * | 2014-03-10 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Method and device for realizing chat on mobile terminal |
| WO2015055041A1 (en) * | 2013-10-16 | 2015-04-23 | Tencent Technology (Shenzhen) Company Limited | Devices and methods for displaying interface elements of media players |
| WO2015081910A1 (en) * | 2013-12-04 | 2015-06-11 | 腾讯科技（深圳）有限公司 | Video playback method, device, and system |
| CN104717123A (en) * | 2013-12-13 | 2015-06-17 | 乐视网信息技术（北京）股份有限公司 | Message sending/receiving method and device and message interaction system |
| CN104735515A (en) * | 2013-12-19 | 2015-06-24 | 乐视网信息技术（北京）股份有限公司 | Method and terminal for displaying video state |
| CN105120359A (en) * | 2015-08-24 | 2015-12-02 | 天脉聚源（北京）科技有限公司 | Method and device of configuring interactive information for television interactive system |
| CN105307025A (en) * | 2014-06-20 | 2016-02-03 | 鸿富锦精密工业（深圳）有限公司 | Film hotspot processing method and system |
| CN105306468A (en) * | 2015-10-30 | 2016-02-03 | 广州华多网络科技有限公司 | Method for real-time sharing of synthetic video data and anchor client side |
| CN105872443A (en) * | 2016-03-30 | 2016-08-17 | 乐视控股（北京）有限公司 | Same video based chatting method and system, and server |
| CN105867756A (en) * | 2015-11-20 | 2016-08-17 | 乐视移动智能信息技术（北京）有限公司 | Browser control method and terminal equipment |
| CN106713968A (en) * | 2016-12-27 | 2017-05-24 | 北京奇虎科技有限公司 | Live broadcast data display method and device |
| WO2017092257A1 (en) * | 2015-11-30 | 2017-06-08 | 乐视控股（北京）有限公司 | Joint watching simulation method and apparatus in live broadcast |
| CN107256136A (en) * | 2012-06-25 | 2017-10-17 | 英特尔公司 | Using superposition animation facilitate by multiple users to media content while consume |
| CN107357480A (en) * | 2016-05-10 | 2017-11-17 | 上海连尚网络科技有限公司 | For realizing the method and apparatus interacted between user in more people's interactive applications |
| WO2018121556A1 (en) * | 2016-12-27 | 2018-07-05 | 北京奇虎科技有限公司 | Live broadcast data processing method, apparatus, program and medium |
| CN108345683A (en) * | 2018-03-05 | 2018-07-31 | 广东欧珀移动通信有限公司 | Webpage display process, device, terminal and storage medium |
| CN108475405A (en) * | 2015-11-18 | 2018-08-31 | 雷蛇(亚太)私人有限公司 | Interleave method, computer-readable medium and alternating device |
| CN109002242A (en) * | 2018-06-11 | 2018-12-14 | 北京电子工程总体研究所 | Target signature information display methods, device, equipment and the medium of touch-control |
| CN109218253A (en) * | 2017-06-29 | 2019-01-15 | 武汉矽感科技有限公司 | Multi-medium play method plays background server and mobile terminal |
| CN109656437A (en) * | 2018-11-30 | 2019-04-19 | 维沃移动通信有限公司 | A kind of information display method and terminal device |
| WO2019149037A1 (en) * | 2018-02-02 | 2019-08-08 | 优酷网络技术（北京）有限公司 | Video interaction method, user client, server, and storage medium |
| CN110708591A (en) * | 2018-07-10 | 2020-01-17 | 杭州海康威视系统技术有限公司 | Image processing method and device and electronic equipment |
| CN111277851A (en) * | 2020-02-13 | 2020-06-12 | 北京达佳互联信息技术有限公司 | Live broadcast method, device, equipment and computer readable storage medium |
| CN111694473A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Control method and control device for music suspension window of household appliance |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1143252C (en) * | 1998-01-15 | 2004-03-24 | 英业达股份有限公司 | Display device for interactive image synchronous captions and displaying method therefor |
| US7293275B1 (en) * | 2002-02-08 | 2007-11-06 | Microsoft Corporation | Enhanced video content information associated with video programs |
| CN101005609B (en) * | 2006-01-21 | 2010-11-03 | 腾讯科技（深圳）有限公司 | Method and system for forming interaction video frequency image |
| CN101076089A (en) * | 2006-06-23 | 2007-11-21 | 腾讯科技（深圳）有限公司 | Method for displaying captions |
-
2008
- 2008-02-03 CN CN2008100334929A patent/CN101500125B/en not_active Expired - Fee Related
Cited By (56)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102067586A (en) * | 2008-03-05 | 2011-05-18 | 惠普开发有限公司 | Synchronizing and windowing external content in digital display systems |
| US8719868B2 (en) | 2008-03-05 | 2014-05-06 | Hewlett-Packard Development Company, L.P. | Presentation of combined video signals from multiple sources |
| CN102067586B (en) * | 2008-03-05 | 2014-01-01 | 惠普开发有限公司 | Synchronizing and windowing external content in digital display systems |
| WO2012085659A1 (en) * | 2010-12-24 | 2012-06-28 | Starbucks (Hk) Limited | Improvements to interactive multimedia systems |
| CN103518357A (en) * | 2011-03-31 | 2014-01-15 | Tivo有限公司 | Phrase-based communication system |
| US9645997B2 (en) | 2011-03-31 | 2017-05-09 | Tivo Solutions Inc. | Phrase-based communication system |
| CN103067747A (en) * | 2011-10-20 | 2013-04-24 | 安美世纪（北京）科技有限公司 | Interactive digital TV display mode |
| CN103297855A (en) * | 2012-03-02 | 2013-09-11 | 腾讯科技（深圳）有限公司 | Application display method and terminal |
| CN103297855B (en) * | 2012-03-02 | 2015-05-20 | 腾讯科技（深圳）有限公司 | Application display method and terminal |
| US9936257B2 (en) | 2012-03-02 | 2018-04-03 | Tencent Technology (Shenzhen) Company Limited | Application display method and terminal |
| WO2013127308A1 (en) * | 2012-03-02 | 2013-09-06 | 腾讯科技（深圳）有限公司 | Application display method and terminal |
| AU2013225479B2 (en) * | 2012-03-02 | 2018-06-14 | Tencent Technology (Shenzhen) Company Limited | Application display method and terminal |
| US10956113B2 (en) | 2012-06-25 | 2021-03-23 | Intel Corporation | Facilitation of concurrent consumption of media content by multiple users using superimposed animation |
| US11526323B2 (en) | 2012-06-25 | 2022-12-13 | Intel Corporation | Facilitation of concurrent consumption of media content by multiple users using superimposed animation |
| US11789686B2 (en) | 2012-06-25 | 2023-10-17 | Intel Corporation | Facilitation of concurrent consumption of media content by multiple users using superimposed animation |
| CN107256136A (en) * | 2012-06-25 | 2017-10-17 | 英特尔公司 | Using superposition animation facilitate by multiple users to media content while consume |
| CN102855053B (en) * | 2012-09-13 | 2016-06-15 | 惠州Tcl移动通信有限公司 | The method inputted based on the information contrast of mobile terminal and mobile terminal |
| CN102855053A (en) * | 2012-09-13 | 2013-01-02 | 惠州Tcl移动通信有限公司 | Mobile terminal based information contrast input method and mobile terminal |
| CN103914464A (en) * | 2012-12-31 | 2014-07-09 | 上海证大喜马拉雅网络科技有限公司 | Streaming media based interactive display method and system of accompanied comments |
| CN103914464B (en) * | 2012-12-31 | 2017-05-24 | 上海证大喜马拉雅网络科技有限公司 | Streaming media based interactive display method and system of accompanied comments |
| CN103546816A (en) * | 2013-05-02 | 2014-01-29 | 乐视网信息技术（北京）股份有限公司 | User interface processing and video playing method and user interface system |
| WO2015055041A1 (en) * | 2013-10-16 | 2015-04-23 | Tencent Technology (Shenzhen) Company Limited | Devices and methods for displaying interface elements of media players |
| CN104571779A (en) * | 2013-10-16 | 2015-04-29 | 腾讯科技（深圳）有限公司 | Method and device for displaying interface elements of player |
| CN103634681B (en) * | 2013-11-29 | 2017-10-10 | 腾讯科技(成都)有限公司 | Living broadcast interactive method, device, client, server and system |
| CN103634681A (en) * | 2013-11-29 | 2014-03-12 | 腾讯科技(成都)有限公司 | Method, device, client end, server and system for live broadcasting interaction |
| US10014030B2 (en) | 2013-12-04 | 2018-07-03 | Tencent Technology (Shenzhen) Company Limited | Method, device and system for playing video |
| WO2015081910A1 (en) * | 2013-12-04 | 2015-06-11 | 腾讯科技（深圳）有限公司 | Video playback method, device, and system |
| CN104717123A (en) * | 2013-12-13 | 2015-06-17 | 乐视网信息技术（北京）股份有限公司 | Message sending/receiving method and device and message interaction system |
| CN104735515A (en) * | 2013-12-19 | 2015-06-24 | 乐视网信息技术（北京）股份有限公司 | Method and terminal for displaying video state |
| CN103634690A (en) * | 2013-12-23 | 2014-03-12 | 乐视致新电子科技（天津）有限公司 | User information processing method, device and system in smart television |
| CN103702040B (en) * | 2013-12-31 | 2018-03-23 | 广州华多网络科技有限公司 | Real-time video figure ornament superposition processing method and system |
| CN103702040A (en) * | 2013-12-31 | 2014-04-02 | 广州华多网络科技有限公司 | Real-time video graphic decoration superposing processing method and system |
| CN104394480A (en) * | 2014-03-10 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Method and device for realizing chat on mobile terminal |
| CN105307025A (en) * | 2014-06-20 | 2016-02-03 | 鸿富锦精密工业（深圳）有限公司 | Film hotspot processing method and system |
| CN105120359A (en) * | 2015-08-24 | 2015-12-02 | 天脉聚源（北京）科技有限公司 | Method and device of configuring interactive information for television interactive system |
| CN105306468B (en) * | 2015-10-30 | 2019-01-11 | 广州华多网络科技有限公司 | A kind of method and its main broadcaster's client of synthetic video real-time data sharing |
| CN105306468A (en) * | 2015-10-30 | 2016-02-03 | 广州华多网络科技有限公司 | Method for real-time sharing of synthetic video data and anchor client side |
| CN108475405A (en) * | 2015-11-18 | 2018-08-31 | 雷蛇(亚太)私人有限公司 | Interleave method, computer-readable medium and alternating device |
| CN105867756A (en) * | 2015-11-20 | 2016-08-17 | 乐视移动智能信息技术（北京）有限公司 | Browser control method and terminal equipment |
| WO2017092257A1 (en) * | 2015-11-30 | 2017-06-08 | 乐视控股（北京）有限公司 | Joint watching simulation method and apparatus in live broadcast |
| CN105872443A (en) * | 2016-03-30 | 2016-08-17 | 乐视控股（北京）有限公司 | Same video based chatting method and system, and server |
| CN107357480A (en) * | 2016-05-10 | 2017-11-17 | 上海连尚网络科技有限公司 | For realizing the method and apparatus interacted between user in more people's interactive applications |
| WO2018121556A1 (en) * | 2016-12-27 | 2018-07-05 | 北京奇虎科技有限公司 | Live broadcast data processing method, apparatus, program and medium |
| CN106713968B (en) * | 2016-12-27 | 2020-04-24 | 北京奇虎科技有限公司 | Live data display method and device |
| CN106713968A (en) * | 2016-12-27 | 2017-05-24 | 北京奇虎科技有限公司 | Live broadcast data display method and device |
| WO2018121557A1 (en) * | 2016-12-27 | 2018-07-05 | 北京奇虎科技有限公司 | Live broadcast data display method, device, program and medium |
| CN109218253A (en) * | 2017-06-29 | 2019-01-15 | 武汉矽感科技有限公司 | Multi-medium play method plays background server and mobile terminal |
| WO2019149037A1 (en) * | 2018-02-02 | 2019-08-08 | 优酷网络技术（北京）有限公司 | Video interaction method, user client, server, and storage medium |
| CN108345683B (en) * | 2018-03-05 | 2021-10-22 | Oppo广东移动通信有限公司 | Webpage display method, device, terminal and storage medium |
| CN108345683A (en) * | 2018-03-05 | 2018-07-31 | 广东欧珀移动通信有限公司 | Webpage display process, device, terminal and storage medium |
| CN109002242A (en) * | 2018-06-11 | 2018-12-14 | 北京电子工程总体研究所 | Target signature information display methods, device, equipment and the medium of touch-control |
| CN110708591B (en) * | 2018-07-10 | 2022-04-26 | 杭州海康威视系统技术有限公司 | Image processing method and device and electronic equipment |
| CN110708591A (en) * | 2018-07-10 | 2020-01-17 | 杭州海康威视系统技术有限公司 | Image processing method and device and electronic equipment |
| CN109656437A (en) * | 2018-11-30 | 2019-04-19 | 维沃移动通信有限公司 | A kind of information display method and terminal device |
| CN111694473A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Control method and control device for music suspension window of household appliance |
| CN111277851A (en) * | 2020-02-13 | 2020-06-12 | 北京达佳互联信息技术有限公司 | Live broadcast method, device, equipment and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101500125B (en) | 2011-03-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101500125B (en) | Method and apparatus for providing user interaction during displaying video on customer terminal | |
| US10277951B2 (en) | Method of recommending broadcasting contents and recommending apparatus therefor in multimedia contents reproducing device | |
| US9596518B2 (en) | System and method for searching an internet networking client on a video device | |
| US10595089B2 (en) | Information processing apparatus, information processing method, program, and information processing system | |
| US8732749B2 (en) | Virtual desktop services | |
| US20090183199A1 (en) | Devices, Systems, and Methods Regarding Advertisement on Demand | |
| US20140351865A1 (en) | System and method for real-time composite broadcast with moderation mechanism for multiple media feeds | |
| JP6067708B2 (en) | How to capture video related content | |
| US20070180488A1 (en) | System and method for processing video content | |
| CN101467451A (en) | Method for displaying a mosaic image in a receiver for the selection of audiovisual programs, receivers and related servers | |
| US20140366055A1 (en) | Terminal, a set information inputting method of an electronic apparatus, a computer readable information storage medium, and an electronic apparatus | |
| CN111586452A (en) | Cross-device interaction method and device and playing device | |
| US20140337883A1 (en) | Method and apparatus for networking media content consumption status in a group of users | |
| KR20140038799A (en) | Image display apparatus, server and method for operating the same | |
| US20020154244A1 (en) | Moving images synchronization system | |
| US20140331258A1 (en) | Apparatus and method for networking media content consumption status in a group of users | |
| CN111953838B (en) | Call dialing method, display device and mobile terminal | |
| JP2012209824A (en) | Information management device, information management method and program | |
| CN106302543B (en) | Multimedia display method, device and system | |
| JP6736517B2 (en) | Electronic device and method | |
| CN111818369B (en) | Multi-account personalized artificial intelligent television interface display method and system thereof | |
| WO2024032044A1 (en) | Display method and display device | |
| CN117407611A (en) | Portal wall-mounting method, portal wall-mounting device and computer storage medium | |
| CN116192788A (en) | Information processing method, device, equipment, medium and program product | |
| CN113344640A (en) | Advertisement display method, device, sending end and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110309 Termination date: 20220203 |