CN101500125B - Method and apparatus for providing user interaction during displaying video on customer terminal - Google Patents

Method and apparatus for providing user interaction during displaying video on customer terminal Download PDF

Info

Publication number
CN101500125B
CN101500125B CN 200810033492 CN200810033492A CN101500125B CN 101500125 B CN101500125 B CN 101500125B CN 200810033492 CN200810033492 CN 200810033492 CN 200810033492 A CN200810033492 A CN 200810033492A CN 101500125 B CN101500125 B CN 101500125B
Authority
CN
Grant status
Grant
Patent type
Prior art keywords
interactive
video
user
information
window
Prior art date
Application number
CN 200810033492
Other languages
Chinese (zh)
Other versions
CN101500125A (en )
Inventor
汪奕菲
Original Assignee
突触计算机系统(上海)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date

Links

Abstract

The invention provides a method for providing user interaction when in video displaying on a user terminal and a device. The invention directly synthesizes interaction windows of a local user and a local terminal device or other online users with a video picture so as to generate a synthesized picture of overlapping the interaction windows on the video picture for displaying, thereby improving the convenience and flexibility of users when watching videos on line and enhancing the user experience.

Description

用户终端上用于在视频显示时提供用户交互的方法及装置 Providing user interaction in the method and apparatus for a video display on a user terminal

技术领域 FIELD

[0001] 本发明涉及视频播放领域,尤其涉及在用户终端所播放的视频画面上提供用户交互的功能。 [0001] The present invention relates to video displays, and in particular relates to providing user interaction functionality in the video picture playback of the user terminal.

[0002] 背景技术 [0002] BACKGROUND OF THE INVENTION

[0003] 在现有技术中,用户在线观看网络视频内容的过程中,尤其是视频窗口为全屏状态下的时候,如果用户想收看另一个网络视频内容,往往需要从当前的全屏的视频状态下退出,视频窗口变为一个缩小了的窗口,然后,用户到网络服务提供商的网站上找到所欲新观看的网络视频内容的链接,并打开此链接,然后重新切回到原视频窗口,再全屏该视频窗口以观看新的视频内容。 Process [0003] In the prior art, online users watched online video content, especially video window when in full screen mode, if you want to watch another online video content, often require full-screen video from the current state exit, the video window into a scaled-down window, then the user to the network service provider's website to find links to online video content desired new watch, and open this link, then again switch back to the original video window, and then the full-screen video window to watch the new video content. 当用户再次需要更改所欲观看的视频内容的时候,或者需要多次在不同视频内容间切换的时候,就需要不停的重复上述过程,因此操作显得比较繁琐,用户的体验度不高。 When the user needs to change again the desired video content viewing time, or times when you need to switch between different video content, you need to keep repeating the process, so the operation seemed more complicated, the user experience is not high. 再有,用户在全屏观看视频内容的同时,如果还希望实时的与他人进行沟通和交流,往往也需要首先从全屏观看状态下退出,视频窗口被切换到一缩小了的窗口,然后用户启动诸如msn或者QQ之类的聊天软件以与他人沟通,有时可能还会需要用户在视频窗口和用户间交互窗口之间来回切换,很不方便,即使将用户间交互窗口置顶于视频窗口之上,也只是一个简单的窗口覆盖,用户间交互窗口与视频窗口通常很不一致,视觉效果很不理想,而且通常用户间交互窗口会遮盖部分视频画面,影响用户的观看,用户体验度不好。 Furthermore, users watch video content in full-screen at the same time, if you also want real-time communication and exchange with others, often need to exit from full-screen viewing state, the video window is switched to a narrowing of the window, then the user initiates such as like msn or QQ chat software to communicate with others, which may also require the user to switch back and forth between the video window and the window of interaction between users, very convenient, even if the user interaction between the top window on top of the video window, too just a simple window covering, inter-window user interaction with the video window is usually very inconsistent, the visual effect is far from ideal, but is usually between user interaction window will cover part of the video screen, affecting the user's viewing, the user experience is not good. 或者,即使观看视频和在线交流可以在一个浏览器中同时进行,但通常是视频画面被缩小呈现在浏览器的一小块区域,而用户则在浏览器中的另一个专门区域进行在线聊天之类的交流,在这种情况下,用户是无法实现全屏观赏视频内容的。 Alternatively, even watch videos and online communication may be performed simultaneously in a browser, but is usually presented video pictures is reduced in a small area of ​​the browser, and the user is online chat region other specialized browser AC class, in this case, the user is unable to achieve full-screen viewing of video content. 另外,例如在广播电视中,有时会在电视内容画面下方叠加一滚动条以播放一些诸如实事新闻等文字信息,但对于用户来说,这些滚动条中的文字都是预先生成好以后再叠加视频画面上并发送给各个用户的,因此每个用户所观看的文字信息是一样的,用户不能主动进行动态文字和图片叠加的操作以实现个性化的显示。 In addition, for example, in broadcast television, sometimes superimposed on a scroll bar to play some and then superimposed text information such as news and other things, but for users, these are the words of the scroll bar after a good pre-generated video content at the bottom of the TV screen and sent to each user on the screen, so each user to view text information is the same, the user can not take the initiative to dynamic text and images superimposed operations to achieve the display personalization.

[0004] 发明内容 [0004] SUMMARY OF THE INVENTION

[0005] 鉴于现有技术中存在上述问题,本发明提出了一种在用户终端上用于在视频显示时提供用户交互的方法,其直接将用户交互窗口如用户间的用户间交互窗口及其中的动态聊天文字内容、动态图片或者控制菜单等与视频播放画面合成以生成该交互窗口叠加于视频画面上的合成画面。 [0005] In view of the aforementioned problems in the prior art, the present invention provides a method of providing user interaction in the video display method used on a user terminal, user interaction directly between the window as user interaction between a user and the window dynamic chat text, moving pictures or the like with the video playback control menu screen synthesis to generate a synthesized the interactive window superimposed on the video picture screen.

[0006] 根据本发明的第一方面,提供了一种在用户终端上用于在视频显示时提供用户交互的方法,包括以下步骤:a)判断预定条件是否满足,所述预定条件包括接收到本地用户输入的交互请求、接收到来自其他用户的交互请求、本用户终端上视频播放器开始运行或者本用户终端上视频内容开始播放中的任意项;b)当满足所述预定条件时,将一个或多个交互窗口与视频播放画面合成,以生成用于显示的一个或多个交互窗口叠加于视频播放画面上的合成画面;其中,所述一个或多个交互窗口包括发送信息栏,该方法还包括:当满足所述预定条件时,将本地用户输入的交互信息加入到所述一个或多个交互窗口的发送信息栏中,以生成一个或多个更新后的交互窗口;所述步骤b还包括:将所述一个或多个更新后的交互窗口与所述视频画面合成,以生成用于显示 [0006] According to a first aspect of the present invention, there is provided a method of providing user interaction in the video display method used on a user terminal, comprising the steps of: a) determining whether a predetermined condition is satisfied, said predetermined condition comprises receiving interaction request local user input, receives interactive requests from other users, the present user terminal starts running on a video player or video content on a user terminal according to any of the playback start; when b) when a predetermined condition is satisfied, the one or more interactive windows with the video player screen synthesis, to generate one or more interactive windows displayed superimposed on the composite screen video playback picture; wherein the one or more interactive windows comprises transmitting information bar, the the method further comprises: when a predetermined condition is satisfied, the local user input mutual information is added to the transmission information field of the one or more interactive windows, to generate the one or more updated interactive window; said step b further comprising: the one or more updates of the interactive window of the synthesized video picture, to generate a display 一个或多个更新后的交互窗口叠加于所述视频画面上的合成画面;该方法还包括步骤:m.将所述本地用户输入的交互信息提供给与所述本地用户输入的交互信息相对应的交互对象。 One or more updated interactive window superimposed on the video picture synthesized picture; the method further comprising the step of: m the local user interaction information to provide interactive input information given to the local user input corresponds. the interactive objects.

[0007] 可选地,该方法还包括步骤m)将本地用户输入的交互信息提供给与所述本地用户输入的交互信息相对应的交互对象,根据交互方式的不同,所述交互对象包括本地终端设备和/或其他用户。 [0007] Optionally, the method further comprising the step of m) the mutual information input by a user to provide local interactive information given to the local user input corresponding to the interactive objects is different, according to the interactive objects include local interaction terminal devices and / or other users.

[0008] 根据本发明的第二方面,提供了一种在用户终端上用于在视频显示时提供用户交互的视频交互装置,其中,包括:判断装置,用于判断预定条件是否满足,所述预定条件包括接收到本地用户输入的交互请求,接收到来自其他用户的交互请求,本用户终端上视频播放器开始运行或者本用户终端上视频内容开始播放;合成装置,用于当满足所述预定条件时,将一个或多个交互窗口与视频播放画面合成,以生成用于显示的一个或多个交互窗口叠加于视频播放画面上的合成画面;所述一个或多个交互窗口包括发送信息栏,该视频交互装置还包括第一加入装置,用于当满足所述预定条件时,将本地用户输入的交互信息加入到所述一个或多个交互窗口的发送信息栏中,以生成一个或多个更新后的交互窗口;所述合成装置还用于,将所述一个或多个更新后的 [0008] According to a second aspect of the present invention, there is provided a means for providing video interactive user interaction when the video displayed on the terminal for user, comprising: judging means for judging whether predetermined conditions are satisfied, the the predetermined condition including the received interactive request local user input, receives interactive requests from other users, the present user terminal on the video player is running or present on the user terminal begins playback of video content; synthesizing means for, when said predetermined satisfied the condition, one or more interactive windows with the video player screen synthesis, to generate one or more interactive windows displayed superimposed on the composite screen video playback picture; the one or more interactive windows comprises sending information bar the interactive video apparatus further comprises a first adding means for, when said predetermined condition is satisfied, the local user input mutual information is added to the transmission information field of the one or more interactive windows, to generate one or more an updated interactive window; said further means for synthesizing, the one or more post-update 交互窗口与所述视频画面合成,以生成用于显示的一个或多个更新后的交互窗口叠加于所述视频画面上的合成画面;所述视频交互装置还包括发送装置,用于将本地用户输入的交互信息提供给与所述本地用户输入的交互信息相对应的交互对象,包括本地终端设备和/或其他用户。 Interactive window with the video picture synthesized to generate one or more updated interactive window superimposed on the video picture displayed synthesized picture; the apparatus further comprises a transmitting video interactive means for the local user interaction information to provide interactive input information given to the local user input corresponding to the interactive objects, including a local terminal device and / or other users.

[0009] 采用本发明所提供的技术方案,用户可在观看视频内容的同时,直接在所观看的视频画面上进行人机、用户间交互,交互的动态文字和图片等信息直接合成显示于所观看的视频画面中,优选地,所述合成中还能实现交互窗口透明和半透明的效果,大大提升视觉效果和用户的体验度。 [0009] The technical solution provided by the present invention, the user can, directly on the video screen of the display unit viewed while viewing the video content, the interaction between users, interactive dynamic text and images and other information directly to the display synthesis viewing the video picture, preferably the synthesis window can interact transparent and translucent effects greatly enhance the visual effects and the degree of experience of the user.

[0010] 附图说明 [0010] BRIEF DESCRIPTION OF DRAWINGS

[0011] 通过阅读以下参照附图所作的对非限制性实施例的详细描述,本发明的其它特征、目的和优点将会变得更明显。 [0011] By reading the following detailed description of non-limiting embodiments with reference to the accompanying drawings Other features, objects and advantages of the invention will become more apparent.

[0012] 图1示出了一个网络在线观看视频的系统框图; [0012] FIG. 1 shows a block diagram of a network system to watch online video;

[0013] 图2是根据本发明的一个具体实施方式的在用户终端上用于在视频显示时提供用户交互的方法的流程图; [0013] FIG. 2 is accordance with the invention on the user terminal provides a flowchart of the user interaction when a video display method for a particular embodiment;

[0014] 图3示出了未叠加交互窗口的原始视频画面; [0014] FIG. 3 shows an original video image is not superimposed interactive window;

[0015] 图4为根据本发明的一个具体实施例的交互窗口与视频画面合成后的合成画面第一示例图; [0015] FIG. 4 is an interactive window synthesized picture after synthesis with the video picture a first exemplary embodiment according to one specific embodiment of the present invention;

[0016] 图5为根据本发明的一个具体实施例的交互窗口与视频画面合成后的合成画面第二示例图; [0016] FIG. 5 is a composite picture of the video picture with the interactive window Synthesis of the second exemplary embodiment of the present invention, according to one specific embodiment;

[0017] 图6为根据本发明的一个具体实施方式的在用户终端上用于在视频显示时提供用户交互的视频交互装置的框图 A block diagram [0017] Figure 6 provides user interaction when the video displayed on the user terminal according to the present invention a particular embodiment is a video interaction device

[0018] 在附图中,相同或相似的附图标记代表相同或相似的装置或步骤特征。 [0018] In the drawings, same or similar reference numerals or like means or step features.

[0019] 具体实施方式 [0019] DETAILED DESCRIPTION

[0020] 下面结合附图和具体实施例对本发明做进一步的详细说明。 Drawings and specific embodiments of the present invention will be further described in detail [0020] below in conjunction. 前已述及,本发明的技术目的在于为用户终端提供生成交互窗口叠加于视频画面上的方法和装置,基于此发明目的,本发明的应用场景可以包括但不限于视频点播(Video on Demand)、直播(live)以及本地预存的媒体文件的播放。 Mentioned before, the technical object of the present invention is to provide a method and apparatus for generating an interactive window superimposed on the video screen of the user terminal, based on the object of this invention, application scenario of the present invention may include, but are not limited to, VOD (Video on Demand) play live (live) as well as local pre-stored media files.

[0021] 图1示出了一个网络在线观看视频的系统框图,其中包括3个在线用户(示为用户终端1、用户终端2和用户终端3)以及一视频服务器0。 [0021] FIG. 1 shows a block diagram of a network system to watch online video, including three user (shown as user terminal 1, the user terminal 2 and the user terminal 3) 0, and a video server. 其中,该视频服务器0为用户终端1、2、3提供视频资源以及视频资源的播放服务。 Among them, the video server to the user terminal 0 and resources to provide video services play video resources, 2, 3. 本领域技术人员应理解,本发明的应用并不局限于上述客户端/服务器架构的网络系统,本发明同样适用于基于P2P协议进行视频数据传输的网络系统,也即,用户终端1上所播放的视频资源可以至少部分来源于用户终端2和3。 Those skilled in the art will appreciate, the present invention is applied is not limited to the client / server architecture of the network system, the present invention is equally applicable to video data transmission network system based on P2P protocol, i.e., a play on the user terminal video assets may be at least partially derived from the user terminal 2 and 3. 其中,对于某一具体用户终端,使用该用户终端的用户即被称为本地用户,使用其它两个用户终端的用户则被称为其它用户。 Wherein, for a particular user terminal, a user using the user terminal, i.e., the local user is called, using the other two are called user terminal of the user to other users.

[0022] 以下,不失一般性地以客户端/服务器架构下的网络视频点播为例进行说明。 [0022] The following, without loss of generality in a client / server network video-on-demand in architecture as an example. 本发明典型地通过计算机软件的方式实现,例如,用户终端1、2、3通过访问拥有视频服务器0 的网络服务提供商网站(例如,www, pplive. com)以下载所述点播所必需的在线视频观看软件(例如,PPLive Player),然后通过运行软件来连接到视频服各器0以点播视频内容。 The present invention is typically implemented by way of computer software, for example, a video server has a user terminal 1,2,3 network service provider website 0 (e.g., www, pplive. Com) to download the necessary demand online access video viewing software (e.g., PPLive Player), and then connected to the video server to the respective 0-demand video content by running software. 特别地,该在线视频观看软件还集成有聊天功能,于是用户终端1的用户在观看视频内容的同时,还能在视频窗口中直接启动聊天功能以与用户终端2和用户终端3的用户进行实时交流沟通。 In particular, the online video chat software also integrated, so the user of the terminal 1 of the user while viewing the video content, but also to start the chat function to direct the user terminal 2 and the user terminal 3 with the user in real-time video window communicate. 并且,用户终端1与2、3的聊天内容直接被叠加显示于用户终端1上所播放的视频画面中,这样,能够保证用户终端1的用户无需从全屏的视频状态下退出来,保证了观赏视频内容时的视觉冲击力。 Further, the user terminal 1 and the chat content 3 is directly displayed superimposed on the video screen of the user terminal 1 being played, so that, to ensure that the user without leaving the user of the terminal 1 from the full screen video state, to ensure that the ornamental when the visual impact of video content. 另外,用户终端1的用户在观看视频内容的过程中,还可通过点击鼠标或者按下键盘功能键等方式来启动一人机交互窗口,如,视频内容菜单,该视频内容菜单同样被直接叠加显示于用户终端1上所播放的视频画面中,用户终端1的用户同样无需从全屏的视频状态下退出,便可通过在视频内容菜单中点击其它视频内容的链接, 轻松从当前播放的视频内容切换到其所欲观看的所述其它视频内容。 Further, the user terminal 1 of the user during the viewing of the video content, or may be initiated by a mouse click interactive window, such as video content menu Press keyboard function keys, etc., the same video content is displayed directly superimposed menu the user terminal 1 video played on the screen, the user terminal 1 again without the user from the state exit full-screen video, you can by clicking on other video content in the video content menu links to easily switch from the currently playing video content to which the other video content desired to watch.

[0023] 用户终端1、2、3上在同一时刻所播放的视频内容可以是相同的,比如同一部影片或者同一场体育赛事,于是用户终端1、2、3的用户可在观看相同影片或体育赛事的同时, 实时进行聊天以交流观感,而相互间的聊天内容被直接叠加显示于所观看的行进中的视频画面中,于是观看、交流两不误,大大提升了用户的体验度。 [0023] video content on the user terminal 1, 2, played at the same time can be the same, such as the same movie or a sporting event with, so the user terminals 1, 2, users can watch the same movie or at the same time sporting events, real-time chat to exchange impressions, and chat with one another directly displayed superimposed travel watched the video screen, then watch, correct exchange, greatly enhance the user experience. 本领域技术人员应理解,本发明的应用并不仅限于此种情形,换言之,用户终端1、2、3上所播放的视频内容也可以是不同的甚至完全不相干的,本领域技术人员理解,虽然用户终端1、2、3的用户虽未同时观看相同的视频内容,但这并不妨碍他们进行交互,实际上,该等用户间的聊天内容可涉及当时他们所感兴趣的任何话题。 Those skilled in the art will appreciate, the present invention is applied is not limited to this case, in other words, the video content played on the user terminals 2, 3 can be different or even completely irrelevant, those skilled in the art understand, Although the user terminals 1, 2 users, although not simultaneously view the same video content, but that does not prevent them from interacting, in fact, chats between those users may involve any topic of interest to them at that time. 甚至,用户终端1、2、3上可以不播放任何视频内容,用户终端1、2、 3的用户专心进行聊天交流,此时在线视频观看软件即用作一聊天软件。 Even, the user terminal may not be played on any video content 2, 3, the user terminals 1, 2, 3 concentrate user chat exchange, this time online video software that is used as a chat software.

[0024] 图2为根据本发明的一个具体实施方式在用户终端上用于在视频显示时提供用户交互的方法的流程图,其中,所述用户交互包括用户间交互和/或人机交互。 [0024] Figure 2 is a specific embodiment of the present invention on the user terminal provides a flowchart of the user interaction when a method for video display, wherein the user interaction comprises a user interaction between and / or human-computer interaction. 下面参照图2并结合图1对本发明进行详细说明。 FIG 2 and FIG. 1 in conjunction with the present invention will be described in detail below with reference to. 假设,用户终端1、2、3同时在线观看网络服务器0上所提供的影片《虎胆龙威4》,由于场景假设为点播,因此,用户终端1、2、3上的视频画面不尽相同,假设用户终端1屏幕显示的视频画面如图4所示。 Suppose, the user terminals 2, 3 while watching a video on a network server online 0 provides "Die Hard 4", since the scene is assumed to demand, therefore, the video image on the user terminals 2, 3 are not the same video picture, assuming that the user terminal 1 displays a screen as shown in FIG.

[0025] 可见,在如图4所示地全屏播放该视频内容时,用户所看到的视频画面与通常通过windows media player或者realplayer全屏观看影片时效果无异。 [0025] visible, when the full-screen playback of the video content as shown in FIG. 4, the user sees the video picture with a normal video viewing windows media player or by realplayer full screen effect is no different. 很灵活地,本发明可以在视频播放伊始甚至播放器启动伊始即开始交互窗口与视频画面的叠加,优选地,本发明在检测到特定事件发生后再将交互窗口与当前播放画面进行叠加,以生成交互窗口叠加在视频画面之上的合成画面。 Very flexible, even at the beginning of the present invention may start at the beginning of the player that is superimposed with the video picture interactive window starts, preferably, the present invention is the interactive window will be superimposed on the currently playing screen is detected after a specific event occurs in the video player to composite picture generating interactive window superimposed on the video picture. 以用户终端1为例,在播放《虎胆龙威4》的过程中,本地用户移动鼠标、点击鼠标左键、按下多功能键盘上的一个功能键、其它用户发来交互请求等等均能够作为触发用户终端1上的上述叠加的事件,典型地,用户终端1根据预存信息(指示哪些事件会触发交互窗口与视频画面的叠加,该预存信息可集成于所述在线视频观看软件中),来判断是否发生了触发所述叠加的事件。 In the user terminal 1 as an example, during playback "Die Hard 4", the local user moves the mouse, click the left mouse button, pressing a function key on the multifunctional keyboard, the other user requests, etc. are sent to interact as the above-described trigger events can be superimposed on the user terminal, typically, the user terminal 1 according to the pre-stored information (indicating which events will trigger the interactive window is superimposed with the video picture, the pre-stored information may be integrated to the online video viewing software) to determine whether the trigger of the superposition of the incident. 更具体地,所述预存信息中可以细化确定哪些事件与用户间交互相关,哪些事件与人机交互相关。 More specifically, the stored information can be refined to determine which events associated with the interaction between the user and which events related to human-computer interaction. 从而在检测到特定事件后,触发相应类型的交互窗口与视频画面的叠加,这些内容将在下文中有详细介绍。 So that after detection of a particular event, trigger the corresponding type of interaction with the video picture superimposed window, the content will be described in detail below.

[0026] 参看图2,在步骤Sl中,用户终端1判断预定条件是否得到满足,优选地,在《虎胆龙威4》这一视频内容的播放过程中,所述步骤Sl周期性地执行,直至检测到预定条件满足。 [0026] Referring to Figure 2, in step Sl, the user terminal 1 determines whether a predetermined condition is satisfied, preferably, in the "Die Hard 4" during playback of the video content, the step Sl is performed periodically , until detecting a predetermined condition is satisfied. 本例中,假设用户终端1的用户按下了多功能键盘上的一个功能键,而根据预存信息, 该功能键能够触发一个人机交互窗口与视频画面的叠加。 In this example, assume that the user terminal 1 to the user presses a function key on the multifunctional keyboard, according to pre-stored information, the function key can trigger a superimposed window and interactive video picture. 因此,在一次执行步骤Sl时,用户终端1将判断出预定条件满足。 Thus, in step Sl is executed once, the user terminal 1 determines that the predetermined condition is satisfied.

[0027] 于是,用户终端1需要将相应的交互窗口与视频画面进行合成,而在此之前,尚需确定交互窗口在合成画面中的位置及其大小。 [0027] Thus, the user terminal needs a corresponding interactive window synthesized with the video picture, but before, still need to determine the position and size of the interactive window in the composite picture. 于是,在步骤S2中,用户终端1获得交互窗口a的位置信息,所述位置信息用于指示该交互窗口a在与《虎胆龙威4》视频画面进行合成后所得的合成画面中的显示位置。 Then, in step S2, the user terminal obtaining location information of a interactive window, the position information for indicating a display in the interactive window obtained after synthesis and "Die Hard 4" picture video picture synthesis position. 参看图3,其中示出了以未经合成的视频画面为参考的坐标系,以分辨率1024*768的视频画面为例,一个像素点在其中的坐标取值范围为(0,0) 至(1024,768)。 Referring to Figure 3, which shows a non-composite video picture in a reference coordinate system, the video image resolution 1024 * 768, for example, a pixel at the coordinates where the range (0,0) to (1024, 768). 因此,通过确定交互窗口a的一个特殊点的坐标,即可确定该交互窗口a的位置。 Thus, the coordinates of a particular point by determining the interaction of a window, you can determine the position of the interaction of a window. 在实际应用中,可以预先设定该位置信息,例如,缺省地设定交互窗口a的最左上角一个像素点的坐标为(724,568),于是,该窗口将位于合成画面的右下角落。 In practice, the location information may be previously set, e.g., a default set in the upper left corner pixel coordinates of the point of interaction of a window (724,568), so that the synthesis window at the lower right of the screen corner.

[0028] 此外,用户终端1还需要确定该交互窗口a的大小,譬如,在缺省地设定交互窗口a最左上角一个像素点坐标为(724,568)的基础上,可以再缺省地将该窗口的大小设定为300*200,于是,该窗口的最右下角一个像素点正好叠加在原始视频画面最右下角的一个像素点上,由此,交互窗口a可以恰好(透明或半透明或不透明地)完全覆盖原始视频画面的右下角落。 [0028] In addition, the user terminal 1 needs to determine a size of the window of interaction, such as, in a default interactive window set the upper left corner of a pixel's coordinates (724,568) on the basis of default can then the window size is set to 300 * 200, then, a most bottom right pixel of the window exactly superimposed on the lower right corner of a pixel of the original video picture, thus, a window can be exactly interaction (or transparent be translucent or opaque) completely covers the lower right corner of the original video picture. 如图4所示。 As shown in Figure 4.

[0029] 可选地,交互窗口a的位置信息和大小信息可以由用户在进行画面合成前确定, 譬如,在步骤Sl中得到预定条件满足的判断结果后,用户终端1在视频画面的缺省位置将一个具有缺省大小的信息输入窗口与视频画面进行合成,并指示用户输入与其所希望的交互窗口a的位置和大小相关的参数,进而确定交互窗口a的位置信息和大小信息。 After [0029] Alternatively, the interactive window position information and a size information may be determined before the screen synthesis is performed by the user, for example, the judgment result obtained in step satisfies a predetermined condition Sl, the user terminal 1 in the default video picture the default size having a location information input window synthesized video picture, and instructs the user to input their desired position and size of a window of interaction parameters related interactive window and to determine a position information and size information.

[0030] 可选地,交互窗口a的位置信息和大小信息可以在基于上述任一方式确定后,在播放合成画面的过程中,根据用户进一步输入的信息来进行更新,典型地,用户通过鼠标点击和拖拽来实现该等信息的更新。 [0030] Alternatively, the interactive window position information and a size information may be determined based upon any of the embodiments, composite screen during playback in accordance with a further input information of the user to be updated, typically, mouse users click and drag to achieve update such information.

[0031] 然后,在步骤S4中,按照步骤S2与S3中得到的交互窗口a的位置信息和大小信息,用户终端1将一个包含“聊天”、“视频”等圆形按钮的人机交互窗口a与正在播放的《虎胆龙威4》的视频画面合成,以生成该交互窗口a叠加于《虎胆龙威4》的视频画面上的合成画面并显示于用户终端1上。 [0031] Then, in step S4, following the procedure of S2 and S3 obtained in a interactive window position information and size information, a user terminal 1 the window comprises interactive "chat", "video" and the circular button and it is playing a "Die Hard 4" video screen synthesis, the interaction to generate a window superimposed on the synthesized picture "Die Hard 4 'and a video picture displayed on the user terminal 1. 如图5中右下部分所示。 5 in the lower right portion as shown in FIG. 为简明起见,其中同时示出了其它交互窗口,并将在下文中有相应的详细描述。 For brevity, which also shows the other interactive windows and corresponding detailed description below.

[0032] 有利地,交互窗口a在图4中所示的位置(合成画面的右下角)为一优选位置。 [0032] Advantageously, a position of the interactive window (lower right corner of the synthesized picture) shown in FIG. 4 is a preferred position. [0033] 一方面,由于视频画面的要素部分通常会被安排在画面较靠近中央或其它特定位置的地方以适应人们的视觉惯性,将交互窗口a置于合成画面的角落部分可尽可能的减少对《虎胆龙威4》视频画面的遮盖,而且即使有所遮盖,其所遮盖到的视频画面部分也是整个视频画面中比较次要的部分,从而降低对用户的观感所造成的影响。 [0033] In one aspect, since the video picture element part is usually arranged at the place closer to the center of the screen or a particular location to accommodate other people's visual inertia, the interactive window will be placed in a corner portion of the synthesized picture can be reduced as much as possible of covering "Die Hard 4" video pictures, and even some cover, it covers the entire video picture video picture portion is relatively minor portion, thereby reducing the impact on the user's perception caused. 当然,画面中的要素不一定位于画面的中间位置或上述其它特定位置,此时,用户终端1可以在进行视频画面与交互窗口的合成之前,对解码后的视频帧进行解析,从中找出要素信息的位置,例如,进行人脸识别,或者对多帧进行解析以找出帧间发生变化的像素点(本领域技术人员理解,通常发生变化的像素点承载了该段时间内用户最为关心的视频信息),从而可以在步骤S2和步骤S3中确定交互窗口a的位置和大小时,使其特意地避开该等要素信息的位置,以保证观感。 Of course, the picture elements are not necessarily located in the middle of the screen or said other specific location, time, user terminal 1 may interact with the video picture prior to the synthesis window is performed, the decoded video frame is parsed to find out element position information, for example, face recognition, or a plurality of frames parsed to find the inter pixel changes (those skilled in the art understand, the pixels are usually changed within the period of time it carries the user is most concerned about video information), it can be determined when the interactive window in step S2 and a step S3, the position and size so that the position of these elements deliberately avoided information to ensure perception. 本领域技术人员理解,对于采用关键帧+预测帧的构成方式的多媒体内容,通过解析预测帧(表征了一个帧与相应关键帧之间的区别)可以轻松地获得该等要素信息的位置。 Those skilled in the art understand, for the multimedia content using the key frames constituting + frame prediction mode, the position can easily be obtained by parsing the element information such predictive frame (characterized by a difference between a frame and the corresponding key frame). 而对于仅包含关键帧的多媒体内容,则可以比较相邻关键帧之间的信息,从而得到其间的不同,并将其作为要素信息的位置信息。 For the multimedia content comprising key frames only, the information can be compared between adjacent key frames, whereby different therebetween, and the element information as the location information.

[0034] 另一方面,交互窗口a出现在视频画面右下角也比较符合人们的操作习惯,至少是对于习惯右手操作的人。 [0034] On the other hand, a window appears in the bottom right of the interactive video screen is also more in line with people's habits operation, at least for a right-handed person operation. 而对于左手操作鼠标的用户,则可将交互窗口a置于视频画面的左下角。 For left-handed mouse user, the interactive window will be placed in a lower left corner of the video screen. 为实现这种针对用户输入习惯进行窗口位置适应性调整的目的,用户终端1可以查询其上的设置来获取用户终端1的用户的操作习惯,比如,假设用户终端1采用微软Windows操作系统,则可由“控制面板”获取“鼠标”项目的设置以获悉用户习惯右手操作鼠标还是左手操作鼠标,从而将交互窗口a置于合成画面的相应位置。 In order to achieve the purpose of this adaptation of the position of the window for user input habits, the user can query set its terminal 1 on the user to obtain the user terminal 1 operating practices, for example, assume that the user terminal 1 uses the Microsoft Windows operating system, by the "control panel" Get set "mouse" project to learn user operating the mouse right-handed or left hand operation of the mouse, so as to interact with a window in the appropriate position of the synthesized picture. 在另一种实施例中,在用户安装在线视频观看软件或初次使用该软件时,指示用户输入自己操作鼠标的习惯,于是在线视频观看软件将此记录,以后每次叠加交互窗口a的时候,可以据此确定视频画面的位置。 In another embodiment, when a user installs software or online video initial use of the software, the user input indicating their customary operation of the mouse, then this online video recording software, interactive window after each overlay a time, can determine whether the position of the video picture.

[0035] 步骤S4的具体实现进行详细介绍。 [0035] The specific implementation of step S4 is described in detail. 具体地,在将交互窗口叠加到视频画面的过程中,可通过对用户间交互窗口的像素与视频画面当前帧上的相应像素进行像素加权合成, 以生成合成画面。 Specifically, the interactive window superimposed in the video picture of the process, by the corresponding pixels between the current frame and the pixel video picture user interactive window of pixel weighting, to generate a synthesized picture. 优选地,采用所述像素加权合成来实现如透明或半透明的效果以提升视觉效果。 Preferably, a weighting of the pixel to achieve the effect of transparent or translucent to enhance the visual effect. 具体地,设交互窗口a中坐标为(x,y)的像素点的像素值为M(x,y)设《虎胆龙威4》 视频画面当前帧上相应像素点的像素值为N(x,y),将此两像素点合成后在合成画面中的相应位置上的新的像素点的像素值为:R(x,y) = aM(x,y)+bN(x,y),其中a和b为分别为交互窗口像素和视频画面当前帧像素的加权因子,其中,0 < = a,b < = 1且a+b = 1。 In particular pixel, the pixel coordinates is set (x, y) in the interactive window a value of M (x, y) set "Die Hard 4" pixel values ​​corresponding to pixels on the video screen of the current frame N ( x, y), this pixel point on the new pixel of the composite picture corresponding position in the two pixels after synthesis is: R (x, y) = aM (x, y) + bN (x, y) wherein a and b are interactive window pixel video picture and a current frame pixel weighting factor, where, 0 <= a, b <= 1 and a + b = 1. 优选地,对于交互窗口a中的文字部分,如图4中的“聊天”、“视频”、“圈子”和“设置”等,由于其对于本地用户而言比较重要,因此,可为该等文字赋予较大的权重,譬如,对于该等文字所占据的各像素点,a = l、b = 0,这样,该等文字将完全遮盖(不同于透明、半透明)视频画面上的相应像素点,从而清晰地呈现给本地用户。 Preferably, for a character portion in the interactive window, as shown in "chat" 4, "video", "circle" and "setting" and the like, because of its more important for a local user, therefore, may for the text given greater weight, for example, for each pixel occupied by these characters, a = l, b = 0, so, those words will be completely covered (different from the transparent, translucent) of the corresponding pixel on the video screen point, so clearly presented to the local user. 更优选地,对于交互窗口a中的边线部分或者非文字背景部分的像素点,可取a = b = 0. 5,这样,交互窗口a的边线或非文字背景部分与视频播放画面相互融合,以实现半透明的效果。 More preferably, the interactive window for the edge portion of a non-text pixel or a background portion, preferably a = b = 0. 5, so that, interactive window or a text background of the edge portion of the video playback screen the mergence achieve a translucent effect. 当然,对于交互窗口a中某些部分,还可以取a = 0、b = 1,以实现完全透明的效果,从而尽可能的减少对背景视频画面的遮盖,保证用户体验。 Of course, the interactive window for a certain part, also can take a = 0, b = 1, to achieve full transparency effect, thereby reducing the background video picture cover as much as possible, to ensure that the user experience. 当然,a、b还可以相应地取其他值,这里不再赘述。 Of course, a, b may also be other values ​​accordingly, will not be repeated here.

[0036] 交互窗口a中包含了“聊天”、“视频”等4个圆形按钮,用户通过鼠标点击“聊天” 按钮,该点击操作即视为是用户终端1的本地用户与用户终端1之间的人机交互信息,借此,用户终端1能够识别出用户在与“聊天”相对应的位置执行了点击鼠标的操作。 [0036] contains a window interactive "chat", "video" and four radio button, the user clicks the "chat" button with the mouse, the click operation is deemed to be a local user terminal 1 with a user of the user terminal 1 of between the interactive information, whereby the user can recognize that the user terminal 1 in a position corresponding to "chat" mouse click operation is performed. 该点击操作既是一个用户在人机交互界面a内执行的人机交互操作,也可视为用户终端1的本地用户利用用户终端1所输入的用户间交互请求,并会在周期性执行的步骤Sl中使得判断结果为预定条件满足,继而,用户终端1要为即将用于画面合成的用户间交互窗口确定大小和位置,详述如下: The click operation is both an interactive operation performed by the user interactive interface in a, it may be considered as a local user of the user terminal in step 1 by user interaction between a user request input terminal 1, and performs the periodic Sl determination result is such that the predetermined condition is satisfied, then the user terminal 1 to determine the size and location of the upcoming inter-user interactive window for the screen synthesis, as detailed below:

[0037] 在步骤S2、S3中所获得的所述用户间交互窗口的位置信息和大小信息可以是来自于在线视频观看软件本身所预先设定的一显示位置缺省值,例如,在每次用户最初启动聊天功能的时候,用户间交互窗口便自动叠加显示于视频画面的中下部(如图4所示的用户间交互窗口b)。 [0037] In step S2, the location information and size information between the user interaction obtained in S3 window may be derived from an online video display position of the default values ​​set in advance the software itself, e.g., in each chat user initially starts when the user interaction between the display window is automatically superimposed in the lower portion of the video picture (FIG inter-user interactive window shown in FIG. 4 b). 可选地,步骤S2、S3中所获得的用户间交互窗口b的位置、大小信息还可以来自于用户终端1上预存的一个文件,其中记录着上次聊天功能关闭前用户间交互窗口b的大小及其在合成画面中所处的位置,于是此后每当用户终端1的本地用户启动聊天功能的时候,用户终端1便从该文件中读取用户间交互窗口的位置、大小信息,以用于画面合成。 Alternatively, step S2, S3 obtained in the inter-user interactive window position b, the size information may also be derived from a file stored on the user terminal 1, wherein the recording is disabled between the last chat before the user interactive window b in which the size and position of the composite picture, then after each time the user terminal 1 to start the local user chat function, the user terminal 1 begins reading the file position of interaction between users of the window size information used to in the picture synthesis. 具体地,通过将本地预存的所述文件中的信息与用户身份信息关联地保存,用户终端1可根据不同用户的喜好为各用户将用户间交互窗口b以定制大小置于定制位置之上。 In particular, by the local information in association with the file stored in the stored user identity information, the user terminal 1 can be inter-user to customize the size of the interactive window b placed on customized for each user depending on the position of the user's preferences. 其中,可在用户运行该在线视频播放软件时输入的登录信息(用户名+ 口令)或在此后的激活聊天功能时在弹出对话框/人机交互界面中输入的登录信息来获取该用户的身份信肩、ο Which can be entered when the user runs the online video player software, the login information (username + password) or in the subsequent activation of chat pop-up login box / man-machine interface entered to get the user's identity letter shoulder, ο

[0038] 优选地,步骤S2、S3中所获得的用户间交互窗口b的位置、大小信息也可以是来自于本地用户,比如,在聊天的过程中,用户可通过鼠标对用户间交互窗口b进行任意拖动, 或者通过键盘上的方向键对用户间交互窗口进行任意移动,以将用户间交互窗口置于用户所希望出现在的位置上。 [0038] Preferably, the step S2, the inter-user S3 obtained in the interactive window b of the position, size information may be derived from the local user, for example, the chat in the process, the user can mouse inter-user interactive window b drag arbitrary, or by any user interaction between the movement of the window by the arrow keys on the keyboard, to the window on the user interaction between a user at the desired position occurs. 此外,因为视频在不停地播放,视频画面在不断的改变,某些时候, 用户间交互窗口b会覆盖到视频画面中用户认为比较重要的部分,于是,用户可在必要时通过拖动用户间交互窗口b将其移到其所认为的当前视频画面中较次要的部分,从而将用户认为比较重要的部分不受遮盖的显现出来。 Further, because the video is constantly playing the video pictures constantly changing, sometimes, the user interaction between the window b will cover the video picture that are important part of the user, so the user can, if necessary, by dragging a user b interaction between the window to move it deems the current video picture lesser part, so the user is not considered to be more important part covered apparent.

[0039] 更优选地,步骤S2、S3中所获得的用户间交互窗口b的位置、大小信息也可以由用户终端1来自适应地确定,并实时或周期地动态更新。 [0039] More preferably, the step S2, S3 obtained in the inter-user interactive window position b, the size information may also be adaptively determined by a user terminal, and dynamically updated in real time or periodically. 具体地,用户终端1实时地对所播放的视频画面进行监测,通过一定算法找出当前播放的视频画面中最为次要画面的位置信息,比如,将视频画面的背景部分认为是比较次要的;或者,将当前播放帧与前一帧进行比较,将有明显改变的部分认为是比较重要的,而基本未有改变的部分认为是比较次要的;或者,由于现在很多的视频内容均采用宽荧幕的呈现方式,于是,在视频画面的上部以及下部会出现具有一定宽度的空白区域(如,始终显示为黑色),则可将用户间交互窗口b置于该位置,等等。 Specifically, the user terminal 1 in real time on the played video picture monitor, identify the location of the currently playing video picture information in a secondary screen by the most certain method, for example, the background portion of the video picture that is relatively minor ; or currently playing portion of the front frame and a comparison, a significant change is considered more important, without substantially No change is considered relatively minor portion; Alternatively, since many of the video content are used widescreen presentation, thus, the upper and lower video screen will appear blank area having a certain width (e.g., always displayed in black), the inter-user interactive window may be placed in the position b, and the like.

[0040] 优选地,由于随着视频播放的进行,视频画面不断改变,其次要部分的位置也会随之变化,于是,用户终端1会不断地监测视频播放画面,并为各个交互窗口(包括但不限于用户间交互窗口b和人机交互窗口a)更新其位置和大小,使其始终能处于视频画面中的次要部分,而不对视频画面的重要部分造成遮盖,从而尽可能的降低对用户观看造成的影响。 [0040] Preferably, because with the progress of video playback, changing the video screen, and secondly to position the portion will also change, so, the user terminal 1 constantly monitors the video play screen, and for each interactive window (including but are not limited to user interaction between a window and interactive window b a) to update its location and size, it is always the secondary part can be in the video picture, not an important part of the video picture caused by the cover, so as to reduce users watch the impact. 当然,避免对重要画面的遮盖还可以通过降低交互窗口在像素加权中的权重来实现。 Of course, important to avoid covering screen may also be achieved by reducing the weight of the right pixel in the interactive window of weighting.

[0041] 在确定了交互窗口b的位置和大小信息后,在步骤S4中,用户终端1将其与正在播放的《虎胆龙威4》的视频画面合成,以生成一用户间交互窗口b叠加于《虎胆龙威4》的视频画面上的合成画面。 [0041] After determining the position b and interactive window size information, in step S4, the user terminal 1 to the "Die Hard 4" being played video picture synthesized to generate user interaction between a window b superimposed on the synthesized picture "Die Hard 4" video screen. 如图4所示。 As shown in Figure 4.

[0042] 在本例的一个变化例中,用户间交互窗口b与视频画面的合成还可以由用户按下键盘上的特殊键(如回车键)来触发,即,当用户在视频播放过程中按下回车键时,步骤Sl 中将得到预定条件满足的判断结果。 [0042] In one variation of this embodiment, the user interaction between the synthesis window and the video picture b may also be a special key is pressed by the user (e.g., enter key) on the keyboard to trigger, i.e., when the user during the video playback when the Enter key is pressed, the judgment result obtained in step Sl predetermined condition is satisfied.

[0043] 在本例的又一变化例中,用户终端1接收到其他用户发送给本地用户的一个聊天请求或者一句聊天内容,于是,在步骤Si中将因此判定预定条件得到满足,从而启动聊天功能。 [0043] In still another variation of the present embodiment, the user terminal 1 receives a chat request to other users to the local user, or a chat content, then, it is determined in step Si predetermined condition is satisfied, to initiate a chat Features. 具体地,用户终端1将所述其它用户发来的聊天内容(可包括文字、图片甚至多媒体信息)加入到即将用于合成的用户间交互窗口b中的接收信息栏中,以生成更新后的交互窗口b,用于步骤S4中的合成。 Specifically, the user terminal 1 to send the other user's chat content (which may include text, pictures and even multimedia information) is added to the column for receiving information coming user interaction between the synthesis window b, to generate the updated interactive window b, for the synthesis of step S4. 由此,本地用户可在S4中生成并随后展示的合成画面中看到所述其它用户发来的聊天内容。 Accordingly, the local user may generate S4 and subsequently displayed composite picture sent to the user to see the other chat content.

[0044] 为了提供用户间的双向交互,用户间交互窗口还包括发送信息栏,或者称其为输入信息栏,本地用户在进行输入的过程中,如步骤S5,其所输入的文字会实时加入到用户间交互窗口b中(所见即所得),以生成更新的用户间交互窗口b,该更新后的窗口将在逐帧执行的合成过程中与当前视频帧合成,以显示给本地用户。 [0044] In order to provide two-way interaction between the user, the user interaction between the window further comprises sending information field, or called information input field, the process of performing a local user input, such as the step S5, the text input in real time it was added the interaction between users of the window b (WYSIWYG), inter-user to generate an updated interactive window b, the updated window frame is synthesized with the current video frame by frame during the synthesis of execution for display to the local user. 此外,为使得其它用户看到用户终端1的本地用户所输入的交互信息,所述本地用户完成一段文字的输入后,通过鼠标点击窗口b中的“发送”按钮(未示于图4中)或者按下键盘上的特殊功能键,该点击操作将被视为该本地用户希望将其输入的信息发送给其用户间交互对象。 After the addition, the other users to see the interaction information such that the user terminal 1 of a local user input, the input of the local user to complete a text by clicking the mouse in the window b "Send" button (not shown in FIG. 4) or by pressing a special function key on the keyboard, the click operation will be considered as a local user wishes to send the information input to the user that interaction between objects. 于是,优选地,该方法还包括一个图2未示出的步骤,其中,用户终端1将该段文字发送给所述本地用户的用户间交互对象。 Thus, preferably, the method further comprises a step 2 is not shown in FIG, wherein the user terminal to send the text of the paragraph 1 the interaction between a local user object.

[0045] 所述本地用户的用户间交互对象可以是本地用户的在线好友,从而在观看视频内容的同时联络感情;所述用户间交互对象也可以是与本地用户观看相同视频《虎胆龙威4》 的其他在线用户,如用户终端2和用户终端3的用户,以相互间实时交流对影片《虎胆龙威4》的观感;所述用户间交互对象还可以是本地用户所指定的任意特定用户。 [0045] between the local user interaction object may be a local user's online friends, so in touch with friends while watching video content; interactive objects can also be a local user to watch the same video user among the "Die Hard 4, "the other online users, such as user terminal 2 and the user terminal 3 of the user, real-time communication to each other on the film" Die Hard 4 "perception; interaction between the user object may also be any local user specified specific user. 另外,在上述聊天开始之前,可能还需要本地用户登录聊天服务器和进行身份认证的过程,这类似于使用msn或QQ进行聊天前的登录验证过程,这里不予赘述。 In addition, prior to the above start chatting, you may need to log in to chat server and a local user identity authentication process, which is similar to using msn or QQ login authentication process before the chat, not repeat them here.

[0046] 更优选地,所述本地用户输入的该段文字会在被发送给各交互对象后由发送信息栏中清除而显示在接收信息栏中。 [0046] More preferably, the local user that text will be entered by the clear to send message bar displayed in the information bar received after being transmitted to each of the interactive objects. 如此,接收信息栏中显示了用户间聊天对话记录,其显示内容随着聊天进行而实时更新。 So, to receive information bar shows the chat conversation records between users, their content is displayed as chats and real-time updates. 当然,接收信息栏也可不显示所述本地用户发出的用户间交互信息。 Of course, the display may not receive the information field of the local inter-user interaction information sent by the user.

[0047] 根据本发明,所述用户间交互窗口b不仅可以包括文字内容,还可以包括图片。 [0047] According to the present invention, the user interaction between the window b may include not only text, images may also include. 优选地,在上述聊天功能启动后,用户终端1将参与所述聊天的在线用户的头像加入到该窗口的相应位置,图中未示出。 Preferably, after the above chat function is activated, the user terminal 1 to participate in the chat online user's picture is added to the corresponding position of the window, not shown in FIG.

[0048] 图4中所示的交互窗口c优选地由网络服务提供商的服务器推送至用户侧,图中示例为热点选秀比赛的投票竞猜,其中包含3个竞争者的照片、供本地用户输入评分或选手编号的信息栏以及“确认”、“取消”按钮。 [0048] FIG 4 c is preferably an interactive window as shown by the network service provider server to the user-side push, exemplified in FIG hot draft voting quiz game, which contains three photographs competitors for local user input information bar score or number of players as well as "OK", "cancel" button.

[0049] 图5中示出了另一人机交互窗口与视频画面合成的例子。 [0049] FIG. 5 shows an example of another window of the interactive video picture synthesis. 其中,当用户通过用鼠标点击交互窗口a中的“视频”按钮后,在步骤Sl中将判定预定条件得到满足,认为用户欲查看视频内容清单,于是在步骤S4中,将一视频内容清单交互窗口叠加显示在视频播放画面中,其效果如图5所示。 Wherein, when the user interaction with a mouse click on a window in the "Video" button, it is determined in step Sl predetermined condition is satisfied, that users want to see a list of video content, then in step S4, the video content is a list of interaction window superimposed and displayed on the video playback screen, the effect is as shown in FIG. 其中包含有多个视频内容链接或者频道链接供用户选择,用户通过点击某个欲观看的视频内容链接,以停止当前视频的播放,重新下载新视频内容的数据用于本地终端播放。 Which comprises a plurality of channels of video content link or links for users to choose, the user clicks on a link video content to be viewed, to stop playing the current video, and data re-download the new video content to play for a local terminal. 如此,用户便可在观看视频内容的过程中方便的在多个视频内容或者频道间切换,大大提升了用户的体验度。 Thus, the user can easily move among multiple video content or channel switching in the process of viewing video content, greatly enhance the user experience. 并且,当用户的鼠标移动到某个视频内容链接上时,便在视频内容清单交互窗口的右边部分示出该视频内容的一些相关信息,包括精彩视频截图、视频内容海报、内容说明以及用户评论等内容,以帮助用户做出是否观看本视频的决定。 And, when the user's mouse moves to a link on the video content, video content will be in the right part of the window shows a list of interactive video content of some of the relevant information, including the exciting video capture, video content posters, description and user reviews and other content to help users make the decision whether or not to watch this video.

[0050] 根据本发明的第二方面,提供了一种在用户终端上用于在视频显示时提供用户交互的视频交互装置10,图3为该视频交互装置10的框图,下面结合图3加以详细说明,图1 和图2 —并在此作为参考。 [0050] According to a second aspect of the present invention, there is provided a method for providing a user terminal on the user interaction when a video interactive video display apparatus 10, a block diagram of a video interaction device 10 in FIG. 3 that, in conjunction with FIG. 3 below be described in detail, FIGS. 1 and 2 - and herein incorporated by reference. 仍然以用户终端1、2、3同时在线观看网络服务器0上所提供的影片《虎胆龙威4》为例进行说明,用户终端1、2、3为普通的个人电脑。 The user terminal 2, 3 still while watching online videos on a network server provided 0 "Die Hard 4" as an example, the user terminal 1,2,3 is an ordinary PC.

[0051] 所示视频交互装置10包括:判断装置101、合成装置102、第一获得装置103、第二获得装置104、发送装置10、第一加入装置106以及第二加入装置107。 [0051] FIG interactive video apparatus 10 comprises: judging means 101, a synthesizing device 102, a first obtaining means 103, a second obtaining means 104, transmitting means 10, a first adding means 106 and a second adding means 107. 具体地,所述合成装置102包括加权因子确定装置和像素加权合成装置。 In particular, the combining means comprises weighting factor determining means 102 and the pixel weighting means.

[0052] 可见,在如图3所示地全屏播放该视频内容时,用户所看到的视频画面与通常通过windows media player或者realplayer全屏观看影片时效果无异。 [0052] visible, while FIG full-screen playback of the video content as shown in 3, the user sees the video picture with a normal video viewing windows media player or by realplayer full screen effect is no different. 很灵活地,本发明可以在视频播放伊始甚至播放器启动伊始即开始交互窗口与视频画面的叠加,优选地,本发明在检测到特定事件发生后再将交互窗口与当前播放画面进行叠加,以生成交互窗口叠加在视频画面之上的合成画面。 Very flexible, even at the beginning of the present invention may start at the beginning of the player that is superimposed with the video picture interactive window starts, preferably, the present invention is the interactive window will be superimposed on the currently playing screen is detected after a specific event occurs in the video player to composite picture generating interactive window superimposed on the video picture. 以用户终端1为例,在播放《虎胆龙威4》的过程中,本地用户移动鼠标、点击鼠标左键、按下多功能键盘上的一个功能键、其它用户发来交互请求等等均能够作为触发用户终端1上的上述叠加的事件,典型地,判断装置101根据预存信息(指示哪些事件会触发交互窗口与视频画面的叠加,该预存信息可集成于所述在线视频观看软件中),来判断是否发生了触发所述叠加的事件。 In the user terminal 1 as an example, during playback "Die Hard 4", the local user moves the mouse, click the left mouse button, pressing a function key on the multifunctional keyboard, the other user requests, etc. are sent to interact as the above-described trigger events can be superimposed on the user terminal, typically, determination means 101 according to pre-stored information (information indicating which events will trigger the interactive window is superimposed with the video picture, the pre-stored information may be integrated to the online video viewing software) to determine whether the trigger of the superposition of the incident. 更具体地,所述预存信息中可以细化确定哪些事件与用户间交互相关,哪些事件与人机交互相关。 More specifically, the stored information can be refined to determine which events associated with the interaction between the user and which events related to human-computer interaction. 从而在检测到特定事件后,触发相应类型的交互窗口与视频画面的叠加,这些内容将在下文中有详细介绍。 So that after detection of a particular event, trigger the corresponding type of interaction with the video picture superimposed window, the content will be described in detail below.

[0053] 参看图6,判断装置101判断预定条件是否得到满足,优选地,在《虎胆龙威4》这一视频内容的播放过程中,所述判断装置101周期性地执行判断操作,直至检测到预定条件满足。 [0053] Referring to Figure 6, it is determined whether the predetermined condition is satisfied judging means 101, preferably in the "Die Hard 4" during playback of the video content, the determining means 101 determines the operation performed periodically, until detecting a predetermined condition is satisfied. 本例中,假设用户终端1的用户按下了多功能键盘上的一个功能键,而根据预存信息,该功能键能够触发一个人机交互窗口与视频画面的叠加。 In this example, assume that the user terminal 1 to the user presses a function key on the multifunctional keyboard, according to pre-stored information, the function key can trigger a superimposed window and interactive video picture. 因此,判断装置101在一次执行判断步骤时,将判断出预定条件满足。 Thus, the judging means 101 next execution determination step, it is determined that the predetermined condition is satisfied.

[0054] 于是,用户终端1中的合成装置102需要将相应的交互窗口与视频画面进行合成, 而在此之前,尚需第一获得装置103和第二获得装置104来确定交互窗口在合成画面中的位置及其大小。 [0054] Then, the user terminal 102 in the synthesizing apparatus 1 requires that the corresponding synthesis window and interactive video picture, but before, still need to obtain the first apparatus 104 and second apparatus 103 to obtain synthesized picture is determined in the interactive window the location and size. 于是,第一获得装置103获得交互窗口a的位置信息,所述位置信息用于指示该交互窗口a在与《虎胆龙威4》视频画面进行合成后所得的合成画面中的显示位置。 Thus, the position information obtaining apparatus 103 of a first interactive window obtaining the location information of the interactive window in a display position of the resulting synthesized picture synthesized with "Die Hard 4" is used to indicate a video picture. 参看图3,其中示出了以未经合成的视频画面为参考的坐标系,以分辨率1024*768的视频画面为例,一个像素点在其中的坐标取值范围为(0,0)至(1024,768)。 Referring to Figure 3, which shows a non-composite video picture in a reference coordinate system, the video image resolution 1024 * 768, for example, a pixel at the coordinates where the range (0,0) to (1024, 768). 因此,通过确定交互窗口a的一个特殊点的坐标,即可确定该交互窗口a的位置。 Thus, the coordinates of a particular point by determining the interaction of a window, you can determine the position of the interaction of a window. 在实际应用中,可以预先设定该位置信息,例如,缺省地设定交互窗口a的最左上角一个像素点的坐标为(724,568),于是, 该窗口将位于合成画面的右下角落。 In practice, the location information may be previously set, e.g., a default set in the upper left corner pixel coordinates of the point of interaction of a window (724,568), so that the synthesis window at the lower right of the screen corner.

[0055] 此外,用户终端1处的第二获得装置104还需要确定该交互窗口a的大小,譬如,在缺省地设定交互窗口a最左上角一个像素点坐标为(724,568)的基础上,可以再缺省地将该窗口的大小设定为300*200,于是,该窗口的最右下角一个像素点正好叠加在原始视频画面最右下角的一个像素点上,由此,交互窗口a可以恰好(透明或半透明或不透明地)完全覆盖原始视频画面的右下角落。 [0055] In addition, the user terminal a second obtaining means 104 further needs to determine a size of the window of interaction, such as, in a default interactive window set the upper left corner of a pixel's coordinates (724,568) of basis, may then be the default window size is set to 300 * 200, then, a most bottom right pixel of the window exactly superimposed on the lower right corner of a pixel of the original video picture, whereby interaction a window can be exactly (or transparent or translucent to opaque) completely covers the lower right corner of the original video picture. 如图4所示。 As shown in Figure 4.

[0056] 可选地,交互窗口a的位置信息和大小信息可以由用户在进行画面合成前确定, 譬如,在判断装置101得到预定条件满足的判断结果后,合成装置102在视频画面的缺省位置将一个具有缺省大小的信息输入窗口与视频画面进行合成,并指示用户输入与其所希望的交互窗口a的位置和大小相关的参数,进而帮助第一获得装置103和第二获得装置104 确定交互窗口a的位置信息和大小信息。 [0056] Alternatively, the interactive window position information and a size information determined by the user can be performed before the screen synthesis, for example, the determination result in the determination means 101 to obtain a predetermined condition is satisfied, the combining means 102 in the default video picture the default position of a position information input window size is synthesized with the video picture, and instructs the user to input their desired interactive window and a size parameter associated with, thereby helping the first obtaining means 103 and the second obtaining means 104 determines a interactive window position information and size information.

[0057] 可选地,交互窗口a的位置信息和大小信息可以在基于上述任一方式确定后,在播放合成画面的过程中,根据用户进一步输入的信息来进行更新,典型地,用户通过鼠标点击和拖拽来实现该等信息的更新。 [0057] Alternatively, the interactive window position information and a size information may be determined based upon any of the embodiments, composite screen during playback in accordance with a further input information of the user to be updated, typically, mouse users click and drag to achieve update such information.

[0058] 然后,合成装置102按照第一获得装置103与第二获得装置104所得到的交互窗口a的位置信息和大小信息,将一个包含“聊天”、“视频”等圆形按钮的人机交互窗口a与正在播放的《虎胆龙威4》的视频画面合成,以生成该交互窗口a叠加于《虎胆龙威4》的视频画面上的合成画面并显示于用户终端1上。 [0058] Then, the synthesis apparatus 102 according to the location and size information of the first information obtaining means 103 and the second obtaining means 104 resulting in a interactive window, will comprise a "chat", "video" radio button and other man-machine and the interactive window is playing a "Die Hard 4" video screen synthesis, the interaction to generate a window superimposed on the synthesized picture "Die Hard 4 'and a video picture displayed on the user terminal 1. 如图5中右下部分所示。 5 in the lower right portion as shown in FIG. 为简明起见,其中同时示出了其它交互窗口,并将在下文中有相应的详细描述。 For brevity, which also shows the other interactive windows and corresponding detailed description below.

[0059] 有利地,交互窗口a在图4中所示的位置(合成画面的右下角)为一优选位置。 [0059] Advantageously, a position of the interactive window (lower right corner of the synthesized picture) shown in FIG. 4 is a preferred position.

[0060] 一方面,由于视频画面的要素部分通常会被安排在画面较靠近中央或其它特定位置的地方以适应人们的视觉惯性,将交互窗口a置于合成画面的角落部分可尽可能的减少对《虎胆龙威4》视频画面的遮盖,而且即使有所遮盖,其所遮盖到的视频画面部分也是整个视频画面中比较次要的部分,从而降低对用户的观感所造成的影响。 [0060] In one aspect, since the video picture element part is usually arranged at the place closer to the center of the screen or a particular location to accommodate other people's visual inertia, the interactive window will be placed in a corner portion of the synthesized picture can be reduced as much as possible of covering "Die Hard 4" video pictures, and even some cover, it covers the entire video picture video picture portion is relatively minor portion, thereby reducing the impact on the user's perception caused. 当然,画面中的要素不一定位于画面的中间位置或上述其它特定位置,此时,用户终端1可以在进行视频画面与交互窗口的合成之前,对解码后的视频帧进行解析,从中找出要素信息的位置,例如,进行人脸识别,或者对多帧进行解析以找出帧间发生变化的像素点(本领域技术人员理解,通常发生变化的像素点承载了该段时间内用户最为关心的视频信息),从而可以在确定交互窗口a的位置和大小时,使其特意地避开该等要素信息的位置,以保证观感。 Of course, the picture elements are not necessarily located in the middle of the screen or said other specific location, time, user terminal 1 may interact with the video picture prior to the synthesis window is performed, the decoded video frame is parsed to find out element position information, for example, face recognition, or a plurality of frames parsed to find the inter pixel changes (those skilled in the art understand, the pixels are usually changed within the period of time it carries the user is most concerned about video information), it can be determined when the position and size of a window of interaction, so the position of these elements deliberately avoided information to ensure perception. 本领域技术人员理解,对于采用关键帧+预测帧的构成方式的多媒体内容,通过解析预测帧(表征了一个帧与相应关键帧之间的区别)可以轻松地获得该等要素信息的位置。 Those skilled in the art understand, for the multimedia content using the key frames constituting + frame prediction mode, the position can easily be obtained by parsing the element information such predictive frame (characterized by a difference between a frame and the corresponding key frame). 而对于仅包含关键帧的多媒体内容,则可以比较相邻关键帧之间的信息,从而得到其间的不同,并将其作为要素信息的位置信息。 For the multimedia content comprising key frames only, the information can be compared between adjacent key frames, whereby different therebetween, and the element information as the location information.

[0061] 另一方面,交互窗口a出现在视频画面右下角也比较符合人们的操作习惯,至少是对于习惯右手操作的人。 [0061] On the other hand, a window appears in the bottom right of the interactive video screen is also more in line with people's habits operation, at least for a right-handed person operation. 而对于左手操作鼠标的用户,则可将交互窗口a置于视频画面的左下角。 For left-handed mouse user, the interactive window will be placed in a lower left corner of the video screen. 为实现这种针对用户输入习惯进行窗口位置适应性调整的目的,用户终端1可以查询其上的设置来获取用户终端1的用户的操作习惯,比如,假设用户终端1采用微软Windows操作系统,则可由“控制面板”获取“鼠标”项目的设置以获悉用户习惯右手操作鼠标还是左手操作鼠标,从而将交互窗口a置于合成画面的相应位置。 In order to achieve the purpose of this adaptation of the position of the window for user input habits, the user can query set its terminal 1 on the user to obtain the user terminal 1 operating practices, for example, assume that the user terminal 1 uses the Microsoft Windows operating system, by the "control panel" Get set "mouse" project to learn user operating the mouse right-handed or left hand operation of the mouse, so as to interact with a window in the appropriate position of the synthesized picture. 在另一种实施例中,在用户安装在线视频观看软件或初次使用该软件时,指示用户输入自己操作鼠标的习惯,于是在线视频观看软件将此记录,以后每次叠加交互窗口a的时候,可以据此确定视频画面的位置。 In another embodiment, when a user installs software or online video initial use of the software, the user input indicating their customary operation of the mouse, then this online video recording software, interactive window after each overlay a time, can determine whether the position of the video picture.

[0062] 以下,对合成装置102功能的具体实现进行详细介绍。 [0062] Hereinafter, the specific implementation of the synthesis device 102 function will be described in detail. 具体地,在将交互窗口叠加到视频画面的过程中,可通过对用户间交互窗口的像素与视频画面当前帧上的相应像素进行像素加权合成,以生成合成画面。 Specifically, the interactive window superimposed in the video picture of the process, by the corresponding pixels between the current frame and the pixel video picture user interactive window of pixel weighting, to generate a synthesized picture. 优选地,采用所述像素加权合成来实现如透明或半透明的效果以提升视觉效果。 Preferably, a weighting of the pixel to achieve the effect of transparent or translucent to enhance the visual effect. 具体地,设交互窗口a中坐标为(X,y)的像素点的像素值为M(x,y), 设《虎胆龙威4》视频画面当前帧上相应像素点的像素值为N(x,y),将此两像素点合成后在合成画面中的相应位置上的新的像素点的像素值为:R(x,y) =aM(x,y)+bN(x,y),其中a和b为加权因子确定装置分别为交互窗口像素和视频画面当前帧像素的加权因子,其中,0 <= a, b <=! In particular pixel point, a set of interactive window coordinates (X, y) the value M (x, y), set "Die Hard 4" corresponding pixel points in the current frame video picture pixel value N (x, y), this pixel value of the new pixel at the corresponding position in the synthetic picture of two pixels after synthesis: R (x, y) = aM (x, y) + bN (x, y ), where a and b are weighting factors determining means are interactive window pixel video picture and a current frame pixel weighting factor, where, 0 <= a, b <=! 且^! And ^! 卄=丨。 Nian = Shu. 优选地,对于交互窗口a中的文字部分,如图4中的“聊天”、“视频”、“圈子”和“设置”等,由于其对于本地用户而言比较重要,因此,加权因子确定装置可为该等文字赋予较大的权重,譬如,对于该等文字所占据的各像素点,a = 1、b = 0,这样,在经过像素加权合成装置的合成操作后,该等文字将完全遮盖(不同于透明、半透明)视频画面上的相应像素点,从而清晰地呈现给本地用户。 Preferably, for a character portion in the interactive window, as shown in "chat" 4, "video", "circle" and "setting" and the like, because of its more important for a local user, therefore, the weighting factor determination means for such text may be given greater weight, for example, for each pixel occupied by these characters, a = 1, b = 0, so that, in operation of the pixel after synthesized after the weighting means, such text will be completely cover (other than transparent, translucent) of the corresponding pixel on the video screen, so clearly presented to the local user. 更优选地,对于交互窗口a中的边线部分或者非文字背景部分的像素点,可取a = b = 0. 5,这样,交互窗口a的边线或非文字背景部分与视频播放画面相互融合,以实现半透明的效果。 More preferably, the interactive window for the edge portion of a non-text pixel or a background portion, preferably a = b = 0. 5, so that, interactive window or a text background of the edge portion of the video playback screen the mergence achieve a translucent effect. 当然,对于交互窗口a中某些部分,还可以取a = 0、b = 1,以实现完全透明的效果,从而尽可能的减少对背景视频画面的遮盖,保证用户体验。 Of course, the interactive window for a certain part, also can take a = 0, b = 1, to achieve full transparency effect, thereby reducing the background video picture cover as much as possible, to ensure that the user experience. 当然,a、b还可以相应地取其他值,这里不再赘述。 Of course, a, b may also be other values ​​accordingly, will not be repeated here.

[0063] 交互窗口a中包含了“聊天”、“视频”等4个圆形按钮,用户通过鼠标点击“聊天” 按钮,该点击操作即视为是用户终端1的本地用户与用户终端1之间的人机交互信息,借此,判断装置101能够识别出用户在与“聊天”相对应的位置执行了点击鼠标的操作。 [0063] contains a window interactive "chat", "video" and four radio button, the user clicks the "chat" button with the mouse, the click operation is deemed to be a local user terminal 1 with a user of the user terminal 1 of between the interactive information, thereby determining apparatus 101 can recognize the user in a position corresponding to the "chat" mouse click operation is performed. 该点击操作既是一个用户在人机交互界面a内执行的人机交互操作,也可视为用户终端1的本地用户利用用户终端1所输入的用户间交互请求,并会在周期性执行的判断操作中使得判断结果为预定条件满足,继而,用户终端1要为即将用于画面合成的用户间交互窗口确定大小和位置,详述如下: The click operation is both an interactive operation performed by the user interactive interface in a, may be considered as a local user terminal 1 by the user terminal between a user of the user interaction request input, and it will be executed periodically determines operation so that the determination result is predetermined condition is satisfied, then the user terminal 1 to determine the size and location of the upcoming inter-user interactive window for the screen synthesis, as detailed below:

[0064] 第一获得装置103、第二获得装置104所获得的所述用户间交互窗口的位置信息和大小信息可以是来自于在线视频观看软件本身所预先设定的一显示位置缺省值,例如, 在每次用户最初启动聊天功能的时候,用户间交互窗口便自动叠加显示于视频画面的中下部(如图4所示的用户间交互窗口b)。 [0064] a first obtaining means 103, a second obtaining position information and size information between the user device 104 may be interactive window obtained from an online video display position of the default values ​​set in advance the software itself, For example, each time the user initially starts the chat function, the user interaction between a window is automatically displayed superimposed video pictures in a lower portion (FIG inter-user interactive window shown in FIG. 4 b). 可选地,所获得的用户间交互窗口b的位置、大小信息还可以来自于用户终端1上预存的一个文件,其中记录着上次聊天功能关闭前用户间交互窗口b的大小及其在合成画面中所处的位置,于是此后每当用户终端1的本地用户启动聊天功能的时候,用户终端1便从该文件中读取用户间交互窗口的位置、大小信息,以用于画面合成。 Alternatively, the obtained inter-user interactive window position b, the size information from the user terminal may also be stored on a file, which is recorded last chat off between the size of the window before the user interaction in the synthesis and b in which the position of the screen, then after each time the user terminal 1 to start the local user chat function, the user terminal 1 begins with the file location of the interaction between the user reads window, size information, for picture synthesis. 具体地,通过将本地预存的所述文件中的信息与用户身份信息关联地保存,用户终端1可根据不同用户的喜好为各用户将用户间交互窗口b以定制大小置于定制位置之上。 In particular, by the local information in association with the file stored in the stored user identity information, the user terminal 1 can be inter-user to customize the size of the interactive window b placed on customized for each user depending on the position of the user's preferences. 其中,可在用户运行该在线视频播放软件时输入的登录信息(用户名+ 口令)或在此后的激活聊天功能时在弹出对话框/人机交互界面中输入的登录信息来获取该用户的身份fe息。 Which can be entered when the user runs the online video player software, the login information (username + password) or in the subsequent activation of chat pop-up login box / man-machine interface entered to get the user's identity fe interest.

[0065] 优选地,所获得的用户间交互窗口b的位置、大小信息也可以是来自于本地用户, 比如,在聊天的过程中,用户可通过鼠标对用户间交互窗口b进行任意拖动,或者通过键盘上的方向键对用户间交互窗口进行任意移动,以将用户间交互窗口置于用户所希望出现在的位置上。 [0065] Preferably, the positions between the obtained user interactive window b, and may be derived from the size information in the local user, for example, in the course of chatting, the user can drag any window of interaction between the user through the mouse b, or by any user interaction between the movement of the window by the arrow keys on the keyboard, to the window on the user interaction between a user at the desired position occurs. 此外,因为视频在不停地播放,视频画面在不断的改变,某些时候,用户间交互窗口b会覆盖到视频画面中用户认为比较重要的部分,于是,用户可在必要时通过拖动用户间交互窗口b将其移到其所认为的当前视频画面中较次要的部分,从而将用户认为比较重要的部分不受遮盖的显现出来。 Further, because the video is constantly playing the video pictures constantly changing, sometimes, the user interaction between the window b will cover the video picture that are important part of the user, so the user can, if necessary, by dragging a user b interaction between the window to move it deems the current video picture lesser part, so the user is not considered to be more important part covered apparent.

[0066] 更优选地,所获得的用户间交互窗口b的位置、大小信息也可以由用户终端1来自适应地确定,并实时或周期地动态更新。 [0066] More preferably, the obtained inter-user interactive window position b, the size information may be an adaptively determined by the user terminal, and dynamically updated in real time or periodically. 具体地,用户终端1实时地对所播放的视频画面进行监测,通过一定算法找出当前播放的视频画面中最为次要画面的位置信息,比如,将视频画面的背景部分认为是比较次要的;或者,将当前播放帧与前一帧进行比较,将有明显改变的部分认为是比较重要的,而基本未有改变的部分认为是比较次要的;或者,由于现在很多的视频内容均采用宽荧幕的呈现方式,于是,在视频画面的上部以及下部会出现具有一定宽度的空白区域(如,始终显示为黑色),则可将用户间交互窗口b置于该位置,等等。 Specifically, the user terminal 1 in real time on the played video picture monitor, identify the location of the currently playing video picture information in a secondary screen by the most certain method, for example, the background portion of the video picture that is relatively minor ; or currently playing portion of the front frame and a comparison, a significant change is considered more important, without substantially No change is considered relatively minor portion; Alternatively, since many of the video content are used widescreen presentation, thus, the upper and lower video screen will appear blank area having a certain width (e.g., always displayed in black), the inter-user interactive window may be placed in the position b, and the like.

[0067] 优选地,由于随着视频播放的进行,视频画面不断改变,其次要部分的位置也会随之变化,于是,第一获得装置103和第二获得装置会不断地监测视频播放画面,并为各个交互窗口(包括但不限于用户间交互窗口b和人机交互窗口a)更新其位置和大小,使其始终能处于视频画面中的次要部分,而不对视频画面的重要部分造成遮盖,从而尽可能的降低对用户观看造成的影响。 [0067] Preferably, because with the progress of video playback, changing the video screen, and secondly to position the portion will also change, so, first obtaining means 103 and the second obtaining means constantly monitors the video playback screen, and for each interactive window (including, but not limited to, user interaction between a window and interactive window b a) to update its location and size, it is always the secondary part can be in the video picture, not an important part of the video picture caused by masking , thereby reducing the impact on users viewing caused as much as possible. 当然,避免对重要画面的遮盖还可以通过降低合成装置102交互窗口在像素加权中的权重来实现。 Of course, important to avoid covering screen may also be achieved by reducing the weight of the right synthesis apparatus 102 in the interactive window of pixel weighting.

[0068] 在确定了交互窗口b的位置和大小信息后,像素加权合成装置根据加权因子确定装置所确定的加权因子来将交互窗口b与正在播放的《虎胆龙威4》的视频画面合成,以生成一用户间交互窗口b叠加于《虎胆龙威4》的视频画面上的合成画面。 [0068] After determining the interaction of the window location and size information b, the pixel weighting means determines weighting factors to be determined b the interactive window being played according to the weighting factor "Die Hard 4" video screen synthesis to generate a user interaction between b window superimposed on the synthesized picture "Die Hard 4" video screen. 如图4所示。 As shown in Figure 4.

[0069] 在本例的一个变化例中,用户间交互窗口b与视频画面的合成还可以由用户按下键盘上的特殊键(如回车键)来触发,即,当用户在视频播放过程中按下回车键时,步骤Sl中将得到预定条件满足的判断结果。 [0069] In one variation of this embodiment, the user interaction between the synthesis window and the video picture b may also be a special key is pressed by the user (e.g., enter key) on the keyboard to trigger, i.e., when the user during the video playback when the Enter key is pressed, the judgment result obtained in step Sl predetermined condition is satisfied.

[0070] 在本例的又一变化例中,用户终端1接收到其他用户发送给本地用户的一个聊天请求或者一句聊天内容,于是,判断装置101将因此判定预定条件得到满足,从而启动聊天功能。 [0070] In still another variation of the present embodiment, the user terminal 1 receives a chat request to other users to the local user, or a chat content, then, the determination means 101 determines that the predetermined condition is satisfied so, to initiate a chat function . 具体地,第一加入装置106将所述其它用户发来的聊天内容(可包括文字、图片甚至多媒体信息)加入到即将用于合成的用户间交互窗口b中的接收信息栏中,以生成更新后的交互窗口b,用于合成装置102所执行的合成。 Specifically, the first adding means 106 to the other chat content sent by the user (which may include text, pictures and even multimedia messaging) between a user is added to the received information for the synthesis of forthcoming interaction column in the window b, to generate an updated after the interactive window b, synthesizing apparatus 102 for synthesizing performed. 由此,本地用户可在由合成装置102生成并随后由显示设备展示的合成画面中看到所述其它用户发来的聊天内容。 Accordingly, the local user can see the other and then sent to the user by the display synthesizing chat contents screen shown in generating apparatus by the synthesizing means 102.

[0071] 为了提供用户间的双向交互,用户间交互窗口还包括发送信息栏,或者称其为输入信息栏,本地用户在进行输入的过程中,其所输入的文字会由第二加入装置107实时加入到用户间交互窗口b中(所见即所得),以生成更新的用户间交互窗口b,该更新后的窗口将在合成装置102逐帧执行的合成过程中与当前视频帧合成,以显示给本地用户。 [0071] In order to provide two-way interaction between the user, the user interaction between the window further comprises sending information field, or called information input field, the process of performing a local user input, the text input it by the second adding means 107 will was added to the real-time interaction between the user of the window b (WYSIWYG), inter-user to generate an updated interactive window b, the updated window frame is synthesized with the current video synthesizing means 102 during the synthesis performed frame by frame in order to display to the local user. 此外, 为使得其它用户看到用户终端1的本地用户所输入的交互信息,所述本地用户完成一段文字的输入后,通过鼠标点击窗口b中的“发送”按钮(未示于图4中)或者按下键盘上的特殊功能键,该点击操作将被视为该本地用户希望将其输入的信息发送给其用户间交互对象。 After the addition, the other users to see the interaction information such that the user terminal 1 of a local user input, the input of the local user to complete a text by clicking the mouse in the window b "Send" button (not shown in FIG. 4) or by pressing a special function key on the keyboard, the click operation will be considered as a local user wishes to send the information input to the user that interaction between objects. 于是,优选地,该视频交互装置10还包括一个发送装置105,用于将该段文字发送给所述本地用户的用户间交互对象。 Thus, preferably, the interactive video apparatus 10 further comprises a transmitting means 105 for transmitting the segment of text to the user interaction between the local user object.

[0072] 所述本地用户的用户间交互对象可以是本地用户的在线好友,从而在观看视频内容的同时联络感情;所述用户间交互对象也可以是与本地用户观看相同视频《虎胆龙威4》 的其他在线用户,如用户终端2和用户终端3的用户,以相互间实时交流对影片《虎胆龙威4》的观感;所述用户间交互对象还可以是本地用户所指定的任意特定用户。 [0072] between the local user interaction object may be a local user's online friends, so in touch with friends while watching video content; interactive objects can also be a local user to watch the same video user among the "Die Hard 4, "the other online users, such as user terminal 2 and the user terminal 3 of the user, real-time communication to each other on the film" Die Hard 4 "perception; interaction between the user object may also be any local user specified specific user. 另外,在上述聊天开始之前,可能还需要本地用户登录聊天服务器和进行身份认证的过程,这类似于使用msn或QQ进行聊天前的登录验证过程,这里不予赘述。 In addition, prior to the above start chatting, you may need to log in to chat server and a local user identity authentication process, which is similar to using msn or QQ login authentication process before the chat, not repeat them here.

[0073] 更优选地,所述本地用户输入的该段文字会在被发送给各交互对象后由发送信息栏中清除而显示在接收信息栏中。 [0073] More preferably, the local user that text will be entered by the clear to send message bar displayed in the information bar received after being transmitted to each of the interactive objects. 如此,接收信息栏中显示了用户间聊天对话记录,其显示内容随着聊天进行而实时更新。 So, to receive information bar shows the chat conversation records between users, their content is displayed as chats and real-time updates. 当然,接收信息栏也可不显示所述本地用户发出的用户间交互信息。 Of course, the display may not receive the information field of the local inter-user interaction information sent by the user.

[0074] 根据本发明,所述用户间交互窗口b不仅可以包括文字内容,还可以包括图片。 [0074] According to the present invention, the user interaction between the window b may include not only text, images may also include. 优选地,在上述聊天功能启动后,用户终端1将参与所述聊天的在线用户的头像加入到该窗口的相应位置,图中未示出。 Preferably, after the above chat function is activated, the user terminal 1 to participate in the chat online user's picture is added to the corresponding position of the window, not shown in FIG.

[0075] 图4中所示的交互窗口c优选地由网络服务提供商的服务器推送至用户侧,图中示例为热点选秀比赛的投票竞猜,其中包含3个竞争者的照片、供本地用户输入评分或选手编号的信息栏以及“确认”、“取消,,按钮。 [0075] FIG 4 c is preferably an interactive window as shown by the network service provider server to the user-side push, exemplified in FIG hot draft voting quiz game, which contains three photographs competitors for local user input information bar score or number of players as well as "OK", "cancel, button.

[0076] 图5中示出了另一人机交互窗口与视频画面合成的例子。 [0076] FIG. 5 shows an example of another window of the interactive video picture synthesis. 其中,当用户通过用鼠标点击交互窗口a中的“视频”按钮后,判断装置101将判定预定条件得到满足,认为用户欲查看视频内容清单,于是,合成装置102将一视频内容清单交互窗口叠加显示在视频播放画面中,其效果如图5所示。 Wherein, when the user using the mouse to click on the interactive window a the "Video" button, determination means 101 determines that the predetermined condition is satisfied, that users want to view the video content list, then, synthesizing device 102 a video content list interactive window superimposed displayed in the video playback screen, the effect is as shown in FIG. 其中包含有多个视频内容链接或者频道链接供用户选择,用户通过点击某个欲观看的视频内容链接,以停止当前视频的播放,重新下载新视频内容的数据用于本地终端播放。 Which comprises a plurality of channels of video content link or links for users to choose, the user clicks on a link video content to be viewed, to stop playing the current video, and data re-download the new video content to play for a local terminal. 如此,用户便可在观看视频内容的过程中方便的在多个视频内容或者频道间切换,大大提升了用户的体验度。 Thus, the user can easily move among multiple video content or channel switching in the process of viewing video content, greatly enhance the user experience. 并且,当用户的鼠标移动到某个视频内容链接上时,便在视频内容清单交互窗口的右边部分示出该视频内容的一些相关信息,包括精彩视频截图、视频内容海报、内容说明以及用户评论等内容,以帮助用户做出是否观看本视频的决定。 And, when the user's mouse moves to a link on the video content, video content will be in the right part of the window shows a list of interactive video content of some of the relevant information, including the exciting video capture, video content posters, description and user reviews and other content to help users make the decision whether or not to watch this video.

[0077] 以上对本发明的实施例进行了描述,但是本发明并不局限于特定的系统、设备和具体协议,本领域内技术人员可以在所附权利要求的范围内做出各种变形或修改。 [0077] The embodiments of the present invention have been described, but the present invention is not limited to specific systems, specific devices and protocols, those skilled in the art can make various changes and modifications within the scope of the appended claims .

Claims (24)

  1. 一种在用户终端上用于在视频显示时提供用户交互的方法,其中,包括以下步骤:a.判断预定条件是否满足;b.当满足所述预定条件时,将一个或多个交互窗口与视频画面合成,以生成用于显示的一个或多个交互窗口叠加于视频画面上的合成画面;其中,所述一个或多个交互窗口包括发送信息栏,该方法还包括:当满足所述预定条件时,将本地用户输入的交互信息加入到所述一个或多个交互窗口的发送信息栏中,以生成一个或多个更新后的交互窗口;所述步骤b还包括:将所述一个或多个更新后的交互窗口与所述视频画面合成,以生成用于显示的一个或多个更新后的交互窗口叠加于所述视频画面上的合成画面;该方法还包括步骤:m.将所述本地用户输入的交互信息提供给与所述本地用户输入的交互信息相对应的交互对象。 A method of providing user interaction in the video display method on a user terminal, comprising the steps of:.. A predetermined determination condition is satisfied; B when the predetermined condition is satisfied, the one or more interactive windows and video picture synthesized to generate one or more interactive windows displayed on the screen superimposed on the video picture synthesis; wherein the one or more interactive windows comprises sending information field, the method further comprising: when said predetermined satisfied the condition, the local user input mutual information is added to the transmission information or a plurality of interactive window tree to generate one or more updated after the interactive window; said step b further comprises: the one or interactive window synthesized with the video picture of the plurality of update, to generate a display of one or more updated interactive window superimposed on the video picture synthesized picture; the method further comprising the step of: m the. said local interaction information input by the user to provide interactive information given to the local user input corresponding to the interactive objects.
  2. 2.根据权利要求1所述的方法,其特征在于,所述本地用户输入的交互信息包括人机交互信息和/或用户间交互信息,其中,当所述交互信息包括用户间交互信息时,与所述本地用户输入的用户间交互信息相对应的交互对象包括以下各项中的任一项或任多项:-所述本地用户的在线好友; _与所述本地用户观看相同视频的其他用户; -由所述本地用户所指定的特定用户。 2. The method according to claim 1, wherein the interactive information between the local user input includes interactive information and / or user interaction information, wherein, when the interaction between the user interaction information comprising information, interaction between the user information corresponding to the interactive objects with the local user input comprises any one or any of the following more of: - the local user's online friends; _ other with the local user to view the same video user; - the user specified by the local user specified.
  3. 3.根据权利要求1或2所述的方法,其特征在于,所述一个或多个交互窗口包括接收信息栏,该方法还包括:-将来自所述本地用户的交互对象的交互信息加入到所述一个或多个交互窗口的接收信息栏中,以生成一个或多个更新后的交互窗口; 所述步骤b还包括:_将所述一个或多个更新后的交互窗口与所述视频画面合成,以生成用于显示的所述一个或多个更新后的交互窗口叠加于所述视频画面上的合成画面。 3. The method of claim 1 or claim 2, wherein said one or more interactive windows includes receiving information field, the method further comprises: - the interactive object interaction information from the local user is added to the receiving the one or more interactive window information field to generate the one or more updated interactive window; said step b further comprises: _ after one or more updates of the interactive window with the video picture synthesis, to generate the one or more updates of the interactive window displayed superimposed on the video picture synthesized picture.
  4. 4.根据权利要求1所述的方法,其特征在于,所述预定条件包括以下各项中的任一项或任多项:-接收到本地用户输入的交互请求; -接收到来自其他用户的交互请求; -本用户终端上的视频播放器开始运行; -本用户终端上视频内容开始播放。 4. The method according to claim 1, wherein said predetermined condition comprises any of the following one or more of any of: - receiving a request for the local interactive user input; - receiving from other users interaction request; - a video player on the present user terminal starts running; - present on the user terminal starts playing the video content.
  5. 5.根据权利要求4所述的方法,其特征在于,所述本地用户输入的交互请求包括使用以下各输入设备中的任一输入设备所进行的输入:-鼠标; -键盘;-声/光识别设备; -手柄;其中,所述来自其他用户的交互请求包括以下各项中的任一项或任多项:_来自所述其他用户的用于与所述本地用户进行交互的请求消息; -来自所述其他用户的交互内容。 5. The method as claimed in claim 4, wherein said local interaction request includes a user input device input performed using any of the following input devices: - Mouse; - keyboard; - sound / light identification device; - a handle; wherein the request from the other user interaction comprises any one or any of the following number: _ from the other user message request for interaction with the local user; - the interaction content from other users.
  6. 6.根据权利要求1所述的方法,其特征在于,所述步骤b之前还包括:I.获得所述一个或多个交互窗口的位置信息,所述位置信息指示所述一个或多个交互窗口在所述合成画面中的显示位置;所述步骤b还包括:_当满足所述预定条件时,根据所述位置信息将所述一个或多个交互窗口与所述视频画面合成,以生成用于显示的一个或多个交互窗口叠加于视频画面上的合成画面。 6. The method according to claim 1, wherein, prior to said step b further comprises:. I obtain location information of the one or more interactive windows, the location information indicates that the one or more interaction position of the window displayed in the composite picture; said step b further comprises: _ when the predetermined condition satisfied, based on the position information of the one or more interactive windows of the video picture synthesized to generate one or more interactive windows for displaying the synthesized picture superimposed on the video picture.
  7. 7.根据权利要求6所述的方法,其特征在于,所述步骤I还包括:_接收所述本地用户输入的位置指示信息,所述位置指示信息用于指示所述一个或多个交互窗口在所述合成画面中的显示位置;_将所接收到的位置指示信息作为所述位置信息。 7. The method according to claim 6, wherein said step I further comprising: _ receiving the local user input information indicating the location, the position indication information indicating the one or more interactive windows a display position in the composite picture; _ the position indication of the received information as the location information.
  8. 8.根据权利要求1所述的方法,其特征在于,所述步骤b之前还包括:II.获得所述一个或多个交互窗口的大小信息,所述大小信息指示所述一个或多个交互窗口的显示大小;所述步骤b还包括:_当满足所述预定条件时,根据所述大小信息将所述一个或多个交互窗口与所述视频画面合成,以生成用于显示的一个或多个交互窗口叠加于视频画面上的合成画面。 8. The method according to claim 1, wherein, prior to said step b further comprises:. II obtaining the size information of the one or more interactive windows, the size information indicative of the one or more interaction display size of the window; said step b further comprises: _ when the predetermined condition satisfied, in accordance with the size information of the one or more interactive windows synthesized with the video picture, to generate a display or a a plurality of composite screen interactive window superimposed on the video screen.
  9. 9.根据权利要求8所述的方法,其特征在于,所述步骤II还包括:_接收所述本地用户输入的大小指示信息,所述大小指示信息用于指示所述一个或多个交互窗口的显示大小;_将所接收到的大小指示信息作为所述大小信息。 9. The method according to claim 8, wherein said step II further comprises: _ receiving the information indicative of the size of the local user input, the indication information indicates the size of the one or more interactive windows display size; _ the size indication of the received information as the size information.
  10. 10.根据权利要求1所述的方法,其特征在于,所述步骤b包括:-当满足所述预定条件时,对所述一个或多个交互窗口中的像素与所述视频画面的当前帧上的相应像素进行像素合成,以生成所述合成画面。 10. The method according to claim 1, wherein said step b comprises: - when said predetermined condition is satisfied, a current frame of said one or more interactive windows pixel and the video picture respective pixels on the pixel synthesis to generate the composite picture.
  11. 11.根据权利要求10所述的方法,其特征在于,所述步骤b还包括:-当满足预定条件时,对所述一个或多个交互窗口中的像素与所述视频画面的当前帧上的相应像素进行加权像素合成,以生成所述合成画面。 11. The method according to claim 10, wherein said step b further comprises: - when a predetermined condition is satisfied, the one or on the current frame pixel and the plurality of interactive video picture windows pixel corresponding pixel weighting synthesis to generate the composite picture.
  12. 12.根据权利要求11所述的方法,其特征在于,所述步骤b还包括:-当满足预定条件时,为所述一个或多个交互窗口中的像素以及所述视频画面的当前帧上的相应像素分别确定加权因子;-根据所确定的加权因子对所述一个或多个交互窗口中的像素与所述视频画面的当前帧上的相应像素进行加权像素合成,以生成所述合成画面。 12. The method according to claim 11, wherein said step b further comprises: - when a predetermined condition is satisfied, the current frame or a plurality of pixels, and an interactive window in the video picture of the one the weighting factor is determined respectively corresponding to a pixel; - weighting the pixel synthesized according to the determined weighting factor corresponding to the current frame on a pixel of the one or more interactive windows pixel and the video picture, to generate the synthesized picture .
  13. 13. —种在用户终端上用于在视频显示时提供用户交互的视频交互装置,其中,包括: 判断装置,用于判断预定条件是否满足;合成装置,当满足所述预定条件时,将一个或多个交互窗口与视频画面合成,以生成用于显示的一个或多个交互窗口叠加于视频画面上的合成画面;其中,所述一个或多个交互窗口包括发送信息栏,所述视频交互装置还包括: 第一加入装置,用于当满足所述预定条件时,将本地用户输入的交互信息加入到所述一个或多个交互窗口的发送信息栏中,以生成一个或多个更新后的交互窗口;所述合成装置还用于,将所述一个或多个更新后的交互窗口与所述视频画面合成,以生成用于显示的一个或多个更新后的交互窗口叠加于所述视频画面上的合成画面; 所述视频交互装置还包括:发送装置,用于将所述本地用户输入的交互信息提 13. - kind of interactive video on the user terminal device provides user interaction when a video display, comprising: judging means for judging whether or not a predetermined condition is satisfied; synthesis means, when a predetermined condition is satisfied, a a plurality of windows or interacting with the video picture synthesized to generate one or more interactive windows displayed on the screen superimposed on the video picture synthesis; wherein the one or more interactive windows comprises sending information field, the video interaction apparatus further comprises: a first adding means for, when said predetermined conditions are satisfied, the local user input mutual information added to the transmitted information bar one or more interactive windows, to generate one or more updated interactive window; said further means for synthesizing, the one or more interactive windows synthesized with the video frame update, to generate the one or more interactive window displayed superimposed on the updated synthesis of the video picture on the screen; the interactive video apparatus further comprising: transmitting means for interfacing to the local information providing user input 供给与所述本地用户输入的交互信息相对应的交互对象。 Interaction information supplied with the local user input corresponding to the interactive objects.
  14. 14.根据权利要求13所述的视频交互装置,其特征在于,所述本地用户输入的交互信息包括人机交互信息和/或用户间交互信息,其中,当所述交互信息包括用户间交互信息时,与所述本地用户输入的用户间交互信息相对应的交互对象包括以下各项中的任一项或任多项:-所述本地用户的在线好友; _与所述本地用户观看相同视频的其他用户; -由所述本地用户所指定的特定用户。 14. The interactive video apparatus according to claim 13, wherein the interactive information between the local user input comprises interactive information and / or user interaction information, wherein, when the interaction between the user interaction information comprises information when, between the local user and the interactive user input information corresponding to the interactive objects include any one or more of any of the following: - the local user's online friends; _ with the local user to view the same video other user; - the user specified by the local user specified.
  15. 15.根据权利要求13或14所述的视频交互装置,其特征在于,所述一个或多个交互窗口包括接收信息栏,其中,还包括:第二加入装置,用于将来自所述本地用户的交互对象的交互信息加入到所述一个或多个交互窗口的接收信息栏中,以生成一个或多个更新后的交互窗口;所述合成装置还用于,将所述一个或多个更新后的交互窗口与所述视频画面合成,以生成用于显示的所述一个或多个更新后的交互窗口叠加于所述视频画面上的合成画面。 15. The interactive video apparatus of claim 13 or claim 14, wherein said one or more interactive windows includes receiving information column, wherein, further comprising: a second adding means, for from said local user interactive object interaction information added to the received information or a plurality of interactive window tree to generate one or more updated after the interactive window; said further means for synthesizing, the one or more updates after the interactive window of the video picture after synthesis, to generate a display of the one or more updates composite screen interactive window superimposed on the video picture.
  16. 16.根据权利要求13所述的视频交互装置,其特征在于,所述预定条件包括以下各项中的任一项或任多项:-接收到本地用户输入的交互请求; -接收到来自其他用户的交互请求; -本用户终端上的视频播放器开始运行; -本用户终端上视频内容开始播放。 16. The interactive video apparatus according to claim 13, wherein said predetermined condition comprises any one or any of the following more of: - receiving a request for the local interactive user input; - receiving from the other a user interaction request; - a video player on the present user terminal starts running; - present on the user terminal starts playing the video content.
  17. 17.根据权利要求16所述的视频交互装置,其特征在于,所述本地用户输入的交互请求包括使用以下各输入设备中的任一输入设备所进行的输入:-鼠标; -键盘;-声/光识别设备; -手柄;其中,所述来自其他用户的交互请求包括以下各项中的任一项或任多项: -来自所述其他用户的用于与所述本地用户进行交互的请求消息; -来自所述其他用户的交互内容。 17. The interactive video apparatus according to claim 16, wherein said local interaction request includes a user input device input performed using any of the following input devices: - Mouse; - keyboard; - acoustic / optical recognition device; - a handle; wherein the request from other user interactions include any one or any of the following more of: - from the other user's request for interaction with the local user message; - the interaction content from other users.
  18. 18.根据权利要求13所述的视频交互装置,其特征在于,还包括:第一获得装置,用于获得所述一个或多个交互窗口的位置信息,所述位置信息指示所述一个或多个交互窗口在所述合成画面中的显示位置; 所述合成装置还用于:_当满足所述预定条件时,根据所述位置信息将所述一个或多个交互窗口与所述视频画面合成,以生成用于显示的一个或多个交互窗口叠加于视频画面上的合成画面。 18. The interactive video apparatus according to claim 13, characterized in that, further comprising: a first obtaining means for obtaining location information of the one or more interactive windows, the location information indicating the one or more an interactive window in the display position of the composite picture; said synthesis means further configured to: _ when the predetermined condition is satisfied, based on the position information of the one or more interactive windows of the video picture synthesis , one or more interactive windows to generate a composite screen displayed superimposed on the video picture.
  19. 19.根据权利要求18所述的视频交互装置,其特征在于,所述第一获得装置还用于:_接收所述本地用户输入的位置指示信息,所述位置指示信息用于指示所述一个或多个交互窗口在所述合成画面中的显示位置;_将所接收到的位置指示信息作为所述位置信息。 19. The interactive video apparatus according to claim 18, wherein said first obtaining means is further configured to: _ receiving the input of the local user location information indicating the location indication information indicating a or more interactive window displayed position in the composite picture; _ the position indication of the received information as the location information.
  20. 20.根据权利要求13所述的视频交互装置,其特征在于,还包括:第二获得装置,用于获得所述一个或多个交互窗口的大小信息,所述大小信息指示所述一个或多个交互窗口的显示大小; 所述合成装置还用于:_当满足所述预定条件时,根据所述大小信息将所述一个或多个交互窗口与所述视频画面合成,以生成用于显示的一个或多个交互窗口叠加于视频画面上的合成画面。 20. The interactive video apparatus according to claim 13, characterized by further comprising: second obtaining means for obtaining the size information of the one or more interactive windows, the size information indicative of the one or more a display size of the interactive window; said synthesis means further configured to: _ when the predetermined condition satisfied, in accordance with the size information of the one or more interactive windows synthesized with the video picture, to generate a display one or more interactive window superimposed on the composite screen video picture.
  21. 21.根据权利要求20所述的视频交互装置,其特征在于,所述第二获得装置还用于:_接收所述本地用户输入的大小指示信息,所述大小指示信息用于指示所述一个或多个交互窗口的显示大小;_将所接收到的大小指示信息作为所述大小信息。 21. The interactive video apparatus according to claim 20, wherein said second obtaining means is further configured to: _ receiving the information indicative of the size of the local user input, the indication information indicating the size of a or more interactive display size of the window; _ the size indication of the received information as the size information.
  22. 22.根据权利要求13所述的视频交互装置,其特征在于,所述合成装置用于:-当满足所述预定条件时,对所述一个或多个交互窗口中的像素与所述视频画面的当前帧上的相应像素进行像素合成,以生成所述合成画面。 22. The interactive video apparatus according to claim 13, wherein said synthesizing means for: - when said predetermined conditions are satisfied, the pixel of the one or more interactive windows with the video picture the pixel corresponding to the current frame on a pixel synthesis to generate the composite picture.
  23. 23.根据权利要求22所述的视频交互装置,其特征在于,所述合成装置还用于:_当满足预定条件时,对所述一个或多个交互窗口中的像素与所述视频画面的当前帧上的相应像素进行加权像素合成,以生成所述合成画面。 23. The interactive video apparatus according to claim 22, wherein said synthesizing means further configured to: _ when a predetermined condition is satisfied, the one or more interactive windows pixel and the video picture the corresponding pixel on the current frame pixel weighting synthesis to generate the composite picture.
  24. 24.根据权利要求23所述的视频交互装置,其特征在于,所述合成装置还包括: 加权因子确定装置,用于当满足预定条件时,为所述一个或多个交互窗口中的像素以及所述视频画面的当前帧上的相应像素分别确定加权因子;像素加权合成装置根据所确定的加权因子对所述一个或多个交互窗口中的像素与所述视频画面的当前帧上的相应像素进行加权像素合成,以生成所述合成画面。 24. The interactive video apparatus according to claim 23, wherein said synthesizing means further comprises: weighting factor determining means for, when a predetermined condition is satisfied, the one or more interactive windows pixels and corresponding pixel on a current frame of the video picture are determined weighting factors; pixel weighting means corresponding pixel on the current frame of the one or more interactive windows pixel and the video picture according to the determined weighting factor pixel weighting synthesis to generate the composite picture.
CN 200810033492 2008-02-03 2008-02-03 Method and apparatus for providing user interaction during displaying video on customer terminal CN101500125B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200810033492 CN101500125B (en) 2008-02-03 2008-02-03 Method and apparatus for providing user interaction during displaying video on customer terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200810033492 CN101500125B (en) 2008-02-03 2008-02-03 Method and apparatus for providing user interaction during displaying video on customer terminal

Publications (2)

Publication Number Publication Date
CN101500125A true CN101500125A (en) 2009-08-05
CN101500125B true CN101500125B (en) 2011-03-09

Family

ID=40946974

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200810033492 CN101500125B (en) 2008-02-03 2008-02-03 Method and apparatus for providing user interaction during displaying video on customer terminal

Country Status (1)

Country Link
CN (1) CN101500125B (en)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009110897A1 (en) 2008-03-05 2009-09-11 Hewlett-Packard Development Company, L.P. Synchronizing and windowing external content in digital display systems
GB2486744A (en) * 2010-12-24 2012-06-27 Starbucks Hk Ltd Multimedia system with separately transmitted supplementary data overlaid onto broadcast video stream based on user input
US9215506B2 (en) * 2011-03-31 2015-12-15 Tivo Inc. Phrase-based communication system
CN103297855B (en) * 2012-03-02 2015-05-20 腾讯科技(深圳)有限公司 Application display method and terminal
CN102855053B (en) * 2012-09-13 2016-06-15 惠州Tcl移动通信有限公司 The method of the mobile terminal based on the information of the mobile terminal and a control input
CN103914464B (en) * 2012-12-31 2017-05-24 上海证大喜马拉雅网络科技有限公司 Based on reviews syndrome streaming of interactive display system and method
CN103546816A (en) * 2013-05-02 2014-01-29 乐视网信息技术(北京)股份有限公司 User interface processing and video playing method and user interface system
CN104571779A (en) * 2013-10-16 2015-04-29 腾讯科技(深圳)有限公司 Method and device for displaying interface elements of player
CN103634681B (en) * 2013-11-29 2017-10-10 腾讯科技(成都)有限公司 Live interactive methods, apparatus, client, server and systems
CN104703056A (en) 2013-12-04 2015-06-10 腾讯科技(北京)有限公司 Video playing method, video playing device and video playing system
CN104717123A (en) * 2013-12-13 2015-06-17 乐视网信息技术(北京)股份有限公司 Message sending/receiving method and device and message interaction system
CN104735515A (en) * 2013-12-19 2015-06-24 乐视网信息技术(北京)股份有限公司 Method and terminal for displaying video state
CN103634690A (en) * 2013-12-23 2014-03-12 乐视致新电子科技(天津)有限公司 User information processing method, device and system in smart television
CN103702040B (en) * 2013-12-31 2018-03-23 广州华多网络科技有限公司 FIG decorative overlay live video processing method and system
CN104394480A (en) * 2014-03-10 2015-03-04 贵阳朗玛信息技术股份有限公司 Method and device for realizing chat on mobile terminal
CN105307025B (en) * 2014-06-20 2018-11-13 南宁富桂精密工业有限公司 Hot video processing method and system
CN105120359A (en) * 2015-08-24 2015-12-02 天脉聚源(北京)科技有限公司 Method and device of configuring interactive information for television interactive system
CN105306468A (en) * 2015-10-30 2016-02-03 广州华多网络科技有限公司 Method for real-time sharing of synthetic video data and anchor client side
CN105867756A (en) * 2015-11-20 2016-08-17 乐视移动智能信息技术(北京)有限公司 Browser control method and terminal equipment
CN105681855B (en) * 2015-11-30 2018-07-06 乐视网信息技术(北京)股份有限公司 Co-simulation method and device types to watch the live broadcast of
CN105872443A (en) * 2016-03-30 2016-08-17 乐视控股(北京)有限公司 Same video based chatting method and system, and server

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1201215A (en) 1998-01-15 1998-12-09 英业达股份有限公司 Display device for interactive image synchronous captions and displaying method therefor
CN101005609A (en) 2006-01-21 2007-07-25 腾讯科技(深圳)有限公司 Method and system for forming interaction video frequency image
US7293275B1 (en) 2002-02-08 2007-11-06 Microsoft Corporation Enhanced video content information associated with video programs
CN101076089A (en) 2006-06-23 2007-11-21 腾讯科技(深圳)有限公司 Method for displaying captions

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1201215A (en) 1998-01-15 1998-12-09 英业达股份有限公司 Display device for interactive image synchronous captions and displaying method therefor
US7293275B1 (en) 2002-02-08 2007-11-06 Microsoft Corporation Enhanced video content information associated with video programs
CN101005609A (en) 2006-01-21 2007-07-25 腾讯科技(深圳)有限公司 Method and system for forming interaction video frequency image
CN101076089A (en) 2006-06-23 2007-11-21 腾讯科技(深圳)有限公司 Method for displaying captions

Also Published As

Publication number Publication date Type
CN101500125A (en) 2009-08-05 application

Similar Documents

Publication Publication Date Title
US5724492A (en) Systems and method for displaying control objects including a plurality of panels
US20120102403A1 (en) Video integration
US20100229197A1 (en) Digital broadcast widget system
US6754904B1 (en) Informing network users of television programming viewed by other network users
US6762773B2 (en) System and method for providing a context-sensitive instructional user interface icon in an interactive television system
US6559866B2 (en) System and method for providing foreign language support for a remote control device
US5931906A (en) System for creating a multimedia presentation by integrating local program materials with remotely accessible program materials
US20060129908A1 (en) On-content streaming media enhancement
US20100313231A1 (en) Information processing apparatus, information processing method, and program
US20030084456A1 (en) Mixed entertainment application
US20070180488A1 (en) System and method for processing video content
US20140168277A1 (en) Adaptive Presentation of Content
US20110161999A1 (en) Systems and methods for selectively obscuring portions of media content using a widget
US20140223481A1 (en) Systems and methods for updating a search request
US20120124625A1 (en) System and method for searching an internet networking client on a video device
US20090271820A1 (en) Method of recommending broadcasting contents and recommending apparatus therefor in multimedia contents reproducing device
US20090183199A1 (en) Devices, Systems, and Methods Regarding Advertisement on Demand
US20120139945A1 (en) Method for controlling screen display and display device using the same
CN102905170A (en) Screen popping method and system for video
US20040117830A1 (en) Receiving apparatus and method
US20100269135A1 (en) Virtual desktop services
US20150128164A1 (en) Systems and methods for easily disabling interactivity of interactive identifiers by user input of a geometric shape
WO2001078381A2 (en) Online/offline triggers
US20130174035A1 (en) Systems and methods for representing a content dependency list
US20120159356A1 (en) Enhanced World Wide Web-Based Communications

Legal Events

Date Code Title Description
C06 Publication
C10 Request of examination as to substance
C14 Granted