CN103414751B - One kind of pc screen content sharing interactive control method - Google Patents

One kind of pc screen content sharing interactive control method Download PDF

Info

Publication number
CN103414751B
CN103414751B CN201310297489.9A CN201310297489A CN103414751B CN 103414751 B CN103414751 B CN 103414751B CN 201310297489 A CN201310297489 A CN 201310297489A CN 103414751 B CN103414751 B CN 103414751B
Authority
CN
China
Prior art keywords
screen
pc
remote
client
interactive
Prior art date
Application number
CN201310297489.9A
Other languages
Chinese (zh)
Other versions
CN103414751A (en
Inventor
章云
谢胜利
何文涛
华耀波
吴宗泽
林耀城
谭国坚
曾星
胡磊
Original Assignee
广东工业大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广东工业大学 filed Critical 广东工业大学
Priority to CN201310297489.9A priority Critical patent/CN103414751B/en
Publication of CN103414751A publication Critical patent/CN103414751A/en
Application granted granted Critical
Publication of CN103414751B publication Critical patent/CN103414751B/en

Links

Abstract

本发明涉及一种PC屏幕内容分享互动控制方法技术领域,更具体地,涉及现有PC屏幕内容分享的方法的改进。 The present invention relates to a PC screen content sharing BACKGROUND Interactive control method, and more particularly, to an improved conventional PC screen content sharing method. 一种PC屏幕内容分享互动控制方法,包括以下步骤,S1.远程PC主机指定需要进行内容分享的窗口,S2.获取共享内存数据缓冲区中的屏幕RGB数据,S3.利用软件编码器将YUV420格式数据编码压缩成为H.264视频流;S4.将编码压缩好的屏幕内容视频流通过RTMP协议上传到流媒体服务器S5.用户通过浏览器登录到发布远程PC主机媒体流的网页客户端地址S6.通过TCP协议向远程PC主机传输控制信息;S7.远程PC主机解析接收到的用户端的控制信息呈现在PC屏幕上;S8.将屏幕响应的效果呈现在用户登录的网页客户端。 Between PC screen interactive content sharing controlling method, comprising the following steps, S1. Specifies the remote host PC window sharing content, S2. RGB data acquired screen data buffer in the shared memory, S3. By software encoder YUV420 format data encoding compressed into H.264 video streams;. S4 good compression encoding the video stream screen content uploaded to the streaming media server via RTMP protocol S5 user logs on to the web client address S6 issue a remote host PC media streaming through the browser. control via TCP protocol to transmit information to a remote host PC;. S7 control information to a remote host PC parsing the received client's presented on the PC screen;. S8 will effect the screen in response to the presentation of the web client user login. 使得用户可以直接通过网页浏览器浏览主机的屏幕内容。 Screen allows the user to browse the contents of the host directly through a web browser. 自定远程交互控制协议,实现一个轻量级的用于PC屏幕内容分享互动。 Custom interactive remote control protocol, to achieve a lightweight PC screen for interactive content sharing.

Description

一种PC屏幕内容分享互动控制方法 Between PC screen content sharing interactive control method

技术领域 FIELD

[0001 ]本发明涉及一种PC屏幕内容分享互动控制方法技术领域,更具体地,涉及现有PC屏幕内容分享的方法的改进。 [0001] The present invention relates to an interactive PC screen content sharing BACKGROUND control method, and more particularly, to an improved conventional PC screen content sharing method.

背景技术 Background technique

[0002]互联网技术已经日益成熟,为了满足当前互联网多用户之间的屏幕内容分享、内容展示、互动交流的需求,轻型的屏幕内容分享系统将会很好地在普通用户之间普及多媒体互动应用。 [0002] Internet technology has become more sophisticated, in order to meet the current screen content between multiple users to share Internet, content presentation, interaction of demand and lightweight screen content sharing system will be well popular multimedia interactive applications between ordinary users .

[0003]多媒体教学系统通常采用特定的服务端和客户端构建,在实施多媒体教学的时候需要首先在所有的客户PC机上安装对应的客户端软件,操作性和适用性较差。 [0003] Multimedia systems are typically built using a specific service and the client, the corresponding need to install the client software on all Client PC in the implementation of multimedia teaching, poor workability and applicability. 而且大多数多媒体教学系统缺乏互动,有时候仅仅是在屏幕上单向接受老师的授课,对于某些需要操作性的课程教学没有起到很好的作用。 And most interactive multimedia teaching system lacks, sometimes just a way to accept the teacher's teaching on the screen, for some curriculum needs operability did not play a good role. 因此,从快速部署教学系统,低成本实现简单的教学互动,设计一种轻型的基于PC屏幕分享互动的教学平台是具有实用意义的。 Therefore, from the rapid deployment teaching system, interactive teaching simple low cost, PC-based screen sharing interactive teaching platform is a lightweight design with a practical sense.

[0004]当前视频会议系统通常采用SIP协议负责会话管理,媒体流使用RTP协议进行传输,系统需要安装独立的系统和客户端,与直接在浏览器上操作相比,操作复杂,适用性比较差。 [0004] The current video conferencing systems typically employ SIP protocol is responsible for session management, the media stream is transmitted using the RTP protocol, need to install a separate system and client systems, as compared with directly on the browser, complicated operation, poor applicability . 另外SIP协议比较复杂,简单的应用并不需要复杂的协议,而且不方便针对特定业务的扩展。 In addition SIP protocol is more complex, simple applications do not require complex protocols, and inconvenient expand business-specific. 此外,针对轻量化应用的需求,自定简单的互动控制协议更具有实用性。 In addition, the demand for lightweight applications, from simple interactive control protocol given more practical.

发明内容 SUMMARY

[0005]本发明为克服上述现有技术所述的至少一种缺陷,提供一种PC屏幕内容分享互动控制方法,其使用视频编码压缩技术将屏幕内容(RGB图片数据)编码成H.264,将其打包成FLV格式上传至开源的流媒体服务器,使其具有普遍性,可适用于普通的PC,成本消耗低,资源开销较小。 [0005] To overcome the above prior art according to at least one defect present invention, there is provided a PC screen interactive control content sharing method which uses the video coding screen content compression techniques (RGB image data) encoded as H.264, package it into FLV format to upload open source streaming media server, making it universal, applicable to ordinary PC, low cost consumption, less resource overhead. 并使用一种通用的流媒体传输协议RTMP在流媒体服务器上将编码成视频流的屏幕内容在互联网上下发到各个用户,使得用户可以直接通过网页浏览器浏览主机的屏幕内容。 And using a common transport protocol streaming RTMP encoded on the screen content to the streaming server over the Internet a video stream sent to all users, so that the user can browse the contents of the host screen using a web browser. 自定远程交互控制协议,实现一个轻量级的用于PC屏幕内容分享互动的系统。 Custom interactive remote control protocol, to achieve a lightweight PC screen content for interactive sharing system. 多用户之间可以利用这个轻量级系统在互联网上开展视频会议展示主机电脑屏幕内容,并可以适用于在互动教育场景中供用户实现交互直观的学习。 This lightweight system can be used to carry out a multi-user video conference between the host computer display screen content on the Internet, and can be applied for users to interact in an intuitive learning interactive educational scene.

[0006]为解决上述技术问题,本发明采用的技术方案是:一种PC屏幕内容分享互动控制方法,包括以下步骤,其中步骤SI至S4是PC屏幕的内容分享步骤,步骤S5至S8是PC屏幕互动控制步骤。 [0006] To solve the above problems, the present invention adopts the technical solution is: A PC screen interactive content sharing controlling method, comprising the following steps, wherein the step SI to S4 is the contents of the PC screen sharing step, steps S5 to S8 is a PC screen interactive control step.

[0007] S1.远程PC主机指定需要进行内容分享的窗口,如PPT窗口的名字、图片窗口的名字,截屏程序将截取指定窗口内容,获得的屏幕数据以RGB格式数据存储在共享内存数据缓冲区中; [0007] S1. Remote host PC to specify the need for content sharing window, as the name PPT window, the name of the picture window, screen capture program interception of a specified window contents, screen data obtained in RGB format data stored in the shared memory data buffers in;

[0008] S2.获取共享内存数据缓冲区中的屏幕RGB数据,将其转换为YUV420数据,压缩数据量,以适应视频编码和实时传输的需求; . [0008] S2 screen RGB data acquired shared memory data buffer, converts it into YUV420 data, compress the data, to meet the needs of real-time video encoding and transmission;

[0009] S3.利用软件编码器将YUV420格式数据编码压缩成为H.264视频流; . [0009] S3 by software encoder YUV420 format data encoded compressed into H.264 video stream;

[0010] S4.将编码压缩好的屏幕内容视频流通过RTMP协议上传到流媒体服务器,流媒体服务器发布到网络上,按用户请求以RTMP协议下发媒体流; . [0010] S4 good compression encoding the video stream uploaded to the screen content streaming server via RTMP protocol, streaming media server publishing to the network, the user request issued by RTMP protocol media stream;

[0011] S5.用户通过浏览器登录到发布远程PC主机媒体流的网页客户端地址,网页客户端捕获用户端的鼠标或键盘操作动作; . [0011] S5 user logs on to the web client address issue a remote host PC media streaming through the browser, web client captures the end user's mouse or keyboard action;

[0012] S6.按照自订远程控制协议,通过TCP协议向远程PC主机传输控制信息; . [0012] S6 in accordance with the custom remote control protocol, control information to a remote host PC via TCP transport protocol;

[0013] S7.远程PC主机解析接收到的用户端的控制信息,进行相应的控制操作,呈现在PC屏幕上; . [0013] S7 remote PC host parses the received control information to the UE performs the corresponding control operation, presented on the PC screen;

[0014] S8.将屏幕响应的效果呈现在用户登录的网页客户端。 [0014] S8. The effect of the screen in response to the presentation of the web client user login.

[0015] 进一步的,所述的步骤SI中,获取指定windows窗口的名字后,调用windows系统的API对其指定的windows窗口进行截屏,自动按照获取的实际窗口的长宽参数进行截取。 After [0015] Further, the step SI, the obtaining of the name of the specified windows windows, windows system API calls for a screen shot of the windows to be specified window automatically taken in accordance with the actual length and width parameters of the acquisition window.

[0016]进一步的,所述的步骤S3中,要保证码率不能消耗过多的带宽,使其能在较差的网络环境也能顺利浏览到主机的屏幕内容,将截屏帧率和输出帧率都限定为10帧,使得在流畅与低消耗之间取得折中。 [0016] Further, in the step S3, to ensure that the rate can not consume excessive bandwidth, so that it can also be successfully navigate to the host in the screen content poor network environment, the frame rate and the output frame screenshots rates are limited to 10, so that to obtain compromise between smooth and low consumption.

[0017]进一步的,所述的步骤S4中,根据RTMP协议需要将压缩好的视频流内容封装为FLV,然后通过RTMP协议以媒体流的形式上传到RTMP服务器上。 [0017] Further, in the step S4, the compressed according RTMP protocol requires good video streaming content is encapsulated FLV, then spread to form a media stream server via RTMP RTMP protocol.

[0018]所述步骤S5中,网页客户端调用了用户浏览器的Flash插件实现解码播放,无需安装特定的客户端软件,只需要使用网页浏览器登录到网页客户端地址,即可浏览到远程PC主机屏幕内容的分享。 [0018] The step S5, the web client calls the user's browser Flash plug-in implementation decode and play, without having to install special client software, simply log on to the web client address using a web browser, you can browse to the remote Share screen content of the host PC.

[0019]总体来说,所述步骤SI和步骤S2、S3、S4,分属两个异步线程,这两个异步线程并行工作,提高程序效率。 [0019] In general, the steps SI step S2, S3, S4, belong to two asynchronous thread, the two threads in parallel asynchronous, program efficiency. 同时整个处理流程采取的处理策略为截取一张图片立即编码一帧视频然后立刻上传到流媒体服务器。 At the same time the entire process flow of processing strategies taken immediately to intercept a picture encoding a video and then immediately uploaded to the streaming server.

[0020]进一步的,所述的步骤S5、S6中,用户是通过网页客户端实现对远程PC主机屏幕的控制的,网页客户端使用Act1nScript的接口捕获针对网页客户端的鼠标动作或者键盘动作,并将鼠标操作时在网页客户端中的相对坐标记录下来,通过自定协议将其坐标和动作信息传送到远程PC主机中去;或者捕获针对网页客户端的键盘动作,同样通过自订协议将其传输到远程PC主机中去。 [0020] Further, the steps S5, S6, the user is to achieve control of a remote host PC screen through a web client, the web client to use Act1nScript interface capture for web client mouse operation or keyboard operation, and the relative coordinates on the page in the client when the mouse operation is recorded, will be transmitted via a custom protocol which coordinates and the movement information to a remote host PC to; or capture for web client keyboard actions, the same custom protocol to transmit go to a remote host PC.

[0021]所述的步骤S7中,远程PC主机接收到用户端的控制信息后,通过Windows系统的API实现对应的操作,将响应的操作效果呈现在远程PC主机屏幕显示上,用户就可以实现远程交互控制的效果。 [0021] The step S7, the remote host PC after receiving the control information of the user terminal, to achieve the corresponding operation by API Windows systems, operational effects will respond presented on a remote host PC screen, the user can remotely interactive control effect. 如屏幕展示的是一个PPT内容,用户可以通过鼠标点击实现远程翻页的操作、通过键盘操作实现远程修改PPT内容。 Such as screen display is a PPT content, users can flip through mouse clicks remote operation, remote modification PPT content via the keyboard.

[0022]与现有技术相比,有益效果是: [0022] Compared with the prior art, the beneficial effects are:

[0023] 1、使用截取PC屏幕的方式,通过图像压缩编码成H.264视频流的方式将截屏获得的图像数据转为H.264视频流上传到服务器中,然后发布到网络上供用户远程浏览主机屏幕内容。 [0023] 1, the use of interception PC screen mode, the image compression by way of encoding H.264 video stream of the image data obtained screen shots into H.264 video streams uploaded to the server, and then publish to the network for users to remotely browse the contents of the host screen. 采用固定帧率的截屏和编码输出,就很好地保证了实时性、流畅性和画面连续性,使得用户体验良好。 A fixed frame rate and the code output screenshots, very good to ensure real-time, fluency and continuity of the picture, so that a good user experience.

[0024] 2、使用开源的RTMP服务器,资源消耗低,安装设置方便。 [0024] 2, using the open source server RTMP, low resource consumption, easy installation is provided. 不采用如SIP协议比较复杂的通用视频会议系统常用协议进行屏幕内容分享展示,而是采用RTMP协议传输屏幕视频流,使得客户端无需安装任何软件,只需要通过浏览器浏览屏幕内容发布的URL,就能实现远程浏览屏幕分享内容。 SIP protocol were not used as commonly used protocols more complex universal video conferencing systems to share content display screen, instead of using the RTMP protocol to transmit screen video stream, so that clients do not need to install any software, just browse URL screen content published through the browser, You will be able to browse remote screen sharing. 使用简单的RTMP传输协议是针对比较轻便简单的系统应用,使得无需在小系统上使用复杂协议带来的资源不必要消耗,能最有效地利用少量资源实现简单的效果。 Using a simple RTMP transmission protocol is relatively light and simple system for applications that do not need to use the resources to bring a complex agreement on small systems unnecessary consumption, most effective use of resources to achieve a small amount of simple effects.

[0025] 3、依赖高效的压缩编码算法,整个处理流程采取的处理策略为截取一张图片立即编码一帧视频然后立刻上传到流媒体服务器,简化了系统的实现,无需使用复杂的内存缓冲机制,节省了内存资源。 [0025] 3, dependent on efficient compression algorithm, the entire process flow of processing strategies taken immediately to intercept a picture encoding a video and upload it immediately to the streaming media server, simplifies the implementation of the system, without the use of complex memory buffering mechanism , saving memory resources.

[0026] 4、不使用复杂的微软远程桌面控制协议实现交互操作,自订简单协议,只需客户端捕获鼠标和键盘的事件,将其通过TCP发送到PC主机,在远程主机上实现响应,并将响应效果通过屏幕内容截屏视频流反馈到网页客户端,实现了简单的远程桌面控制效果。 [0026] 4, without the use of complex Microsoft Remote Desktop Control Protocol interoperate, custom simple protocol, the client simply capture mouse and keyboard events, send it to the host PC via TCP, to achieve a response on a remote host, and respond to the effect of the screen content screencast video streams back to the web client, to achieve a simple remote desktop control. 而且由于不涉及复杂的控制协议,易于针对具体的使用场景进行扩展。 And because they do not involve complex control protocols, easily be extended for specific usage scenarios.

附图说明 BRIEF DESCRIPTION

[0027]图1是本发明系统架构示意图。 [0027] FIG. 1 is a schematic diagram of a system architecture of the present invention.

[0028]图2是本发明的PC屏幕的内容分享步骤流程示意图; [0028] FIG. 2 is a PC screen content sharing step of the present invention is a schematic flow diagram;

[0029]图3是本发明的PC屏幕互动控制步骤流程示意图; [0029] FIG. 3 is a schematic diagram of the present invention to interact with the PC screen control steps;

[0030]图4是本发明的远程PC主机端流程示意图; [0030] FIG. 4 is a remote PC host schematic process of the present invention;

[0031]图5是本发明的网页客户端流程示意图; [0031] FIG. 5 is a process according to the present invention, the web client is a schematic diagram;

[0032]图6是本发明的用户角度系统架构示意图。 [0032] FIG. 6 is a perspective of a user system architecture diagram of the present invention.

具体实施方式 Detailed ways

[0033]附图仅用于示例性说明,不能理解为对本专利的限制;为了更好说明本实施例,附图某些部件会有省略、放大或缩小,并不代表实际产品的尺寸;对于本领域技术人员来说,附图中某些公知结构及其说明可能省略是可以理解的。 [0033] The drawings are only for illustrative, not be construed as limiting of the present patent; For a better description of the embodiment, the drawings have omitted some components, zoom in or out, do not represent the actual size of the product; for Those skilled in the art, the drawings and description of some well-known structures may be omitted can be appreciated.

[0034]如图1、2、3所示,一种PC屏幕内容分享互动控制方法,包括以下步骤,其中步骤SI至S4是PC屏幕的内容分享步骤,步骤S5至S8是PC屏幕互动控制步骤。 [0034] As shown in FIG An interactive 1,2,3 PC screen content sharing control method, comprising the following steps, wherein the step SI to S4 is the contents of the PC screen sharing step, steps S5 to S8 is a step of controlling interactive PC screen .

[0035] S1.远程PC主机指定需要进行内容分享的窗口,如PPT窗口的名字、图片窗口的名字,截屏程序将截取指定窗口内容,获得的屏幕数据以RGB格式数据存储在共享内存数据缓冲区中; [0035] S1. Remote host PC to specify the need for content sharing window, as the name PPT window, the name of the picture window, screen capture program interception of a specified window contents, screen data obtained in RGB format data stored in the shared memory data buffers in;

[0036] S2.获取共享内存数据缓冲区中的屏幕RGB数据,将其转换为YUV420数据,压缩数据量,以适应视频编码和实时传输的需求; . [0036] S2 screen RGB data acquired shared memory data buffer, converts it into YUV420 data, compress the data, to meet the needs of real-time video encoding and transmission;

[0037] S3.利用软件编码器将YUV420格式数据编码压缩成为H.264视频流; . [0037] S3 by software encoder YUV420 format data encoded compressed into H.264 video stream;

[0038] S4.将编码压缩好的屏幕内容视频流通过RTMP协议上传到流媒体服务器,流媒体服务器发布到网络上,按用户请求以RTMP协议下发媒体流; . [0038] S4 good compression encoding the video stream uploaded to the screen content streaming server via RTMP protocol, streaming media server publishing to the network, the user request issued by RTMP protocol media stream;

[0039] S5.用户通过浏览器登录到发布远程PC主机媒体流的网页客户端地址,网页客户端捕获用户端的鼠标或键盘操作动作; . [0039] S5 user logs on to the web client address issue a remote host PC media streaming through the browser, web client captures the end user's mouse or keyboard action;

[0040] S6.按照自订远程控制协议,通过TCP协议向远程PC主机传输控制信息; . [0040] S6 in accordance with the custom remote control protocol, control information to a remote host PC via TCP transport protocol;

[0041] S7.远程PC主机解析接收到的用户端的控制信息,进行相应的控制操作,呈现在PC屏幕上; . [0041] S7 remote PC host parses the received control information to the UE performs the corresponding control operation, presented on the PC screen;

[0042] S8.将屏幕响应的效果呈现在用户登录的网页客户端。 [0042] S8. The effect of the screen in response to the presentation of the web client user login.

[0043] 进一步的,所述的步骤SI中,获取指定windows窗口的名字后,调用windows系统的API对其指定的windows窗口进行截屏,自动按照获取的实际窗口的长宽参数进行截取。 After [0043] Further, the step SI, the obtaining of the name of the specified windows windows, windows system API calls for a screen shot of the windows to be specified window automatically taken in accordance with the actual length and width parameters of the acquisition window.

[0044]进一步的,所述的步骤S3中,要保证码率不能消耗过多的带宽,使其能在较差的网络环境也能顺利浏览到主机的屏幕内容,将截屏帧率和输出帧率都限定为10帧,使得在流畅与低消耗之间取得折中。 [0044] Further, in the step S3, to ensure that the rate can not consume excessive bandwidth, so that it can also be successfully navigate to the host in the screen content poor network environment, the frame rate and the output frame screenshots rates are limited to 10, so that to obtain compromise between smooth and low consumption.

[0045]进一步的,所述的步骤S4中,根据RTMP协议需要将压缩好的视频流内容封装为FLV,然后通过RTMP协议以媒体流的形式上传到RTMP服务器上。 [0045] Further, in the step S4, the compressed according RTMP protocol requires good video streaming content is encapsulated FLV, then spread to form a media stream server via RTMP RTMP protocol.

[0046]所述步骤S5中,网页客户端调用了用户浏览器的Flash插件实现解码播放,无需安装特定的客户端软件,只需要使用网页浏览器登录到网页客户端地址,即可浏览到远程PC主机屏幕内容的分享。 [0046] The step S5, the web client calls the user's browser Flash plug-in implementation decode and play, without having to install special client software, simply log on to the web client address using a web browser, you can browse to the remote Share screen content of the host PC.

[0047]总体来说,所述步骤SI和步骤S2、S3、S4,分属两个异步线程,这两个异步线程并行工作,提高程序效率。 [0047] In general, the steps SI step S2, S3, S4, belong to two asynchronous thread, the two threads in parallel asynchronous, program efficiency. 同时整个处理流程采取的处理策略为截取一张图片立即编码一帧视频然后立刻上传到流媒体服务器。 At the same time the entire process flow of processing strategies taken immediately to intercept a picture encoding a video and then immediately uploaded to the streaming server.

[0048]进一步的,所述的步骤S5、S6中,用户是通过网页客户端实现对远程PC主机屏幕的控制的,网页客户端使用Act1nScript的接口捕获针对网页客户端的鼠标动作或者键盘动作,并将鼠标操作时在网页客户端中的相对坐标记录下来,通过自定协议将其坐标和动作信息传送到远程PC主机中去;或者捕获针对网页客户端的键盘动作,同样通过自订协议将其传输到远程PC主机中去。 [0048] Further, the steps S5, S6, the user is to achieve control of a remote host PC screen through a web client, the web client to use Act1nScript interface capture for web client mouse operation or keyboard operation, and the relative coordinates on the page in the client when the mouse operation is recorded, will be transmitted via a custom protocol which coordinates and the movement information to a remote host PC to; or capture for web client keyboard actions, the same custom protocol to transmit go to a remote host PC.

[0049]所述的步骤S7中,远程PC主机接收到用户端的控制信息后,通过Windows系统的API实现对应的操作,将响应的操作效果呈现在远程PC主机屏幕显示上,用户就可以实现远程交互控制的效果。 [0049] The step S7, the remote host PC after receiving the control information of the user terminal, to achieve the corresponding operation by API Windows systems, operational effects will respond presented on a remote host PC screen, the user can remotely interactive control effect. 如屏幕展示的是一个PPT内容,用户可以通过鼠标点击实现远程翻页的操作、通过键盘操作实现远程修改PPT内容。 Such as screen display is a PPT content, users can flip through mouse clicks remote operation, remote modification PPT content via the keyboard.

[0050] 如图4所示,为远程PC主机端流程示意图,其步骤如下: [0050] 4, a schematic flow diagram of the remote host end of the PC, the following steps:

[0051 ] a.远程PC主机指定需要进行内容分享的窗口,如PPT窗口的名字、图片窗口的名字; . [0051] a remote host PC is required to specify the content sharing window, as the name PPT window, picture window name;

[0052] b.根据需求是否接受远程控制进行分支处理,若不需要则不开辟远程交互控制管理进程,执行以下操作;否则,开辟新的进程,并行于以下操作; [0052] b according to the needs of whether to accept remote control branching, if not need to open up remote interactive control management process, do the following; otherwise, the process of opening up new, parallel to the following;

[0053]线程一:截屏程序将截取指定分享窗口的内容,获得的屏幕数据以RGB格式数据存储在共享内存数据缓冲区中; [0053] a thread: screenshots sharing program intercepts the window, the screen data obtained from the RGB format data stored in the shared memory data buffer;

[0054] c.线程二:将共享内存数据缓冲区中的屏幕RGB数据转换为YUV420数据,利用软件编码器将YUV420格式数据编码压缩成为H.264视频流;将编码压缩好的屏幕内容视频流数据通过RTMP协议上传到流媒体服务器,流媒体服务器发布到网络上,按用户请求以RTMP协议下发媒体流; . [0054] c two threads: the shared memory data buffers screen RGB data into data YUV420, YUV420 by software encoder format data encoded compressed into H.264 video stream; encoding the compressed video stream good screen content protocol to upload data via RTMP streaming server, the streaming server publishing to the network, the user request sent by the RTMP protocol media stream;

[0055] d.若需要新开辟远程交互控制进程,循环等待接收用户端的控制信息,然后进行解析,并在主机上响应。 [0055] d. If desired the newly opened remote interactive control process, the control loop waits for the user information receiving terminal, and then parses the response and on the host.

[0056]如图5所示,为网页客户端流程示意图,其步骤如下: [0056] As shown in FIG 5, a schematic flow diagram for the web client, comprises the following steps:

[0057] A.接受用户登录; [0057] A. accepts user login;

[0058] B.网页客户端向流媒体服务器请求远程PC屏幕的媒体流; [0058] B. web client requests streaming media remote PC screen to the streaming media server;

[0059] C.调用浏览器Flash插件解码播放视频流; [0059] C. invoke the browser Flash plug-in decoding and playing video stream;

[0060] D.判断远程主机是否接受用户的交互控制,如果不接受则不执行以下操作,否则,执行下面操作; [0060] D. host determines whether to accept the remote control of the user interaction, is not performed if the following does not accept, otherwise, perform the following operations;

[0061 ] E.捕获用户端的鼠标或键盘操作动作; [0061] E. UE captured mouse or keyboard actions;

[0062] F.按照自订远程控制协议,通过TCP协议向远程PC主机传输控制信息。 [0062] F. According to custom remote control protocol, control information to a remote host PC via TCP transport protocol.

[0063]如图6所示,综合远程PC主机端和网页客户端,从用户角度出发描述系统实施流程,其步骤如下: [0063] As shown, the PC host and the remote integrated web client 6, starting from the user perspective to describe the system implementation process, the following steps:

[0064] (I)主机指定分享内容窗口,程序执行截屏操作,并进行压缩编码成视频流上传到流媒体服务器,流媒体服务器发布该视频流在网络上; [0064] (I) specified by the host share window, the screenshots program execution, and coding into a video stream uploaded to the streaming server, the streaming server publish the video stream on the network;

[0065] (2)用户获知远程主机发布的视频流对应的网页客户端URL,通过网页浏览器登录到网页客户端; [0065] (2) the user informed of the video stream corresponding to the release of the remote host web client URL, log on to the web client using a web browser;

[0066] (3)网页客户端向流媒体服务器请求对应的视频流数据,并调用浏览器的Flash插件进行解码播放,将远程主机分享窗口内容呈现在用户屏幕上; [0066] (3) the web client requests the corresponding video stream data to the streaming media server, and calls the browser's Flash plug-in to decode playback, the remote host will share the window content presented on the user's screen;

[0067] (4)若远程主机开放接收用户的远程交互控制,网页客户端则通过不断捕获用的鼠标和键盘动作,并根据自订的控制协议封装好通过TCP协议传输到远程主机; [0067] (4) If the remote host receives a remote opening control user interaction, through the continuous web client mouse and keyboard trapping operation, and good transport package to a remote host via the TCP protocol in accordance with custom control protocol;

[0068] (5)远程主机接收到用户的控制信息,进行解析、响应,呈现在屏幕变化上,从而达到用户远程交互控制的效果。 [0068] (5) remote host receives the control information of the user, analyzing, in response, changes presented on the screen, so as to achieve interactive control of a remote user.

[0069]相同或相似的标号对应相同或相似的部件;附图中描述位置关系仅用于示例性说明,不能理解为对本专利的限制。 [0069] The same or similar reference numerals correspond to like or similar parts; positional relationship depicted in the figures only for illustrative, not be construed as limiting this patent.

[0070]以上所述仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,对发明的技术方案可以做若干适合实际情况的改进。 [0070] The above are only preferred embodiments of the present invention, it should be noted that those of ordinary skill in the art, in the present invention without departing from the principles of the premise, the technical solutions of the invention may be suitable for the actual situation of several improvement of. 因此,本发明的保护范围不限于此,本领域中的技术人员任何基于本发明技术方案上非实质性变更均包括在本发明保护范围之内。 Accordingly, the scope of the present invention is not limited thereto, and those skilled in the art based on any aspect of the present invention is non-substantive changes are included within the scope of the present invention.

Claims (7)

1.一种PC屏幕内容分享互动控制方法,其特征在于包括以下步骤: 51.远程PC主机指定需要进行内容分享的窗口,截屏程序将截取指定窗口内容,获得的屏幕数据以RGB格式数据存储在共享内存数据缓冲区中; 52.获取共享内存数据缓冲区中的屏幕RGB数据,将其转换为YUV420数据,压缩数据量,以适应视频编码和实时传输的需求; 53.利用软件编码器将YUV420格式数据编码压缩成为H.264视频流; 54.将编码压缩好的屏幕内容视频流通过RTMP协议上传到流媒体服务器,流媒体服务器发布远程PC主机媒体流到网页客户端上,按用户请求以RTMP协议下发远程PC主机媒体流; 55.用户通过浏览器登录到所述网页客户端的地址,网页客户端捕获用户端的鼠标或键盘操作动作; 56.按照自订远程控制协议,通过TCP协议向远程PC主机传输捕获的用户端的鼠标或键盘操作动作信息; 57.远程P An interactive PC screen content sharing controlling method, comprising the steps of: the remote PC 51. The host specifies the contents of the window need to be shared, the program intercepts screenshots contents of the window, the screen data obtained from the data stored in the RGB format shared memory data buffer; screen 52. RGB data acquired shared memory data buffer, which was converted to YUV420 data, compress the data, to meet the needs of real-time video encoding and transmission; using software encoder 53. YUV420 data encoding formats compressed into H.264 video streams; 54. the encoded video stream compression good screen content uploaded by the RTMP protocol to the streaming media server, streaming media server publishing remote host PC media stream to the web client, according to user request issued RTMP protocol remote host PC media stream; 55. the user logs into the web page address of the client browser, web client captures the client mouse or keyboard actions; 56. the customized remote control protocol, over TCP to mouse or keyboard operation information of the remote PC client host transmits the captured; 57. distance P C主机解析接收到捕获的用户端的鼠标或键盘操作动作信息,进行相应的控制操作,呈现在远程PC主机的屏幕上; 58.将远程PC主机的屏幕响应的效果呈现在用户登录的网页客户端,网页客户端调用用户浏览器的Flash插件实现解码播放,使用户浏览到远程PC主机屏幕内容。 C host parses the received captured client's mouse or keyboard operation information, the corresponding control operation, presented on a remote host PC screen; 58. effects remote host PC screen in response to the presentation of the page the client user login , web client calls the user's browser Flash plug-in implementation decode and play, allowing users to browse a remote host PC screen content.
2.根据权利要求1所述的一种PC屏幕内容分享互动控制方法,其特征在于,所述的步骤SI中,获取指定windows窗口的名字后,调用windows系统的API对其指定的windows窗口进行截屏,自动按照获取的实际窗口的长宽参数进行截取。 The screen of the PC 1. An interactive control content sharing method as claimed in claim, wherein said step SI, the obtaining of the name of the specified window of windows, the windows system API calls for the windows to be specified window screenshots taken automatically in accordance with the actual length and width parameters of the acquisition window.
3.根据权利要求1所述的一种PC屏幕内容分享互动控制方法,其特征在于,所述的步骤S3中,截屏帧率和输出帧率都为10帧。 The screen of the PC 1. An interactive control content sharing method as claimed in claim, wherein said step S3, the output frame rate and frame rate screenshots are both 10.
4.根据权利要求1所述的一种PC屏幕内容分享互动控制方法,其特征在于,所述的步骤S4中,根据RTMP协议需要将压缩好的视频流内容封装为FLV,然后通过RTMP协议以媒体流的形式上传到流媒体服务器上。 The screen of the PC 1. An interactive control content sharing method as claimed in claim, wherein, in the step S4, the compressed according RTMP protocol requires good video streaming content is encapsulated FLV, then through RTMP protocol formally media stream transmitted streaming media server.
5.根据权利要求1所述的一种PC屏幕内容分享互动控制方法,其特征在于,所述的步骤SI和步骤S2、S3、S4,分属两个异步线程,这两个异步线程并行工作。 According to claim 1. A PC screen interactive content sharing controlling method as claimed in claim, wherein said step of step SI and S2, S3, S4, belong to two asynchronous thread, the two threads in parallel asynchronous .
6.根据权利要求1所述的一种PC屏幕内容分享互动控制方法,其特征在于,所述的步骤S5、S6中,用户是通过网页客户端实现对远程PC主机屏幕的控制的,网页客户端使用Act1nScript的接口捕获针对网页客户端的鼠标动作或者键盘动作,并将鼠标操作时在网页客户端中的相对坐标记录下来,通过自定协议将其坐标和动作信息传送到远程PC主机中去;或者捕获针对网页客户端的键盘动作,同样通过自订协议将其传输到远程PC主机中去。 According to claim 1. A PC screen interactive content sharing control method as claimed in claim, wherein said steps S5, S6, the user is to achieve remote control of the host PC screen, the web client via the client web end using Act1nScript interface capture for web client mouse operation or keyboard operation and a mouse operation relative coordinates recorded page in the client, will be transmitted via a custom protocol which coordinates and the movement information to a remote host PC go; or capture page for the client's keyboard action, also through a custom protocol transmits it to a remote PC to the host.
7.根据权利要求1所述的一种PC屏幕内容分享互动控制方法,其特征在于,所述的步骤S7中,远程PC主机接收到捕获的用户端的鼠标或键盘操作动作信息后,通过Windows系统的API实现对应的操作,将响应的操作效果呈现在远程PC主机屏幕显示上,以实现远程交互控制。 The screen of the PC 1. An interactive control content sharing method as claimed in claim, wherein, in the step S7, the remote host PC client receives the captured mouse or keyboard operation of the operation information, through the Windows API implementation corresponding to operation, the response operation effects presented on a remote host PC screen display for interactive remote control.
CN201310297489.9A 2013-07-16 2013-07-16 One kind of pc screen content sharing interactive control method CN103414751B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310297489.9A CN103414751B (en) 2013-07-16 2013-07-16 One kind of pc screen content sharing interactive control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310297489.9A CN103414751B (en) 2013-07-16 2013-07-16 One kind of pc screen content sharing interactive control method

Publications (2)

Publication Number Publication Date
CN103414751A CN103414751A (en) 2013-11-27
CN103414751B true CN103414751B (en) 2016-08-17

Family

ID=49607737

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310297489.9A CN103414751B (en) 2013-07-16 2013-07-16 One kind of pc screen content sharing interactive control method

Country Status (1)

Country Link
CN (1) CN103414751B (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104834554A (en) * 2014-04-02 2015-08-12 腾讯科技(北京)有限公司 Information interaction method and device
TWI604375B (en) * 2014-06-23 2017-11-01 緯創資通股份有限公司 Methods for screen sharing and apparatuses using the same
CN104333789A (en) * 2014-10-30 2015-02-04 向火平 On-screen interacting system and control method thereof
CN105743949A (en) * 2014-12-11 2016-07-06 厦门雅迅网络股份有限公司 Method for realizing double-screen synchronization between two devices
CN104473339A (en) * 2015-01-03 2015-04-01 严政 Intelligent air conditioning garment device
CN104899039B (en) * 2015-06-12 2018-12-25 百度在线网络技术(北京)有限公司 For providing the method and apparatus of screenshotss service on the terminal device
CN104951270B (en) * 2015-06-19 2018-01-26 北京大学深圳研究生院 Frame processing method and system are shown in a kind of Android WifiDisplay
CN106412691A (en) * 2015-07-27 2017-02-15 腾讯科技(深圳)有限公司 Interception method and device of video images
CN106412702A (en) * 2015-07-27 2017-02-15 腾讯科技(深圳)有限公司 Video clip interception method and device
CN105163128B (en) * 2015-08-31 2018-04-13 华南理工大学 A kind of screen picture acquisition methods for accelerating image to change parallel using GPU
CN107070671A (en) * 2017-04-08 2017-08-18 广东公信智能会议股份有限公司 Processing method for sharing desktop in conference system
CN107592576A (en) * 2017-09-15 2018-01-16 威创集团股份有限公司 A kind of video sharing method, system, share end and be shared end
CN109104635A (en) * 2018-08-31 2018-12-28 四川长虹电器股份有限公司 The method and system of instant delivery screen picture

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102035834A (en) * 2010-12-11 2011-04-27 常州达奇医疗科技有限公司 Remote picture reading system for performing remote network operation of microscope
CN102272719A (en) * 2008-12-30 2011-12-07 萨基姆通讯宽带公司 Comprising a terminal and a server provided with a graphical interface for communicating via a protocol image sharing system
CN103152458A (en) * 2011-12-07 2013-06-12 中国移动通信集团广东有限公司 Test mobile phone, remote mobile phone test system, method and device of remote mobile phone test

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7962552B2 (en) * 2005-11-14 2011-06-14 Red Hat, Inc. Borrow and give back of windows

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102272719A (en) * 2008-12-30 2011-12-07 萨基姆通讯宽带公司 Comprising a terminal and a server provided with a graphical interface for communicating via a protocol image sharing system
CN102035834A (en) * 2010-12-11 2011-04-27 常州达奇医疗科技有限公司 Remote picture reading system for performing remote network operation of microscope
CN103152458A (en) * 2011-12-07 2013-06-12 中国移动通信集团广东有限公司 Test mobile phone, remote mobile phone test system, method and device of remote mobile phone test

Also Published As

Publication number Publication date
CN103414751A (en) 2013-11-27

Similar Documents

Publication Publication Date Title
US7890985B2 (en) Server-side media stream manipulation for emulation of media playback functions
RU2543568C2 (en) Smooth, stateless client media streaming
US7614075B2 (en) Dynamically generating video streams for user interfaces
US9800939B2 (en) Virtual desktop services with available applications customized according to user type
US9973557B2 (en) Media acceleration for virtual computing services
US9001886B2 (en) Dynamic time synchronization
US20050204393A1 (en) Home network server
US7558760B2 (en) Real-time key frame generation
CN102883134B (en) Screen sharing and controlling method for video conference system
JP2005057771A (en) Apparatus and method for processing multimedia data via home media gateway improving thin client system
CN1669015A (en) Resolving a distributed topology to stream data
JP5866125B2 (en) Digital video streaming between video devices using a cable TV system
CN101064713B (en) Control method for realizing remote tabletop using television set platform
CN102802048A (en) Multi-screen interaction system and method
WO2012097549A1 (en) Method and system for sharing audio and/or video
CN102510541B (en) Multi-screen interaction video and audio content switching method and media player
CN102158553B (en) Method and apparatus for remote desktop to play multimedia files
US9172979B2 (en) Experience or “sentio” codecs, and methods and systems for improving QoE and encoding based on QoE experiences
CN102883135B (en) Screen sharing and control method
CN102811368A (en) Mobile video live broadcasting system
CN103607571B (en) Android phone using remote video surveillance and PTZ control method
EP2541442B1 (en) Multimedia redirection
CN103248956A (en) Realizing method and system of intelligent home video business in multi-screen cooperating mode
CN101198045B (en) Stream media digital watermarking system
RU2392753C2 (en) Method for sending instructions to device not to carryout synchronisation or delay synchronisation of multimedia streams

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C14 Grant of patent or utility model