WO2015180446A1 - System and method for maintaining connection channel in multi-device interworking service - Google Patents

System and method for maintaining connection channel in multi-device interworking service Download PDF

Info

Publication number
WO2015180446A1
WO2015180446A1 PCT/CN2014/093467 CN2014093467W WO2015180446A1 WO 2015180446 A1 WO2015180446 A1 WO 2015180446A1 CN 2014093467 W CN2014093467 W CN 2014093467W WO 2015180446 A1 WO2015180446 A1 WO 2015180446A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
channel
page
screen
control
Prior art date
Application number
PCT/CN2014/093467
Other languages
French (fr)
Chinese (zh)
Inventor
李艳霞
王劲林
党寿江
刘学
Original Assignee
中国科学院声学研究所
上海尚恩华科网络科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国科学院声学研究所, 上海尚恩华科网络科技股份有限公司 filed Critical 中国科学院声学研究所
Priority to EP14893357.5A priority Critical patent/EP3151574A4/en
Publication of WO2015180446A1 publication Critical patent/WO2015180446A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home

Definitions

  • the present invention relates to the field of WEB technologies, and in particular, to a connection channel maintenance apparatus and method in a multi-device linkage service; and particularly relates to an application scenario in which a WEB service performs data interaction with multiple devices.
  • WEB services can support multiple types of terminals, such as PCs, TV sets, mobile phones with different resolutions, etc.
  • terminals such as PCs, TV sets, mobile phones with different resolutions, etc.
  • the patent application with the application number "201310590251.5” discloses a "multi-screen interactive system and its processing method".
  • the television system starts a multi-screen interactive service, and then the television system searches for the multi-screen in the same local area network.
  • the other device interacting with, establishes communication with the other device, and then pushes the multimedia resource to the television system for presentation, and then the user inputs a control command for the multimedia resource through the television system, and the television system converts the control command into a digital signal and Sending to the other device, and finally the other device converts the received digital signal into an operation command recognizable by the device, and performs corresponding operations on the multimedia resource according to the operation instruction.
  • the patent application with the application number of "201210460776.2” discloses "a multi-screen interactive system and method", which includes a mobile electronic device and a display terminal, and collects webpages, pictures or audio and video displayed on the current interface through the mobile electronic device. And transmitting the address to the display terminal, parsing by the display terminal, and displaying a webpage, a picture or an audio and video corresponding to the address according to the parsing result, and implementing multi-screen interaction.
  • the mobile electronic device since the mobile electronic device only needs to transmit address information, it does not need to occupy a large bandwidth resource, and the transmission speed is fast, which is beneficial to real-time performance of multi-screen interaction.
  • Both of the above patents involve the implementation of UI synchronization and linkage operations between different types of terminals, but in the first patent, multimedia resources need to be pushed between two terminals, which is the connection bandwidth between terminals. There are high requirements, and the multimedia resources are limited to the resources existing on the terminal device, and the resources cannot be selected.
  • the resource content is not transmitted between the terminals, but only the address information is transmitted. This reduces the transmission bandwidth pressure, but the operations such as picture matching and adaptation are completed in the terminal, which puts high requirements on the processing capability of the terminal, and the source information is divided into three types: picture, webpage and video. The type data must be differentiated and the business logic is complex.
  • the object of the present invention is to provide a connection in a multi-device linkage service in order to overcome the above problems.
  • Road maintenance system and method is to provide a connection in a multi-device linkage service in order to overcome the above problems.
  • the present invention provides a connection channel maintenance system in a multi-device linkage service, including: a server and a terminal device for providing data services, wherein the system includes: a screen channel control client module and a multi-screen channel control server module located on the server;
  • the multi-screen channel control client module is configured to acquire the identifier of the device terminal, and report the binding relationship between the terminal and the multi-screen channel to the multi-screen channel control server;
  • the multi-screen channel control server module is configured to record a binding relationship between the terminal and the multi-screen channel, and push the service to the party that binds the terminal.
  • the multi-screen channel control server module includes:
  • a channel maintenance unit for establishing and maintaining a Websocket channel between the multi-screen channel control client and the multi-screen channel control server;
  • a terminal binding unit configured to record a binding relationship between clients
  • the terminal adaptation unit is configured to identify the device type of the terminal where the client is located, and send a matching page address according to the device type.
  • the present invention provides a method for maintaining a connection channel in a multi-device linkage service, the connection channel maintenance system described above, the method comprising:
  • Step 101 maintaining a service channel of the terminal, and adding a control channel of the multi-screen linkage service to the terminal device;
  • Binding, UI synchronization, and state control between the multi-terminal devices are implemented by the control channel, thereby separating the separation of the service and the multi-device linkage;
  • Step 102) implement page jump in the multi-page application by multiplexing the control channel.
  • the terminal device automatically loads the client module controlled by the multi-screen channel.
  • control channel is located between the client module controlled by the multi-screen channel and the server module controlled by the multi-screen channel, and the client module controlled by the multi-screen channel is located on the terminal device;
  • the multi-screen channel control client module establishes a Websocket connection between the server module and the server module controlled by the multi-screen channel, that is, the control channel, and reports the terminal identifier of the client to the server module controlled by the multi-screen channel;
  • the multi-screen channel control server module is further configured to save the correspondence between the identifier of the terminal device and the Websocket channel.
  • the multi-screen channel control client module periodically sends a heartbeat message to the multi-screen channel control server module through the Websocket channel to maintain a connection channel between the two.
  • a multi-screen channel control client module requests binding of the terminal device of the multi-screen channel client module by scanning the two-dimensional code to the multi-screen channel control server module, and the multi-screen channel control service is provided.
  • the end module saves the binding relationship between the two terminal devices; the binding packet is transmitted through the Websocket channel.
  • the foregoing UI synchronization method specifically includes:
  • the multi-screen channel control client module located on the terminal device reports the current page information of the terminal device to the multi-screen channel control server module located on the server through the Websocket channel, and the multi-screen channel is displayed.
  • the control server module receives the current page information of the terminal device, and saves the correspondence between the terminal device and the current page information;
  • the terminal that matches the sending request is matched from the terminal adaptation knowledge base. Type and find out whether there are other terminals bound to the terminal, and whether other terminals are on the page corresponding to the page where the terminal is located. If no terminal is bound, no processing is performed; if other terminals are already in the corresponding page of the terminal On the page, no processing is performed; otherwise, according to the target type parameter and the configured synchronization relationship in the request, the synchronization page address of the target type terminal is obtained, and the synchronization page address is pushed to the target terminal.
  • the foregoing state control method includes:
  • the terminal adaptation module pushes the video play page to the bound TV type terminal corresponding to the mobile phone type terminal, and pushes the play control and recommendation to the mobile phone type terminal.
  • the recommendation page includes a control button for playing a video and a recommended program list corresponding to the video
  • the multi-screen channel control client When the mobile phone type terminal clicks the video play control button, the multi-screen channel control client sends the corresponding control command to the multi-screen channel control server through the Websocket channel; the terminal binding module searches for the TV type terminal bound to the terminal and passes the Websocket channel. Pushing corresponding control commands to the multi-screen channel control client on the terminal; the multi-screen channel control client on the television type terminal receives the control command and performs an action to control video playback;
  • the terminal that is bound by the mobile phone type terminal is controlled to jump to the corresponding program detail page through the UI synchronization mechanism.
  • the foregoing step 102) is specifically: setting an iframe in the dom structure of the page of the multi-screen channel control client, embedding the original service page into the iframe, and creating and maintaining the multi-screen channel control service in the outer layer of the iframe
  • the Websocket channel of the end realizes the jump of the business page by refreshing the iframe.
  • the invention has the advantages that the original service service does not need to be affected, the binding relationship maintenance and UI synchronization are performed on the newly added Websocket layer, and the service is stably upgraded; and in the implementation of the client Websocket channel, the form of the nested iframe is adopted. To achieve reuse of Websocket channels between pages, reducing channel maintenance complexity.
  • FIG. 1 is a block diagram showing the composition of a connection channel maintenance apparatus and method in a multi-device linkage service according to the present invention
  • FIG. 2 is a schematic diagram of a binding process in a multi-device linkage service of the present invention
  • FIG. 3 is a schematic diagram of a search and play process in the multi-device linkage service of the present invention.
  • FIG. 4 is a schematic diagram of a broadcast control process in the multi-device linkage service of the present invention.
  • connection channel maintenance apparatus and method in the multi-device linkage service of the present invention will be further described below through specific embodiments.
  • the present invention provides a connection channel maintenance apparatus and method in a multi-device linkage service, the apparatus comprising: a multi-screen channel control client module located on the terminal device and a multi-screen channel control server module located on the server end.
  • the multi-screen channel control server module includes a terminal adaptation unit, a terminal binding unit, and a service processing unit.
  • the basic principle of the device is: when the terminal device logs in, the connection with the server is established and the terminal identifier is reported, and the server records the binding relationship between the terminal device and the multi-screen channel; the terminal device reports the binding to be bound by scanning the two-dimensional code.
  • the identity of the terminal device the server records the binding relationship between the two terminal identifiers; the terminal uploads the new page and reports the current page address, the server searches for the binding terminal of the terminal and pushes the matching address; after the mobile terminal performs the playback control operation,
  • the multi-screen channel reports the control command, and the server receives the command and pushes the command to the bound TV terminal to implement the control of the playback process.
  • the invention adds a multi-screen linkage service control channel based on the original service channel (ie, the service channel between the server and the terminal device), and the channel establishes a connection between the client and the server through the Websocket technology. At the same time, for multi-page applications, the multiplexing of control channels is realized, which avoids the overhead of repeated channel establishment during page jumps.
  • the invention provides a device and a method for maintaining a connection channel based on HTTP and Websocket in a multi-device linkage service, wherein:
  • the multi-device linkage service shown in FIG. 1 is a connection channel maintenance device, and the device includes:
  • the multi-screen channel control server module 101 completes the function of establishing and maintaining the Websocket channel, and filters the terminal request to implement services such as terminal binding, terminal adaptation, and UI synchronization.
  • the multi-screen channel control client module 102 is a javascript client library that is added to the local browser runtime when the terminal requests a business page.
  • the component library maintains a two-way Websocket channel with a multi-screen channel control server, and supports a multi-screen channel control server to push data to the terminal in real time, and responds and jumps according to the push content.
  • the multi-screen channel control server 101 further includes:
  • the terminal adaptation unit 103 identifies the browser information of the terminal, and matches the most suitable terminal type according to the existing terminal type library.
  • the terminal binding unit 104 supports multi-terminal binding by scanning a two-dimensional code, and maintains the bound terminal. The relationship between them.
  • the multi-screen channel control server module 101 and the service processing module 105 are both located on the server, and the server is used to provide data services to the terminal device; the multi-screen channel control client module 102 is located on the terminal device; The unit 105 responds to the original service request through the HTTP channel, and keeps the original business logic unchanged.
  • FIG. 2 is a binding flowchart of a multi-device linkage service, which specifically includes:
  • the TV terminal starts the multi-screen linkage application, requests the initial page, loads the multi-screen channel control client module, establishes a Websocket channel with the server, and reports its own terminal identifier.
  • the server records the correspondence between the terminal identifier and the Websocket channel, and proceeds to 202);
  • the mobile terminal starts the multi-screen linkage application, requests the initial page, loads the multi-screen channel control client, establishes a Websocket channel with the server, and reports its own terminal identifier.
  • the server records the correspondence between the terminal identifier and the Websocket channel, and proceeds to 203);
  • the TV end requests the QR code scanning page from the server through the HTTP channel, and the server returns the QR code scanning page. Enter 204);
  • the mobile terminal reports the identifier of the terminal to be bound to the server through the Websocket channel by scanning the two-dimensional code, and enters 205);
  • the terminal binding module After receiving the terminal binding request, the terminal binding module saves the binding relationship according to the terminal identifier, and the server pushes the search page address to the mobile terminal through the Websocket channel, and enters 206);
  • the mobile terminal receives the push address, requests a search page from the server through the HTTP channel, and the server returns to the search page, and enters 207);
  • the mobile terminal After loading the search page, the mobile terminal reports the current page address to the server through the Websocket channel, and enters 208);
  • the server saves the current page address of the mobile terminal, and searches for the binding terminal as the television end according to the terminal identifier thereof, and the terminal adaptation module determines whether the television end is on the corresponding page, and if so, no operation; if not, Then enter 209);
  • the terminal adaptation module obtains the corresponding search page address according to the terminal type of the television terminal, and pushes the address to the television terminal through the Websocket channel, and enters 210);
  • the TV terminal receives the push address, requests the page from the server through the HTTP channel, and after loading the search page, reports the current page address to the server through the Websocket channel, and enters 211);
  • the server saves the current page address of the television end, and searches for the binding terminal as the mobile terminal according to the terminal identifier, and the terminal adaptation module determines that the mobile terminal is on the corresponding page.
  • FIG. 3 is a flowchart of a search linkage process in a multi-device linkage service, which specifically includes:
  • the mobile terminal inputs the program for short search, the server returns the search result through ajax and displays on the mobile terminal, the mobile terminal selects the program, requests the program details page from the server through the HTTP channel, and the server returns the program details page, enters 302);
  • the mobile terminal After loading the program details page, the mobile terminal reports the current page address to the server, and enters 303);
  • the server saves the current page address of the mobile terminal, and searches for the binding terminal as the television end according to the terminal identifier, and the terminal adaptation module determines whether the television end is on the corresponding page of the program detail page, and if so, no operation; No, go to 304);
  • the terminal adaptation module searches for the corresponding program detail page address according to the terminal type of the television terminal, and pushes the address to the television terminal through the Websocket channel, and enters 305);
  • the TV terminal receives the push address, requests the page through the HTTP channel, and after loading the program details page, reports the current page address to the server through the Websocket channel, and enters 306);
  • the server saves the current page address of the television end, and searches for the binding terminal as the mobile terminal according to the terminal identifier, and the terminal adaptation module determines that the mobile terminal is on the corresponding page.
  • FIG. 4 is a flowchart of a play linkage process in a multi-device linkage service, which specifically includes:
  • the mobile terminal selects the program source, the number of program episodes on the details page, clicks on the play, and requests the playback control and recommendation page corresponding to the program from the server through the HTTP channel, and the server side
  • the mobile terminal returns the playback control and recommendation page corresponding to the program, and enters 402);
  • the mobile terminal After loading the playback control and recommendation page, the mobile terminal reports the current page address to the server through the Websocket channel, and enters 403);
  • the server saves the current page address of the mobile phone, and finds that the binding terminal is the TV end according to the terminal identifier, and the terminal adaptation module determines that the corresponding page of the bound TV terminal is the play page, and determines whether the bound TV terminal is in the On the play page, if yes, no operation; if not, go to 404);
  • the terminal adaptation module finds the corresponding play page address according to the type of the television end, and pushes the address to the television end through the Websocket channel, and enters 405);
  • the television end receives the push address, requests the corresponding page through the HTTP channel, and after loading the play page, starts playing the corresponding program;
  • the mobile terminal clicks the operation button such as pause, play, fast forward, fast rewind in the play control and recommendation page, and sends a corresponding instruction to the server through the Websocket channel, and enters 407);
  • the server receives the broadcast control command from the mobile terminal, and finds whether the terminal is bound to the TV terminal. If not, there is no operation; if yes, enter 408);
  • the server pushes the broadcast control instruction to the television terminal through the Websocket channel to control the playing of the television terminal;
  • the mobile terminal browses the recommended content corresponding to the program on the play control and recommendation page, selects a recommended program, requests the program details page of the program from the server through the HTTP channel, and the server returns the program details page, and enters 410);
  • the mobile terminal After loading the program details page, the mobile terminal reports the current page address to the server through the Websocket channel, and enters 411);
  • the server saves the current page address of the mobile terminal, and searches for the binding terminal as the television end according to the terminal identifier thereof, and the terminal adaptation module determines whether it is on the corresponding page of the program detail page according to the type of the television terminal, and if so, No action; if not, go to 412);
  • the server finds the address of the program detail page corresponding to the television end, and pushes the address to the television terminal through the Websocket channel, and enters 413);
  • the TV terminal receives the push address, requests the corresponding page through the HTTP channel, and after loading the program details page, reports the current page address to the server, and enters 414);
  • the server saves the current page address of the TV end, and searches for the binding terminal as the mobile terminal according to the terminal identifier thereof, and the terminal adaptation module determines that it is on the corresponding page according to the type of the mobile terminal.
  • the present invention provides a connection channel maintenance system and method in a multi-device linkage service, by which a multi-screen linkage service control channel can be added without affecting the original service logic, and multiple devices are implemented through the control channel. Binding, UI synchronization, and state control.
  • the method of the present invention differs from other channel maintenance methods in that:
  • the terminal After the initial page is loaded, the terminal automatically loads the multi-screen channel control client, establishes a Websocket connection with the multi-screen channel control server, and reports the terminal identifier of the client; the multi-screen channel control server saves the terminal identifier and the Websocket channel. Correspondence relationship.
  • the multi-screen channel control client periodically sends a heartbeat message to the multi-screen channel control server through the Websocket channel to maintain the connection channel between the two.
  • the multi-screen channel control client can scan the two-dimensional code and carry the terminal identifier of another client to request binding to the multi-screen channel control server, and the binding packet is transmitted through the Websocket channel, and the terminal binding module receives The binding relationship between the two terminals is saved after the binding request.
  • the multi-screen channel control client After the multi-screen channel control client jumps to the new page, the current page information is reported to the multi-screen channel control server through the Websocket channel, and the multi-screen channel control server receives the current page information of the terminal, and the terminal and the terminal The correspondence of the current page information is stored.
  • the terminal adaptation module searches for the terminal type matching the sending request from the terminal adaptation knowledge base according to the terminal browser capability and the browser type. Whether the other terminal bound to the terminal and other terminals are on the page corresponding to the page where the terminal is located, if no terminal is bound, no processing is performed; if other terminals are already on the page corresponding to the page where the terminal is located, no processing is performed. Otherwise, according to the target type parameter and the configured synchronization relationship in the request, the synchronization page address of the target type terminal is obtained, and the synchronization page address is pushed to the target terminal.
  • the terminal adapting module pushes the video play page to its corresponding bound TV type terminal, and pushes the play control and recommendation page to the mobile phone type terminal, where the page includes the video play control. a button and a list of related recommended programs corresponding to the video, wherein
  • the multi-screen channel control client sends the corresponding control command to the multi-screen channel control server through the Websocket channel; the binding module searches for the TV type client bound by the client and passes the Websocket. The channel pushes the corresponding control command to the client; the TV type client receives the control command and performs an action to control the video playback.
  • the mobile phone type terminal browses the recommended program in the play control and recommendation page and clicks into the detail page of a recommended program, it controls the binding terminal to jump to the corresponding program details through the UI synchronization mechanism in 5) and 6). page.
  • an iframe is included, the original service page is embedded in the iframe, and the Websocket channel on the server side is created and maintained in the outer layer of the iframe, and the business page is jumped by refreshing the iframe.
  • the service processing module responds to the original service request through the HTTP channel, and keeps the original business logic unchanged.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present invention provides a system and a method for maintaining a connection channel in a multi-device interworking service. The system comprises: a multi-screen channel control client module and a multi-screen channel control server module. The multi-screen channel control client module is located on each terminal device, and used for acquiring an identifier of the device terminal and reporting a binding relationship between the terminal and a multi-screen channel to the multi-screen channel control server. The multi-screen channel control server module is used for recording the binding relationship between the terminal and the multi-screen channel, and pushing services to the bound terminal side. The multi-screen channel control server module is located on a server that provides a data service. The present invention has the advantages that the binding relationship maintenance and UI synchronization can be implemented on a newly added Websocket layer without affecting an original service, and stable service upgrade is achieved; and during the implementation of a Websocket channel on a client, multiplexing of the Websocket channel between pages is implemented in a nested iframe mode, thereby reducing the channel maintenance complexity.

Description

一种多设备联动服务中的连接通道维护系统及方法Connection channel maintenance system and method in multi-device linkage service 技术领域Technical field
本发明涉及WEB技术领域,特别涉及一种多设备联动服务中的连接通道维护装置及方法;特别涉及WEB服务与多个设备进行数据交互的应用场景。The present invention relates to the field of WEB technologies, and in particular, to a connection channel maintenance apparatus and method in a multi-device linkage service; and particularly relates to an application scenario in which a WEB service performs data interaction with multiple devices.
背景技术Background technique
目前,WEB服务已经可以支持多种类型的终端,比如PC、电视机、不同分辨率的手机等,人们享受多终端访问服务的同时,不再满足于使用不同终端单独访问同一服务系统,而是要求利用多个终端进行联动服务,从而方便用户操作,提升观看体验。At present, WEB services can support multiple types of terminals, such as PCs, TV sets, mobile phones with different resolutions, etc. When people enjoy multi-terminal access services, they are no longer satisfied with using different terminals to access the same service system separately. It is required to use multiple terminals for linkage services, thereby facilitating user operations and improving the viewing experience.
申请号为“201310590251.5”的专利申请公开了一种“多屏互动系统及其处理方法”,该系统中首先电视系统启动多屏互动服务,然后电视系统搜索到同一局域网内的该开启了多屏互动的其他设备,与其建立通讯,该其他设备再将其多媒体资源推送到电视系统进行呈现,然后用户通过电视系统输入对该多媒体资源的控制指令,则电视系统将该控制指令转换为数字信号并发送给该其他设备,最后该其他设备将接收到的数字信号转换为本设备能够识别的操作指令,根据该操作指令对该多媒体资源进行相应操作。中国申请号为“201210460776.2”的专利申请公开了“一种多屏互动系统及方法”,该系统包括移动电子设备和显示终端,通过移动电子设备采集当前界面上显示的网页、图片或音视频的地址,并将所述地址传输至显示终端,由所述显示终端进行解析,并根据解析结果显示与所述地址相对应的网页、图片或音视频,实现了多屏互动。在这个过程中,由于所述移动电子设备只需传输地址信息,无需占用较大的带宽资源,且传输速度快,有利于实现多屏互动的实时性。The patent application with the application number "201310590251.5" discloses a "multi-screen interactive system and its processing method". In the system, first, the television system starts a multi-screen interactive service, and then the television system searches for the multi-screen in the same local area network. The other device interacting with, establishes communication with the other device, and then pushes the multimedia resource to the television system for presentation, and then the user inputs a control command for the multimedia resource through the television system, and the television system converts the control command into a digital signal and Sending to the other device, and finally the other device converts the received digital signal into an operation command recognizable by the device, and performs corresponding operations on the multimedia resource according to the operation instruction. The patent application with the application number of "201210460776.2" discloses "a multi-screen interactive system and method", which includes a mobile electronic device and a display terminal, and collects webpages, pictures or audio and video displayed on the current interface through the mobile electronic device. And transmitting the address to the display terminal, parsing by the display terminal, and displaying a webpage, a picture or an audio and video corresponding to the address according to the parsing result, and implementing multi-screen interaction. In this process, since the mobile electronic device only needs to transmit address information, it does not need to occupy a large bandwidth resource, and the transmission speed is fast, which is beneficial to real-time performance of multi-screen interaction.
上述两个专利都涉及了不同类型终端之间UI同步及联动操作的实现,但是在第一个专利中,需要将多媒体资源在两个终端之间进行推送,这就对终端之间的连接带宽有较高的要求,而且其中的多媒体资源也仅限于终端设备上已有的资源,不能对资源进行选择;在第二个专利中,终端之间不再传输资源内容,而只是传输地址信息,这就减小了传输带宽压力,但是其中图片匹配和适配等操作都在终端完成,对终端的处理能力提出很高的要求,而且源信息分为图片、网页、视频三种类型,对三种类型数据都要区分处理,业务逻辑复杂。Both of the above patents involve the implementation of UI synchronization and linkage operations between different types of terminals, but in the first patent, multimedia resources need to be pushed between two terminals, which is the connection bandwidth between terminals. There are high requirements, and the multimedia resources are limited to the resources existing on the terminal device, and the resources cannot be selected. In the second patent, the resource content is not transmitted between the terminals, but only the address information is transmitted. This reduces the transmission bandwidth pressure, but the operations such as picture matching and adaptation are completed in the terminal, which puts high requirements on the processing capability of the terminal, and the source information is divided into three types: picture, webpage and video. The type data must be differentiated and the business logic is complex.
发明内容Summary of the invention
本发明的目的在于,为克服上述问题,本发明提供一种多设备联动服务中的连接通 道维护系统及方法。The object of the present invention is to provide a connection in a multi-device linkage service in order to overcome the above problems. Road maintenance system and method.
为实现上述目的,本发明提供一种多设备联动服务中的连接通道维护系统,包含:用于提供数据业务的服务端和终端设备,其特征在于,所述系统包含:位于终端设备上的多屏通道控制客户端模块和位于服务端上的多屏通道控制服务端模块;To achieve the above object, the present invention provides a connection channel maintenance system in a multi-device linkage service, including: a server and a terminal device for providing data services, wherein the system includes: a screen channel control client module and a multi-screen channel control server module located on the server;
所述多屏通道控制客户端模块,用于获取设备终端的标识,并向多屏通道控制服务端上报本终端与多屏通道的绑定关系;The multi-screen channel control client module is configured to acquire the identifier of the device terminal, and report the binding relationship between the terminal and the multi-screen channel to the multi-screen channel control server;
所述多屏通道控制服务端模块,用于记录终端与多屏通道的绑定关系,并向绑定终端的一方推送服务。The multi-screen channel control server module is configured to record a binding relationship between the terminal and the multi-screen channel, and push the service to the party that binds the terminal.
可选的,上述多屏通道控制服务端模块包含:Optionally, the multi-screen channel control server module includes:
通道维护单元,用于建立并维护多屏通道控制客户端和多屏通道控制服务端之间的Websocket通道;a channel maintenance unit for establishing and maintaining a Websocket channel between the multi-screen channel control client and the multi-screen channel control server;
终端绑定单元,用于记录客户端之间的绑定关系;a terminal binding unit, configured to record a binding relationship between clients;
终端适配单元,用于识别客户端所在终端的设备类型,并按照设备类型下发匹配的页面地址。The terminal adaptation unit is configured to identify the device type of the terminal where the client is located, and send a matching page address according to the device type.
此外,本发明提供一种多设备联动服务中的连接通道维护方法,上述记载的连接通道维护系统,所述方法包含:In addition, the present invention provides a method for maintaining a connection channel in a multi-device linkage service, the connection channel maintenance system described above, the method comprising:
步骤101)维持终端的业务通道,并在终端设备加入多屏联动服务的控制通道;Step 101) maintaining a service channel of the terminal, and adding a control channel of the multi-screen linkage service to the terminal device;
通过所述控制通道实现多终端设备之间的绑定、UI同步和状态控制,进而实现了业务和多设备联动控制的分离;Binding, UI synchronization, and state control between the multi-terminal devices are implemented by the control channel, thereby separating the separation of the service and the multi-device linkage;
步骤102)采用控制通道的复用实现多页面应用程序中的页面跳转。Step 102) implement page jump in the multi-page application by multiplexing the control channel.
可选的,终端设备在业务页面加载完成后,自动加载多屏通道控制的客户端模块。Optionally, after the service page is loaded, the terminal device automatically loads the client module controlled by the multi-screen channel.
可选的,上述的控制通道位于多屏通道控制的客户端模块和多屏通道控制的服务端模块之间,且所述多屏通道控制的客户端模块位于终端设备上;Optionally, the control channel is located between the client module controlled by the multi-screen channel and the server module controlled by the multi-screen channel, and the client module controlled by the multi-screen channel is located on the terminal device;
所述多屏通道控制客户端模块建立与多屏通道控制的服务端模块之间的Websocket连接,即控制通道,并向多屏通道控制的服务端模块上报客户端的终端标识;The multi-screen channel control client module establishes a Websocket connection between the server module and the server module controlled by the multi-screen channel, that is, the control channel, and reports the terminal identifier of the client to the server module controlled by the multi-screen channel;
所述多屏通道控制服务端模块还用于保存终端设备的标识和Websocket通道的对应关系。The multi-screen channel control server module is further configured to save the correspondence between the identifier of the terminal device and the Websocket channel.
可选的,上述多屏通道控制客户端模块定期通过Websocket通道向多屏通道控制服务端模块发送心跳报文,用以维护两者之间的连接通道。Optionally, the multi-screen channel control client module periodically sends a heartbeat message to the multi-screen channel control server module through the Websocket channel to maintain a connection channel between the two.
可选的,一个多屏通道控制客户端模块通过扫描二维码的方式携带另一个多屏通道客户端模块所在终端设备的标识向多屏通道控制服务端模块请求绑定,多屏通道控制服务端模块保存两个终端设备之间的绑定关系;其中,绑定报文通过Websocket通道传输。 Optionally, a multi-screen channel control client module requests binding of the terminal device of the multi-screen channel client module by scanning the two-dimensional code to the multi-screen channel control server module, and the multi-screen channel control service is provided. The end module saves the binding relationship between the two terminal devices; the binding packet is transmitted through the Websocket channel.
可选的,上述的UI同步方法具体包含:Optionally, the foregoing UI synchronization method specifically includes:
当终端设备跳转到新页面之后,位于该终端设备上的多屏通道控制客户端模块通过Websocket通道向位于服务端上的多屏通道控制服务端模块上报终端设备当前所在页面信息,多屏通道控制服务端模块接收终端设备的当前所在页面信息,并保存终端设备与当前所在页面信息的对应关系;After the terminal device jumps to the new page, the multi-screen channel control client module located on the terminal device reports the current page information of the terminal device to the multi-screen channel control server module located on the server through the Websocket channel, and the multi-screen channel is displayed. The control server module receives the current page information of the terminal device, and saves the correspondence between the terminal device and the current page information;
当多屏通道控制服务端模块收到多屏通道控制客户端模块上报的当前所在页面的信息后,根据终端设备浏览器能力和浏览器类型,从终端适配知识库中匹配出发送请求的终端类型并查找是否有与该终端绑定的其他终端,以及其他终端是否处于与该终端所在页面对应的页面上,如果没有绑定终端,不做处理;如果其他终端已经处于该终端所在页面对应的页面上,不作处理;否则,根据请求中的目标类型参数和配置的同步关系,获取目标类型终端的同步页面地址,向目标终端推送同步页面地址。After the multi-screen channel control server module receives the information of the current page reported by the multi-screen channel control client module, according to the browser capability of the terminal device and the type of the browser, the terminal that matches the sending request is matched from the terminal adaptation knowledge base. Type and find out whether there are other terminals bound to the terminal, and whether other terminals are on the page corresponding to the page where the terminal is located. If no terminal is bound, no processing is performed; if other terminals are already in the corresponding page of the terminal On the page, no processing is performed; otherwise, according to the target type parameter and the configured synchronization relationship in the request, the synchronization page address of the target type terminal is obtained, and the synchronization page address is pushed to the target terminal.
可选的,上述的状态控制方法包含:Optionally, the foregoing state control method includes:
当终端设备为手机类型的终端时:当手机类型终端点击进入播放页面时:终端适配模块向手机类型终端对应的绑定电视类型终端推送视频播放页面,而向手机类型终端推送播放控制及推荐页面,所述推荐页面中包括视频播放的控制按钮以及该视频对应的推荐节目列表,其中,When the terminal device is a mobile phone type terminal: when the mobile phone type terminal clicks into the play page: the terminal adaptation module pushes the video play page to the bound TV type terminal corresponding to the mobile phone type terminal, and pushes the play control and recommendation to the mobile phone type terminal. a page, where the recommendation page includes a control button for playing a video and a recommended program list corresponding to the video, where
当手机类型终端点击视频播放控制按钮时,多屏通道控制客户端将对应控制命令通过Websocket通道发送到多屏通道控制服务端;终端绑定模块查找该终端绑定的电视类型终端并通过Websocket通道向该终端上的多屏通道控制客户端推送对应控制命令;电视类型终端上的多屏通道控制客户端收到控制命令并执行动作,控制视频播放;When the mobile phone type terminal clicks the video play control button, the multi-screen channel control client sends the corresponding control command to the multi-screen channel control server through the Websocket channel; the terminal binding module searches for the TV type terminal bound to the terminal and passes the Websocket channel. Pushing corresponding control commands to the multi-screen channel control client on the terminal; the multi-screen channel control client on the television type terminal receives the control command and performs an action to control video playback;
当手机类型终端浏览播放控制及推荐页面中的推荐节目,点击进入一个推荐节目的详情页时,会通过UI同步机制,控制该手机类型终端绑定的终端跳转到对应节目详情页面。When the mobile phone type terminal browses the recommended program in the play control and recommendation page and clicks into the detail page of the recommended program, the terminal that is bound by the mobile phone type terminal is controlled to jump to the corresponding program detail page through the UI synchronization mechanism.
可选的,上述步骤102)具体为:将多屏通道控制客户端的页面的dom结构中设置一个iframe,将原有服务页面嵌入iframe中,且在iframe外层创建和维护与多屏通道控制服务端的Websocket通道,通过对iframe刷新实现业务页面的跳转。Optionally, the foregoing step 102) is specifically: setting an iframe in the dom structure of the page of the multi-screen channel control client, embedding the original service page into the iframe, and creating and maintaining the multi-screen channel control service in the outer layer of the iframe The Websocket channel of the end realizes the jump of the business page by refreshing the iframe.
本发明的优点在于:不需要影响原有服务业务,在新增的Websocket层上进行绑定关系维护及UI同步,实现业务稳定升级;且在客户端Websocket通道实现中,通过嵌套iframe的形式,实现Websocket通道在页面间的复用,降低通道维护复杂度。The invention has the advantages that the original service service does not need to be affected, the binding relationship maintenance and UI synchronization are performed on the newly added Websocket layer, and the service is stably upgraded; and in the implementation of the client Websocket channel, the form of the nested iframe is adopted. To achieve reuse of Websocket channels between pages, reducing channel maintenance complexity.
附图说明DRAWINGS
图1是本发明的多设备联动服务中连接通道维护装置和方法组成框图; 1 is a block diagram showing the composition of a connection channel maintenance apparatus and method in a multi-device linkage service according to the present invention;
图2是本发明的多设备联动服务中的绑定流程示意图;2 is a schematic diagram of a binding process in a multi-device linkage service of the present invention;
图3是本发明的多设备联动服务中的搜索及播放流程示意图;3 is a schematic diagram of a search and play process in the multi-device linkage service of the present invention;
图4是本发明的多设备联动服务中的播控流程示意图。4 is a schematic diagram of a broadcast control process in the multi-device linkage service of the present invention.
具体实施方式detailed description
下面通过具体实施例对本发明的多设备联动服务中的连接通道维护装置和方法做进一步阐述。The connection channel maintenance apparatus and method in the multi-device linkage service of the present invention will be further described below through specific embodiments.
本发明提供一种多设备联动服务中的连接通道维护装置及方法,该装置包括:位于终端设备上的多屏通道控制客户端模块和位于服务端上的多屏通道控制服务端模块。所述多屏通道控制服务端模块包含终端适配单元、终端绑定单元和业务处理单元。本装置基本原理为:终端设备登录时建立与服务端的连接并上报自己的终端标识,服务端记录终端设备的标识和多屏通道的绑定关系;终端设备通过扫描二维码方式上报待绑定终端设备的标识,服务端记录两个终端标识的绑定关系;终端加载新页面后上报当前页面地址,服务端查找该终端的绑定终端并推送匹配地址;手机终端进行播放控制操作后,通过多屏通道上报控制命令,服务端接收命令,并向其绑定的电视终端推送该命令,实现播放进程的控制。本发明在原有业务通道(即服务端与终端设备之间的业务通道)基础之上,加入多屏联动服务控制通道,该通道通过Websocket技术建立客户端和服务器之间的连接。与此同时,针对多页面应用程序,实现了控制通道的复用,避免了页面跳转时通道重复建立的开销。The present invention provides a connection channel maintenance apparatus and method in a multi-device linkage service, the apparatus comprising: a multi-screen channel control client module located on the terminal device and a multi-screen channel control server module located on the server end. The multi-screen channel control server module includes a terminal adaptation unit, a terminal binding unit, and a service processing unit. The basic principle of the device is: when the terminal device logs in, the connection with the server is established and the terminal identifier is reported, and the server records the binding relationship between the terminal device and the multi-screen channel; the terminal device reports the binding to be bound by scanning the two-dimensional code. The identity of the terminal device, the server records the binding relationship between the two terminal identifiers; the terminal uploads the new page and reports the current page address, the server searches for the binding terminal of the terminal and pushes the matching address; after the mobile terminal performs the playback control operation, The multi-screen channel reports the control command, and the server receives the command and pushes the command to the bound TV terminal to implement the control of the playback process. The invention adds a multi-screen linkage service control channel based on the original service channel (ie, the service channel between the server and the terminal device), and the channel establishes a connection between the client and the server through the Websocket technology. At the same time, for multi-page applications, the multiplexing of control channels is realized, which avoids the overhead of repeated channel establishment during page jumps.
本发明提供的一种多设备联动服务中基于HTTP和Websocket双通道的连接通道维护装置和方法,其中:The invention provides a device and a method for maintaining a connection channel based on HTTP and Websocket in a multi-device linkage service, wherein:
图1所示的多设备联动服务中连接通道维护装置,该装置包括:The multi-device linkage service shown in FIG. 1 is a connection channel maintenance device, and the device includes:
多屏通道控制服务端模块101完成Websocket通道建立和维护的功能,并对终端请求进行过滤,实现终端绑定、终端适配和UI同步等业务。The multi-screen channel control server module 101 completes the function of establishing and maintaining the Websocket channel, and filters the terminal request to implement services such as terminal binding, terminal adaptation, and UI synchronization.
多屏通道控制客户端模块102是一个javascript客户端库,在终端请求业务页面时加入到本地浏览器运行时中。此组件库维护与多屏通道控制服务端的双向Websocket通道,支持多屏通道控制服务端实时向终端推送数据,并根据推送内容进行响应和跳转。The multi-screen channel control client module 102 is a javascript client library that is added to the local browser runtime when the terminal requests a business page. The component library maintains a two-way Websocket channel with a multi-screen channel control server, and supports a multi-screen channel control server to push data to the terminal in real time, and responds and jumps according to the push content.
上述多屏通道控制服务端101进一步包含:The multi-screen channel control server 101 further includes:
终端适配单元103对终端的浏览器信息进行识别,并根据已有的终端类型库,匹配出最合适的终端类型。The terminal adaptation unit 103 identifies the browser information of the terminal, and matches the most suitable terminal type according to the existing terminal type library.
终端绑定单元104支持通过扫描二维码的方式进行多终端绑定,维护绑定的终端 之间的关联关系。The terminal binding unit 104 supports multi-terminal binding by scanning a two-dimensional code, and maintains the bound terminal. The relationship between them.
上述多屏通道控制服务端模块101和业务处理模块105均位于服务端上,所述的服务端用于向终端设备提供数据业务;上述多屏通道控制客户端模块102位于终端设备上;业务处理单元105通过HTTP通道响应原有服务请求,保持原有业务逻辑不变。The multi-screen channel control server module 101 and the service processing module 105 are both located on the server, and the server is used to provide data services to the terminal device; the multi-screen channel control client module 102 is located on the terminal device; The unit 105 responds to the original service request through the HTTP channel, and keeps the original business logic unchanged.
实施例Example
图2是多设备联动服务中的绑定流程图,具体包括:FIG. 2 is a binding flowchart of a multi-device linkage service, which specifically includes:
201)电视端启动多屏联动应用,请求初始页面,加载多屏通道控制客户端模块,建立与服务端的Websocket通道,上报自己的终端标识。服务端记录该终端标识与Websocket通道的对应关系,进入202);201) The TV terminal starts the multi-screen linkage application, requests the initial page, loads the multi-screen channel control client module, establishes a Websocket channel with the server, and reports its own terminal identifier. The server records the correspondence between the terminal identifier and the Websocket channel, and proceeds to 202);
202)手机端启动多屏联动应用,请求初始页面,加载多屏通道控制客户端,建立与服务端的Websocket通道,上报自己的终端标识。服务端记录该终端标识与Websocket通道的对应关系,进入203);202) The mobile terminal starts the multi-screen linkage application, requests the initial page, loads the multi-screen channel control client, establishes a Websocket channel with the server, and reports its own terminal identifier. The server records the correspondence between the terminal identifier and the Websocket channel, and proceeds to 203);
203)电视端通过HTTP通道向服务端请求二维码扫描页面,服务端返回二维码扫描页面。进入204);203) The TV end requests the QR code scanning page from the server through the HTTP channel, and the server returns the QR code scanning page. Enter 204);
204)手机端通过扫描二维码的方式,通过Websocket通道向服务端上报将要绑定终端的标识,进入205);204) The mobile terminal reports the identifier of the terminal to be bound to the server through the Websocket channel by scanning the two-dimensional code, and enters 205);
205)收到终端绑定请求后,终端绑定模块根据终端标识保存绑定关系,服务端通过Websocket通道向手机终端推送搜索页面地址,进入206);205) After receiving the terminal binding request, the terminal binding module saves the binding relationship according to the terminal identifier, and the server pushes the search page address to the mobile terminal through the Websocket channel, and enters 206);
206)手机终端接收到推送地址,通过HTTP通道向服务端请求搜索页面,服务端返回搜索页面,进入207);206) The mobile terminal receives the push address, requests a search page from the server through the HTTP channel, and the server returns to the search page, and enters 207);
207)手机端加载完搜索页面后,通过Websocket通道向服务端上报当前所在页面地址,进入208);207) After loading the search page, the mobile terminal reports the current page address to the server through the Websocket channel, and enters 208);
208)服务端保存手机端的当前页面地址,并根据其终端标识查找其绑定终端为电视端,终端适配模块判断该电视端是否处于相对应页面上,如果是,则无操作;如果不是,则进入209);208) The server saves the current page address of the mobile terminal, and searches for the binding terminal as the television end according to the terminal identifier thereof, and the terminal adaptation module determines whether the television end is on the corresponding page, and if so, no operation; if not, Then enter 209);
209)终端适配模块根据电视端的终端类型,得到其对应的搜索页面地址,通过Websocket通道向电视端推送该地址,进入210);209) The terminal adaptation module obtains the corresponding search page address according to the terminal type of the television terminal, and pushes the address to the television terminal through the Websocket channel, and enters 210);
210)电视端收到推送地址,通过HTTP通道向服务端请求该页面,加载完搜索页面后,通过Websocket通道向服务端上报当前所在页面地址,进入211);210) The TV terminal receives the push address, requests the page from the server through the HTTP channel, and after loading the search page, reports the current page address to the server through the Websocket channel, and enters 211);
211)服务端保存电视端的当前页面地址,并根据其终端标识查找其绑定终端为手机端,终端适配模块判断手机端是正处于相对应页面上。 211) The server saves the current page address of the television end, and searches for the binding terminal as the mobile terminal according to the terminal identifier, and the terminal adaptation module determines that the mobile terminal is on the corresponding page.
图3是多设备联动服务中的搜索联动过程流程图,具体包括:FIG. 3 is a flowchart of a search linkage process in a multi-device linkage service, which specifically includes:
301)手机端输入节目简称进行搜索,服务端通过ajax返回搜索结果并在手机端显示,手机端选择节目,通过HTTP通道向服务端请求节目详情页面,服务端返回节目详情页面,进入302);301) The mobile terminal inputs the program for short search, the server returns the search result through ajax and displays on the mobile terminal, the mobile terminal selects the program, requests the program details page from the server through the HTTP channel, and the server returns the program details page, enters 302);
302)手机端加载完节目详情页面后,向服务端上报当前所在页面地址,进入303);302) After loading the program details page, the mobile terminal reports the current page address to the server, and enters 303);
303)服务端保存手机端的当前页面地址,并根据其终端标识查找其绑定终端为电视端,终端适配模块判断电视端是否处于节目详情页面的对应页面上,如果是,则无操作;如果不是,则进入304);303) The server saves the current page address of the mobile terminal, and searches for the binding terminal as the television end according to the terminal identifier, and the terminal adaptation module determines whether the television end is on the corresponding page of the program detail page, and if so, no operation; No, go to 304);
304)终端适配模块根据电视端的终端类型,查找其对应的节目详情页面地址,通过Websocket通道向电视端推送该地址,进入305);304) the terminal adaptation module searches for the corresponding program detail page address according to the terminal type of the television terminal, and pushes the address to the television terminal through the Websocket channel, and enters 305);
305)电视端收到推送地址,通过HTTP通道请求该页面,加载完节目详情页面后,通过Websocket通道向服务端上报当前所在页面地址,进入306);305) The TV terminal receives the push address, requests the page through the HTTP channel, and after loading the program details page, reports the current page address to the server through the Websocket channel, and enters 306);
306)服务端保存电视端的当前页面地址,并根据其终端标识查找其绑定终端为手机端,终端适配模块判断手机端是正处于相对应页面上。306) The server saves the current page address of the television end, and searches for the binding terminal as the mobile terminal according to the terminal identifier, and the terminal adaptation module determines that the mobile terminal is on the corresponding page.
图4是多设备联动服务中的播放联动过程流程图,具体包括:4 is a flowchart of a play linkage process in a multi-device linkage service, which specifically includes:
401)电视端和手机端同步显示节目详情页面时,手机端在详情页选择节目源、节目集数,点击播放,通过HTTP通道向服务端请求该节目对应的播放控制及推荐页面,服务端向手机端返回该节目对应的播放控制及推荐页面,进入402);401) When the TV terminal and the mobile terminal simultaneously display the program detail page, the mobile terminal selects the program source, the number of program episodes on the details page, clicks on the play, and requests the playback control and recommendation page corresponding to the program from the server through the HTTP channel, and the server side The mobile terminal returns the playback control and recommendation page corresponding to the program, and enters 402);
402)手机端加载完播放控制及推荐页面后,通过Websocket通道向服务端上报当前所在页面地址,进入403);402) After loading the playback control and recommendation page, the mobile terminal reports the current page address to the server through the Websocket channel, and enters 403);
403)服务端保存手机端的当前页面地址,并根据其终端标识查找其绑定终端为电视端,终端适配模块判断其绑定电视终端的对应页面为播放页面,判断其绑定电视终端是否处于播放页面上,如果是,则无操作;如果不是,则进入404);403) The server saves the current page address of the mobile phone, and finds that the binding terminal is the TV end according to the terminal identifier, and the terminal adaptation module determines that the corresponding page of the bound TV terminal is the play page, and determines whether the bound TV terminal is in the On the play page, if yes, no operation; if not, go to 404);
404)终端适配模块根据电视端类型,查找到其对应的播放页面地址,并通过Websocket通道向电视端推送该地址,进入405);404) The terminal adaptation module finds the corresponding play page address according to the type of the television end, and pushes the address to the television end through the Websocket channel, and enters 405);
405)电视端接收推送地址,通过HTTP通道请求对应页面,加载完播放页面后,开始播放对应节目;405) The television end receives the push address, requests the corresponding page through the HTTP channel, and after loading the play page, starts playing the corresponding program;
406)手机端在播放控制及推荐页面点击暂停、播放、快进、快退等操作按钮,通过Websocket通道向服务端发送对应指令,进入407);406) The mobile terminal clicks the operation button such as pause, play, fast forward, fast rewind in the play control and recommendation page, and sends a corresponding instruction to the server through the Websocket channel, and enters 407);
407)服务端收到手机端的播控指令,并查找该终端是否绑定电视终端,如果不是,则无操作;如果是,则进入408);407) The server receives the broadcast control command from the mobile terminal, and finds whether the terminal is bound to the TV terminal. If not, there is no operation; if yes, enter 408);
408)服务端通过Websocket通道向电视端推送播控指令,控制电视终端的播放; 408) The server pushes the broadcast control instruction to the television terminal through the Websocket channel to control the playing of the television terminal;
409)手机端在播放控制及推荐页面浏览该节目对应的推荐内容,选中某个推荐节目,通过HTTP通道向服务端请求该节目的节目详情页面,服务端返回节目详情页面,进入410);409) The mobile terminal browses the recommended content corresponding to the program on the play control and recommendation page, selects a recommended program, requests the program details page of the program from the server through the HTTP channel, and the server returns the program details page, and enters 410);
410)手机端加载完节目详情页面后,通过Websocket通道向服务端上报当前所在页面地址,进入411);410) After loading the program details page, the mobile terminal reports the current page address to the server through the Websocket channel, and enters 411);
411)服务端保存手机端的当前页面地址,并根据其终端标识查找其绑定终端为电视端,终端适配模块根据电视终端类型,判断其是否处于节目详情页面的对应页面上,如果是,则无操作;如果不是,则进入412);411) The server saves the current page address of the mobile terminal, and searches for the binding terminal as the television end according to the terminal identifier thereof, and the terminal adaptation module determines whether it is on the corresponding page of the program detail page according to the type of the television terminal, and if so, No action; if not, go to 412);
412)服务端查找电视端对应的节目详情页面地址,并通过Websocket通道向电视端推送该地址,进入413);412) The server finds the address of the program detail page corresponding to the television end, and pushes the address to the television terminal through the Websocket channel, and enters 413);
413)电视端接收推送地址,通过HTTP通道请求对应页面,加载完节目详情页面后,向服务端上报当前所在页面地址,进入414);413) The TV terminal receives the push address, requests the corresponding page through the HTTP channel, and after loading the program details page, reports the current page address to the server, and enters 414);
414)服务端保存电视端的当前页面地址,并根据其终端标识查找其绑定终端为手机端,终端适配模块根据手机端终端类型,判定其是正处于相对应页面上。414) The server saves the current page address of the TV end, and searches for the binding terminal as the mobile terminal according to the terminal identifier thereof, and the terminal adaptation module determines that it is on the corresponding page according to the type of the mobile terminal.
总之,本发明提出一种多设备联动服务中的连接通道维护系统及方法,通过该方法,可以在不影响原有业务逻辑的基础上加入多屏联动服务控制通道,通过控制通道实现多设备之间的绑定、UI同步和状态控制。In summary, the present invention provides a connection channel maintenance system and method in a multi-device linkage service, by which a multi-screen linkage service control channel can be added without affecting the original service logic, and multiple devices are implemented through the control channel. Binding, UI synchronization, and state control.
本发明的方法区别于其他通道维护方法在于:The method of the present invention differs from other channel maintenance methods in that:
1)在不影响原有业务服务通道情况下,加入多屏联动服务控制通道,通过控制通道实现多设备之间的绑定、UI同步和状态控制,实现了原有业务和多设备联动服务的分离。1) Join the multi-screen linkage service control channel without affecting the original service channel, and realize the binding between multiple devices, UI synchronization and state control through the control channel, and realize the original service and multi-device linkage service. Separation.
2)终端在初始页面加载完成后,自动加载多屏通道控制客户端,建立与多屏通道控制服务端的Websocket连接,并上报客户端的终端标识;多屏通道控制服务端保存终端标识和Websocket通道的对应关系。2) After the initial page is loaded, the terminal automatically loads the multi-screen channel control client, establishes a Websocket connection with the multi-screen channel control server, and reports the terminal identifier of the client; the multi-screen channel control server saves the terminal identifier and the Websocket channel. Correspondence relationship.
3)多屏通道控制客户端定期通过Websocket通道向多屏通道控制服务端发送心跳报文,用以维护两者之间的连接通道。3) The multi-screen channel control client periodically sends a heartbeat message to the multi-screen channel control server through the Websocket channel to maintain the connection channel between the two.
4)多屏通道控制客户端可以通过扫描二维码的方式,携带另一个客户端的终端标识向多屏通道控制服务端请求绑定,绑定报文通过Websocket通道传输,终端绑定模块收到绑定请求后保存两个终端之间的绑定关系。4) The multi-screen channel control client can scan the two-dimensional code and carry the terminal identifier of another client to request binding to the multi-screen channel control server, and the binding packet is transmitted through the Websocket channel, and the terminal binding module receives The binding relationship between the two terminals is saved after the binding request.
5)多屏通道控制客户端跳转到新页面之后,会通过Websocket通道向多屏通道控制服务端上报当前所在页面信息,多屏通道控制服务端接收终端的当前所在页面信息,并将终端与当前所在页面信息的对应关系存储下来。 5) After the multi-screen channel control client jumps to the new page, the current page information is reported to the multi-screen channel control server through the Websocket channel, and the multi-screen channel control server receives the current page information of the terminal, and the terminal and the terminal The correspondence of the current page information is stored.
6)多屏通道控制服务端收到终端上报的当前所在页面信息后,终端适配模块根据终端浏览器能力和浏览器类型,从终端适配知识库中匹配出发送请求的终端类型查找是否有与该终端绑定的其他终端,以及其他终端是否处于与该终端所在页面对应的页面上,如果没有绑定终端,不做处理;如果其他终端已经处于该终端所在页面对应的页面上,不作处理;否则,根据请求中的目标类型参数和配置的同步关系,获取目标类型终端的同步页面地址,向目标终端推送同步页面地址。6) After the multi-screen channel control server receives the current page information reported by the terminal, the terminal adaptation module searches for the terminal type matching the sending request from the terminal adaptation knowledge base according to the terminal browser capability and the browser type. Whether the other terminal bound to the terminal and other terminals are on the page corresponding to the page where the terminal is located, if no terminal is bound, no processing is performed; if other terminals are already on the page corresponding to the page where the terminal is located, no processing is performed. Otherwise, according to the target type parameter and the configured synchronization relationship in the request, the synchronization page address of the target type terminal is obtained, and the synchronization page address is pushed to the target terminal.
7)当手机类型终端点击进入播放页面时,终端适配模块向其对应的绑定电视类型终端推送视频播放页面,而向手机类型终端推送播放控制及推荐页面,该页面中包括视频播放的控制按钮以及该视频对应的相关推荐节目列表,其中7) When the mobile phone type terminal clicks into the play page, the terminal adapting module pushes the video play page to its corresponding bound TV type terminal, and pushes the play control and recommendation page to the mobile phone type terminal, where the page includes the video play control. a button and a list of related recommended programs corresponding to the video, wherein
当手机类型终端点击视频播放控制按钮时,多屏通道控制客户端将对应控制命令通过Websocket通道发送到多屏通道控制服务端;绑定模块查找该客户端绑定的电视类型客户端并通过Websocket通道向该客户端推送对应控制命令;电视类型客户端收到控制命令并执行动作,控制视频播放。When the mobile phone type terminal clicks the video play control button, the multi-screen channel control client sends the corresponding control command to the multi-screen channel control server through the Websocket channel; the binding module searches for the TV type client bound by the client and passes the Websocket. The channel pushes the corresponding control command to the client; the TV type client receives the control command and performs an action to control the video playback.
当手机类型终端浏览播放控制及推荐页面中的推荐节目,点击进入某个推荐节目的详情页时,会通过5)、6)中的UI同步机制,控制其绑定终端跳转到对应节目详情页面。When the mobile phone type terminal browses the recommended program in the play control and recommendation page and clicks into the detail page of a recommended program, it controls the binding terminal to jump to the corresponding program details through the UI synchronization mechanism in 5) and 6). page.
8)在多屏通道控制客户端页面的dom结构中包含一个iframe,将原有服务页面嵌入iframe中,在iframe外层创建和维护与服务端的Websocket通道,通过对iframe刷新实现业务页面的跳转。8) In the dom structure of the multi-screen channel control client page, an iframe is included, the original service page is embedded in the iframe, and the Websocket channel on the server side is created and maintained in the outer layer of the iframe, and the business page is jumped by refreshing the iframe. .
9)业务处理模块通过HTTP通道响应原有业务请求,保持原有业务逻辑不变。9) The service processing module responds to the original service request through the HTTP channel, and keeps the original business logic unchanged.
最后所应说明的是,以上实施例仅用以说明本发明的技术方案而非限制。尽管参照实施例对本发明进行了详细说明,本领域的普通技术人员应当理解,对本发明的技术方案进行修改或者等同替换,都不脱离本发明技术方案的精神和范围,其均应涵盖在本发明的权利要求范围当中。 Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention and not limiting. While the invention has been described in detail herein with reference to the embodiments of the embodiments of the invention Within the scope of the claims.

Claims (10)

  1. 一种多设备联动服务中的连接通道维护系统,包含:用于提供数据业务的服务端和终端设备,其特征在于,所述系统包含:位于终端设备上的多屏通道控制客户端模块和位于服务端上的多屏通道控制服务端模块;A connection channel maintenance system in a multi-device linkage service, comprising: a server and a terminal device for providing data services, wherein the system comprises: a multi-screen channel control client module located on the terminal device and located at Multi-screen channel control server module on the server;
    所述多屏通道控制客户端模块,用于获取设备终端的标识,并向多屏通道控制服务端上报本终端与多屏通道的绑定关系;The multi-screen channel control client module is configured to acquire the identifier of the device terminal, and report the binding relationship between the terminal and the multi-screen channel to the multi-screen channel control server;
    所述多屏通道控制服务端模块,用于记录终端与多屏通道的绑定关系,并向绑定终端的一方推送服务。The multi-screen channel control server module is configured to record a binding relationship between the terminal and the multi-screen channel, and push the service to the party that binds the terminal.
  2. 根据权利要求1所述的多设备联动服务中的连接通道维护系统,其特征在于,所述多屏通道控制服务端模块包含:The connection channel maintenance system in the multi-device linkage service according to claim 1, wherein the multi-screen channel control server module comprises:
    通道维护单元,用于建立并维护多屏通道控制客户端和多屏通道控制服务端之间的Websocket通道;a channel maintenance unit for establishing and maintaining a Websocket channel between the multi-screen channel control client and the multi-screen channel control server;
    终端绑定单元,用于记录客户端之间的绑定关系;a terminal binding unit, configured to record a binding relationship between clients;
    终端适配单元,用于识别客户端所在终端的设备类型,并按照设备类型下发匹配的页面地址。The terminal adaptation unit is configured to identify the device type of the terminal where the client is located, and send a matching page address according to the device type.
  3. 一种多设备联动服务中的连接通道维护方法,该方法基于权利要求1-2中任意一条权利要求记载的连接通道维护系统,所述方法包含:A method for maintaining a connection channel in a multi-device linkage service, the method is based on the connection channel maintenance system according to any one of claims 1-2, the method comprising:
    步骤101)维持终端的业务通道,并在终端设备加入多屏联动服务的控制通道;Step 101) maintaining a service channel of the terminal, and adding a control channel of the multi-screen linkage service to the terminal device;
    通过所述控制通道实现多终端设备之间的绑定、用户界面UI同步和状态控制,进而实现了业务和多设备联动控制的分离;The binding between the multi-terminal devices, the UI synchronization of the user interface, and the state control are implemented by the control channel, thereby separating the separation of the service and the multi-device linkage;
    步骤102)采用控制通道的复用实现多页面应用程序中的页面跳转。Step 102) implement page jump in the multi-page application by multiplexing the control channel.
  4. 根据权利要求3所述的多设备联动服务中的连接通道维护方法,其特征在于,终端设备在业务页面加载完成后,自动加载多屏通道控制的客户端模块。The method for maintaining a connection channel in the multi-device linkage service according to claim 3, wherein the terminal device automatically loads the client module controlled by the multi-screen channel after the service page is loaded.
  5. 根据权利要求4所述的多设备联动服务中的连接通道维护方法,其特征在于, 所述的控制通道位于多屏通道控制的客户端模块和多屏通道控制的服务端模块之间,且所述多屏通道控制的客户端模块位于终端设备上;The method for maintaining a connection channel in a multi-device linkage service according to claim 4, wherein The control channel is located between the client module controlled by the multi-screen channel and the server module controlled by the multi-screen channel, and the client module controlled by the multi-screen channel is located on the terminal device;
    所述多屏通道控制客户端模块建立与多屏通道控制的服务端模块之间的Websocket连接,即控制通道,并向多屏通道控制的服务端模块上报客户端的终端标识;The multi-screen channel control client module establishes a Websocket connection between the server module and the server module controlled by the multi-screen channel, that is, the control channel, and reports the terminal identifier of the client to the server module controlled by the multi-screen channel;
    所述多屏通道控制服务端模块还用于保存终端设备的标识和Websocket通道的对应关系。The multi-screen channel control server module is further configured to save the correspondence between the identifier of the terminal device and the Websocket channel.
  6. 根据权利要求5所述的多设备联动服务中的连接通道维护方法,其特征在于,所述多屏通道控制客户端模块定期通过Websocket通道向多屏通道控制服务端模块发送心跳报文,用以维护两者之间的连接通道。The method for maintaining a connection channel in the multi-device linkage service according to claim 5, wherein the multi-screen channel control client module periodically sends a heartbeat message to the multi-screen channel control server module through the Websocket channel, Maintain the connection channel between the two.
  7. 根据权利要求5所述的多设备联动服务中的连接通道维护方法,其特征在于,一个多屏通道控制客户端模块通过扫描二维码的方式携带另一个多屏通道客户端模块所在终端设备的标识向多屏通道控制服务端模块请求绑定,多屏通道控制服务端模块保存两个终端设备之间的绑定关系;The method for maintaining a connection channel in a multi-device linkage service according to claim 5, wherein a multi-screen channel control client module carries a terminal device of another multi-screen channel client module by scanning a two-dimensional code The identifier requests binding to the multi-screen channel control server module, and the multi-screen channel control server module saves the binding relationship between the two terminal devices;
    其中,绑定报文通过Websocket通道传输。The binding packet is transmitted through the Websocket channel.
  8. 根据权利要求5所述的多设备联动服务中的连接通道维护方法,其特征在于,所述的用户界面UI同步方法具体包含:The method for maintaining a connection channel in the multi-device linkage service according to claim 5, wherein the user interface UI synchronization method specifically includes:
    当终端设备跳转到新页面之后,位于该终端设备上的多屏通道控制客户端模块通过Websocket通道向位于服务端上的多屏通道控制服务端模块上报终端设备当前所在页面信息,多屏通道控制服务端模块接收终端设备的当前所在页面信息,并保存终端设备与当前所在页面信息的对应关系;After the terminal device jumps to the new page, the multi-screen channel control client module located on the terminal device reports the current page information of the terminal device to the multi-screen channel control server module located on the server through the Websocket channel, and the multi-screen channel is displayed. The control server module receives the current page information of the terminal device, and saves the correspondence between the terminal device and the current page information;
    当多屏通道控制服务端模块收到多屏通道控制客户端模块上报的当前所在页面的信息后,根据终端设备浏览器能力和浏览器类型,从终端适配知识库中匹配出发送请求的终端类型并查找是否有与该终端绑定的其他终端,以及其他终端是否处于与该终端所在页面对应的页面上,如果没有绑定终端,不做处理;如果其他终端已经处于该终端所在页面对应的页面上,不作处理;否则,根据请求中的目标类型参数和配置的同步关系,获取目标类型终端的同步页面地址,向目标终端推送同步页面地址。After the multi-screen channel control server module receives the information of the current page reported by the multi-screen channel control client module, according to the browser capability of the terminal device and the type of the browser, the terminal that matches the sending request is matched from the terminal adaptation knowledge base. Type and find out whether there are other terminals bound to the terminal, and whether other terminals are on the page corresponding to the page where the terminal is located. If no terminal is bound, no processing is performed; if other terminals are already in the corresponding page of the terminal On the page, no processing is performed; otherwise, according to the target type parameter and the configured synchronization relationship in the request, the synchronization page address of the target type terminal is obtained, and the synchronization page address is pushed to the target terminal.
  9. 根据权利要求3所述的多设备联动服务中的连接通道维护方法,其特征在于, 所述的状态控制方法包含:The method for maintaining a connection channel in a multi-device linkage service according to claim 3, wherein The state control method includes:
    当终端设备为手机类型的终端时:当手机类型终端点击进入播放页面时:终端适配模块向手机类型终端对应的绑定电视类型终端推送视频播放页面,而向手机类型终端推送播放控制及推荐页面,所述推荐页面中包括视频播放的控制按钮以及该视频对应的推荐节目列表,其中,When the terminal device is a mobile phone type terminal: when the mobile phone type terminal clicks into the play page: the terminal adaptation module pushes the video play page to the bound TV type terminal corresponding to the mobile phone type terminal, and pushes the play control and recommendation to the mobile phone type terminal. a page, where the recommendation page includes a control button for playing a video and a recommended program list corresponding to the video, where
    当手机类型终端点击视频播放控制按钮时,多屏通道控制客户端将对应控制命令通过Websocket通道发送到多屏通道控制服务端;终端绑定模块查找该终端绑定的电视类型终端并通过Websocket通道向该终端上的多屏通道控制客户端推送对应控制命令;电视类型终端上的多屏通道控制客户端收到控制命令并执行动作,控制视频播放;When the mobile phone type terminal clicks the video play control button, the multi-screen channel control client sends the corresponding control command to the multi-screen channel control server through the Websocket channel; the terminal binding module searches for the TV type terminal bound to the terminal and passes the Websocket channel. Pushing corresponding control commands to the multi-screen channel control client on the terminal; the multi-screen channel control client on the television type terminal receives the control command and performs an action to control video playback;
    当手机类型终端浏览播放控制及推荐页面中的推荐节目,点击进入一个推荐节目的详情页时,会通过UI同步机制,控制该手机类型终端绑定的终端跳转到对应节目详情页面。When the mobile phone type terminal browses the recommended program in the play control and recommendation page and clicks into the detail page of the recommended program, the terminal that is bound by the mobile phone type terminal is controlled to jump to the corresponding program detail page through the UI synchronization mechanism.
  10. 根据权利要求3所述的多设备联动服务中的连接通道维护方法,其特征在于,所述步骤102)具体为:将多屏通道控制客户端的页面的dom结构中设置一个iframe,将原有服务页面嵌入iframe中,且在iframe外层创建和维护与多屏通道控制服务端的Websocket通道,通过对iframe刷新实现业务页面的跳转。 The method for maintaining a connection channel in the multi-device linkage service according to claim 3, wherein the step 102) is specifically: setting an iframe in the dom structure of the page of the multi-screen channel control client, and the original service The page is embedded in the iframe, and the Websocket channel of the multi-screen channel control server is created and maintained in the outer layer of the iframe, and the business page is jumped by refreshing the iframe.
PCT/CN2014/093467 2014-05-27 2014-12-10 System and method for maintaining connection channel in multi-device interworking service WO2015180446A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP14893357.5A EP3151574A4 (en) 2014-05-27 2014-12-10 System and method for maintaining connection channel in multi-device interworking service

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410228743.4A CN105245959B (en) 2014-05-27 2014-05-27 Interface channel maintenance system and method in a kind of more equipment linkages service
CN201410228743.4 2014-05-27

Publications (1)

Publication Number Publication Date
WO2015180446A1 true WO2015180446A1 (en) 2015-12-03

Family

ID=54698019

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/093467 WO2015180446A1 (en) 2014-05-27 2014-12-10 System and method for maintaining connection channel in multi-device interworking service

Country Status (3)

Country Link
EP (1) EP3151574A4 (en)
CN (1) CN105245959B (en)
WO (1) WO2015180446A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107529066B (en) * 2016-06-22 2019-04-12 腾讯科技(深圳)有限公司 The playing method and device of video
CN107797781B (en) * 2016-09-02 2021-11-16 中兴通讯股份有限公司 Multi-screen interactive connection method and terminal
CN110300137B (en) * 2018-03-22 2021-10-08 腾讯科技(深圳)有限公司 Communication method, communication apparatus, computer device, and storage medium
CN109450983A (en) * 2018-10-16 2019-03-08 北京趣拿软件科技有限公司 The treating method and apparatus of information
CN112565421B (en) * 2020-12-03 2022-01-25 创盛视联数码科技(北京)有限公司 Information transmission method, system, electronic device and storage medium
CN114286147A (en) * 2021-12-23 2022-04-05 天翼视讯传媒有限公司 Method for realizing large and small screen remote interaction in EPG page in JS mode

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102510541A (en) * 2011-12-30 2012-06-20 Tcl数码科技(深圳)有限责任公司 Multi-screen interaction video and audio content switching method and media player
CN102571979A (en) * 2012-02-10 2012-07-11 上海视畅信息科技有限公司 Multi-screen interactive equipment and binding method thereof
CN102571964A (en) * 2012-01-16 2012-07-11 深圳创维-Rgb电子有限公司 Multi-screen interaction method and multi-screen interaction system
CN103248952A (en) * 2013-05-08 2013-08-14 青岛快乐视界数字传媒有限公司 Multi-screen interaction method for intelligent terminal and intelligent television
CN103491179A (en) * 2013-09-27 2014-01-01 百视通网络电视技术发展有限责任公司 Multi-screen interaction method and system based on Web

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101773083B1 (en) * 2010-12-30 2017-09-12 삼성전자 주식회사 Method and system for displaying multimedia services from server to multiple clients
JP5857443B2 (en) * 2011-05-12 2016-02-10 ソニー株式会社 Content sharing system
CN103354605B (en) * 2013-06-25 2016-09-28 杭州顺网科技股份有限公司 A kind of IPTV VOD system based on mobile terminal and order method thereof
CN103618930B (en) * 2013-11-14 2017-02-01 四川长虹电器股份有限公司 Method for upgrading hypertext markup language collaboration pages in multi-screen cooperative system
CN103607625A (en) * 2013-11-15 2014-02-26 四川长虹电器股份有限公司 A system realizing multi-screen cooperation based on a hypertext markup language and a method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102510541A (en) * 2011-12-30 2012-06-20 Tcl数码科技(深圳)有限责任公司 Multi-screen interaction video and audio content switching method and media player
CN102571964A (en) * 2012-01-16 2012-07-11 深圳创维-Rgb电子有限公司 Multi-screen interaction method and multi-screen interaction system
CN102571979A (en) * 2012-02-10 2012-07-11 上海视畅信息科技有限公司 Multi-screen interactive equipment and binding method thereof
CN103248952A (en) * 2013-05-08 2013-08-14 青岛快乐视界数字传媒有限公司 Multi-screen interaction method for intelligent terminal and intelligent television
CN103491179A (en) * 2013-09-27 2014-01-01 百视通网络电视技术发展有限责任公司 Multi-screen interaction method and system based on Web

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3151574A4 *

Also Published As

Publication number Publication date
EP3151574A4 (en) 2017-05-17
CN105245959B (en) 2019-01-25
CN105245959A (en) 2016-01-13
EP3151574A1 (en) 2017-04-05

Similar Documents

Publication Publication Date Title
US10841636B2 (en) Information processing apparatus, mobile terminal, information processing method, program, and information processing system
US20150365453A1 (en) Media projection method and device, control terminal and cloud server
WO2015180446A1 (en) System and method for maintaining connection channel in multi-device interworking service
CN104320417B (en) The method of interconnection and streaming and streaming media playing between mobile terminal and web terminals
CN102547443B (en) Resource sharing and interaction realizing method of multi-terminal system
EP3996355B1 (en) Method for transferring media stream and user equipment
CN112073758B (en) Cloud desktop screen projection method and device, computer equipment, computer readable storage medium and cloud desktop screen projection interaction system
US10341733B2 (en) Companion device
US20120282951A1 (en) Anchoring and sharing locations and enjoyment experience information on a presentation timeline for multimedia content streamed over a network
EP2924998A1 (en) Method, apparatus and system for acquiring playback data stream of real-time video communication
AU2010294783B2 (en) Method and device for providing complementary information
WO2016206467A1 (en) Data processing method and device
WO2015139547A1 (en) Method, device and system for setting up application scenario
US20130007863A1 (en) Streaming video to cellular phones
WO2014190655A1 (en) Application synchronization method, application server and terminal
CN105228080A (en) Multi-screen interaction method, system and browser
CN114025244A (en) Audio and video pushing method, device, equipment and computer readable storage medium
CN112243158B (en) Media file processing method and device, computer readable medium and electronic equipment
US20190014370A1 (en) Method forplaying back a plurality of media titles, adapted media source device, media player device, media delegation device and configurable and adapted computer program
WO2017092323A1 (en) Main control device, playing device and data transmission method therefor
WO2015089790A1 (en) Service processing method, apparatus, and system
CN110049360B (en) Cross-platform content control method, device, terminal, server and storage medium
EP3089459B1 (en) Apparatus and method for implementing video-on-demand quick switching among multiple screens
CN115499693A (en) Multi-screen different display control method, device and system, storage medium and electronic equipment
CN118042215A (en) Playback apparatus and channel switching method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14893357

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2014893357

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2014893357

Country of ref document: EP