CN102377823B - Method and system for realizing interactive sharing among multiple screens and multiple users by sliding screens - Google Patents
Method and system for realizing interactive sharing among multiple screens and multiple users by sliding screens Download PDFInfo
- Publication number
- CN102377823B CN102377823B CN 201110316489 CN201110316489A CN102377823B CN 102377823 B CN102377823 B CN 102377823B CN 201110316489 CN201110316489 CN 201110316489 CN 201110316489 A CN201110316489 A CN 201110316489A CN 102377823 B CN102377823 B CN 102377823B
- Authority
- CN
- China
- Prior art keywords
- server
- terminal
- video
- main control
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a method and a system for realizing interactive sharing among multiple screens and multiple users by sliding the screens and belongs to the field of network communication. The method and the system are based on a communication protocol, a corresponding instruction is sent to a middle service layer (a server or a virtual server) in a screen-sliding manner; and an information instruction of a terminal is transmitted through the middle service layer, therefore instant communication among terminals connected with the middle service layer is realized. In the method and the system, unprecedented communication convenience in the network era can be experienced in a screen-sliding mode combining the characteristic of a touch screen, so a user feels the unprecedented interactive sharing smoothness; and by the method and the system, supplied resources, such as information, films and televisions and the like, can be quickly transmitted to different terminals of the same user or other user terminals instantly without waiting.
Description
Technical field
The present invention relates to network communication field, be specifically related to a kind of method and system that realize that between the multi-screen multi-user, interaction is shared of shielding by cunning.
Background technology
Under the trend of " three screen merge ", mobile phone, computer, TV become the most universal electronic product that content consumption is provided, and the seamless link of it and network has presented irresistible gesture.Be accompanied by the development of computer digit technology and the extensive use of the Internet, it is further tight that person-to-person communication exchange becomes, people extend into and break through the convenient and happy of space-time constraint, multi-angle, multi-faceted enjoyment, sharing information demanding, utilize from simple voice " dialogue " of information, and between multi-screen, (sharing contents comprises: word information, picture, video request program, net cast, video break-point continuous playing, video intercept are created again, magic expression, file etc.) shared in interaction becomes development trend.
Share ground zero in the situation that interactive between existing multi-screen, the interaction that can realize simple text, picture, voice extremely has been not easy with just sharing, and can realize that uploading pictures and video realize that many people share just rarer.Under three screen integrated environments, on existing network between the different screen of alone family or between multi-user's multi-screen interactive sharing method can only realize each complicated self terminal and the operation of screen by the distinct methods of original different screen.
The phantom of Beijing Worldwide United Network Science and Technology Co., Ltd (Media Express) is that a image that is applicable to all kinds of crowds' secret is shared instrument, realized that video, atlas send, many people send simultaneously and share, but this imaging tool exists the user experiences poor, the problems such as transmission time length.
The QQ of Tengxun has realized instant messaging, has realized that word, the communication of expression, shooting exchange, but all be confined to PC; Word and expression have only been realized on mobile terminal.
Tengxun micro-reliable showed the real-time phonetic communication, realized sharing of video, voice, picture; But adopt traditional QQ mode, and be only the real-time phonetic communication tool, do not possess the function that multi-screen interactive is shared.
Summary of the invention
For the defect existed in prior art, the object of the present invention is to provide and a kind ofly by cunning, shield and realize between the multi-screen multi-user the interactive method and system of sharing, realize between the difference screen at the alone families such as mobile terminal on network, computer, Web TV or share the method for word, picture, audio frequency and video between the different screens of multi-user.
For achieving the above object, the technical solution used in the present invention is as follows:
A kind of method that realizes that between the multi-screen multi-user, interaction is shared of shielding by cunning comprises the following steps:
(1) user terminal, by the network entry server, is set up communications protocol with server and other terminal equipment with network communication function and is connected; Described user terminal is divided into main control terminal and controlled terminal in logic from business, and described network comprises the Internet, 3G or 4G wireless wide-area communication network, wired local area network or WLAN;
(2) main control terminal sends to server in the mode of sliding screen by corresponding instruction, the described mode with sliding screen refers to by the mode of finger sliding terminal Touch Screen, sliding button, button click, corresponding instruction refers to the information that need to transmit the main control terminal user, comprises communications protocol, authentication information, system information, point-to-point information;
(3) server is processed, transfer, is broadcast to the controlled terminal connected with server described instruction;
(4) controlled terminal receive server or the instruction that directly sent by main control terminal after, operate accordingly according to instruction, thereby realize that the interaction between multiple terminals, alone family, between the multi-user multiple terminals shares.
Further, a kind of method that realizes that between the multi-screen multi-user, interaction is shared of shielding by cunning as above, in step (1), described login comprises manual entry and two kinds of modes of automatic login, and described manual entry refers to that the user inputs the mode that username and password is logined; Described automatic login refers to by hardware is identified as MAC Address, realizes the terminal mode of login automatically;
Further, in step (1), described server refers to the intermediary service layer, is the general designation of one group of server.
Further, described server is property server, comprises subscriber management server, continued broadcasting server, protocol instructions server, database server, Video processing server, CDN& Streaming media server, web services server, Streaming Media processing server.
Perhaps, described server is the server by software virtual;
If after main control terminal and controlled terminal login, judge that through network main control terminal and controlled terminal are in same LAN, main control terminal and controlled terminal communication will directly connect by communications protocol, and at this time main control terminal or controlled terminal reception server function provide service.If the user opens function of local area network, main control terminal and controlled terminal are logined the virtual server by main control terminal or controlled terminal software creation, and directly set up the communication relation.
Further, described communications protocol is ICP/IP protocol, proprietary protocol.
Described user terminal is mobile phone terminal, PDA mobile terminal, panel computer, computer terminal, internet television all-in-one or Set Top Box.
Further, a kind of method that realizes that between the multi-screen multi-user, interaction is shared of shielding by cunning as above, after described main control terminal sends instruction to server, if do not receive server response information within the time of setting, declarative instruction sends unsuccessfully, need to resend.After server sends instruction to controlled terminal, if do not receive the controlled terminal echo message within the time of setting, declarative instruction sends unsuccessfully, need to resend.After main control terminal directly sends instruction to controlled terminal, if do not receive the controlled terminal echo message within the time of setting, declarative instruction sends unsuccessfully, need to resend.Or the information that receiving terminal receives is imperfect, inaccurate, declarative instruction sends unsuccessfully, and receiving terminal proposes to resend demand.
Further, a kind of method that realizes that between the multi-screen multi-user, interaction is shared of shielding by cunning as above, described echo message comprises synchronous echo message and asynchronous echo message, synchronous echo message refers to when main control terminal sends a message to server, after discovering server controlled terminal online (refer to online terminal on network and successfully login) successfully transmission information, server returns to main control terminal immediately by the information processing result after receiving the information that controlled terminal successfully receives; Asynchronous echo message refers to that working as main control terminal sends to server by point-to-point message, discovering server controlled terminal online (do not refer to online terminal not on network or on network but do not login) is kept at server by information, the wait controlled terminal receives, after controlled terminal online (refer to online terminal and login on network and successfully) successfully reception information, server returns to main control terminal by the information processing result.
Further, a kind of method that realizes that between the multi-screen multi-user, interaction is shared of shielding by cunning as above, it is described after main control terminal and/or controlled terminal and server are set up communications protocol and be connected, server end can send a heartbeat instruction to each terminal according to the temporal frequency of setting and determine whether each terminal is normal with being connected of server, and described heartbeat instruction is the information that is used for maintaining connection of default.
Further, as abovely a kind ofly by cunning, shield the interactive method of sharing that realizes between the multi-screen multi-user, describedly by the heartbeat instruction, confirm that whether normally terminal is connected specifically mode and is with server:
If terminal gives a response server according to the heartbeat instruction, illustrate that server is connected normally with the network of terminal; If the terminal nonreply, server can disconnect being connected of current and this terminal, and this terminal need to again log in server and connect.
Further, a kind of method that realizes that between the multi-screen multi-user, interaction is shared of shielding by cunning as above, described system information and point-to-point information are comprised of message header or message header and message body, described message header comprises the message SN generated by message transmission source terminal, in the message queue that described message SN generates in message transmission source terminal, be unique, and message SN is constant in once complete message process.
Further, a kind of method that realizes that between the multi-screen multi-user, interaction is shared of shielding by cunning as above, described system information comprises binding instruction, the cancellation link order connected for disconnected end for setting up the terminal connection and inquires about the terminal inquiry instruction of online terminal list, described point-to-point information comprises the different instruction of the different information of transmission between terminal, comprises that video (comprises the video that system provides, video on the browser browse network provided by system, in terminating machine, the video flowing that terminal obtains video file shared on network or takes in real time by camera by sharing agreement) transfer instruction, voice (comprise in terminating machine, the audio stream that terminal obtains voice document shared on network or passes through Mike or camera real-time recording by sharing agreement) transfer instruction, file (comprises in terminating machine or terminal obtains shared picture file on network by sharing agreement, voice document, video file, text (text-only file, word, the files such as Excel), the file that pdf document etc. exist with document form) transfer instruction, information (comprises the information that system provides, information on the browser browse network provided by system) transfer instruction, the expression transfer instruction, the paper slip transfer instruction, long-distance video or speech play instruction and video or voice status obtain instruction.
Further, a kind of method that realizes that between the multi-screen multi-user, interaction is shared of shielding by cunning as above, described when between main control terminal and controlled terminal, send when the transmission of video instruction, if during the video content that described video provides for system, main control terminal is video ID in server and the initial reproduction time of video to server transmission, and server is transferred to controlled terminal by the initial reproduction time of video playback address video again.If described video is the video in main control terminal the machine or passes through the video flowing that camera is taken in real time, first this video content is reached in server, server is compressed into by video file the video media file that different terminals is used by compression algorithm, and be distributed to corresponding streaming media server and (use different broadcasting agreement (http protocol, RTSP agreement, 3GPP agreement, RTP/RTCP agreement, MMS (Microsoft Media Server) Protocol, proprietary protocol) according to different terminals, the more initial reproduction time of the video playback address video that will newly produce be transferred to controlled terminal;
When between main control terminal and controlled terminal, send when the video editing transfer instruction, if during the video content that described video provides for system, the initial reproduction time for the video ID in server, video of main control terminal and server transmission and the end reproduction time of video, video editing information (comprise captions, dub, scribble etc.), server again by the end reproduction time of the initial reproduction time of video playback address, video and video, video editing communication to controlled terminal.If described video is the video in main control terminal the machine or passes through the video flowing that camera is taken in real time, first this video is completed the machine editor, again the video content editted is reached in server, server is compressed into by video file the video media file that different terminals is used by compression algorithm, and be distributed to corresponding streaming media server, then the video playback address transfer that will newly produce is to controlled terminal;
When between main control terminal and controlled terminal, send when the file transfer instruction, what between main control terminal and controlled terminal, by server, transmit is the file address in server, if being file or the terminal in main control terminal the machine, described file obtains shared file on network by sharing agreement, first file is reached in server, then the file address that will newly produce is transferred to controlled terminal;
What between main control terminal and controlled terminal, send is the voice transfer instruction, if during the voice content that described voice provide for system, what between main control terminal and controlled terminal, by server, transmit is the speech play address in server, if described voice are the voice in main control terminal the machine or the audio stream that passes through Mike or camera real-time recording, first voice are reached in server, then the speech play address transfer that will newly produce is to controlled terminal;
When between main control terminal and controlled terminal, send when the information transfer instruction, if the information that system provides, what between main control terminal and controlled terminal, by server, transmit is the address of information; If the information on the browser browse network that the user provides by system, the network address for the information browsed at browser of transmitting by server between main control terminal and controlled terminal;
When what send between main control terminal and controlled terminal, be while expressing one's feelings transfer instruction, what between main control terminal and controlled terminal, by server, transmit is the expression coding;
When between main control terminal and controlled terminal, send when the paper slip transfer instruction, main control terminal by server directly by the content delivery on paper slip to controlled terminal;
When between main control terminal and controlled terminal, send for long-distance video or speech play instruction the time, what between main control terminal and controlled terminal, by server, transmit is video or voice ID and initial reproduction time in server, if described video or voice are video or voice in main control terminal the machine, first video or voice are reached in server, server is compressed into by video or voice document the audiovisual media file that different terminals is used by compression algorithm, and be distributed to corresponding streaming media server, the audio frequency and video broadcast address that will newly produce again, the initial reproduction time of audio frequency and video is transferred to controlled terminal,
When main control terminal between controlled terminal, send obtain instruction for video or voice status the time, controlled terminal is received after this instruction the current state of video or speech play (comprising video or voice ID and video or speech play time) is transferred to main control terminal by server.
A kind of system that realizes that between the multi-screen multi-user, interaction is shared of shielding by cunning, comprise user terminal and server, and wherein said user terminal is divided into main control terminal and controlled terminal in logic from business;
Wherein, described main control terminal: relative controlled terminal in logic for the file content on the mode sharing service device with sliding screen or upload the file content of sharing to server, and sends instruction by server to controlled terminal;
Described controlled terminal: relative main control terminal in logic, the instruction forwarded for reception server, and carry out corresponding operating according to instruction, represent or play information or the file content in presence server;
Described server: refer to the intermediary service layer, it is the general designation of one group of server, property server or the virtual server that produced by software virtual, for the treatment of with the file content uploaded of each terminal of storage, and the transfer of main control terminal instruction and the transfer of controlled terminal return information, realize communicating by letter of main control terminal and controlled terminal.
Further, described user terminal refers to mobile phone terminal, PDA mobile terminal, panel computer, computer terminal, internet television all-in-one or Set Top Box.
Further again, described server comprises subscriber management server, continued broadcasting server, protocol instructions server, database server, Video processing server, CDN& Streaming media server, web services server, Streaming Media processing server etc. are that the server by software virtual provides service in the local area network (LAN) situation.
Wherein, the file medium content that described CDN server is uploaded for storage and the audiovisual media that provides of dissemination system and terminal comprises " close " principle on Task Assigned Policy.According to request user's geographical position, select the interior node nearest from it of net that service is provided, avoid occurring the inter-network transfer of data as far as possible.
Described streaming media server (comprise live and program request streaming media server), be responsible for processing and store the audiovisual media that file medium content that each terminal uploads and system provide the broadcasting that audio and video stream media is provided.Comprise http protocol streaming media server, RTSP protocol streams media server, 3GPP protocol streams media server, MMS (Microsoft Media Server) Protocol streaming media server, RTP/RTCP protocol streams media server, proprietary protocol streaming media server from agreement.Streaming media server for media content is gathered, buffer memory, scheduling and to the user terminal transmission with play.
Described protocol instructions server is responsible for the transfer of main control terminal instruction and the transfer of controlled terminal return information, realizes communicating by letter of main control terminal and controlled terminal; In the local area network (LAN) situation, the virtual protocol commander server is for the transfer of main control terminal instruction and the transfer of controlled terminal return information, realizes communicating by letter of main control terminal and controlled terminal;
Described subscriber management server is realized the functions such as the logging in of user, registration, good friend's grouping.
Described continued broadcasting server provides watching record of user and breakpoint record, guarantees that the user can realize the continued broadcasting function.
Further again, described Video processing server comprises with lower module:
The file receiver module, the file content of uploading for receiving each terminal;
Video coding and compression module, carry out encoding and decoding and compression for the video that each terminal is uploaded;
The file distributing module, be distributed to the streaming media server of different agreement for the video file by having compressed;
The data writing module, the state after uploading for the tracking of uploading data and record prompting user;
Further, a kind of system that realizes that between the multi-screen multi-user, the realization interaction is shared of shielding by cunning as above, described system comprises system architecture design, terminal room and/or the design of server communications protocol.
Effect of the present invention is: the switching (sharing) that method and system of the present invention are content between mobile terminal, computer, TV multi-screen (word, audio frequency and video, file etc.) provides support, make the user experience smooth and easy that interaction shares, forward the instant messaging of main control terminal by intermediary service layer (server or the virtual server produced by software virtual)
The accompanying drawing explanation
Fig. 1 is a kind of implementation figure that shields the method and system that realize that the multi-screen multiuser interactive is shared by cunning of the present invention;
Simple extension type schematic diagram in the system architecture design that Fig. 2 is the method for the invention and system realization;
Logical extension type schematic diagram in the system architecture design that Fig. 3 is the method for the invention and system realization;
Fig. 4 is a kind of structured flowchart that shields the method and system simple logic that realizes that the multi-screen multiuser interactive is shared by cunning of the present invention;
Fig. 5 is a kind of flow chart that shields the method that realizes that the multi-screen multiuser interactive is shared by cunning of the present invention with Fig. 6;
The schematic flow sheet that Fig. 7 is transmission of video in the embodiment of the present invention;
Fig. 8 is the structured flowchart that in the embodiment of the present invention, the Video processing server is processed video;
Fig. 9 is the effect schematic diagram of transmission of video in the embodiment of the present invention;
Figure 10 is the effect schematic diagram that adopts the method for the invention to carry out the picture transmission;
Figure 11 adopts the method for the invention to carry out the effect schematic diagram of file transfer;
Figure 12 is the effect schematic diagram that adopts the method for the invention to carry out the note transmission.
Embodiment
Below in conjunction with Figure of description and embodiment, the present invention is described in further detail.
A kind of realization of by cunning, shielding the method and system that realize that the multi-screen multiuser interactive is shared of the present invention as shown in Figure 1, can be divided into two aspects of system architecture and communications protocol, and system architecture can be divided into simple extension type and logical extension type; Communications protocol can be divided into TCP/IP communications protocol, privately owned communications protocol.The TCP/IP communications protocol can be divided into Transmission Control Protocol, udp protocol etc. again; And can adopt the concrete communications protocol such as binary message, XMPP agreement, http protocol in Transmission Control Protocol.
As shown in Figure 2, every station server is born whole service logics to the simple extension type, by content-switch, is responsible for load balancing, by traffic sharing in the group on every station server.
The logical extension type, according to the server logic function, expanded, if the protocol instructions server is carried out to logical extension as shown in Figure 3, the protocol instructions server, from dividing in logic different logic functions, is expanded as navigation nodes, access node, IM core node, S2S routing node for each function.
Its effect of navigation nodes (Redirect Server) is the user who will newly log in, and according to certain strategy (ip region, system load, user property etc.), the user is guided to suitable service node, to improve the user, experiences.
Navigation takes node and can be divided into overall navigation nodes and local navigation nodes, acts on respectively whole server cluster and clustered partition inside.
The effect of access node (Access Server) is to receive that client connects and request, and by client-requested deliver to the back-end logic server; Before forwarding is submitted, may simply judge and logical process client-requested, to reduce the pressure of back-end logic server.
IM core node (IM Core Server) is processed nearly all IM core affairs, such as user registration, user authenticate, session management, data base querying, deferred information, personal information management, good friend's logic, user message strategy and information inquiry etc.
The IM core node that S2S routing node (S2S Router) UNICOM cluster is inner all makes the communication between the IM core node become simple: only need to send to the S2S route, by the S2S route, do forwarding.
Under the environment of mobile phone, computer, TV " three screens merge ", on network between different screen between alone family or multi-user interactive realization of sharing more difficult more complicated, a kind of method and system that realize that the multi-screen multiuser interactive is shared of shielding by cunning that the present invention proposes for this problem just, share to realize the interaction between the multi-screen multi-user.
Fig. 4 shows a kind of simple logic structured flowchart that shields the system that realizes that the multi-screen multiuser interactive is shared by cunning of the present invention, comprising:
Main control terminal 11: user terminal is by network entry server 12 and set up communications protocol with server and be connected.The user of main control terminal 11 sends to server 12 content of sharing in the mode of sliding screen, and sends instruction by server 12 to controlled terminal 13;
Server 12: for the treatment of with each terminal of storage file or the information content uploaded, and the transfer of main control terminal instruction and the transfer of controlled terminal return information, realize communicating by letter of main control terminal and controlled terminal;
Controlled terminal 13: after the instruction that receives server or directly sent by main control terminal, according to instruction, operate accordingly, thereby realize that the interaction between multiple terminals, alone family, between the multi-user multiple terminals shares.
Described server comprises subscriber management server, continued broadcasting server, protocol instructions server, database server, Video processing server, CDN& Streaming media server, web services server, Streaming Media processing server are that the server by software virtual provides service in the local area network (LAN) situation;
Wherein, the file medium content that described CDN server is uploaded for storage and the audiovisual media that provides of dissemination system and terminal, comprise " close " principle on Task Assigned Policy, geographical position according to the request user, select the interior node nearest from it of net that service is provided, avoid occurring the inter-network transfer of data as far as possible;
Described streaming media server is responsible for processing and store the audiovisual media that file medium content that each terminal uploads and system provide the broadcasting that audio and video stream media is provided, comprise http protocol streaming media server, RTSP protocol streams media server, 3GPP protocol streams media server, MMS (Microsoft Media Server) Protocol streaming media server, RTP/RTCP protocol streams media server, proprietary protocol streaming media server from agreement, streaming media server for media content is gathered, buffer memory, scheduling and to the user terminal transmission with play;
Described protocol instructions server is responsible for the transfer of main control terminal instruction and the transfer of controlled terminal return information, realizes communicating by letter of main control terminal and controlled terminal; In the local area network (LAN) situation, the virtual protocol commander server is for the transfer of main control terminal instruction and the transfer of controlled terminal return information, realizes communicating by letter of main control terminal and controlled terminal;
Described subscriber management server is for realizing the logging in of user, registration, good friend's block functions;
Described continued broadcasting server, for watching record of user and breakpoint record are provided, guarantees that the user can realize the continued broadcasting function;
As shown in Figure 8, described Video processing server comprises with lower module:
The file receiver module, the file content of uploading for receiving each terminal;
Video coding and compression module, carry out encoding and decoding and compression for the video that each terminal is uploaded;
The file distributing module, for the video file compressed being distributed to the streaming media server of different agreement, described streaming media server for media content is gathered, buffer memory, scheduling and play to the user terminal transmission, streaming media server comprises HTTP streaming media server, RTSP streaming media server and 3GPP streaming media server, MMS (Microsoft Media Server) Protocol streaming media server, RTP/RTCP protocol streams media server, proprietary protocol streaming media server.
The data writing module, the state after uploading for the tracking of uploading data and record prompting user.
Fig. 5 shows a kind of flow chart that shields the method that realizes that the multi-screen multiuser interactive is shared by cunning, and as can be seen from Figure, the method comprises the following steps:
Step S21: each terminal of main control terminal is set up communications protocol with server and is connected;
User terminal is by network entry or system automatic login server, setting up communications protocol TCP with server is connected, described terminal is divided into main control terminal and controlled terminal in logic from business, and terminal specifically refers to mobile phone terminal, PDA mobile terminal, panel computer, computer terminal, internet television (all-in-one or Set Top Box).Described network comprises the Internet, 3G or 4G wireless wide-area communication network (at present China's 3G network has the TD-SCDMA of China Mobile and the CDMA2000 of China Telecom and tri-kinds of network formats of WCDMA of CHINAUNICOM), wired local area network or WLAN.
Step S22: main control terminal sends to server by instruction;
Main control terminal sends to server in the mode of sliding screen by corresponding instruction, the described mode with sliding screen refers to by the mode of finger sliding terminal Touch Screen, sliding button, button click, corresponding instruction refers to the information that need to transmit the main control terminal user, comprises authentication information (comprise user log-in authentication and be connected Certificate Authority), system information and point-to-point information.
Step S23: server is forwarded to controlled terminal by instruction;
Server process and each terminal of storage file or the information content uploaded, and the transfer of main control terminal instruction and the transfer of controlled terminal return information, realize communicating by letter of main control terminal and controlled terminal;
Step S24: controlled terminal carries out corresponding operating after receiving instruction.
Controlled terminal operates accordingly according to instruction after receiving the instruction that server sends, thereby realizes that the interaction between multiple terminals, alone family, between the multi-user multiple terminals shares.
Wherein, in the operating process of practical application, setting up communications protocol when user terminal and server is connected, during game server, server needs terminal to send the debarkation authentication instruction, and after only having the debarkation authentication instruction to pass through, this terminal can receive instruction from server, and operate accordingly according to instruction, as shown in Figure 6.
System be take communications protocol (including but not limited to ICP/IP protocol, proprietary protocol) as basic multiple terminals multi-user's the instant messaging that completes.
In the present embodiment, the Transmission Control Protocol binary message of first take in TCP/IP (Transmission Control Protocol transmission control protocol/Internet Protocol Internet Interconnection agreement) agreement is example, describes the realization of the method for the invention and system.
Each terminal (main control terminal and controlled terminal) is after user or the automatic login of system, setting up TCP with server is connected, main control end sends to server by corresponding instruction, server carries out transfer, is broadcast on the online terminal connected with service instruction again, after controlled terminal receives instruction, carry out corresponding motion action.System is that between mobile terminal, computer, TV multi-screen, real time content switching (sharing) provides support, and by an intermediary service layer, carrys out Forward-reques.And then realize the instant messaging of a plurality of terminals.
The base unit transmitted in agreement is message, and message is divided into three major types: authentication information, system information and point-to-point information.Article one, complete information is comprised of message header and message body, and some type of messages are without message body.Data type in message comprises signless integer Integer type and text type.Comprised the information such as total length, type, transmission source ID, message SN of message at message header.
Wherein, described message SN sends source by message and generates, and in the message queue of source terminal, be unique, and message SN is unmodifiable in once complete message process.For example: terminal A sends a piece of news to terminal B.The ID that source ID is terminal A, the ID that purpose ID is terminal B, sequence number is that terminal A is created on sequence number unique in terminal A.Message is dealt into server, and the server former state is transmitted to terminal B, and terminal B needs to respond this message after receiving message, the ID that the source of receiveing the response ID now is terminal B, the ID that purpose ID is terminal A, sequence number is constant, message is dealt into server, and the server former state is transmitted to terminal A by message.
And if server communication source ID or purpose ID mean with 0.For example: terminal A sends the online terminal list message of inquiry to server and obtains the online terminal list of designated user.The ID that source ID is terminal A, purpose ID is 0, the sequence number meaning is constant.Server is responded this message after receiving message, and now source ID is 0, the ID that purpose ID is terminal A.
In the present embodiment, system information mainly comprises binding instruction, the cancellation link order connected for disconnected end for setting up the terminal connection and inquires about the terminal inquiry instruction of online terminal list; Point-to-point information comprises the different instruction of the different information of transmission between terminal, comprises that transmission of video instruction, voice transfer instruction, picture transfer instruction, information transfer instruction, expression transfer instruction, paper slip transfer instruction, long-distance video or speech play instruction and video or voice status obtain instruction.
Wherein, for point-to-point information, when between main control terminal and controlled terminal, send when the transmission of video instruction, if during the video content that described video provides for system, main control terminal is video ID in server and the initial reproduction time of video to server transmission, and server is transferred to controlled terminal by the initial reproduction time of video playback address video again.If described video is the video in main control terminal the machine or passes through the video flowing that camera is taken in real time, first this video content is reached in server, server is compressed into by video file the video media file that different terminals is used by compression algorithm, and be distributed to corresponding streaming media server and (use different broadcasting agreement (http protocol, RTSP agreement, 3GPP agreement, RTP/RTCP agreement, MMS (Microsoft Media Server) Protocol, proprietary protocol) according to different terminals, the more initial reproduction time of the video playback address video that will newly produce be transferred to controlled terminal;
When between main control terminal and controlled terminal, send when the video editing transfer instruction, if during the video content that described video provides for system, the initial reproduction time for the video ID in server, video of main control terminal and server transmission and the end reproduction time of video, video editing information (comprise captions, dub, scribble etc.), server again by the end reproduction time of the initial reproduction time of video playback address, video and video, video editing communication to controlled terminal.If described video is the video in main control terminal the machine or passes through the video flowing that camera is taken in real time, first this video is completed the machine editor, again the video content editted is reached in server, server is compressed into by video file the video media file that different terminals is used by compression algorithm, and be distributed to corresponding streaming media server, then the video playback address transfer that will newly produce is to controlled terminal;
When between main control terminal and controlled terminal, send when the file transfer instruction, what between main control terminal and controlled terminal, by server, transmit is the file address in server, if being file or the terminal in main control terminal the machine, described file obtains shared file on network by sharing agreement, first file is reached in server, then the file address that will newly produce is transferred to controlled terminal;
What between main control terminal and controlled terminal, send is the voice transfer instruction, if during the voice content that described voice provide for system, what between main control terminal and controlled terminal, by server, transmit is the speech play address in server, if described voice are the voice in main control terminal the machine or the audio stream that passes through Mike or camera real-time recording, first voice are reached in server, then the speech play address transfer that will newly produce is to controlled terminal;
When between main control terminal and controlled terminal, send when the information transfer instruction, if the information that system provides, what between main control terminal and controlled terminal, by server, transmit is the address of information; If the information on the browser browse network that the user provides by system, the network address for the information browsed at browser of transmitting by server between main control terminal and controlled terminal;
When what send between main control terminal and controlled terminal, be while expressing one's feelings transfer instruction, what between main control terminal and controlled terminal, by server, transmit is the expression coding;
When between main control terminal and controlled terminal, send when the paper slip transfer instruction, main control terminal by server directly by the content delivery on paper slip to controlled terminal;
When between main control terminal and controlled terminal, send for long-distance video or speech play instruction the time, what between main control terminal and controlled terminal, by server, transmit is video or voice ID and initial reproduction time in server, if described video or voice are video or voice in main control terminal the machine, first video or voice are reached in server, server is compressed into by video or voice document the audiovisual media file that different terminals is used by compression algorithm, and be distributed to corresponding streaming media server, the audio frequency and video broadcast address that will newly produce again, the initial reproduction time of audio frequency and video is transferred to controlled terminal,
When main control terminal between controlled terminal, send obtain instruction for video or voice status the time, controlled terminal is received after this instruction the current state of video or speech play (comprising video or voice ID and video or speech play time) is transferred to main control terminal by server.
In the present embodiment, then the XMPP agreement of take in Transmission Control Protocol is example, describes the realization of the method for the invention and system.Adopt ripe instant communication protocol XMPP exploitation, XMPP is a kind of agreement of XML-based, and it has inherited in the XML environment expansionary flexibly.Therefore, the application based on XMPP has superpower extensibility.
XMPP (scalable message is processed on-the-spot agreement) is based on the agreement of extend markup language (XML), and it is for instant message (IM) and online in-situ measurement.It is at the accurate real time operation promoted between server.This agreement may finally allow the Internet user to transfer immediate news to all other men on the internet, even its operating system is different with browser.
XMPP has been completed standardization effort by IETF International Standards Organization at present.Standardized core results is divided into two parts:
◆ the XML flow host-host protocol of core
◆ the instant messaging expanded application of XML-based FreeEIM flow transmission
Each terminal (main control terminal and controlled terminal) is after login, setting up TCP with server is connected, main control end sends to server in the mode of sliding screen by corresponding instruction, server carries out transfer, is broadcast on the online terminal connected with service instruction again, after controlled terminal receives instruction, carry out corresponding motion action.System is that between mobile terminal, computer, internet television multi-screen, real time content switching (sharing) provides support, and by an intermediary service layer, carrys out Forward-reques.And then realize the instant messaging of a plurality of terminals.
In the present embodiment, login XML asks detailed reference example as follows:
In the present embodiment, user rs authentication is as follows by detailed reference example:
In the present embodiment, reference example is as follows in detail in the user rs authentication failure:
Transmit the detailed reference example of sharing video frequency in the present embodiment as follows:
Receive the detailed reference example of sharing video frequency in the present embodiment as follows:
The http protocol that this explanation be take in Transmission Control Protocol again is example, describes the realization of the method for the invention and system.
After client logs in, the interface of server is read in circulation, by the judgement return value, according to return value, carries out different operating, and the communications protocol of client and service end is all the http agreement.
Main control end: after video playback, in sliding mode of shielding, to server, send switching command (http get request), after server end records current information, return service device current time stamp, client retains this timestamp.
Controlled terminal: after login, create order and read thread, every 2 seconds, read a server data (http get), if return data is not 0, according to return value, carry out different operating.
Terminal and service end are used TCP to connect, and carry out sending and receiving message, and message structure is message size+message body, the text data that message body is the JSON structure.
When in accepting state, at first read message size, if the data that read are greater than 0, continue to receive so the data of corresponding size, it is resolved to execution.
When needs send message, at first construct message, then send message size, then send source body.
Unsteadiness due to network, service end is connected the situation that improper disconnection may occur with the network of terminal, in order to guarantee the correctness of online list, server may a heartbeat instruction inquiring client terminal of timed sending presence, after client is received the heartbeat instruction, need make corresponding response.If server end is found the long-time nonreply of client, will close current link so.Client need to again be logined and could carry out communication with other-end.
The mutual employing answer-mode of service end and terminal, after service end (terminal) receives instruction, service end (terminal) must be returned to the message that comprises MsgType and RetCode field, and the RetCode field is also that the judgement current message is order or unique foundation of replying.
Every message all comprises a field " MsgType " type of message, and its value is an integer, and the parameter of different messages is different.In most of situation, service end is only done message and is forwarded operation, and the message that client sends can completely be transmitted to other equipment, so can be with reference to sending message structure during the message that in most situation, client process receives.
Below in conjunction with concrete application example, again the present invention is described in more detail.
This application example with the broadcasting of video be transmitted as example and describe.
User terminal is by after the network login server, if current not displaying video, this user terminal self is video playback and is subject to prosecutor (controlled terminal) so, setting up communications protocol with the protocol instructions server is connected, wait for the instruction that other terminal or user send, carry out video request program, break-point continuous playing, live operation after receiving instruction.After carrying out the video playback operation, disconnect with the protocol instructions server is long and being connected, enter armed state, when the mode of main control terminal with sliding screen, the relevant information of current displaying video is sent to server, the machine arranges and stops or continuing playing according to the user simultaneously.After prosecution receives the instruction of the displaying video that main control terminal sends, just can receive the relevant information of this video in streaming media server: comprise video ID and play zero-time etc., carry out immediately instant online broadcasting of video, the zero-time that play by prosecutor is exactly that time point of current displaying video while sending instruction, and its effect as shown in Figure 9.
If the video of playing is the video in main control terminal the machine, need master control side first this video to be uploaded to the Video processing server, the file receiver module of server is responsible for uploading and breakpoint transmission work of user, as shown in Fig. 7 and Fig. 8, after video has all been uploaded, proceed to coding and decoding video and compression module video is carried out to encoding and decoding and compression, the streaming media server that by the file distributing module, the video file compressed is distributed to different agreement again (is used different broadcasting agreement (http protocols according to different terminals, the RTSP agreement, the 3GPP agreement, the RTP/RTCP agreement, MMS (Microsoft Media Server) Protocol, proprietary protocol) in, master control side just can receive the relevant information of this video in streaming media server: comprise video ID and play zero-time etc., carry out the broadcasting of video.Simultaneously, the data writing module is responsible for data tracking and record, the state after the prompting user uploads.
Method and system of the present invention, be not limited only to the above-mentioned broadcasting to video and transmission, is equally applicable to the transmission of the information such as note, picture, file or information.Adopt method of the present invention to carry out the effect schematic diagram of picture, file, note transmission respectively as shown in Figure 10, Figure 11, Figure 12.The communication of experiencing network by the characteristics of slip screen combination of touch control screen is convenient, by the method, realizes the fast sharing between the multi-screen multi-user of information.
Obviously, those skilled in the art can carry out various changes and modification and not break away from the spirit and scope of the present invention the present invention.Like this, if within of the present invention these are revised and modification belongs to the scope of the claims in the present invention and equivalent technology thereof, the present invention also is intended to comprise these changes and modification interior.
Claims (11)
1. one kind shields by cunning the interactive method of sharing between the multi-screen multi-user that realizes, comprises the following steps:
(1) user terminal, by the network entry server, is set up communications protocol with server and other terminal equipment with network communication function and is connected; Described user terminal is divided into main control terminal and controlled terminal in logic from business, and described network comprises the Internet, 3G or 4G wireless wide-area communication network, wired local area network or WLAN;
Described user terminal is mobile phone terminal, PDA mobile terminal, panel computer, computer terminal, internet television all-in-one or Set Top Box;
Described server refers to the intermediary service layer, is the general designation of one group of server;
(2) main control terminal sends to server in the mode of sliding screen by corresponding instruction, the described mode with sliding screen refers to by the mode of finger sliding terminal Touch Screen, sliding button, button click, corresponding instruction refers to the information that need to transmit the main control terminal user, comprises communications protocol, authentication information, system information, point-to-point information;
Described system information and point-to-point information are comprised of message header or message header and message body, described message header comprises the message SN generated by message transmission source terminal, in the message queue that described message SN generates in message transmission source terminal, be unique, and message SN is constant in once complete message process;
Described system information comprises binding instruction, the cancellation link order connected for disconnected end for setting up the terminal connection and inquires about the terminal inquiry instruction of online terminal list; Described point-to-point information comprises the different instruction of the different information of transmission between terminal, comprises that transmission of video instruction, voice transfer instruction, file transfer instruction, information transfer instruction, expression transfer instruction, paper slip transfer instruction, long-distance video or speech play instruction and video or voice status obtain instruction;
(3) server is processed, transfer, is broadcast to the controlled terminal connected with server described instruction;
(4) controlled terminal receive server or the instruction that directly sent by main control terminal after, operate accordingly according to instruction, thereby realize that the interaction between multiple terminals, alone family, between the multi-user multiple terminals shares;
When between main control terminal and controlled terminal, send when the transmission of video instruction, if during the video content that described video provides for system, main control terminal is video ID in server and the initial reproduction time of video to server transmission, and server is transferred to controlled terminal by the initial reproduction time of video playback address video again, if described video is the video in main control terminal the machine or passes through the video flowing that camera is taken in real time, first this video content is reached in server, server is compressed into by video file the video media file that different terminals is used by compression algorithm, and be distributed to corresponding streaming media server, use different broadcasting agreements according to different terminals, described agreement comprises http protocol, the RTSP agreement, the 3GPP agreement, the RTP/RTCP agreement, MMS (Microsoft Media Server) Protocol, proprietary protocol, the initial reproduction time of the video playback address video that will newly produce again is transferred to controlled terminal,
When between main control terminal and controlled terminal, send when the video editing transfer instruction, if during the video content that described video provides for system, main control terminal is the video ID in server, the initial reproduction time of video and end reproduction time, the video editing information of video to server transmission, server again by the end reproduction time of the initial reproduction time of video playback address, video and video, video editing communication to controlled terminal; If described video is the video in main control terminal the machine or passes through the video flowing that camera is taken in real time, first this video is completed the machine editor, again the video content editted is reached in server, server is compressed into by video file the video media file that different terminals is used by compression algorithm, and be distributed to corresponding streaming media server, then the video playback address transfer that will newly produce is to controlled terminal;
When between main control terminal and controlled terminal, send when the file transfer instruction, what between main control terminal and controlled terminal, by server, transmit is the file address in server, if being file or the terminal in main control terminal the machine, described file obtains shared file on network by sharing agreement, first file is reached in server, then the file address that will newly produce is transferred to controlled terminal;
What between main control terminal and controlled terminal, send is the voice transfer instruction, if during the voice content that described voice provide for system, what between main control terminal and controlled terminal, by server, transmit is the speech play address in server, if described voice are the voice in main control terminal the machine or the audio stream that passes through Mike or camera real-time recording, first voice are reached in server, then the speech play address transfer that will newly produce is to controlled terminal;
When between main control terminal and controlled terminal, send when the information transfer instruction, if the information that system provides, what between main control terminal and controlled terminal, by server, transmit is the address of information; If the information on the browser browse network that the user provides by system, the network address for the information browsed at browser of transmitting by server between main control terminal and controlled terminal;
When what send between main control terminal and controlled terminal, be while expressing one's feelings transfer instruction, what between main control terminal and controlled terminal, by server, transmit is the expression coding;
When between main control terminal and controlled terminal, send when the paper slip transfer instruction, main control terminal by server directly by the content delivery on paper slip to controlled terminal;
When between main control terminal and controlled terminal, send for long-distance video or speech play instruction the time, what between main control terminal and controlled terminal, by server, transmit is video or voice ID and initial reproduction time in server, if described video or voice are video or voice in main control terminal the machine, first video or voice are reached in server, server is compressed into by video or voice document the audiovisual media file that different terminals is used by compression algorithm, and be distributed to corresponding streaming media server, the audio frequency and video broadcast address that will newly produce again, the initial reproduction time of audio frequency and video is transferred to controlled terminal,
When main control terminal between controlled terminal, send obtain instruction for video or voice status the time, controlled terminal transfers to main control terminal by the current state of video or speech play by server after receiving this instruction, and described current state comprises video or voice ID and video or speech play time.
2. as claimed in claim 1ly a kind ofly by cunning, shield the interactive method of sharing that realizes between the multi-screen multi-user, it is characterized in that: in step (1), described login comprises manual entry and two kinds of modes of automatic login, and described manual entry refers to that the user inputs the mode that username and password is logined; Described automatic login refers to by hardware is identified as MAC Address, realizes the terminal mode of login automatically.
3. as claimed in claim 1ly a kind ofly by cunning, shield the interactive method of sharing that realizes between the multi-screen multi-user; it is characterized in that: described server is property server, comprises subscriber management server, continued broadcasting server, protocol instructions server, database server, Video processing server, CDN& Streaming media server, web services server, Streaming Media processing server.
4. as claimed in claim 1ly a kind ofly by cunning, shield and realize between the multi-screen multi-user the interactive method of sharing, it is characterized in that: described server is the server by software virtual;
If after main control terminal and controlled terminal login, judge that through network main control terminal and controlled terminal are in same LAN, main control terminal and controlled terminal communication will directly connect by communications protocol, at this time main control terminal or controlled terminal reception server function provide service, if the user opens function of local area network, main control terminal and controlled terminal are logined the virtual server by main control terminal or controlled terminal software creation, and directly set up the communication relation.
5. as claimed in claim 1ly a kind ofly by cunning, shield and realize between the multi-screen multi-user the interactive method of sharing, it is characterized in that: described communications protocol is ICP/IP protocol or proprietary protocol.
6. as claimed in claim 1ly a kind ofly by cunning, shield the interactive method of sharing that realizes between the multi-screen multi-user, it is characterized in that: in step (2), after main control terminal sends instruction to server, if do not receive server response information within the time of setting, declarative instruction sends unsuccessfully, need to resend;
After server sends instruction to controlled terminal, if do not receive the controlled terminal echo message within the time of setting, declarative instruction sends unsuccessfully, need to resend;
After main control terminal directly sends instruction to controlled terminal, if do not receive the controlled terminal echo message within the time of setting, declarative instruction sends unsuccessfully, need to resend, or the information that receiving terminal receives is imperfect, inaccurate, declarative instruction sends unsuccessfully, and receiving terminal proposes to resend demand.
7. as claimed in claim 6ly a kind ofly by cunning, shield the interactive method of sharing that realizes between the multi-screen multi-user, it is characterized in that: described echo message comprises synchronous echo message and asynchronous echo message, synchronous echo message refers to when main control terminal sends a message to server, after the online and successfully transmission information of discovering server controlled terminal, server returns to main control terminal immediately by the information processing result after receiving the information that controlled terminal successfully receives; Asynchronous echo message refers to that working as main control terminal sends to server by point-to-point message, the discovering server controlled terminal is not kept at server by information online, the wait controlled terminal receives, and after the online also successfully reception information of controlled terminal, server returns to main control terminal by the information processing result.
8. as arbitraryly as claim 1 to 7 describedly a kind ofly by cunning, shield the interactive method of sharing that realizes between the multi-screen multi-user, it is characterized in that: after main control terminal and/or controlled terminal and server are set up communications protocol and be connected, server end can send a heartbeat instruction to each terminal according to the temporal frequency of setting and determine whether each terminal is normal with being connected of server, and described heartbeat instruction is the information that is used for maintaining connection of default.
9. a kind of method that realizes that between the multi-screen multi-user, interaction is shared of shielding by cunning as claimed in claim 8, is characterized in that, by the heartbeat instruction, confirms terminal is connected with server whether normal concrete mode is:
If terminal gives a response server according to the heartbeat instruction, illustrate that server is connected normally with the network of terminal; If the terminal nonreply, server can disconnect being connected of current and this terminal, and this terminal need to again log in server and connect.
10. one kind shields by cunning the interactive system of sharing between the multi-screen multi-user that realizes, comprise user terminal and server, wherein said user terminal is divided into main control terminal and controlled terminal in logic from business, and described user terminal refers to mobile phone terminal, PDA mobile terminal, panel computer, computer terminal, internet television all-in-one or Set Top Box;
Wherein, described main control terminal: relative controlled terminal in logic for the file content on the mode sharing service device with sliding screen or upload the file content of sharing to server, and sends instruction by server to controlled terminal; Described instruction refers to the information that need to transmit the main control terminal user, comprises communications protocol, authentication information, system information, point-to-point information; Described system information and point-to-point information are comprised of message header or message header and message body, described message header comprises the message SN generated by message transmission source terminal, in the message queue that described message SN generates in message transmission source terminal, be unique, and message SN is constant in once complete message process;
Described controlled terminal: relative main control terminal in logic, the instruction forwarded for reception server, and carry out corresponding operating according to instruction, represent or play information or the file content in presence server;
Described server: refer to the intermediary service layer, it is the general designation of one group of server, property server or the virtual server that produced by software virtual, for the treatment of with the file content uploaded of each terminal of storage, and the transfer of main control terminal instruction and the transfer of controlled terminal return information, realize communicating by letter of main control terminal and controlled terminal;
Described server comprises subscriber management server, continued broadcasting server, protocol instructions server, database server, Video processing server, CDN& Streaming media server, web services server, Streaming Media processing server are that the server by software virtual provides service in the local area network (LAN) situation;
Wherein, the file medium content that described CDN server is uploaded for storage and the audiovisual media that provides of dissemination system and terminal, comprise " close " principle on Task Assigned Policy, geographical position according to the request user, select the interior node nearest from it of net that service is provided, avoid occurring the inter-network transfer of data as far as possible;
Described streaming media server is responsible for processing and store the audiovisual media that file medium content that each terminal uploads and system provide the broadcasting that audio and video stream media is provided, comprise http protocol streaming media server, RTSP protocol streams media server, 3GPP protocol streams media server, MMS (Microsoft Media Server) Protocol streaming media server, RTP/RTCP protocol streams media server, proprietary protocol streaming media server from agreement, streaming media server for media content is gathered, buffer memory, scheduling and to the user terminal transmission with play;
Described protocol instructions server is responsible for the transfer of main control terminal instruction and the transfer of controlled terminal return information, realizes communicating by letter of main control terminal and controlled terminal; In the local area network (LAN) situation, the virtual protocol commander server is for the transfer of main control terminal instruction and the transfer of controlled terminal return information, realizes communicating by letter of main control terminal and controlled terminal;
Described subscriber management server is for realizing the logging in of user, registration, good friend's block functions;
Described continued broadcasting server, for watching record of user and breakpoint record are provided, guarantees that the user can realize the continued broadcasting function.
11. a kind of system that realizes that between the multi-screen multi-user, interaction is shared of shielding by cunning as claimed in claim 10, is characterized in that, described Video processing server comprises with lower module:
The file receiver module, the file content of uploading for receiving each terminal;
Video coding and compression module, carry out encoding and decoding and compression for the video that each terminal is uploaded;
The file distributing module, be distributed to the streaming media server of different agreement for the video file by having compressed;
The data writing module, the state after uploading for the tracking of uploading data and record prompting user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110316489 CN102377823B (en) | 2011-10-18 | 2011-10-18 | Method and system for realizing interactive sharing among multiple screens and multiple users by sliding screens |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110316489 CN102377823B (en) | 2011-10-18 | 2011-10-18 | Method and system for realizing interactive sharing among multiple screens and multiple users by sliding screens |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102377823A CN102377823A (en) | 2012-03-14 |
| CN102377823B true CN102377823B (en) | 2013-12-25 |
Family
ID=45795773
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110316489 Expired - Fee Related CN102377823B (en) | 2011-10-18 | 2011-10-18 | Method and system for realizing interactive sharing among multiple screens and multiple users by sliding screens |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102377823B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103491424A (en) * | 2013-10-21 | 2014-01-01 | 天津网络广播电视台有限公司 | Server system for IPTV multi-screen interaction and multi-screen interaction achieving method |
Families Citing this family (82)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102595226A (en) * | 2012-03-16 | 2012-07-18 | 深圳市茁壮网络股份有限公司 | Wireless control method and set-top box |
| CN102611753B (en) * | 2012-03-21 | 2015-01-14 | 张雷 | System and method for controlling controlled equipment through mobile terminal based on cloud platform |
| CN103369723A (en) * | 2012-03-29 | 2013-10-23 | 鸿富锦精密工业（深圳）有限公司 | Handheld device and method for controlling roaming of multimedia data |
| CN102638774A (en) * | 2012-03-31 | 2012-08-15 | 王方淇 | Method and system for synchronously sharing mobile terminal data |
| CN106454472B (en) | 2012-05-17 | 2021-06-04 | 华为技术有限公司 | Multi-screen interaction method and system |
| CN103581704B (en) * | 2012-07-31 | 2017-07-07 | 华为技术有限公司 | The method and apparatus for realizing multi-screen interactive |
| CN102821015B (en) | 2012-08-07 | 2015-09-09 | 歌尔声学股份有限公司 | A kind of method and system realizing multimedia terminal in family and mutually control |
| US9424660B2 (en) | 2012-08-07 | 2016-08-23 | Intel Corporation | Media encoding using changed regions |
| US20140330957A1 (en) * | 2012-08-21 | 2014-11-06 | Intel Corporation | Widi cloud mode |
| CN102802048B (en) * | 2012-08-24 | 2015-08-05 | 乐视致新电子科技（天津）有限公司 | A kind of Multi-screen interaction system and method |
| CN102932412B (en) * | 2012-09-26 | 2016-02-03 | 华为终端有限公司 | Document transmission method and system, main control device |
| CN102882772A (en) * | 2012-10-15 | 2013-01-16 | 北京推博信息技术有限公司 | Instant messaging data transmission method, client, server and system |
| CN103517153B (en) * | 2012-11-30 | 2017-07-11 | Tcl集团股份有限公司 | It is a kind of to realize the method and system that multi-screen plays video with screen |
| FR2998995A1 (en) * | 2012-12-03 | 2014-06-06 | France Telecom | METHOD OF COMMUNICATION BETWEEN MULTIPLE USERS WITH COMMUNICATION TERMINALS THROUGH A VIRTUAL COMMUNICATION SPACE |
| CN103024448A (en) * | 2012-12-26 | 2013-04-03 | 武汉长光科技有限公司 | IPQAM (internet protocol quadrature amplitude modulation)-based multi-screen interacting method and IPQAM-based video terminal equipment |
| CN103078848B (en) * | 2012-12-27 | 2015-09-23 | 合一网络技术(北京)有限公司 | A kind of system and method for multi-screen fuse coordination |
| CN104023115A (en) * | 2013-03-01 | 2014-09-03 | 联想(北京)有限公司 | Method for information processing and electronic equipment |
| CN104104562B (en) * | 2013-04-01 | 2018-07-13 | 华为技术有限公司 | Method, client, server and the system of signaling are transmitted in home network |
| CN104125200B (en) * | 2013-04-25 | 2017-09-12 | 中国移动通信集团公司 | Multi-screen interaction method, equipment and system |
| CN103294193A (en) * | 2013-04-27 | 2013-09-11 | 天脉聚源(北京)传媒科技有限公司 | Multi-terminal interaction method, device and system |
| CN103313192A (en) * | 2013-06-25 | 2013-09-18 | 深圳市中兴移动通信有限公司 | Multiple-screen sharing method and system |
| CN103379125A (en) * | 2013-07-02 | 2013-10-30 | 李达航 | Multi-screen interaction method based on social network |
| JP2015012561A (en) * | 2013-07-02 | 2015-01-19 | ソニー株式会社 | Display device, information acquisition method and information provision method |
| CN103368961B (en) * | 2013-07-09 | 2015-12-23 | 李达航 | The method of multi-screen interactive is carried out by social networks |
| CN104090707A (en) * | 2013-07-11 | 2014-10-08 | 腾讯科技（北京）有限公司 | Method, device and system for sharing content between intelligent terminals |
| US9986044B2 (en) | 2013-10-21 | 2018-05-29 | Huawei Technologies Co., Ltd. | Multi-screen interaction method, devices, and system |
| CN103561315B (en) * | 2013-10-21 | 2018-05-04 | 华为技术有限公司 | The method, apparatus and system of a kind of multi-screen interactive |
| CN103581740B (en) * | 2013-10-25 | 2018-09-25 | 南京中兴软件有限责任公司 | A kind of distributed IPTV multi-screens gateway and IPTV multi-screen interaction methods |
| CN103647748A (en) * | 2013-11-14 | 2014-03-19 | 乐视致新电子科技（天津）有限公司 | Network-data-resource transmission method and device |
| CN103647996A (en) * | 2013-11-14 | 2014-03-19 | 乐视致新电子科技（天津）有限公司 | Data-resource transmission method and device |
| US20160295267A1 (en) * | 2013-11-14 | 2016-10-06 | Le Shi Zhi Xin Electronic Technology (Tianjin) Limited | Data resource transmission method and device |
| CN104717559A (en) * | 2013-12-13 | 2015-06-17 | 中国电信股份有限公司 | Method, video server and system for sharing online video |
| CN103686420B (en) * | 2013-12-13 | 2017-09-29 | 广州华多网络科技有限公司 | Good friend is invited to watch method, terminal, server and the system of video |
| CN103793133A (en) * | 2013-12-19 | 2014-05-14 | 弗徕威智能机器人科技（上海）有限公司 | Multi-screen interaction system and multi-screen interaction method applied to intelligent service robots |
| CN104836672B (en) * | 2014-02-10 | 2018-08-24 | 中国移动通信集团公司 | The method, apparatus of data transmission, system and terminal device in multi-screen interactive |
| CN104954406B (en) * | 2014-03-31 | 2018-12-07 | 中国电信股份有限公司 | Carry out the method and system of cloud data sharing |
| CN103974217B (en) * | 2014-05-06 | 2018-07-24 | 上海工程技术大学 | The method and its device of multi-screen service switching |
| CN103957218B (en) * | 2014-05-14 | 2018-09-28 | 刘瑞雪 | The method and system of shared media play |
| CN105100963B (en) | 2014-05-22 | 2017-12-22 | 纬创资通股份有限公司 | Audio/video media file synthesis method and service system |
| CN104092682A (en) * | 2014-07-04 | 2014-10-08 | 深圳深讯和科技有限公司 | Data interaction method and system |
| CN104202561B (en) * | 2014-08-13 | 2016-03-30 | 小米科技有限责任公司 | The method of play stream media data and device |
| CN104219308B (en) * | 2014-09-04 | 2018-09-25 | 百度在线网络技术（北京）有限公司 | The resource transmission method and device of equipment room |
| CN104301385A (en) * | 2014-09-05 | 2015-01-21 | 北京奇虎科技有限公司 | Data acquisition method, calculation equipment, mobile equipment and system |
| CN105573605A (en) * | 2014-10-10 | 2016-05-11 | 广州杰赛科技股份有限公司 | Interactive game method of mobile phone and computer |
| CN104486093B (en) * | 2014-11-19 | 2018-02-23 | 广州华多网络科技有限公司 | A kind of network interdynamic method and relevant device, system |
| CN104506789A (en) * | 2014-12-19 | 2015-04-08 | 天脉聚源(北京)传媒科技有限公司 | Projection method and device |
| CN105807733A (en) * | 2014-12-31 | 2016-07-27 | 北京国基科技股份有限公司 | Dispatching system and method |
| CN104717296A (en) * | 2015-03-25 | 2015-06-17 | 阳海龙 | Social contact interactive method, device, terminal and system |
| US20160309532A1 (en) * | 2015-04-20 | 2016-10-20 | Hisense Usa Corp. | Private social networking platform for real-time content sharing |
| CN104869445A (en) * | 2015-04-24 | 2015-08-26 | 惠州Tcl移动通信有限公司 | A method for realizing content sharing between intelligent terminals based on a cloud system and the cloud system |
| CN105657036B (en) * | 2016-02-02 | 2018-12-11 | 深圳市指点信息科技有限公司 | A kind of method and system of the point-to-point instant messages push based on multi-screen transmission |
| US10664220B2 (en) * | 2016-02-29 | 2020-05-26 | Sharp Kabushiki Kaisha | Display control device, display system, and display control method |
| CN105812838B (en) * | 2016-03-17 | 2018-12-04 | 深圳市九洲电器有限公司 | A kind of multi-screen interactive data sharing method and system |
| CN107205004A (en) * | 2016-03-18 | 2017-09-26 | 中兴通讯股份有限公司 | Multimedia interactive equipment wireless extensions method and multimedia interactive terminals |
| CN105812943B (en) * | 2016-03-31 | 2019-02-22 | 北京奇艺世纪科技有限公司 | A kind of video editing method and system |
| CN106131624A (en) * | 2016-07-15 | 2016-11-16 | 乐视控股（北京）有限公司 | Display packing and device |
| CN107959664A (en) * | 2016-10-18 | 2018-04-24 | 中兴通讯股份有限公司 | Implementation method, device and the platform that mobile terminal is interacted with IPTV |
| CN108243174B (en) * | 2016-12-27 | 2020-10-30 | 北京新唐思创教育科技有限公司 | Online live broadcast interaction system and method |
| CN106790576B (en) * | 2016-12-27 | 2020-01-31 | 深圳市汇龙建通实业有限公司 | interactive desktop synchronization method |
| CN107026866A (en) * | 2017-04-15 | 2017-08-08 | 陈中 | It is a kind of to transmit operational order and the live broadcasting method of audio |
| CN107193961B (en) * | 2017-05-24 | 2021-01-08 | 上海星佑网络科技有限公司 | Information recording method and apparatus |
| EP3627322A4 (en) | 2017-06-14 | 2020-04-29 | Beijing Xiaomi Mobile Software Co., Ltd. | Application interaction method, interaction method and device |
| CN108139952B (en) * | 2017-06-14 | 2022-08-05 | 北京小米移动软件有限公司 | Application interaction method, interaction method and device |
| CN107241640B (en) * | 2017-06-26 | 2019-05-24 | 中广热点云科技有限公司 | A kind of method that mobile device and television equipment are played simultaneously |
| CN107801065A (en) * | 2017-09-12 | 2018-03-13 | 捷开通讯(深圳)有限公司 | Multimedia file sharing method, equipment and system based on WiFi Display |
| CN107566523B (en) * | 2017-09-30 | 2021-02-05 | 深圳绰曦互动科技有限公司 | Cross-platform multi-screen interaction method, device and system |
| CN109379332A (en) * | 2018-09-08 | 2019-02-22 | 北京爱视界科技有限公司 | Multi-screen interactive display methods |
| CN109120645A (en) * | 2018-10-25 | 2019-01-01 | 北京大米未来科技有限公司 | A kind of file uploading method, device, electronic equipment and medium |
| CN109256132A (en) * | 2018-10-29 | 2019-01-22 | 华南农业大学 | A kind of message type information interaction system and method based on speech-sound intelligent identification |
| CN109413651B (en) * | 2018-11-28 | 2021-11-23 | 上海连尚网络科技有限公司 | Method and apparatus for connecting wireless access points |
| CN109741585B (en) * | 2018-12-12 | 2020-11-24 | 青岛海尔科技有限公司 | Communication control system and method |
| CN109672738A (en) * | 2018-12-24 | 2019-04-23 | 成都四方伟业软件股份有限公司 | A kind of method and system based on multi-screen interactive cross-terminal service |
| CN110233890B (en) * | 2019-06-11 | 2022-05-31 | 东软集团股份有限公司 | Interaction method and interaction system for multiple systems on chip on vehicle |
| CN110275532B (en) * | 2019-06-21 | 2020-12-15 | 珠海格力智能装备有限公司 | Robot control method and device and visual equipment control method and device |
| CN110594815A (en) * | 2019-09-05 | 2019-12-20 | 杭州德意电器股份有限公司 | Smoke stove linkage control system and control method based on reliability design |
| CN111669254B (en) * | 2020-06-08 | 2021-07-30 | 华中科技大学 | TCP (transmission control protocol) confirmation and mac confirmation joint processing method based on WiFi (Wireless Fidelity) network |
| CN111988080B (en) * | 2020-08-24 | 2022-05-31 | 深圳市青柠互动科技开发有限公司 | Satellite communication system and method |
| CN112511601B (en) * | 2020-11-16 | 2021-12-07 | 北京仁光科技有限公司 | Multi-screen data interaction system and multi-screen data interaction method |
| CN112565841A (en) * | 2020-12-03 | 2021-03-26 | 福建大屏网络科技有限公司 | Multi-screen interactive connection method and device |
| CN113053374B (en) * | 2021-03-05 | 2022-08-26 | 天九共享网络科技集团有限公司 | Large screen control system |
| CN112994957B (en) * | 2021-05-11 | 2021-09-14 | 西安羚控电子科技有限公司 | Intelligent expansion screen projection and interaction network management method and storage medium |
| CN113709406B (en) * | 2021-10-27 | 2022-03-08 | 广州朗国电子科技股份有限公司 | Software collaboration method, system and storage medium for Hongmon conference all-in-one machine |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1860788A (en) * | 2003-05-16 | 2006-11-08 | 比卡萨有限公司 | Methods and systems for image sharing over a network |
| CN101150484A (en) * | 2006-09-21 | 2008-03-26 | 周伟 | Method and system for remotely playing slide photos by using computer background |
| CN101296201A (en) * | 2008-06-25 | 2008-10-29 | 腾讯科技（深圳）有限公司 | Network information sharing method, system and instant communication device |
| CN201243312Y (en) * | 2008-07-07 | 2009-05-20 | 周爱红 | Geographical information inquiry system based on touch screen and network |
| CN102033697A (en) * | 2009-09-28 | 2011-04-27 | 索尼公司 | Terminal apparatus, server apparatus, display control method, and program |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102196013A (en) * | 2010-03-16 | 2011-09-21 | 袁兰 | Method for remotely controlling video playing storage box terminal from mobile phone terminal |
| US8893022B2 (en) * | 2010-04-01 | 2014-11-18 | Microsoft Corporation | Interactive and shared viewing experience |
| CN102130900A (en) * | 2010-12-26 | 2011-07-20 | 青岛海信宽带多媒体技术有限公司 | Method and device for realizing three-screen interaction |
-
2011
- 2011-10-18 CN CN 201110316489 patent/CN102377823B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1860788A (en) * | 2003-05-16 | 2006-11-08 | 比卡萨有限公司 | Methods and systems for image sharing over a network |
| CN101150484A (en) * | 2006-09-21 | 2008-03-26 | 周伟 | Method and system for remotely playing slide photos by using computer background |
| CN101296201A (en) * | 2008-06-25 | 2008-10-29 | 腾讯科技（深圳）有限公司 | Network information sharing method, system and instant communication device |
| CN201243312Y (en) * | 2008-07-07 | 2009-05-20 | 周爱红 | Geographical information inquiry system based on touch screen and network |
| CN102033697A (en) * | 2009-09-28 | 2011-04-27 | 索尼公司 | Terminal apparatus, server apparatus, display control method, and program |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103491424A (en) * | 2013-10-21 | 2014-01-01 | 天津网络广播电视台有限公司 | Server system for IPTV multi-screen interaction and multi-screen interaction achieving method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102377823A (en) | 2012-03-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102377823B (en) | Method and system for realizing interactive sharing among multiple screens and multiple users by sliding screens | |
| EP3800893B1 (en) | Systems and methods for transmission of data streams | |
| CN102859965B (en) | Method and the electronic installation of content of multimedia are provided | |
| CN103491179B (en) | Multi-screen interaction method and system based on Web | |
| CN103518351B (en) | Use the IP broadcast streaming services distribution of file delivery method | |
| CN102571979B (en) | Multi-screen interactive equipment and its binding method | |
| CN105354002B (en) | A kind of system and method for realizing video seamless switching between multi-screen | |
| US20120287231A1 (en) | Media sharing during a video call | |
| CN105637472B (en) | The frame of screen content shared system with the description of broad sense screen | |
| US9172594B1 (en) | IPv6 to web architecture | |
| JP6007697B2 (en) | Cache device, cache program, and content distribution system | |
| CN103348657B (en) | Flow media playing method, equipment and system | |
| US11374992B2 (en) | Seamless social multimedia | |
| CN104168453A (en) | Method for implementing video monitoring stream media application system | |
| CN107819809A (en) | The method and device of operation is synchronized to content | |
| KR20130009446A (en) | System and method for contents sharing, device and computer readable medium storing the method | |
| CN103167327A (en) | Method, device and system of information interaction | |
| CN109842819A (en) | A kind of video playing interactive approach, device, system, user terminal and medium | |
| CN107547517B (en) | Audio and video program recording method, network equipment and computer device | |
| CN205230019U (en) | System for realize video seamless handover between many screens | |
| CN107749834A (en) | A kind of method for automating the multicast Streaming Media for adapting to network topology chain environment | |
| CN108259530A (en) | A kind of remote control thereof and intelligent terminal and server cluster in XMPP systems | |
| KR20020050903A (en) | Education, Broad Casting, Multi-User Image Conference and Chatting Service Provision Method Using Internet | |
| KR20100121376A (en) | Group communication method in media server system with distributed structure | |
| CN105900433A (en) | Method for providing a content part of a multimedia content to a client terminal, corresponding cache |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20181106 Address after: 519000 -264, 110 room 18, creative Valley 18, 1889 East Ring Road, Hengqin New District, Guangdong. Patentee after: Hengqin excellent network technology Co., Ltd. Address before: 100022 the 25 floor of block B, general international center, 3 East Lane, Chaoyang District, Jian Wai Street, Beijing, Chaoyang District. Patentee before: Beijing Union Voole Technology Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20131225 Termination date: 20191018 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |