CN108829482A - Data cooperative transmission control system, method, storage medium and interactive device - Google Patents
Data cooperative transmission control system, method, storage medium and interactive device Download PDFInfo
- Publication number
- CN108829482A CN108829482A CN201810636792.XA CN201810636792A CN108829482A CN 108829482 A CN108829482 A CN 108829482A CN 201810636792 A CN201810636792 A CN 201810636792A CN 108829482 A CN108829482 A CN 108829482A
- Authority
- CN
- China
- Prior art keywords
- control instruction
- receiving end
- instruction
- receiving
- preset condition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Abstract
The present invention relates to a kind of data cooperative transmission control system, method, storage medium and interactive devices, belong to technical field of data transmission, system includes：Video sending end and at least one receiving end, video sending end are source screen end, establish video circulation road and control instruction channel, receive the control instruction of at least one receiving end sending respectively by control instruction channel；According to locking preset condition, one of receiving end is selected, the control instruction issued to the receiving end successively responds, and meets the control instruction for unlocking preset condition until receiving the receiving end and issuing；When receiving end quantity is excessive, video sending end further includes forwarding media stream server and control instruction server, establishes video circulation road using forwarding media stream server, control instruction server establishes control instruction channel.The present invention effectively solves desktop and synchronizes conflict caused by more people while control and response confusion, and greatly reduces the Capability Requirement of computing capability and the network routing to source screen end.
Description
Technical field
The present invention relates to technical field of data transmission more particularly to a kind of data cooperative transmission control systems, method, storage
Medium and interactive device.
Background technique
As the screen (source screen end) of an equipment is shared with multiple other equipment by the continuous development for passing screen technology
Screen (receiving end), and realize that receiving end interacts the interactive operation at source screen end by way of touching passback, become one
Kind trend.
Under this biography screen mode, the same time might have receiving end while carry out a little to the same place in source screen end
Passback is hit and touches, if source screen end will clash and cause response mixed without good multiple person cooperational control method
Disorderly.
Summary of the invention
In view of above-mentioned analysis, the present invention is intended to provide data cooperative transmission control system, method, storage medium and interaction
Equipment realizes the synchronously control that data are transmitted between multiple receiving ends and source screen end, solves multiple receiving ends simultaneously to source screen
Curtain end sends conflict caused by instruction and response is chaotic.
The purpose of the present invention is mainly achieved through the following technical solutions：
In a first aspect, the embodiment of the invention provides a kind of data cooperative transmission control systems, including：Video sending end,
Video stream data is sent at least one receiving end by video circulation road；At least one is received respectively by control instruction channel
The control instruction that receiving end issues selectes one of receiving end according to locking preset condition, the control issued to the receiving end
Instruction is successively responded；According to unlock preset condition, terminate response；
At least one receiving end is respectively used to send video stream data by video flowing channel reception video sending end；And
Control instruction is sent by control instruction channel.
Second aspect, the embodiment of the invention provides a kind of data cooperative transmission control methods, including：
Video stream data is sent at least one receiving end by video circulation road；
Receive the desktop control instruction of at least one receiving end sending respectively by control instruction channel；
The selected receiving end for being able to satisfy locking preset condition at first, receives the control instruction of the receiving end, and successively carry out
Response meets the control instruction for unlocking preset condition until receiving the receiving end and issuing.
The third aspect, the embodiment of the invention provides a kind of interactive intelligence equipment, including：
Video flowing path setup module passes through video circulation road for establishing video circulation road at least one receiving end
Video stream data is sent to receiving end；
Control instruction path setup module, for establishing control instruction channel at least one receiving end；
Control instruction receiving module, the control for being sent by least one receiving end of control instruction channel reception refer to
It enables；
Control instruction selectes respond module, for one of receiving end being selected, to the reception according to locking preset condition
The control instruction that end issues successively is responded；According to unlock preset condition, terminate response.
Fourth aspect, the embodiment of the invention provides a kind of storage medium comprising computer executable instructions, the meters
Calculation machine executable instruction by computer processor when being executed for executing data cooperative transmission as described in the embodiments of the present invention
Control method.
The present invention has the beneficial effect that：
The present invention realizes the desktop simultaneous display of source screen end and receiving end by the video circulation road established, and uses
Family can share the desktop contents at source screen end by the screen of receiving end, and by the touch event of receiving end screen or mouse thing
Part forms control instruction and passes back to source screen end, realizes and interacts to the interactive operation at source screen end；And source screen end according to
Whether control instruction meets locking preset condition instruction, selectes receiving end and carries out control instruction reception response, effectively solution desktop
It synchronizes conflict caused by more people while control and response is chaotic；
It is excessive in order to solve receiving end quantity, computing capability to source screen end and network routing capabilities are demanding asks
Topic, the present invention realizes one-to-many screen video stream by means of high performance forwarding media stream server and sends, by control
Commander server realizes many-to-one control instruction and receives, and greatly reduces computing capability and the network routing to source screen end
Capability Requirement.
Other features and advantages of the present invention will illustrate in the following description, also, partial become from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention can be by written explanation
Specifically noted structure is achieved and obtained in book, claims and attached drawing.
Detailed description of the invention
Attached drawing is only used for showing the purpose of specific embodiment, and is not to be construed as limiting the invention, in entire attached drawing
In, identical reference symbol indicates identical component.
Fig. 1 is the system composition schematic diagram of the embodiment of the present invention one；
Fig. 2 is source screen end composition schematic diagram in the embodiment of the present invention one；
Fig. 3 is the composition schematic diagram of receiving end in the embodiment of the present invention one；
Fig. 4 is the system composition schematic diagram of the embodiment of the present invention two；
Fig. 5 is control instruction server composition schematic diagram in the embodiment of the present invention two；
Fig. 6 is source screen end composition schematic diagram in the embodiment of the present invention two；
Fig. 7 is the method flow schematic diagram of the embodiment of the present invention；
Fig. 8 is the interactive intelligence equipment composition schematic diagram in the embodiment of the present invention four.
Specific embodiment
Specifically describing the preferred embodiment of the present invention with reference to the accompanying drawing, wherein attached drawing constitutes the application a part, and
Together with embodiments of the present invention for illustrating the principle of the present invention.
Embodiment one
Fig. 1 is a kind of composition schematic diagram of data cooperative transmission control system provided in this embodiment, as shown in Figure 1, packet
It includes, video sending end and 4 receiving ends (120~123)；
It should be noted that the number of receiving end is not limited to the present embodiment the number provided, the number of the receiver with
Computing capability and network routing capabilities no more than source screen end are limited to limit.
In system, video sending end includes source screen end 110, establishes video flowing between the source screen end and each receiving end
Channel and control instruction channel；Each video circulation road or control instruction channel can use the channel socket.
Specifically, source screen end and all receiving ends are arranged under the same local area network；Source screen end can be used solid
Fixed IP address and port numbers, receiving end establish one based on TCP's or UDP with it by the IP address and port at source screen end
Socket is connected to video circulation road, and video stream data is sent to all receptions by the video circulation road by source screen end
End.
Optionally, source screen end and receiving end are all connected under the hot spot that the same router is sent；
Optionally, screen end in source broadcasts the IP address of oneself and port to local area network using the mode of udp broadcast, together
Receiving end in one local area network can all receive this broadcast.
The socket based on TCP or UDP is established with it by the IP address and port at source screen end in each receiving end
It is connected to control instruction channel, relevant control instruction is sent to by receiving end by the control instruction channel of above-mentioned foundation
Source screen end.
Source screen end 110 sends screen video stream to each receiving end (120~123) by video circulation road；
Source screen end 110 obtains the control instruction of at least one receiving end sending by synchronously control instruction path.
The control instruction that receiving end issues can be by receiving end according to itself the desktop touch event got, according to certain
Format pack；Mouse event caused by the desktop coordinate on screen can also be clicked as receiving end mouse, according to one
Fixed format is packed.
Specifically, the control instruction format that receiving end issues can be defined as：Device id, instruction type, coordinate x,
y}}；Wherein,
Device id is a random UUID, represents a unique receiving end；
Instruction type includes：It presses, it is mobile, it lifts；
Coordinate { x, y } is a two-dimensional coordinate.
For example, generating a touch event pressed on a receiving end screen, it is packaged into the encapsulation of desktop control instruction
{ XXJJDUUDUDU is pressed, { 300,200 } } as follows；Wherein, " XXJJDUUDUDU " is the device id of this receiving end, " is pressed
Under " it is the type instructed, { 300,200 } are the specific coordinate pressed in receiving end screen；
Wherein, coordinate can use the screen coordinate of receiving end.
It is special, in order to avoid drawing since receiving end and source screen end screen size are inconsistent and coordinate space is inconsistent
The coordinate position deviation risen, it is also an option that taking uniform coordinate space coordinate.
Uniform coordinate space is obtained disclosed in the present embodiment, including：
The coordinate space for defining receiving end is (Xr,Yr), destination coordinate space is (Xo,Yo), source screen end coordinate space is
(Xs,Ys)；
Receiving end is by the coordinate value (x of screen touch eventr,yr) pass through coordinate transformWithBecome
It is changed to object space coordinate value (xo,yo),
Extract object space coordinate value in source screen end；And by object space coordinate value (xo,yo) pass through coordinate transformWithIt is transformed to the actual coordinate value (X at source screen ends,Ys).Wherein, destination coordinate space (Xo,Yo)
Greater than the receiving end screen coordinate space (Xr,Yr) and source screen end screen coordinate space (Xs,Ys).Make to connect by this method
The clearly fixed of coordinate points, when the screen-sized of other side is unknown, is realized when carrying out coordinate transmission in receiving end and source screen end
Position.
For example, the coordinate space of receiving end is (1366,768), destination coordinate space is (65535,65535), source screen
Holding coordinate space is (1920,1080)；
When a touch point coordinate of receiving end screen is (100,200), converted by coordinate, relative to object space
Coordinate value is (100/1920*65535,200/1080*65535)=(3414,12136), is sent out with this coordinate value to source screen end
It send, the coordinate value that source screen end receives is (3414,12136)；The coordinate for being converted to local Coordinate System by coordinate again, obtains
(3414*1366/65535,12136*768/65535)=(71,142), the coordinate are the seat in the screen local Coordinate System of source
Mark.
Fig. 2 gives the composition schematic diagram at source screen end, as shown in Fig. 2, source screen end 110 includes command reception module
210, instruction queue module 220, instruction respond module 230 and desktop video stream sending module 240；
Wherein,
Command reception module 210, the control instruction sent for receiving at least one described receiving end are default according to locking
Condition selectes one of receiving end, and the control instruction issued to the receiving end is sequentially output instruction queue module 220；Root
According to unlock preset condition, terminate output；
The original state of command reception module 210 is unlocked state；
Wherein, locking preset condition to be currently is unlocked state, and receiving instruction type is the control instruction pressed；
Wherein, unlocking preset condition to be currently is locking state, and receiving instruction type is the control instruction lifted.
It is special, when the command reception module 210 for having selected receiver is more than that preset time does not receive instruction, can also solve
Lock；Wherein, the preset time can be customized, such as 2 seconds.
Common, after selected, the subsequent desktop control instruction for being stored in instruction queue is：Device id and select time-of-the-day order
Identical, instruction type is the control instruction of " movement ".
The specific course of work：The original state of command reception module 210 is unlocked state；Command reception module 210
The control instruction issued from different receiving ends is received, the control instruction that instruction type is " pressing " is judged whether there is, if so, then
The control instruction is exported to instruction queue module, the receiving end for issuing the control instruction is selected, subsequent receives and the control
Commander equipment ID is identical, and instruction type is the control instruction of " movement ", is sequentially output to instruction queue module；It is set until receiving
Standby ID is identical, and instruction type is the control instruction of " lifting ", which is exported to instruction queue module, command reception module
210 switch to unlocked state.
Instruction queue module 220 is the storage queue of a first in first out, successively that described instruction receiving module 210 is defeated
Control instruction out is stored in the tail portion of storage queue；
Respond module 230 is instructed, for reading control instruction from the storage queue head of described instruction Queue module sequence,
Instruction is successively responded.
Desktop video stream sending module 240 obtains the desktop data at source screen end, is sent to reception by video circulation road
The desktop simultaneous display at source screen end and receiving end is realized at end.
Fig. 3 gives the composition schematic diagram of receiving end, as shown in figure 3, receiving end passes through video flowing channel reception source screen
End sends video stream data；And control instruction is sent by control instruction channel, it specifically includes：Video flowing receiving module 310 is sat
Mark acquisition module 320 and instruction sending module 330；
Video flowing receiving module 310, the screen video stream for being sent by video flowing channel reception source screen end, is realized
The desktop simultaneous display at source screen end and receiving end；
Coordinate acquisition module 320 is sent to instruction sending module for acquiring the touch event of receiving end screen,
Instruction sending module 330 is packaged into control instruction for the touch event according to acquisition, logical by control instruction
Road is sent to source screen end.
In conclusion the data cooperative transmission control system of the embodiment of the present invention is realized by the video circulation road of foundation
The desktop simultaneous display at source screen end and receiving end makes user that can share the desktop at source screen end by the screen of receiving end
Content, and the touch event of receiving end screen or mouse event are formed into control instruction and pass back to source screen end, it realizes to source screen
The interactive operation interaction at curtain end；And source screen end is instructed according to whether control instruction meets locking preset condition, selected to connect
Receiving end carries out control instruction and receives response, and effectively solution desktop synchronizes conflict caused by more people while control and response confusion；
Computing capability and network routing since source screen end directly transmits multichannel screen video flow data, to source screen end
Capability Requirement is higher.The synchronous multiple person cooperational control equipment of the desktop of the present embodiment is suitble to source screen end to fewer reception
End is communicated.
Embodiment two
Fig. 4 is a kind of composition schematic diagram of data cooperative transmission control system provided in this embodiment, as indicated at 4, including,
Source screen end 410, forwarding media stream server 430, control instruction server 440 and multiple receiving ends (420~42N), wherein
Source screen end 410, forwarding media stream server 430 and control instruction server 440 form video sending end, the number of receiver
It is limited to limit with the computing capability and network routing capabilities of forwarding media stream server and control instruction server.
Forwarding media stream server 430 establishes the video circulation road at source screen end 410 Yu multiple receiving ends, passes through video flowing
Channel, source screen end 410 send screen video and flow to each receiving end；Realization source screen end is synchronous with the desktop of receiving end aobvious
Show；
Control instruction server 440 establishes the control instruction channel at source screen end 410 Yu multiple receiving ends, is referred to by control
Channel is enabled, source screen end 410 is made to obtain the control instruction of receiving end.
Source screen end 410, forwarding media stream server 430, control instruction server 440 and multiple receiving ends (420~
42N) it is arranged under the same local area network, the IP address and port of forwarding media stream server 430 and control instruction server 440
Using fixed or dynamic IP address and port numbers, receiving end (420~42N) and screen source 410 respectively with media services
Device establishes the socket based on TCP or UDP and is connected to video circulation road；Receiving end (420~42N) and screen source 410
The socket based on TCP or UDP, which is established, with control instruction server 440 respectively is connected to control instruction channel.
When further, using udp broadcast mode, forwarding media stream server 430 or control instruction server 440 are certainly
Oneself IP address and port is broadcasted to local area network, and it is wide that the receiving end or screen source in the same local area network can all receive this
It broadcasts.
In system, control instruction server 440 receives the sending of at least one receiving end by control instruction channel respectively
Control instruction；The selected receiving end for being able to satisfy locking preset condition at first, receives the control instruction of the receiving end, and be sequentially output
To source screen end 410, meet the control instruction for unlocking preset condition until receiving the receiving end and issuing.The format of control instruction
It is identical with embodiment one.
Specifically, as shown in figure 5, control instruction server 440 includes command reception module 510, instruction queue 520 and refers to
Enable sending module 530；
Wherein,
Command reception module 510, the control instruction sent for receiving at least one described receiving end are default according to locking
Condition selectes one of receiving end, and the control instruction which issues is sequentially output instruction queue module 520；Root
According to unlock preset condition, terminate output；Wherein, locking preset condition and unlock preset condition can choose in embodiment one
Identical preset condition；
Instruction queue module 520 is the storage queue of a first in first out, successively that described instruction receiving module 510 is defeated
Control instruction out is stored in the tail portion of storage queue；
Respond module 530 is instructed, for reading control instruction from the storage queue head of described instruction Queue module sequence,
It is sent to source screen end 410.
As shown in fig. 6, source screen end 410 includes command reception module 610 and instruction respond module 620；
Command reception module 610 sequentially receives the instruction of the transmission of instruction sending module 530, is output to instruction respond module
620；
Respond module 620 is instructed, the instruction successively exported to command reception module 610 responds, and completes to touch passback.
Since source screen end can only send screen video flow data all the way, computing capability and network routing capabilities are all transferred to
High-performance forwarding media stream server；Therefore, the computing capability and network routing capabilities at source screen end are not required, this reality
The synchronous multiple person cooperational control equipment of desktop for applying example is suitble to source screen end to communicate more receiving end, for example, 1
A source screen end is to 50 receiving ends.
In conclusion the video circulation road that the present embodiment uses forwarding media stream server to establish, realizes source screen end
With the desktop simultaneous display of receiving end, make user that can share the desktop contents at source screen end by the screen of receiving end；Using
The touch event of receiving end screen or mouse event are formed control instruction by the control instruction channel that control instruction server is established
Pass back to source screen end, realizes and the interactive operation at source screen end is interacted；And it effectively solves desktop and synchronizes more people while controlling
Caused conflict and response are chaotic；
It is excessive in order to solve receiving end quantity, computing capability to source screen end and network routing capabilities are demanding asks
Topic, the present invention realizes one-to-many screen video stream by means of high performance forwarding media stream server and sends, by control
Commander server realizes many-to-one control instruction and receives, and greatly reduces computing capability and the network routing to source screen end
Capability Requirement.
Embodiment three
Fig. 7 is that a kind of flow chart of data cooperative transmission control method provided in this embodiment specifically includes as shown with 7：
Step S710, video circulation road is established；
Video stream data is sent at least one receiving end by video circulation road；
Specifically, video circulation road can be established using with identical method in embodiment one.
Step S720, control instruction channel is established；
Specifically, control instruction channel can be established using with identical method in embodiment one.
Step S730, the control instruction of at least one receiving end sending is received respectively by control instruction channel；
The control instruction that receiving end issues can be by receiving end according to itself the desktop touch event got, according to certain
Format pack；Mouse event caused by the desktop coordinate on screen can also be clicked as receiving end mouse, according to one
Fixed format is packed.
Specifically, the control instruction format definition that receiving end issues includes：{ device id, instruction type, coordinate { x, y } }；
Wherein,
Device id is a random UUID, represents a unique receiving end；
Instruction type includes：It presses, it is mobile, it lifts；
Coordinate { x, y } is a two-dimensional coordinate.
For example, generating a touch event pressed on a receiving end screen, it is packaged into the encapsulation of desktop control instruction
{ XXJJDUUDUDU is pressed, { 300,200 } } as follows；Wherein, " XXJJDUUDUDU " is the device id of this receiving end, " is pressed
Under " it is the type instructed, { 300,200 } are the specific coordinate pressed in receiving end screen；
Wherein, coordinate can use the screen coordinate of receiving end.
It is special, in order to avoid drawing since receiving end and source screen end screen size are inconsistent and coordinate space is inconsistent
The coordinate position deviation risen, can choose and take uniform coordinate space coordinate；
Specifically, can use and identical method uniform coordinate space in embodiment one.
Step S740, according to locking preset condition, one of receiving end is selected, the control instruction issued to the receiving end
Successively responded；According to unlock preset condition, terminate response；
It specifically includes：
Step S741, selected to issue the receiving end for meeting locking preset condition instruction, the control which is continuously sent out
System instruction, sequence storage to instruction queue tail portion；
Original state is unlocked state；From the control instruction that multiple receiving ends issue, satisfaction locking is judged whether there is
The desktop control instruction of preset condition is selected to issue and be somebody's turn to do if so, then storing the desktop control instruction to instruction queue tail portion
The receiving end of desktop control instruction, subsequent receives the desktop control instruction of receiving end transmission, successively puts to instruction queue tail
Portion；
Wherein, locking preset condition to be currently is unlocked state, and receives the control instruction that instruction type is " pressing "；
Step S742, circulation obtains desktop control instruction from instruction queue head, sends desktop control to selected receiving end
System instruction is responded；
Common, instruction queue is after selected, that is, subsequent to be stored in finger after receiving the instruction that instruction type is " pressing "
The desktop control instruction for enabling queue is：Device id with select time-of-the-day order identical, instruction type be " movement " desktop control instruction.
Step S743, it after receiving and responding the receiving end and issue the control instruction for meeting unlock preset condition, is transferred to
Unlocked state；
Wherein, unlocking preset condition to be currently is locking state, and receives the control instruction that instruction type is " lifting ".
Special, when being more than that preset time does not receive instruction, it is transferred to unlocked state, it is pre- to select sending satisfaction locking again
If the receiving end of conditional order；Wherein, the preset time can be customized, such as 2 seconds.
Method in the present embodiment, when in receiving end, quantity is less than the computing capability and network routing capabilities at source screen end,
Video circulation road and control instruction channel are established by source screen end, the selected receiving end for being able to satisfy locking preset condition at first connects
The control instruction of the receiving end is received, and is successively responded, meets unlock preset condition until receiving the receiving end and issuing
Control instruction；
When in receiving end, quantity is more than the computing capability and network routing capabilities at source screen end, by forwarding media stream server
Video circulation road is established, control instruction channel is established by control instruction server；Control instruction is passed through by control instruction server
Channel receives the control instruction of at least one receiving end sending respectively, selected to be able to satisfy the receiving end for locking preset condition at first,
The control instruction of the receiving end is received, and is sequentially output source screen end, meets solution until receiving the receiving end and issuing
Lock the control instruction of preset condition.
In conclusion the data cooperative transmission control method of the embodiment of the present invention is realized by the video circulation road of foundation
The desktop simultaneous display at source screen end and receiving end makes user that can share the desktop at source screen end by the screen of receiving end
Content, and the touch event of receiving end screen or mouse event are formed into control instruction and pass back to source screen end, it realizes to source screen
The interactive operation interaction at curtain end；And source screen end is instructed according to whether control instruction meets locking preset condition, selected to connect
Receiving end carries out control instruction and receives response, and effectively solution desktop synchronizes conflict caused by more people while control and response confusion.
Example IV
As shown in figure 8, a kind of intelligent interaction device is present embodiments provided, including：Video flowing channel module 810, control
Instruction path module 820, control instruction receiving module 830 and control instruction select respond module 840；
Wherein, video flowing path setup module 810 establishes video circulation road at least one receiving end, passes through video flowing
Channel sends video stream data to receiving end；
Specifically, video circulation road can be identical as the video circulation road in embodiment one.
Control instruction path setup module 820 establishes control instruction channel at least one receiving end；
Specifically, control instruction channel can be identical as the control instruction channel in embodiment one.
Control instruction receiving module 830 receives the control instruction of at least one receiving end transmission；
Specifically, the control instruction that issues of receiving end can by receiving end according to itself the desktop touch event got,
It is packed according to certain format；Mouse thing caused by the desktop coordinate on screen can also be clicked as receiving end mouse
Part is packed according to certain format.
Specific receiving end control instruction format is identical as the instruction format in embodiment one.
Control instruction selectes respond module 840, for one of receiving end being selected, to this according to locking preset condition
The control instruction that receiving end issues successively is responded；According to unlock preset condition, terminate response；
Further, selected respond module 840 is instructed to specifically include chosen module 841, memory module 842 and respond module
843。
Chosen module 841 supports the reception for the selected receiving end for issuing control instruction and meeting locking preset condition
The control instruction that supervention goes out, is sequentially outputted to memory module 842；
The original state for instructing chosen module 841 is unlocked state；The control instruction issued from least one receiving end
In, the desktop control instruction for meeting locking preset condition is judged whether there is, if so, then exporting the desktop control instruction to depositing
Module 842 is stored up, the receiving end for issuing the desktop control instruction is selected, subsequent receives the control instruction of receiving end transmission, according to
It is secondary to export to memory module 842；After the control instruction received meets unlock preset condition, it is transferred to unlocked state.
Wherein, locking preset condition to be currently is unlocked state, and receiving instruction type is the control instruction pressed；
Wherein, unlocking preset condition to be currently is locking state, and receiving instruction type is the control instruction lifted.
Special, when being more than that preset time does not receive instruction, it is also transferred to unlocked state, selectes again and issues satisfaction locking
The receiving end of preset condition instruction；Wherein, the preset time can be customized, such as 2 seconds.
Common, instruction queue is after selected, that is, subsequent to be stored in finger after receiving the instruction that instruction type is " pressing "
The desktop control instruction for enabling queue is：Device id with select time-of-the-day order identical, instruction type be " movement " desktop control instruction.
Memory module 842 includes a first in first out storage queue, and the control instruction for successively exporting chosen module 841 is protected
There are the tail portions of storage queue.
Respond module 843 recycles from the head of the storage queue of memory module 842 and obtains control instruction, and to control instruction
It is responded.
And the receiving end that the present embodiment interactive intelligence equipment is attached is identical as the receiving end in embodiment one.
In conclusion the intelligent interaction device of the embodiment of the present invention realizes source screen by the video circulation road of foundation
The desktop simultaneous display at end and receiving end makes user that can share the desktop contents at source screen end by the screen of receiving end, and
The touch event of receiving end screen or mouse event are formed into control instruction and pass back to interactive intelligence equipment, realizes interactive behaviour
It interacts；And interactive intelligence equipment is instructed according to whether control instruction meets locking preset condition, and selected receiving end is controlled
Command reception response processed, effectively solves conflict caused by desktop synchronizes more people while controlling and response is chaotic.
Embodiment five
A kind of computer program product is present embodiments provided, when the instruction processing unit in the computer program product is held
When row, the data cooperative transmission control method of any of the above-described embodiment is executed.
The embodiment of the present invention four also provides a kind of storage medium comprising computer executable instructions, and the computer can be held
Row instruction by computer processor when being executed for executing any technical solution in embodiment three.
Certainly, data cooperative transmission control method provided by the embodiment of the present invention.Its computer executable instructions is unlimited
In data cooperative transmission control method as described above, data transmission provided by any embodiment of the invention association can also be performed
Make the relevant operation in control method, has corresponding function and beneficial effect.
By the description above with respect to embodiment, it is apparent to those skilled in the art that, the present invention
It can be realized by software and required common hardware, naturally it is also possible to which by hardware realization, but in many cases, the former is more
Good embodiment.Based on this understanding, technical solution of the present invention substantially in other words contributes to the prior art
Part can be embodied in the form of software products, which can store in computer readable storage medium
In, floppy disk, read-only memory (Read-Only Memory, ROM), random access memory (Random such as computer
Access Memory, RAM), flash memory (FLASH), hard disk or CD etc., including some instructions are with so that a computer is set
Standby (can be personal computer, server or the network equipment etc.) executes method described in the embodiment of the present invention.
It is worth noting that, included modules are only in the embodiment of the equipment of above-mentioned sampled point Effective judgement
It is to be divided according to the functional logic, but be not limited to the above division, as long as corresponding functions can be realized；Separately
Outside, the specific name of each functional unit is also only for convenience of distinguishing each other, the protection scope being not intended to restrict the invention.
It will be understood by those skilled in the art that realizing all or part of the process of above-described embodiment method, meter can be passed through
Calculation machine program is completed to instruct relevant hardware, and the program can be stored in computer readable storage medium.Wherein, institute
Stating computer readable storage medium is disk, CD, read-only memory or random access memory etc..
The foregoing is only a preferred embodiment of the present invention, but scope of protection of the present invention is not limited thereto,
In the technical scope disclosed by the present invention, any changes or substitutions that can be easily thought of by anyone skilled in the art,
It should be covered by the protection scope of the present invention.
Claims (11)
1. a kind of data cooperative transmission control system, which is characterized in that including：
Video sending end sends video stream data at least one receiving end by video circulation road；Pass through control instruction channel
The control instruction for receiving the sending of at least one receiving end respectively selectes one of receiving end, to this according to locking preset condition
The control instruction that receiving end issues successively is responded；According to unlock preset condition, terminate response；
At least one receiving end is respectively used to send video stream data by video flowing channel reception video sending end；And pass through
Control instruction channel sends control instruction.
2. data cooperative transmission control system according to claim 1, which is characterized in that
The locking preset condition be currently be unlocked state, and receiving instruction type is the control instruction pressed；
The unlock preset condition be currently be locking state, and receiving instruction type is the control instruction lifted.
3. data cooperative transmission control system according to claim 1, which is characterized in that
The video sending end includes source screen end, and source screen end includes：
Command reception module, the control instruction sent for receiving at least one described receiving end, according to locking preset condition, choosing
Fixed one of receiving end, is sequentially output instruction queue module for the control instruction that the receiving end issues；It is default according to unlock
Condition terminates output；
The control instruction that described instruction receiving module exports successively is stored in the tail portion of storage queue by instruction queue module；
Respond module is instructed, for obtaining control instruction from the storage queue head of described instruction Queue module sequence, to described
Instruction is successively responded.
4. data cooperative transmission control system according to claim 1, which is characterized in that
The video sending end includes：
Source screen end, for sending video stream data to forwarding media stream server；Receive the control that control instruction server is sent
System instruction, is responded；
Forwarding media stream server receives the video stream data that screen end in source issues, and will be described for establishing video circulation road
Video stream data is sent at least one described receiving end；
Control instruction server receives the control instruction of at least one receiving end sending for establishing control instruction channel respectively；
According to locking preset condition, one of receiving end is selected, the control instruction which issues is sequentially output the source
Screen end；According to unlock preset condition, terminate output.
5. a kind of data cooperative transmission control method, which is characterized in that include the following steps：
Video stream data is sent at least one receiving end by video circulation road；
Receive the control instruction of at least one receiving end sending respectively by control instruction channel；
According to locking preset condition, one of receiving end is selected, the control instruction issued to the receiving end successively responds；
According to unlock preset condition, terminate response.
6. data cooperative transmission control method according to claim 5, which is characterized in that the received control instruction packet
It includes：Device id, instruction type and screen coordinate value；
Described instruction type is at least one of to press, move, lift.
7. data cooperative transmission control method according to claim 6, which is characterized in that
The locking preset condition be currently be unlocked state, and receiving instruction type is the control instruction pressed；
The unlock preset condition be currently be locking state, and receiving instruction type is the control instruction lifted.
8. according to any data cooperative transmission control method of claim 5-7, which is characterized in that
The video circulation road is established by forwarding media stream server；The control instruction channel is built by control instruction server
It is vertical；
The control instruction server receives the control instruction of at least one receiving end sending by control instruction channel respectively,
According to locking preset condition, one of receiving end is selected, the control instruction which issues is sequentially output the source
Screen end；According to unlock preset condition, terminate output；
The selected receiving end for being able to satisfy locking preset condition at first, receives the control instruction of the receiving end, and be sequentially output institute
Source screen end is stated, meets the control instruction for unlocking preset condition until receiving the receiving end and issuing.
9. data cooperative transmission control method according to claim 8, which is characterized in that further include：By the screen of receiving end
Curtain coordinate value is transformed to object space coordinate value, is responded according to the object space coordinate value to described instruction；The mesh
Mark the coordinate space that coordinate space is greater than the receiving end screen and source screen.
10. a kind of intelligent interaction device, which is characterized in that including：
Video flowing path setup module, for establishing video circulation road at least one receiving end, by video circulation road to connecing
Receiving end sends video stream data；
Control instruction path setup module, for establishing control instruction channel at least one receiving end；
Control instruction receiving module, the control instruction for being sent by least one receiving end of control instruction channel reception；
Control instruction selectes respond module, for selecting one of receiving end according to locking preset condition, sends out the receiving end
Control instruction out is successively responded；According to unlock preset condition, terminate response.
11. a kind of computer readable storage medium, is stored thereon with program, which is characterized in that the program be executed by processor as
Data cooperative transmission control method described in claim 5-9 any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810636792.XA CN108829482B (en) | 2018-06-20 | 2018-06-20 | Data transmission cooperation control system, method, storage medium and interaction device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810636792.XA CN108829482B (en) | 2018-06-20 | 2018-06-20 | Data transmission cooperation control system, method, storage medium and interaction device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108829482A true CN108829482A (en) | 2018-11-16 |
| CN108829482B CN108829482B (en) | 2022-04-05 |
Family
ID=64142828
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810636792.XA Active CN108829482B (en) | 2018-06-20 | 2018-06-20 | Data transmission cooperation control system, method, storage medium and interaction device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108829482B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111629240A (en) * | 2020-05-06 | 2020-09-04 | 上海幻电信息科技有限公司 | Multi-screen interactive display method and device |
| CN112770159A (en) * | 2020-12-30 | 2021-05-07 | 北京字节跳动网络技术有限公司 | Multi-screen interaction system, method, device, equipment and storage medium |
| CN113949674A (en) * | 2020-06-29 | 2022-01-18 | 成都鼎桥通信技术有限公司 | Data transmission method, system, network equipment, media equipment and receiving equipment |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2309366A2 (en) * | 2009-10-09 | 2011-04-13 | Samsung Electronics Co., Ltd. | Method for inputting text and display apparatus using the same |
| JP5035194B2 (en) * | 2008-09-25 | 2012-09-26 | カシオ計算機株式会社 | Server device, client device, server-based computing system, and program |
| EP1785981B1 (en) * | 2004-08-30 | 2013-05-29 | Mitsubishi Electric Corporation | Screen synchronous control apparatus |
| CN103544189A (en) * | 2012-07-17 | 2014-01-29 | 珠海金山办公软件有限公司 | Method and system for locking currently-edited file |
| CN103778208A (en) * | 2014-01-15 | 2014-05-07 | 广州普邦园林股份有限公司 | Method for cooperating working directory or document access and system thereof |
| CN103781171A (en) * | 2012-10-24 | 2014-05-07 | 中兴通讯股份有限公司 | Terminal and synchronization control method thereof |
| CN105446689A (en) * | 2015-12-16 | 2016-03-30 | 广州视睿电子科技有限公司 | Synchronization method and system of remote commenting |
| CN105468450A (en) * | 2015-12-29 | 2016-04-06 | 华为技术有限公司 | Task scheduling method and system |
| CN105790963A (en) * | 2016-02-23 | 2016-07-20 | 深圳市京华科讯科技有限公司 | Method for managing multi-user control virtual meeting interface, server and client |
| CN106027950A (en) * | 2016-07-22 | 2016-10-12 | 微云（武汉）科技有限公司 | Video conference realization method, video conference server and video conference realization system |
| CN106101803A (en) * | 2016-06-13 | 2016-11-09 | Tcl移动通信科技（宁波）有限公司 | The display panel control method of a kind of intelligent television and system |
| CN106202074A (en) * | 2015-04-29 | 2016-12-07 | 中兴通讯股份有限公司 | A kind of method and device processing shared file |
| US20170026574A1 (en) * | 2015-07-21 | 2017-01-26 | Lg Electronics Inc. | Mobile terminal and control method thereof |
| CN106792055A (en) * | 2016-12-28 | 2017-05-31 | 福建星网视易信息系统有限公司 | Screen method, equipment and system are thrown in real time |
| CN107592556A (en) * | 2017-08-08 | 2018-01-16 | 福建星网视易信息系统有限公司 | Control information synthetic method and controlled terminal and mobile terminal based on mobile terminal |
| CN107959687A (en) * | 2017-12-13 | 2018-04-24 | 上海曼恒数字技术股份有限公司 | A kind of data processing method, system, equipment and storage medium |
| CN108011886A (en) * | 2017-12-13 | 2018-05-08 | 上海曼恒数字技术股份有限公司 | A kind of cooperative control method, system, equipment and storage medium |
-
2018
- 2018-06-20 CN CN201810636792.XA patent/CN108829482B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1785981B1 (en) * | 2004-08-30 | 2013-05-29 | Mitsubishi Electric Corporation | Screen synchronous control apparatus |
| JP5035194B2 (en) * | 2008-09-25 | 2012-09-26 | カシオ計算機株式会社 | Server device, client device, server-based computing system, and program |
| EP2309366A2 (en) * | 2009-10-09 | 2011-04-13 | Samsung Electronics Co., Ltd. | Method for inputting text and display apparatus using the same |
| CN103544189A (en) * | 2012-07-17 | 2014-01-29 | 珠海金山办公软件有限公司 | Method and system for locking currently-edited file |
| CN103781171A (en) * | 2012-10-24 | 2014-05-07 | 中兴通讯股份有限公司 | Terminal and synchronization control method thereof |
| CN103778208A (en) * | 2014-01-15 | 2014-05-07 | 广州普邦园林股份有限公司 | Method for cooperating working directory or document access and system thereof |
| CN106202074A (en) * | 2015-04-29 | 2016-12-07 | 中兴通讯股份有限公司 | A kind of method and device processing shared file |
| US20170026574A1 (en) * | 2015-07-21 | 2017-01-26 | Lg Electronics Inc. | Mobile terminal and control method thereof |
| CN105446689A (en) * | 2015-12-16 | 2016-03-30 | 广州视睿电子科技有限公司 | Synchronization method and system of remote commenting |
| CN105468450A (en) * | 2015-12-29 | 2016-04-06 | 华为技术有限公司 | Task scheduling method and system |
| CN105790963A (en) * | 2016-02-23 | 2016-07-20 | 深圳市京华科讯科技有限公司 | Method for managing multi-user control virtual meeting interface, server and client |
| CN106101803A (en) * | 2016-06-13 | 2016-11-09 | Tcl移动通信科技（宁波）有限公司 | The display panel control method of a kind of intelligent television and system |
| CN106027950A (en) * | 2016-07-22 | 2016-10-12 | 微云（武汉）科技有限公司 | Video conference realization method, video conference server and video conference realization system |
| CN106792055A (en) * | 2016-12-28 | 2017-05-31 | 福建星网视易信息系统有限公司 | Screen method, equipment and system are thrown in real time |
| CN107592556A (en) * | 2017-08-08 | 2018-01-16 | 福建星网视易信息系统有限公司 | Control information synthetic method and controlled terminal and mobile terminal based on mobile terminal |
| CN107959687A (en) * | 2017-12-13 | 2018-04-24 | 上海曼恒数字技术股份有限公司 | A kind of data processing method, system, equipment and storage medium |
| CN108011886A (en) * | 2017-12-13 | 2018-05-08 | 上海曼恒数字技术股份有限公司 | A kind of cooperative control method, system, equipment and storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111629240A (en) * | 2020-05-06 | 2020-09-04 | 上海幻电信息科技有限公司 | Multi-screen interactive display method and device |
| CN111629240B (en) * | 2020-05-06 | 2021-08-10 | 上海幻电信息科技有限公司 | Multi-screen interactive display method and device |
| US11910072B2 (en) | 2020-05-06 | 2024-02-20 | Shanghai Hode Information Technology Co., Ltd. | Multi-screen interactive display method and apparatus |
| CN113949674A (en) * | 2020-06-29 | 2022-01-18 | 成都鼎桥通信技术有限公司 | Data transmission method, system, network equipment, media equipment and receiving equipment |
| CN112770159A (en) * | 2020-12-30 | 2021-05-07 | 北京字节跳动网络技术有限公司 | Multi-screen interaction system, method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108829482B (en) | 2022-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210374673A1 (en) | Collaboration system including a spatial event map | |
| US9479549B2 (en) | Collaboration system with whiteboard with federated display | |
| CA2900052C (en) | Collaboration system with whiteboard access to global collaboration data | |
| Rekimoto et al. | SyncTap: An interaction technique for mobile networking | |
| CN108829482A (en) | Data cooperative transmission control system, method, storage medium and interactive device | |
| JP5903835B2 (en) | Transmission terminal, image display control method, image display control program, recording medium, and transmission system | |
| WO2021057120A1 (en) | Data transmission method, device and computer storage medium | |
| CN102916998A (en) | Network public whiteboard system and method based on cloud computing | |
| TW200945907A (en) | N-way multimedia collaboration systems | |
| WO2015100990A1 (en) | Inter-terminal image sharing method, terminal device and communication system | |
| CA3116993A1 (en) | Digital workspace sharing over one or more display clients and authorization protocols for collaboration systems | |
| CN103716353A (en) | Mutual data sharing method for equipment | |
| CN103546493A (en) | Cross-device communication method | |
| TWI294087B (en) | Systems and methods for file transfer management | |
| TW201117590A (en) | Method and system of desktop broadcasting | |
| US20160234258A1 (en) | Minimizing productivity loss in a collaborative sharing environment | |
| US10298652B2 (en) | Control for content channel in web real-time communication | |
| US11797935B2 (en) | Systems and methods for multi-party distributed active co-browsing | |
| CN104618500A (en) | Local area network application program data sharing method based on DLNA | |
| US20230111762A1 (en) | Collaboration system including a spatial event map | |
| CN105122822A (en) | Wireless docking system for audio-video | |
| CN112445628B (en) | Inter-process resource sharing method and device and electronic equipment | |
| JP2022167546A (en) | Screen sharing device, screen sharing method, and computer program | |
| TW200828027A (en) | Program execution sequence data flow network structure and the control method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |