CN110515526A - A kind of multi-screen interaction method and device - Google Patents
A kind of multi-screen interaction method and device Download PDFInfo
- Publication number
- CN110515526A CN110515526A CN201910829381.7A CN201910829381A CN110515526A CN 110515526 A CN110515526 A CN 110515526A CN 201910829381 A CN201910829381 A CN 201910829381A CN 110515526 A CN110515526 A CN 110515526A
- Authority
- CN
- China
- Prior art keywords
- equipment
- virtual
- server
- application program
- display device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Abstract
The embodiment of the invention discloses a kind of multi-screen interaction method, first, application program is set on the server, application program is run on the server, the hardware requirement to the first equipment is reduced, while reducing the power consumption of the first equipment, solves the problems, such as fever and Caton in the operation of the first equipment；Second, application program is installed on the server, first equipment is without installation, the first device memory is saved, realize that application program is shared in several first equipment, third, several first equipment and several second equipment are organically combined by server, the hardware realized between more equipment is shared, since application program is run on the server, while promoting the fluency of application program, reduce to the first equipment i.e. hardware requirement of manipulation side, and also mitigate the hardware load of the first equipment and the second equipment；4th, the first equipment and the second equipment are that solve the problems, such as picture or manipulation delay by the way of cable or local area network and server communication.
Description
Technical field
The present embodiments relate to interface alternation technical fields, and in particular to a kind of multi-screen interaction method and device.
Background technique
Multi-screen interactive refers to through agreement, and in different multimedia terminals, such as Ios, Android, Symbian etc. are carried out
Multimedia, such as the broadcasting of video, audio.It is simply that multiple multimedia play equipments can interconnect conversion, than
If the film on mobile phone can play on TV, the picture on plate can be shared on TV, and the content of computer can be thrown
Shadow is to TV etc..
With the continuous improvement of people's living standards, domestic electric appliance and smart machine are also enriched constantly.However this
Between a little equipment mostly independently of one another, such as between mobile phone, TV band screen equipment independently of one another, this result in there arises a problem that
1) hardware resource such as CPU (central processing unit), GPU (graphics processor), Memory (memory) cannot share, as TV closes
When not used, TV hardware cannot be shared with the mobile phone for the task of being carrying out to machine；2) software resource such as APP (application program), picture
Each equipment room can not be shared, and if filled iqiyi.com on mobile phone, iqiyi.com has been filled on TV, has filled iqiyi.com on plate；3) shield
Curtain content cannot arbitrarily switch in equipment room, and such as mobile phone A screen content sharing to mobile phone B, mobile phone A passes through touch screen control TV
C, TV C screen content are switched to mobile phone；3) mobile phone sees that video, object for appreciation game can generate heat for a long time, reduces mobile phone service life；4)
Mobile phone usually uses wifi 4G to network, and wireless signal is easy to be disturbed, and plays instantaneous game and has been easy delay height, the instantaneous Caton of network
The problems such as；5) mobile phone games throw screen to play on TV be postpone it is too high.If passing through multidisplay technology for the equipment in family
It organically combines, must can bring significant economic benefit.
Summary of the invention
A kind of multi-screen interaction method is provided according to a first aspect of the embodiments of the present invention, comprising: server and several tools
There is the first equipment of display function, wherein several application programs are installed on the server；
According to the device parameter of each first equipment, corresponding first is created on the server and is virtually set
Standby, first virtual unit includes the first virtual display device；
The application program on the server is scanned, shows the application journey on the server in first equipment
Sequence table；
The manipulation application requests that user sends are received, by the application program of user's manipulation in the first virtual unit
Upper operation updates the window data in first virtual display device according to application program operation；
It sends the window data in first virtual display device in its corresponding described first equipment.
Further, in the multi-screen interaction method, the manipulation application requests for receiving user and sending,
The application program that user manipulates is run on the first virtual unit, it is virtual to update described first according to application program operation
Window data in display device, comprising:
The application program of user's manipulation is searched on the server；
First virtual unit starts and runs the application program；
According to the application program that first virtual unit is run, the first void in first virtual unit is updated
The window data of quasi- display device.
Further, in the multi-screen interaction method, the window data by first virtual display device is sent out
It is sent in its corresponding described first equipment, comprising:
The window data of presently described first virtual display device is encoded；
By the window data after coding be sent to first virtual display device to the first equipment；
First equipment is decoded the window data after coding, and according to decoded window data display window
Mouthful.
Further, in the multi-screen interaction method, further includes: several second equipment having a display function；
According to the device parameter of each second equipment, corresponding second is created on the server and is virtually set
Standby, second virtual unit includes the second virtual display；
The application program on the server is scanned, shows the application journey on the server in second equipment
Sequence table；
The request for showing the first equipment display content on the second device that user sends is received, by first equipment pair
The window data for the first virtual display device in the first virtual unit answered is transferred to corresponding second void of second equipment
It proposes standby；
Second virtual unit updates the window number in its second virtual display device according to the window data received
According to；
It sends the window data of second virtual display device in its corresponding described second equipment.
Further, in the multi-screen interaction method, display first on the second device for receiving user and sending
Equipment shows content requests, by the window number of the first virtual display device in corresponding first virtual unit of first equipment
According to being transferred to corresponding second virtual unit of second equipment, comprising:
Receive the request for showing the first equipment display content on the second device that user sends；
According to the ID of the second equipment in the request, filters out and virtually set with the ID matched second of second equipment
It is standby；
Update the window data of the first virtual display device in corresponding first virtual unit of first equipment；
The window data of first virtual display device is transmitted to the second virtual unit filtered out.
Further, in the multi-screen interaction method, further includes:
The window data in first virtual display device is updated according to application program operation；
It sends the window data in first virtual display device in its corresponding described first equipment.
Further, in the multi-screen interaction method, further includes:
Receive the request in the first equipment control the second equipment display content that user sends, wherein wrap in the request
Include the ID and operation application program ID of the second equipment；
According to the ID of the second equipment in the request, filters out and virtually set with the ID matched second of second equipment
It is standby；
Second virtual unit and first virtual unit are operated together the application of the first virtual unit operation
Program, and the mapping relations of second virtual unit and first equipment are created, second virtual unit is received and is held
The instruction that row first equipment is sent；
It is updated in first virtual display device according to the operation of the application program on first virtual unit
Window data updates in second virtual display device according to the operation of the application program on second virtual unit
Window data；
It sends the window data in first virtual display device in its corresponding described first equipment, it will be described
Window data in second virtual display device is sent in its corresponding described second equipment.
Further, in the multi-screen interaction method, the server and several first equipment and several second
Equipment passes through local area network or cable connection communication；
The server is connect with internet.
Further, in the multi-screen interaction method, the parameter of first equipment includes screen resolution, decoder
Support format and unique identifier；
The parameter of second equipment includes screen resolution, decoder support format and unique identifier.
A kind of multi-screen interactive device is provided according to a second aspect of the embodiments of the present invention, comprising: server and several tools
There is the first equipment of energy of display function, wherein several application programs are installed on the server；
Virtual unit creation module is created on the server for the device parameter according to each first equipment
The first corresponding virtual unit is built, first virtual unit includes the first virtual display device；
Application program display module, it is aobvious in first equipment for scanning the application program on the server
Show the application list on the server；
Application program execution module, for receiving the manipulation application requests of user's transmission, by user's manipulation
Application program is run on the first virtual unit, is updated in first virtual display device according to application program operation
Window data；
Data transmission module, it is corresponding described for sending its for the window data in first virtual display device
In first equipment.
The embodiment of the present invention has the advantages that
1. the embodiment of the invention discloses a kind of multi-screen interaction methods, on the one hand, application is arranged in the present invention on the server
Program, and virtual unit corresponding with the first equipment is created on it, so that application program is run on the server, greatly drop
The use of the low hardware to the first equipment, the first equipment only need to decode broadcasting, not only greatly reduce pair
The hardware requirement of first equipment, and the utility ratio due to reducing the first equipment, also greatly reduce the power consumption of the first equipment
Amount, and solve the problems, such as fever and Caton in the operation of the first equipment；On the other hand, application program is mounted on clothes in the application
It is engaged on device, the first equipment has not only saved the memory of the first equipment, but also realize application program several first without installation
It is shared in equipment.
2. the embodiment of the invention discloses a kind of multi-screen interaction method, firstly, the application is by server by several first
Equipment and several second equipment organically combine, and the hardware realized between more equipment is shared, and since application program is taking
It runs on business device, while greatly improving the fluency of application program, reduces to the hard of the i.e. manipulation side of the first equipment
Part requirement, and also mitigate the hardware load of the first equipment and the second equipment；Second, the application is due to the first equipment and second
Equipment is by the way of cable or local area network and server communication, the problem of effective solution picture or manipulation delay.
Detailed description of the invention
It, below will be to embodiment party in order to illustrate more clearly of embodiments of the present invention or technical solution in the prior art
Formula or attached drawing needed to be used in the description of the prior art are briefly described.It should be evident that the accompanying drawings in the following description is only
It is merely exemplary, it for those of ordinary skill in the art, without creative efforts, can also basis
The attached drawing of offer, which is extended, obtains other implementation attached drawings.
Structure depicted in this specification, ratio, size etc., only to cooperate the revealed content of specification, for
Those skilled in the art understands and reads, and is not intended to limit the invention enforceable qualifications, therefore does not have technical
Essential meaning, the modification of any structure, the change of proportionate relationship or the adjustment of size are not influencing the function of the invention that can be generated
Under effect and the purpose that can reach, should all still it fall in the range of disclosed technology contents can cover.
It is implementation environment schematic diagram that Fig. 1, which is involved in the embodiment of the present invention,；
Fig. 2 is a kind of flow chart of multi-screen interaction method provided in an embodiment of the present invention；
Fig. 3 is a kind of structural schematic diagram of multi-screen interactive device provided in an embodiment of the present invention.
Specific embodiment
Embodiments of the present invention are illustrated by particular specific embodiment below, those skilled in the art can be by this explanation
Content disclosed by book is understood other advantages and efficacy of the present invention easily, it is clear that described embodiment is the present invention one
Section Example, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not doing
Every other embodiment obtained under the premise of creative work out, shall fall within the protection scope of the present invention.
Fig. 1 is the schematic diagram of implementation environment involved in the embodiment of the present invention.Referring to Fig. 1, Multi-screen interaction system includes clothes
Business device 101, server 101 are communicated to connect by cable or wirelessly with internet 104, several first equipment 102, and several second
Equipment 103；Wherein, server 101 is wirelessly connect by cable or with internet communication；First equipment 102 is that have
Display function equipment, for example, smart phone, tablet computer etc., the present embodiment is not limited to this；Second equipment 103 is that have to show
Show function device, for example, TV, computer etc., the present embodiment is not limited to this, it is notable that in the present invention, first sets
Standby and the second equipment can be identical equipment, can also be difference.
Implementation environment based on Fig. 1, the embodiment of the present application provides a kind of multi-screen interaction method, shown in Figure 2, including
Following steps:
It include: server and several first equipment having a display function in the present embodiment, wherein pacify on the server
Equipped with several application programs；
S201: according to the device parameter of each first equipment, corresponding first is created on the server
Virtual unit, first virtual unit include the first virtual display device；
In the present embodiment, several application programs is installed on server, for example, iqiyi.com, youku.com, king's honor etc.,
Server is connect with internet communication；Several first equipment can pass through local between the first several equipment and server
Net or cable connection communication, the preferred local area network of the present embodiment, wherein the first equipment can be connect by cable with server；
Each the first equipment connecting with server is registered on the server, sends to server set with oneself first
In the information to server of parameter, server creates corresponding with first equipment first virtually according to device parameter is received
Equipment, this first virtually sets including the first virtual display device, at the same its further include have virtual Mike, virtual player and
Virtual processor；Wherein, the parameter of the first equipment includes screen resolution, decoder support format and unique identifier；
First facility registration is completed, and when the second starting, the first equipment issues broadcast, and server receives broadcast, server
Broadcast is received, and the information such as the address of server are sent to the first equipment, while server determines that issuing the first of broadcast sets
It is standby whether to register on it, if registration, allows the first equipment operation with it；
S202: scanning the application program on the server, shows on the server in first equipment
The application list；
In the present embodiment, a client is installed, user clicks client, client display clothes in every one first equipment
The list of newest application program in business device；
S203: receiving the manipulation application requests that user sends, by the application program of user's manipulation in the first void
Standby upper operation is proposed, the window data in first virtual display device is updated according to application program operation；
Specifically, searching the application program of user's manipulation on the server；
First virtual unit starts and runs the application program；
According to the application program that first virtual unit is run, the first void in first virtual unit is updated
The window data of quasi- display device；
In the present embodiment, user is from an application program in the Application Column on the server in the first equipment,
The event is sent to server by the first equipment, and server finds corresponding first virtual bench of first equipment, takes simultaneously
Business device traverses application program used thereon, in the event sent according to the icon of application program and size and the first equipment,
The position coordinates of the application program of triggering on the first device, find corresponding application program；The first virtual unit found
The application program is run, according to the buffer area of the first virtual display device in the first virtual unit of operation of application program
Window data updates in buffer；
S204: it sends the window data in first virtual display device in its corresponding described first equipment；
Specifically, being encoded to the window data of presently described first virtual display device；
By the window data after coding be sent to first virtual display device to the first equipment；
First equipment is decoded the window data after coding, and according to decoded window data display window
Mouthful；
In the present embodiment, the encoder of server starting thereon, to window data current in the first display device
It is encoded, for example, coding forms h264/265 data, the invention is not limited thereto, and the type of coding can be according to the first equipment
Decoder depending on；The window data that coding is completed is transmitted in the first equipment corresponding with first virtual unit；First
After equipment receives the window data after encoding, which is decoded, then the window data after broadcast decoder.
On the one hand, application program is arranged in the present invention on the server, and creates on it corresponding with the first equipment virtual
Equipment greatly reduces the use of the hardware to the first equipment, the first equipment is only so that application program is run on the server
It only needs to decode broadcasting, the hardware requirement to the first equipment not only greatly reduces, but also due to reducing first
The utility ratio of equipment, also greatly reduces the power consumption of the first equipment, and solves fever and Caton in the operation of the first equipment
The problem of；On the other hand, on the server, the first equipment has not only saved the without installation for application program installation in the application
The memory of one equipment, and it is shared in several first equipment to realize application program.
Multi-screen interaction method disclosed in the present embodiment further includes step S205~S209, it should be noted that step S205
There is no sequencing between~S209 and step S204；
It further include several second equipment having a display function in multi-screen interaction method；Several second equipment pass through local area network
Or cable connection communication；It is connect by HDMI with the second equipment in the present embodiment preferably through cable, such as server；
S205: according to the device parameter of each second equipment, corresponding second is created on the server
Virtual unit, second virtual unit include the second virtual display；
Each the second equipment connecting with server is registered on the server, sends to server set with oneself first
In the information to server of parameter, server creates corresponding with second equipment second virtually according to device parameter is received
Equipment, this second virtually sets including the second virtual display device, at the same its further include have virtual Mike, virtual player and
Virtual processor；Wherein, the parameter of the second equipment includes screen resolution, decoder support format and unique identifier；
Second facility registration is completed, and when the second starting, the second equipment issues broadcast, and server receives broadcast, server
Broadcast is received, and the information such as the address of server are sent to the second equipment, while server determines that issuing the second of broadcast sets
It is standby whether to register on it, if registration, allows the second equipment operation with it；
S206: scanning the application program on the server, shows on the server in second equipment
The application list；
In the present embodiment, a client is installed, user clicks client, client display clothes in every one second equipment
The list of newest application program in business device；
S207: the request for showing the first equipment display content on the second device that user sends is received, by described first
It is corresponding that the window data of the first virtual display device in corresponding first virtual unit of equipment is transferred to second equipment
Second virtual unit；
It is specific:
Receive the request for showing the first equipment display content on the second device that user sends；
According to the ID of the second equipment in the request, filters out and virtually set with the ID matched second of second equipment
It is standby；
Update the window data of the first virtual display device in corresponding first virtual unit of first equipment；
The window data of first virtual display device is transmitted to the second virtual unit filtered out；
S208: second virtual unit updates the window in its second virtual display device according to the window data received
Mouth data；The window data in first virtual display device is updated according to application program operation；
S209: it sends the window data of second virtual display device in its corresponding described second equipment；It will
Window data in first virtual display device is sent in its corresponding described first equipment.
In order to further illustrate in detail below for example, still the present invention is not limited to following situations；First equipment is
Mobile phone, the second equipment are TV, and the first equipment is connect by local area network with server, and the second equipment passes through HDMI (High
Definition Multimedia Interface, high-definition media interface) it is connect with server；
The video played in the first equipment is controlled to show on the second device；
First equipment sends the video software installed on the server run thereon, if the video of iqiyi.com broadcasting is second
The request played in equipment is to server；
Corresponding first virtual unit of first equipment filters out corresponding with the second device id in request on the server
The second virtual unit；
Window data in current first virtual unit buffer is sent to the second virtual unit filtered out；
Window data updates its window data to second virtual unit based on the received；
Encoder compiles the current window data in the current window data and the second equipment in the first virtual unit
Code；
Data after coding are respectively sent to the first equipment and the second equipment；
First the second equipment of equipment is decoded after receiving the data of coding, and the window data after broadcast decoder.
Multi-screen interaction method disclosed in the present embodiment further includes step S210~S214, it should be noted that step S210
There is no sequencing between~S214 and step S209；
S210: the request in the first equipment control the second equipment display content that user sends is received, wherein the request
In include the second equipment ID；
S211: it according to the ID of the second equipment in the request, filters out empty with the ID of second equipment matched second
It proposes standby；
S212: second virtual unit and first virtual unit are operated together the first virtual unit operation
Application program, and the mapping relations of second virtual unit and first equipment are created, second virtual unit receives
With the instruction for executing the first equipment transmission；
In this embodiment, after finding the second virtual unit, the operation of the second virtual unit issues the first equipment of request
The application program of corresponding first virtual unit operation, corresponding first virtual unit of the first equipment for issuing request continue to run
Former application program；
After establishing completion mapping, second virtual unit receives the control of the first equipment, receives the manipulation of its transmission
Instruction, i.e., described first equipment control the first virtual unit and the second virtual unit simultaneously, and the first virtual unit and second is virtually
Equipment is performed simultaneously the instruction of the first equipment sending；
S213: first virtual display device is updated according to the operation of the application program on first virtual unit
In window data, second virtual display device is updated according to the operation of the application program on second virtual unit
In window data；
S214: sending the window data in first virtual display device in its corresponding described first equipment,
It sends the window data in second virtual display device in its corresponding described second equipment；
In order to further illustrate in detail below for example, still the present invention is not limited to following situations；First equipment is
Mobile phone, the second equipment are TV, and the first equipment is connect by local area network with server, and the second equipment passes through HDMI (High
Definition Multimedia Interface, high-definition media interface) it is connect with server；
The game picture of the game such as king's honor of first equipment control thereon is shown on the second device；
Server receives the request in the first equipment control the second equipment display content that user sends, wherein described to ask
ID and operation application program ID in asking including the second equipment；
According to the ID of the second equipment in the request, filters out and virtually set with the ID matched second of second equipment
It is standby；
Second virtual unit and first virtual unit are operated together the application of the first virtual unit operation
Program；That is the first virtual unit is operated together with the second virtual unit issues the first virtual unit of request corresponding first virtually
The application program of equipment operation, i.e. king's honor program；
It is updated in first virtual display device according to the operation of the application program on first virtual unit
Window data updates in second virtual display device according to the operation of the application program on second virtual unit
Window data；First virtual unit encodes window data with the second virtual unit；And creation second virtual unit
With the mapping relations of first equipment, second virtual unit receives and executes the instruction that first equipment is sent；I.e.
User every time on the first device manipulate king's honor manipulation instruction simultaneously be sent to its corresponding first virtual unit and
The second virtual unit filtered out, first virtual unit and second virtual unit are performed simultaneously the manipulation instruction received；
Its corresponding first equipment is sent by the window data after the coding in first virtual display device
On, it sends the coding rear hatch data in second virtual display device in its corresponding described second equipment；
It after first equipment and the second equipment receive the window data after encoding, decodes, display.
Firstly, the application is organically combined several first equipment and several second equipment by server, realize more
Hardware between equipment is shared, and since application program is run on the server, is greatly improving the stream of application program
While freely spending, reduce to the first equipment i.e. hardware requirement of manipulation side, and also mitigate the first equipment and the second equipment
Hardware load；Second, the application is by the way of cable or local area network and server due to the first equipment and the second equipment
The problem of communication, effective solution picture or manipulation delay.
Based on the same inventive concept, it is more that one kind corresponding with a kind of multi-screen interaction method is additionally provided in the embodiment of the present application
Shield interactive device.The principle and a kind of above-mentioned multi-screen of the embodiment of the present application solved the problems, such as due to the device in the embodiment of the present application is mutual
Dynamic method is similar, therefore the implementation of device may refer to the implementation of method, and overlaps will not be repeated.
A kind of multi-screen interactive device shown in Figure 3, comprising: server and several first equipment having a display function,
Wherein, several application programs are installed on the server；
Virtual unit creation module 301, for the device parameter according to each first equipment, on the server
The first corresponding virtual unit is created, first virtual unit includes the first virtual display device；
Application program display module 302, for scanning the application program on the server, in first equipment
Show the application list on the server；
Application program execution module 303 manipulates user for receiving the manipulation application requests of user's transmission
Application program run on the first virtual unit, updated in first virtual display device according to application program operation
Window data；
Data transmission module 304, it is corresponding for sending its for the window data in first virtual display device
In first equipment.
Preferably, the manipulation application requests for receiving user and sending, the application program that user manipulates is existed
It is run on first virtual unit, the window data in first virtual display device is updated according to application program operation,
Include:
The application program of user's manipulation is searched on the server；
First virtual unit starts and runs the application program；
According to the application program that first virtual unit is run, the first void in first virtual unit is updated
The window data of quasi- display device.
Preferably, the window data by first virtual display device is sent to its corresponding first equipment
On, comprising:
The window data of presently described first virtual display device is encoded；
By the window data after coding be sent to first virtual display device to the first equipment；
First equipment is decoded the window data after coding, and according to decoded window data display window
Mouthful.
Preferably, further includes: several second equipment having a display function；
According to the device parameter of each second equipment, corresponding second is created on the server and is virtually set
Standby, second virtual unit includes the second virtual display；
Application program display module 302 is also used to scan the application program on the server, sets described second
Standby the application list shown on the server；
In the first equipment of display on the second device that application program execution module 303 is also used to receive user's transmission is shown
The window data of the first virtual display device in corresponding first virtual unit of first equipment is transferred to by the request of appearance
Corresponding second virtual unit of second equipment；Second virtual unit according to the window data received update its second
Window data in virtual display device；
Data transmission module 304 is also used to send the window data of second virtual display device to its corresponding institute
It states in the second equipment.
Preferably, the first equipment of the display on the second device display content requests for receiving user and sending, will be described
The window data of the first virtual display device in corresponding first virtual unit of first equipment is transferred to second equipment pair
The second virtual unit answered, comprising:
Receive the request for showing the first equipment display content on the second device that user sends；
According to the ID of the second equipment in the request, filters out and virtually set with the ID matched second of second equipment
It is standby；
Update the window data of the first virtual display device in corresponding first virtual unit of first equipment；
The window data of first virtual display device is transmitted to the second virtual unit filtered out.
Preferably, further includes:
Application program execution module 303, which is also used to be run according to the application program, updates first virtual display device
In window data；
Data transmission module 304 is also used to send its for the window data in first virtual display device corresponding
In first equipment.
Application program execution module 303 also controls the second equipment display content in the first equipment with what reception user sent
Request, wherein ID and operation application program ID in the request including the second equipment；
According to the ID of the second equipment in the request, filters out and virtually set with the ID matched second of second equipment
It is standby；
Second virtual unit and first virtual unit are operated together the application of the first virtual unit operation
Program, and the mapping relations of second virtual unit and first equipment are created, second virtual unit is received and is held
The instruction that row first equipment is sent；
It is updated in first virtual display device according to the operation of the application program on first virtual unit
Window data updates in second virtual display device according to the operation of the application program on second virtual unit
Window data；
Data transmission module 304 is also used to send its for the window data in first virtual display device corresponding
In first equipment, its corresponding second equipment is sent by the window data in second virtual display device
On.
Preferably, the server is connect with several first equipment and several second equipment by local area network or cable
Communication；
The server is connect with internet.
Preferably, the parameter of first equipment includes screen resolution, decoder support format and unique identifier；Institute
The parameter for stating the second equipment includes screen resolution, decoder support format and unique identifier.
In all examples being illustrated and described herein, any occurrence should be construed as merely illustratively, without
It is as limitation, therefore, other examples of exemplary embodiment can have different values.
It is apparent to those skilled in the art that for convenience and simplicity of description, the device of foregoing description
Specific work process, can refer to corresponding processes in the foregoing method embodiment, details are not described herein.Provided herein
Several embodiments in, it should be understood that disclosed device and method may be implemented in other ways.It is above to be retouched
The Installation practice stated is only schematical.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in the executable non-volatile computer-readable storage medium of a processor.Based on this understanding, the application
Technical solution substantially the part of the part that contributes to existing technology or the technical solution can be with software in other words
The form of product embodies, which is stored in a storage medium, including some instructions use so that
One computer equipment (can be personal computer, server or the network equipment etc.) executes each embodiment institute of the application
State all or part of the steps of method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only
Memory, ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. is various to deposit
Store up the medium of program code.
Finally, it should be noted that embodiment described above, the only specific embodiment of the application, to illustrate the application
Technical solution, rather than its limitations, the protection scope of the application is not limited thereto, although with reference to the foregoing embodiments to this Shen
It please be described in detail, those skilled in the art should understand that: anyone skilled in the art
Within the technical scope of the present application, it can still modify to technical solution documented by previous embodiment or can be light
It is readily conceivable that variation or equivalent replacement of some of the technical features；And these modifications, variation or replacement, do not make
The essence of corresponding technical solution is detached from the spirit and scope of the embodiment of the present application technical solution, should all cover the protection in the application
Within the scope of.Therefore, the protection scope of the application shall be subject to the protection scope of the claim
Although above having used general explanation and specific embodiment, the present invention is described in detail, at this
On the basis of invention, it can be made some modifications or improvements, this will be apparent to those skilled in the art.Therefore,
These modifications or improvements without departing from theon the basis of the spirit of the present invention are fallen within the scope of the claimed invention.
Claims (10)
1. a kind of multi-screen interaction method characterized by comprising server and several first equipment having a display function,
In, several application programs are installed on the server；
According to the device parameter of each first equipment, the first corresponding virtual unit is created on the server,
First virtual unit includes the first virtual display device；
The application program on the server is scanned, shows the Application Column on the server in first equipment
Table；
The manipulation application requests that user sends are received, the application program that user manipulates is transported on the first virtual unit
Row updates the window data in first virtual display device according to application program operation；
It sends the window data in first virtual display device in its corresponding described first equipment.
2. multi-screen interaction method according to claim 1, which is characterized in that described receive is answered described in the manipulation that user sends
With PROGRAMMED REQUESTS, the application program that user manipulates is run on the first virtual unit, is run and updated according to the application program
Window data in first virtual display device, comprising:
The application program of user's manipulation is searched on the server；
First virtual unit starts and runs the application program；
According to the application program that first virtual unit is run, first updated in first virtual unit is virtually shown
The window data of showing device.
3. multi-screen interaction method according to claim 2, which is characterized in that described by first virtual display device
Window data is sent in its corresponding described first equipment, comprising:
The window data of presently described first virtual display device is encoded；
By the window data after coding be sent to first virtual display device to the first equipment；
First equipment is decoded the window data after coding, and according to decoded window data display window.
4. multi-screen interaction method according to claim 1 to 3, which is characterized in that further include: it is several that there is display function
Second equipment of energy；
According to the device parameter of each second equipment, the second corresponding virtual unit is created on the server,
Second virtual unit includes the second virtual display；
The application program on the server is scanned, shows the Application Column on the server in second equipment
Table；
The request for showing the first equipment display content on the second device that user sends is received, first equipment is corresponding
The window data of the first virtual display device in first virtual unit is transferred to second equipment corresponding second and virtually sets
It is standby；
Second virtual unit updates the window data in its second virtual display device according to the window data received；
It sends the window data of second virtual display device in its corresponding described second equipment.
5. multi-screen interaction method according to claim 4, which is characterized in that it is described receive user send in the second equipment
The first equipment of upper display shows content requests, by the first virtual display dress in corresponding first virtual unit of first equipment
The window data set is transferred to corresponding second virtual unit of second equipment, comprising:
Receive the request for showing the first equipment display content on the second device that user sends；
According to the ID of the second equipment in the request, filter out and matched second virtual unit of the ID of second equipment；
Update the window data of the first virtual display device in corresponding first virtual unit of first equipment；
The window data of first virtual display device is transmitted to the second virtual unit filtered out.
6. multi-screen interaction method according to claim 4, which is characterized in that further include:
The window data in first virtual display device is updated according to application program operation；
It sends the window data in first virtual display device in its corresponding described first equipment.
7. multi-screen interaction method according to claim 4, which is characterized in that further include:
Receive that user sends controls the request that the second equipment shows content in the first equipment, wherein includes the in the request
The ID and operation application program ID of two equipment；
According to the ID of the second equipment in the request, filter out and matched second virtual unit of the ID of second equipment；
Second virtual unit and first virtual unit are operated together the application program of the first virtual unit operation,
And the mapping relations of creation second virtual unit and first equipment, second virtual unit receive and execute described
The instruction that first equipment is sent；
The window in first virtual display device is updated according to the operation of the application program on first virtual unit
Data update the window in second virtual display device according to the operation of the application program on second virtual unit
Data；
It sends the window data in first virtual display device in its corresponding described first equipment, by described second
Window data in virtual display device is sent in its corresponding described second equipment.
8. multi-screen interaction method according to claim 4, which is characterized in that the server and several first equipment
Pass through local area network or cable connection communication with several second equipment；
The server is connect with internet.
9. multi-screen interaction method according to claim 4, which is characterized in that the parameter of first equipment includes screen point
Resolution, decoder support format and unique identifier；
The parameter of second equipment includes screen resolution, decoder support format and unique identifier.
10. a kind of multi-screen interactive device characterized by comprising server and several first equipment having a display function,
In, several application programs are installed on the server；
Virtual unit creation module, for the device parameter according to each first equipment, on the server creation with
Its corresponding first virtual unit, first virtual unit include the first virtual display device；
Application program display module shows institute in first equipment for scanning the application program on the server
State the application list on server；
Application program execution module, for receiving the manipulation application requests of user's transmission, by the application of user's manipulation
Program is run on the first virtual unit, and the window in first virtual display device is updated according to application program operation
Data；
Data transmission module, for by the window data in first virtual display device be sent to its corresponding described first
In equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910829381.7A CN110515526A (en) | 2019-09-03 | 2019-09-03 | A kind of multi-screen interaction method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910829381.7A CN110515526A (en) | 2019-09-03 | 2019-09-03 | A kind of multi-screen interaction method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110515526A true CN110515526A (en) | 2019-11-29 |
Family
ID=68630689
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910829381.7A Pending CN110515526A (en) | 2019-09-03 | 2019-09-03 | A kind of multi-screen interaction method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110515526A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113849231A (en) * | 2021-09-01 | 2021-12-28 | 珠海格力电器股份有限公司 | Application program running method and device, storage medium and electronic equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103491179A (en) * | 2013-09-27 | 2014-01-01 | 百视通网络电视技术发展有限责任公司 | Multi-screen interaction method and system based on Web |
| US20140002389A1 (en) * | 2012-06-29 | 2014-01-02 | Lg Electronics Inc. | Mobile terminal and method of controlling the same |
| CN104796455A (en) * | 2015-03-12 | 2015-07-22 | 安徽讯飞皆成软件技术有限公司 | Cross-platform multi-screen interacting method, device and system |
| CN104866282A (en) * | 2014-02-20 | 2015-08-26 | 联想(北京)有限公司 | Method for controlling electronic equipment and electronic equipment |
| CN106933523A (en) * | 2015-12-30 | 2017-07-07 | 阿里巴巴集团控股有限公司 | A kind of multi-screen interaction method and device |
| CN106980479A (en) * | 2016-01-15 | 2017-07-25 | 优视科技（中国）有限公司 | Method, device and the server of multi-screen interactive |
| CN109299047A (en) * | 2018-09-21 | 2019-02-01 | 深圳市九洲电器有限公司 | Distributed system data sharing method and device, data sharing distributed system |
| CN110087126A (en) * | 2019-04-15 | 2019-08-02 | 广州视源电子科技股份有限公司 | Screen transmission method and multi-screen interactive device, system |
-
2019
- 2019-09-03 CN CN201910829381.7A patent/CN110515526A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140002389A1 (en) * | 2012-06-29 | 2014-01-02 | Lg Electronics Inc. | Mobile terminal and method of controlling the same |
| CN103491179A (en) * | 2013-09-27 | 2014-01-01 | 百视通网络电视技术发展有限责任公司 | Multi-screen interaction method and system based on Web |
| CN104866282A (en) * | 2014-02-20 | 2015-08-26 | 联想(北京)有限公司 | Method for controlling electronic equipment and electronic equipment |
| CN104796455A (en) * | 2015-03-12 | 2015-07-22 | 安徽讯飞皆成软件技术有限公司 | Cross-platform multi-screen interacting method, device and system |
| CN106933523A (en) * | 2015-12-30 | 2017-07-07 | 阿里巴巴集团控股有限公司 | A kind of multi-screen interaction method and device |
| CN106980479A (en) * | 2016-01-15 | 2017-07-25 | 优视科技（中国）有限公司 | Method, device and the server of multi-screen interactive |
| CN109299047A (en) * | 2018-09-21 | 2019-02-01 | 深圳市九洲电器有限公司 | Distributed system data sharing method and device, data sharing distributed system |
| CN110087126A (en) * | 2019-04-15 | 2019-08-02 | 广州视源电子科技股份有限公司 | Screen transmission method and multi-screen interactive device, system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113849231A (en) * | 2021-09-01 | 2021-12-28 | 珠海格力电器股份有限公司 | Application program running method and device, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106846040B (en) | Virtual gift display method and system in live broadcast room | |
| CN105611364B (en) | Method, device and system for interaction between portable digital equipment and large screen | |
| US9067138B2 (en) | Playing browser based games with alternative controls and interfaces | |
| JP2022066238A (en) | System and method for using distributed game engine | |
| CN107864122B (en) | Display method and device for live stream of main broadcast with wheat | |
| US20140195912A1 (en) | Method and system for simultaneous display of video content | |
| WO2022188595A1 (en) | Method and apparatus for displaying application picture, and terminal, screen projection system and medium | |
| US10271105B2 (en) | Method for playing video, client, and computer storage medium | |
| CN203164829U (en) | Wireless high definition transmission screen intelligent all-in-one machine | |
| WO2007053304A3 (en) | Multi-user terminal services accelerator | |
| US9460486B2 (en) | Image display system, information processing device, server, and image processing method | |
| CN106162232A (en) | video playing control method and device | |
| CN102921171A (en) | Intelligent mobile Internet device (MID), television, game server, multi-screen system and multi-screen method | |
| CN106210753A (en) | A kind of net cast method and device | |
| CN111263233A (en) | Television multi-window processing method and device, computer equipment and storage medium | |
| CN103024501B (en) | A kind of system and method utilizing mobile terminal to control television terminal | |
| CN107945101A (en) | Image processing method and device | |
| CN110515526A (en) | A kind of multi-screen interaction method and device | |
| CN102821321A (en) | Remote-control interaction system for digital television | |
| JP2015035996A (en) | Server and method for providing game | |
| CN104007986A (en) | Cross-system remote real-time interaction technology | |
| CN114189542A (en) | Interaction control method and device | |
| JP5545687B1 (en) | Server and method for providing game | |
| US10016676B2 (en) | Processing system, information processing apparatus, control method, program and storage medium | |
| CN104113704A (en) | Game image processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191129 |