CN111142820B - Remote control method, device and system based on multiple screens - Google Patents

Remote control method, device and system based on multiple screens Download PDF

Info

Publication number
CN111142820B
CN111142820B CN201911355623.XA CN201911355623A CN111142820B CN 111142820 B CN111142820 B CN 111142820B CN 201911355623 A CN201911355623 A CN 201911355623A CN 111142820 B CN111142820 B CN 111142820B
Authority
CN
China
Prior art keywords
remote control
display screen
terminal
control information
target data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911355623.XA
Other languages
Chinese (zh)
Other versions
CN111142820A (en
Inventor
张建军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai United Imaging Healthcare Co Ltd
Original Assignee
Shanghai United Imaging Healthcare Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai United Imaging Healthcare Co Ltd filed Critical Shanghai United Imaging Healthcare Co Ltd
Priority to CN201911355623.XA priority Critical patent/CN111142820B/en
Publication of CN111142820A publication Critical patent/CN111142820A/en
Application granted granted Critical
Publication of CN111142820B publication Critical patent/CN111142820B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/547Remote procedure calls [RPC]; Web services

Abstract

The invention discloses a remote control method, a device and a system based on multiple screens, wherein the method comprises the following steps: when triggering remote control operation is detected, acquiring target data in a target area, and when the target data is within a preset data range, generating remote control information based on the target data; and transmitting remote control information to the controlled terminal based on the server corresponding to the control terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information. The technical scheme of the embodiment of the invention solves the technical problems of inconvenient operation and poor user experience when the number of the desktops of the controlled terminal is multiple in the prior art that the control terminal can only control the content of one desktop of the controlled terminal at a time, realizes the operation of multiple display screens of the controlled terminal, and improves the convenience of multi-screen control and the technical effect of user experience.

Description

Remote control method, device and system based on multiple screens
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to a remote control method, device and system based on multiple screens.
Background
With the popularization of networks, there are more and more scenes in which another computer (hereinafter referred to as a local terminal) is remotely operated by a computer. In a remote operation scenario, a user at a remote end can remotely operate a desktop at the local end by sharing content displayed on a certain screen of the local end (hereinafter referred to as a desktop, for example, a dual-screen display is used as a main desktop, and content displayed on another screen is referred to as an auxiliary desktop), so that the user at the remote end can operate the desktop at the local end as if he sits in front of the local end.
Computers today are commonly configured with multiple displays (referred to as multiple screens) to increase the efficiency of the task, e.g., one screen may look up material and write the content of the task based on the material on another screen. And the network bandwidth is large enough to simultaneously transmit desktop contents shared by multiple screens of the local terminal to the remote terminal, so that when the remote terminal is configured with multiple screens, how to use the multiple screens to improve the working efficiency under the remote operation is a challenging problem.
In the prior art, the remote access protocol only supports sharing the content of one desktop to the remote end, so that the remote end cannot fully play the role of multiple screens. In a scenario where the remote end has only one display and the local end has multiple displays, the remote end can only view the content of one desktop at a time. If the content of other desktops needs to be operated, the local end needs to be additionally requested to be switched to the desktop to be operated, and the mode has the technical problems of inconvenient operation and poor user experience.
Disclosure of Invention
The embodiment of the invention provides a multi-screen-based remote control method, device and system, which are used for achieving the technical effects of improving the convenience of remote control of multiple screens and user experience.
In a first aspect, an embodiment of the present invention provides a multi-screen-based remote control method, where the method is applied to a control terminal, and includes:
when triggering remote control operation is detected, acquiring target data in a target area, wherein the target data comprises target quantity of a control terminal using a display screen;
when the target data is within a preset data range, generating remote control information based on the target data;
transmitting the remote control information to a controlled terminal based on a server corresponding to the control terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information;
the remote control information includes the target data.
In a second aspect, an embodiment of the present invention further provides a remote control method based on multiple screens, where the method is applied to a controlled terminal, and includes:
when receiving remote control information sent by a server, acquiring the total display screen quantity corresponding to the controlled terminal;
Determining at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen number;
the remote control information comprises target data determined by the control terminal, wherein the target data comprises target quantity of the control terminal using the display screen.
In a third aspect, an embodiment of the present invention further provides a remote control device based on multiple screens, where the device is configured in a control terminal, and includes:
the target data acquisition module is used for acquiring target data in a target area when triggering remote control operation is detected; the target data comprise target quantity of the control terminal using the display screen;
the remote control information generation module is used for generating remote control information based on the target data when the target data is within a preset data range;
the remote control information sending module is used for sending the remote control information to a controlled terminal based on a server corresponding to the control terminal so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information;
Wherein the remote control information comprises the target data.
In a fourth aspect, an embodiment of the present invention further provides a remote control device based on multiple screens, where the device is configured on a controlled terminal, and includes:
the total display screen quantity determining module is used for acquiring the total display screen quantity corresponding to the controlled terminal when the remote control information sent based on the server is received;
the display screen to be controlled determining module is used for determining at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen quantity;
the remote control information comprises target data determined by the control terminal, wherein the target data comprises target quantity of the control terminal using the display screen.
In a fifth aspect, the embodiment of the invention also provides a remote control system based on multiple screens, which comprises a control terminal and a controlled terminal;
the control terminal includes: the system comprises a target data acquisition module, a remote control information generation module and a remote control information transmission module; the target data acquisition module is used for acquiring target data in a target area when triggering remote control operation is detected; the target data comprise target quantity of the control terminal using the display screen;
The remote control information generation module is used for generating remote control information based on the target data when the target data is within a preset data range;
the remote control information sending module is used for sending the remote control information to a controlled terminal based on a server corresponding to the control terminal so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information;
the remote control information comprises the target data;
the controlled terminal includes: the display screen control system comprises a total display screen quantity determining module and a display screen to be controlled determining module;
the total display screen quantity determining module is used for acquiring the total display screen quantity corresponding to the controlled terminal when the remote control information sent based on the server is received;
the display screen to be controlled determining module is used for determining at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen quantity;
the remote control information comprises target data determined by the control terminal, wherein the target data comprises target quantity of the control terminal using the display screen.
In a sixth aspect, an embodiment of the present invention further provides a terminal, where the terminal includes:
one or more processors;
storage means for storing one or more programs,
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the multi-screen based remote control method according to any of the embodiments of the present invention.
In a seventh aspect, embodiments of the present invention also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are used to perform a multi-screen based remote control method according to any of the embodiments of the present invention.
According to the technical scheme, when triggering remote control operation is detected, target data in a target area are obtained, wherein the target data comprise the target number of the control terminal using a display screen; when the target data is within the preset data range, generating remote control information based on the target data; based on the server corresponding to the control terminal, the remote control information is sent to the controlled terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information, the problem that in the prior art, when the control terminal sends the remote control information, only one desktop content of the controlled terminal can be controlled at a time is solved, if other desktop contents of the controlled terminal are required to be operated simultaneously, the control terminal needs to send request information to the controlled terminal for a plurality of times, the technical problems of inconvenient operation and poor user experience exist, the operation on a plurality of display screens of the controlled terminal based on the number of the display screens to be controlled preset at the control terminal is realized, the convenience of multi-screen control is improved, and the technical effect of user experience is further improved.
Drawings
In order to more clearly illustrate the technical solution of the exemplary embodiments of the present invention, a brief description is given below of the drawings required for describing the embodiments. It is obvious that the drawings presented are only drawings of some of the embodiments of the invention to be described, and not all the drawings, and that other drawings can be made according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a remote control method based on multiple screens according to a first embodiment of the present invention;
fig. 2 is a schematic flow chart of a remote control method based on multiple screens according to a second embodiment of the present invention;
fig. 3 is a schematic flow chart of a multi-screen-based remote control method according to a third embodiment of the present invention;
fig. 4 is a deployment diagram of a control terminal and a controlled terminal according to a third embodiment of the present invention;
fig. 5 is a schematic diagram of a system module structure of a control terminal and a controlled terminal according to a third embodiment of the present invention;
fig. 6 is a schematic structural diagram of a remote control device based on multiple screens according to a fourth embodiment of the present invention;
fig. 7 is a schematic structural diagram of a remote control device based on multiple screens according to a fifth embodiment of the present invention;
Fig. 8 is a schematic structural diagram of a remote control system based on multiple screens according to a sixth embodiment of the present invention;
fig. 9 is a schematic diagram of a terminal structure according to a seventh embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Before the technical scheme of the embodiment is introduced, an application scene is briefly introduced. The control terminal is a terminal that transmits remote control request information, and the controlled terminal is a terminal that receives remote control request information. For example, when the user a wants to remotely manipulate the terminal corresponding to the user B, the user a may transmit remote control request information to the application corresponding to the user B through the application corresponding thereto. And taking the terminal corresponding to the user A as a control terminal, and correspondingly taking the terminal corresponding to the user B as a controlled terminal. The user a can operate the controlled terminal corresponding to the user B through the control terminal.
Example 1
Fig. 1 is a schematic flow chart of a multi-screen-based remote control method according to an embodiment of the present invention, where the embodiment is applicable to a case where a control terminal remotely controls a plurality of display screens, the method may be performed by a multi-screen-based remote control device, and the device may be implemented in a form of software and/or hardware. The hardware may be an electronic device, optionally a PC, a mobile terminal, etc.
As shown in fig. 1, the method of the present embodiment includes:
s110, when triggering remote control operation is detected, acquiring target data in a target area.
Before triggering the remote control operation, the target application program corresponding to the remote control needs to be installed first, and after the installation is completed, the target application program can be registered and logged in. After the user logs in, remote control buttons on the target application program can be triggered to send remote control request information to the controlled terminal, so that remote communication with the controlled terminal is established.
The display interface of the target application program comprises a remote control, and if a user triggers a remote control button, the remote control operation is judged to be triggered, namely a remote control request is initiated to the controlled terminal. The target area may be an area on the target application for writing the number of remote control displays. And taking the data written in the target area as target data. That is, the target data is the number of display screens that the control terminal can operate the controlled terminal.
Specifically, when the remote operation key on the triggering target application program is detected, the number of the display screens of the controlled terminal written in the target area can be obtained.
Optionally, when triggering the remote control operation is detected, a display screen quantity determining module is called to acquire target data in the target area.
That is, when triggering of the remote control operation is detected, the number of display screens of the controlled terminal that the control end needs to control can be determined based on the number of display screens determination program.
And S120, when the target data is within the preset data range, generating remote control information based on the target data.
It should be noted that, the setting of the preset data is related to the number of the display screens of the control terminal. If the number of the display screens of the control terminal is five, the preset data may be 5. That is, the preset data is the number of all display screens of the control terminal. The reason for setting the preset data is that the remote operation user needs to remotely control the display screens of the controlled terminal through the display screens of the control terminal, and thus the number of the remote operation user operable display screens at most corresponds to the number of the display screens of the control terminal.
The preset data are preset according to the number of the display screens of the control terminal, namely the sum of the numbers of all the display screens of the control terminal. The target data is the number set by the remote operation user. The remote control information is control request information sent by the control terminal to the controlled terminal.
Specifically, when the number of the target data, that is, the number of the display screens set in the control terminal is within the preset number range, remote control information can be generated according to the target data and sent to the controlled terminal.
For example, if the preset data is 5 and the target data is 3, that is, the number of the target data is smaller than the number of the preset data, the remote control information may be generated according to the target data and sent to the controlled terminal. That is, the remote control information includes the number of display screens that the control terminal controls the controlled terminal.
And S130, transmitting remote control information to the controlled terminal based on the server corresponding to the control terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information.
The display screen to be controlled is a display screen corresponding to the controlled terminal.
Specifically, after the control terminal generates the remote control information according to the target data, the control terminal may send the remote control information to the server, so that the server sends the remote control information to the controlled terminal, and thus the controlled terminal may determine, based on the remote control information, the number of display screens of the controlled terminal that the control terminal needs to operate.
On the basis of the technical scheme, when the target data is not within the preset data range, the target data changing module is called, the target data is changed into the preset data, and the preset data is used as the target data.
The target data update module may be understood as a module for changing target data.
In the actual application process, there may be a case where the remote operation user ignores the number of display screens of the control terminal, that is, the set target data is larger than the preset data, and at this time, it may not be possible to generate the remote control information according to the set target data. Optionally, when the target data acquired by the display screen number determining module is greater than the preset data, the target data updating module may be invoked to update the target data to the preset data, so that the control terminal may generate the remote control information based on the changed target data.
In this embodiment, the user may trigger a remote control key at the control terminal to operate the remote control service. When the remote control service is triggered, the number N1 of display screens of the control terminal, that is, preset data, may be predetermined, and the number N2 of display screens preconfigured by the user, that is, the target data N2, may be obtained, and the minimum value in N1 and N2 is taken as the number of desktops used by the session, that is, the number N of display screens finally determined by the control terminal. And generating remote control information according to the number of the display screens determined by the control terminal and sending the remote control information to the controlled terminal so that the controlled terminal determines the number of the display screens of the controlled terminal according to the number of the display screens in the remote control information.
According to the technical scheme, when triggering remote control operation is detected, target data in a target area are obtained, wherein the target data comprise the target number of the control terminal using a display screen; when the target data is within the preset data range, generating remote control information based on the target data; based on the server corresponding to the control terminal, the remote control information is sent to the controlled terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information, the problem that in the prior art, when the control terminal sends the remote control information, only one desktop content of the controlled terminal can be controlled at a time is solved, if other desktop contents of the controlled terminal are required to be operated simultaneously, the control terminal needs to send request information to the controlled terminal for a plurality of times, the technical problems of inconvenient operation and poor user experience exist, the operation on a plurality of display screens of the controlled terminal based on the number of the display screens to be controlled preset at the control terminal is realized, the convenience of multi-screen control is improved, and the technical effect of user experience is further improved.
Example two
Fig. 2 is a schematic flow chart of a multi-screen-based remote control method according to a second embodiment of the present invention, where the method can be performed by a multi-screen-based remote control device, and the device can be implemented in software and/or hardware. The hardware may be an electronic device, optionally a PC, a mobile terminal, etc.
S210, when the remote control information sent based on the server is received, the total display screen number corresponding to the controlled terminal is obtained.
The controlled terminal is also provided with a target application program corresponding to the control terminal. When the control terminal sends remote control information to the controlled terminal, the user may trigger an approval or determination button on the target application to establish communication between the control terminal and the controlled terminal. Of course, if the user corresponding to the controlled terminal refuses to receive the remote control request information, the control terminal cannot establish wireless communication with the controlled terminal, that is, the control terminal cannot operate the controlled terminal.
The remote control information is generated by the control terminal based on the target data. The total display screen number is the total display screen number which can be used by the controlled terminal currently.
Specifically, when the control terminal establishes communication with the controlled terminal, the display screen number acquisition module arranged on the controlled terminal can acquire the total display screen number of the controlled terminal.
S220, determining at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen number.
The remote control information comprises target data. The target data may be greater than the total number of display screens or may be less than the total number of display screens. The display screen to be controlled is a display screen corresponding to the remote operation user when operating the controlled terminal. The number of display screens to be controlled is the same as the number of target data in the remote control information.
Specifically, based on the target data in the remote control information and the number of the total display screens, the number of the display screens to be controlled corresponding to the controlled terminal and the display mode of the display screens to be controlled can be determined.
Optionally, when the number of targets in the remote control information is greater than the number of total display screens, creating a virtual desktop according to the number of targets and the number of total display screens; when the target number in the remote control information is smaller than the total display screen number, the display screens to be controlled, which are the same as the target number, are screened out from all the total display screens according to a preset rule.
The virtual desktop is a virtual display screen and corresponds to the traditional display screen. When the target data is greater than the total display screen number, the controlled terminal needs to establish a plurality of virtual desktops to ensure that the display screen number of the controlled terminal corresponds to the target data, so that one display screen of the control terminal corresponds to the display screen of the controlled terminal. The preset rule may be a random selection, or the controlled terminal marks all the display screens, and selects the display screens to be controlled corresponding to the target number according to the sequence from low to high, or selects the display screens to be controlled corresponding to the target number according to the sequence from high to low.
Specifically, if the target number in the remote control information is greater than the total display screen number, a difference value between the target number and the total display screen number can be determined, and a virtual desktop is created based on the difference value, namely, a virtual display screen is created according to the difference value; when the target number in the remote control information is smaller than the total display screen number, the display screens to be controlled, which are the same as the target number, can be screened from all the total display screens according to a certain rule.
In this embodiment, when the remote session is established, the number M of physical desktops of the controlled terminal, that is, the number of total display screens corresponding to the controlled terminal, may be first obtained, when the number M of physical desktops is greater than the target number N, the physical desktops identical to the target number N are screened out from all the physical desktops according to a certain rule, and if the number M of physical desktops is less than the target number N, N-M virtual desktops are established at the controlled terminal. When the control terminal sends remote control information to the controlled terminal, the corresponding relation between the display screen of the controlled terminal and the display screen to be controlled can be predetermined.
On the basis of the technical scheme, it is required to be noted that when a remote operation user moves a cursor on a display screen to the boundary of the display screen, the user can automatically jump to the next display screen of the current display screen.
According to the technical scheme, when the remote control information sent based on the server is received, the total display screen number corresponding to the controlled terminal is obtained; determining at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen number; the remote control information comprises target data determined by the control terminal, and the target data comprises the target number of the display screens used by the control terminal, so that the technical problem that the user experience is poor because the plurality of display screens cannot be controlled simultaneously because only one display screen of the controlled terminal can be processed during remote control in the prior art is solved, the remote control of the plurality of display screens of the controlled terminal by the control terminal is realized, and the control efficiency and the technical effect of the user experience are improved.
Example III
Fig. 3 is a schematic flow chart of a multi-screen-based remote control method according to a third embodiment of the present invention. The embodiment is an interaction flow between a control terminal and a controlled terminal.
As shown in fig. 3, the method includes:
and S310, when the control terminal detects triggering of the remote control operation, acquiring target data in a target area.
For example, if the user a corresponding to the control terminal wants to control the computer of the controlled terminal, communication with the controlled terminal may be established through the target application installed in the control terminal. Optionally, the user a triggers a control for establishing remote communication, and when the control terminal detects an operation for triggering remote control, the target data acquisition module may be invoked to acquire target data set in the target area, that is, the number of display screens of the terminal to be controlled is operated.
And S320, when the control terminal detects that the target data is within the preset data range, generating remote control information based on the target data.
Specifically, when the target data detection module detects that the target data in the target area is within the preset data range, the remote control information can be generated based on the target data.
That is, when a remote control request is transmitted to a controlled terminal, target data may be included in the remote control request.
And S330, transmitting the remote control information to the controlled terminal based on the server.
When the control terminal transmits a remote control request to the controlled terminal, remote control information may be transmitted to the controlled terminal through a server corresponding to the control terminal.
S340, when the controlled terminal receives the remote control information sent by the server, the total display screen number corresponding to the controlled terminal is obtained.
Specifically, the controlled terminal may receive the remote control information sent by the control terminal, and when the controlled terminal receives the remote control information, the display screen number obtaining module of the controlled terminal may obtain the total display screen number corresponding to the controlled terminal.
And S350, the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen number.
Specifically, the controlled terminal may determine, according to the received remote control information and the total number of display screens, the display screen to be controlled corresponding to the controlled terminal, and the specific determination method may refer to specific steps in the second embodiment.
According to the technical scheme, when triggering remote control operation is detected, target data in a target area are obtained, wherein the target data comprise the target number of the control terminal using a display screen; when the target data is within the preset data range, generating remote control information based on the target data; based on the server corresponding to the control terminal, the remote control information is sent to the controlled terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information, the problem that in the prior art, when the control terminal sends the remote control information, only one desktop content of the controlled terminal can be controlled at a time is solved, if other desktop contents of the controlled terminal are required to be operated simultaneously, the control terminal needs to send request information to the controlled terminal for a plurality of times, the technical problems of inconvenient operation and poor user experience exist, the operation on a plurality of display screens of the controlled terminal based on the number of the display screens to be controlled preset at the control terminal is realized, the convenience of multi-screen control is improved, and the technical effect of user experience is further improved.
In this embodiment, the deployment diagram of the control terminal and the controlled terminal may be referred to fig. 4. The local computer corresponds to the controlled terminal, the remote computer is a control terminal, and the control terminal can comprise a plurality of displays, namely a main display of the control terminal and a sub-display of the control terminal. Accordingly, the system modules for implementing the technical solution of the embodiment may be as shown in fig. 5. Fig. 5 includes a local-side remote operation service, i.e., a controlled terminal, and a remote operation session, i.e., an application program for transmitting remote control information, where the controlled terminal may include a physical desktop and a virtual desktop. The specific relationship between whether the virtual desktop exists and the target data set in the control terminal can be seen from the above embodiment. The remote end remotely operates the client, namely the control terminal. The control terminal may also comprise a plurality of display screens, i.e. physical desktops.
Example IV
Fig. 6 is a schematic structural diagram of a remote control device based on multiple screens according to a fourth embodiment of the present invention, where the device includes: a target data acquisition module 610, a remote control information generation module 620, and a remote control information transmission module 630.
The target data obtaining module 610 is configured to obtain target data in a target area when detecting that a remote control operation is triggered; the target data comprise target quantity of the control terminal using the display screen; a remote control information generating module 620, configured to generate remote control information based on the target data when the target data is within a preset data range; a remote control information sending module 630, configured to send the remote control information to a controlled terminal based on a server corresponding to the control terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information; the remote control information includes the target data.
According to the technical scheme, when triggering remote control operation is detected, target data in a target area are obtained, wherein the target data comprise the target number of the control terminal using a display screen; when the target data is within the preset data range, generating remote control information based on the target data; based on the server corresponding to the control terminal, the remote control information is sent to the controlled terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information, the problem that in the prior art, when the control terminal sends the remote control information, only one desktop content of the controlled terminal can be controlled at a time is solved, if other desktop contents of the controlled terminal are required to be operated simultaneously, the control terminal needs to send request information to the controlled terminal for a plurality of times, the technical problems of inconvenient operation and poor user experience exist, the operation on a plurality of display screens of the controlled terminal based on the number of the display screens to be controlled preset at the control terminal is realized, the convenience of multi-screen control is improved, and the technical effect of user experience is further improved.
On the basis of the technical scheme, the target data acquisition module is further used for:
And when the triggering remote control operation is detected, calling a display screen quantity determining module to acquire target data in a target area.
On the basis of the technical schemes, the device further comprises: a target data updating module; the target data updating module is used for calling a target data changing module when the target data is not in the preset data range, changing the target data into preset data and taking the preset data as target data.
The multi-screen-based remote control device provided by the embodiment of the invention can execute the multi-screen-based remote control method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
It should be noted that each unit and module included in the above apparatus are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present invention.
Example five
Fig. 7 is a schematic structural diagram of a remote control device based on multiple screens according to a fourth embodiment of the present invention, where the device includes: a total display number determining module 710 and a display to be controlled determining module 720.
The total display screen number determining module 710 is configured to obtain, when receiving remote control information sent based on the server, the total display screen number corresponding to the controlled terminal; the to-be-controlled display screen determining module 720 is configured to determine at least one to-be-controlled display screen corresponding to the controlled terminal based on the remote control information and the total display screen number; the remote control information comprises target data determined by the control terminal, wherein the target data comprises target quantity of the control terminal using the display screen.
According to the technical scheme, when the remote control information sent based on the server is received, the total display screen number corresponding to the controlled terminal is obtained; determining at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen number; the remote control information comprises target data determined by the control terminal, and the target data comprises the target number of the display screens used by the control terminal, so that the technical problem that the user experience is poor because the plurality of display screens cannot be controlled simultaneously because only one display screen of the controlled terminal can be processed during remote control in the prior art is solved, the remote control of the plurality of display screens of the controlled terminal by the control terminal is realized, and the control efficiency and the technical effect of the user experience are improved.
On the basis of the technical scheme, the display screen determining module to be controlled comprises:
the virtual desktop creation unit is used for creating a virtual desktop according to the target number and the total display screen number when the target number in the remote control information is larger than the total display screen number;
and the display screen to be controlled determining unit is used for screening the display screens to be controlled, which are the same as the target number, from all the total display screens according to a preset rule when the target number in the remote control information is smaller than the total display screen number.
On the basis of the above technical solutions, the virtual display screen creating unit is further configured to:
calculating the difference between the target number and the total display screen number, and taking the difference as the number of the virtual desktops;
the virtual desktop is created based on a number corresponding to the virtual desktop.
On the basis of the technical schemes, the device further comprises: and the display module is used for jumping to the next display screen of the current display screen when detecting that the cursor moves to the preset position.
The multi-screen-based remote control device provided by the embodiment of the invention can execute the multi-screen-based remote control method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
It should be noted that each unit and module included in the above apparatus are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present invention.
Example six
Fig. 8 is a schematic diagram of a tree structure of a remote control system based on multiple screens according to a sixth embodiment of the present invention. The system comprises a control terminal and a controlled terminal.
Wherein, control terminal includes: a target data acquisition module 610, a remote control information generation module 620, and a remote control information transmission module 630; a target data acquisition module 610, configured to acquire target data in a target area when triggering a remote control operation is detected; the target data comprise target quantity of the control terminal using the display screen; a remote control information generation module 620 for generating remote control information based on the target data when the target data is within a preset data range; a remote control information transmitting module 630, configured to transmit remote control information to a controlled terminal based on a server corresponding to the controlled terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information; the remote control information comprises target data; the controlled terminal includes: a total display screen number determining module 710 and a display screen to be controlled determining module 720; the total display screen number determining module 710 is configured to obtain, when receiving remote control information sent based on the server, the total display screen number corresponding to the controlled terminal; the to-be-controlled display screen determining module 720 is configured to determine at least one to-be-controlled display screen corresponding to the controlled terminal based on the remote control information and the total display screen number; the remote control information comprises target data determined by the control terminal, and the target data comprises target quantity of the control terminal using the display screen.
According to the technical scheme, when the remote control information sent based on the server is received, the total display screen number corresponding to the controlled terminal is obtained; determining at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen number; the remote control information comprises target data determined by the control terminal, and the target data comprises the target number of the display screens used by the control terminal, so that the technical problem that the user experience is poor because the plurality of display screens cannot be controlled simultaneously because only one display screen of the controlled terminal can be processed during remote control in the prior art is solved, the remote control of the plurality of display screens of the controlled terminal by the control terminal is realized, and the control efficiency and the technical effect of the user experience are improved.
Example seven
Fig. 9 is a schematic structural diagram of a terminal according to a sixth embodiment of the present invention. Fig. 9 shows a block diagram of an exemplary terminal 80 suitable for use in implementing the embodiments of the present invention. The terminal 80 shown in fig. 9 is merely an example, and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention.
As shown in fig. 9, the terminal 80 is in the form of a general purpose computing device. The components of terminal 80 may include, but are not limited to: one or more processors or processing units 801, a system memory 802, and a bus 803 that connects the various system components (including the system memory 802 and processing units 801).
Bus 803 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, micro channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Terminal 80 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by terminal 80 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 802 may include computer-system-readable media in the form of volatile memory, such as Random Access Memory (RAM) 804 and/or cache memory 805. The terminal 80 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 806 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 9, commonly referred to as a "hard disk drive"). Although not shown in fig. 9, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each drive may be coupled to bus 803 via one or more data medium interfaces. Memory 802 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
A program/utility 808 having a set (at least one) of program modules 807 may be stored in, for example, memory 802, such program modules 807 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 807 typically carry out the functions and/or methods of the described embodiments of the invention.
The terminal 80 can also communicate with one or more external devices 809 (e.g., keyboard, pointing device, display 810, etc.), one or more devices that enable a user to interact with the terminal 80, and/or any devices (e.g., network card, modem, etc.) that enable the terminal 80 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 811. Also, terminal 80 can communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, through network adapter 812. As shown, network adapter 812 communicates with other modules of terminal 80 over bus 803. It should be appreciated that although not shown in fig. 9, other hardware and/or software modules may be used in connection with terminal 80, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processing unit 801 executes various functional applications and data processing by running programs stored in the system memory 802, for example, implementing a multi-screen based remote control method provided by an embodiment of the present invention.
Example eight
An eighth embodiment of the present invention also provides a storage medium containing computer-executable instructions for performing a multi-screen based remote control method when executed by a computer processor.
The method comprises the following steps:
when triggering remote control operation is detected, acquiring target data in a target area, wherein the target data comprises target quantity of a control terminal using a display screen;
when the target data is within a preset data range, generating remote control information based on the target data;
transmitting the remote control information to a controlled terminal based on a server corresponding to the control terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information;
the remote control information includes the target data.
Or alternatively, the first and second heat exchangers may be,
when receiving remote control information sent by a server, acquiring the total display screen quantity corresponding to the controlled terminal;
Determining at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen number;
the remote control information comprises target data determined by the control terminal, wherein the target data comprises target quantity of the control terminal using the display screen.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for embodiments of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.

Claims (10)

1. The remote control method based on the multiple screens is characterized by being applied to a control terminal and comprising the following steps:
when triggering remote control operation is detected, acquiring target data in a target area, wherein the target data comprises target quantity of a control terminal using a display screen;
when the target data is within a preset data range, generating remote control information based on the target data;
transmitting the remote control information to a controlled terminal based on a server corresponding to the control terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen number corresponding to the controlled terminal;
Wherein the remote control information comprises the target data.
2. The method of claim 1, wherein the acquiring the target data within the target area when triggering the remote control operation is detected comprises:
and when the triggering remote control operation is detected, calling a display screen quantity determining module to acquire target data in a target area.
3. The method as recited in claim 1, further comprising:
and when the target data is not in the preset data range, a target data changing module is called, the target data is changed into preset data, and the preset data is used as target data.
4. The remote control method based on the multiple screens is characterized by being applied to a controlled terminal and comprising the following steps of:
when receiving remote control information sent by a server, acquiring the total display screen quantity corresponding to the controlled terminal;
determining at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen number;
the remote control information comprises target data determined by the control terminal, wherein the target data comprises target quantity of the control terminal using the display screen.
5. The method of claim 4, wherein the determining at least one display to be controlled corresponding to the controlled terminal based on the remote control information and the total display number comprises:
when the target number in the remote control information is larger than the total display screen number, creating a virtual desktop according to the target number and the total display screen number;
when the target number in the remote control information is smaller than the total display screen number, screening out the display screens to be controlled, which are the same as the target number, from all the total display screens according to a preset rule.
6. The method of claim 5, wherein the creating a virtual desktop from the target number and the total number of display screens comprises:
calculating the difference between the target number and the total display screen number, and taking the difference as the number of the virtual desktops;
the virtual desktop is created based on a number corresponding to the virtual desktop.
7. The method as recited in claim 4, further comprising:
when the cursor is detected to move to the preset position, the next display screen of the current display screen is skipped.
8. A multi-screen based remote control device, configured in a control terminal, comprising:
the target data acquisition module is used for acquiring target data in a target area when triggering remote control operation is detected; the target data comprise target quantity of the control terminal using the display screen;
the remote control information generation module is used for generating remote control information based on the target data when the target data is within a preset data range;
a remote control information sending module, configured to send the remote control information to a controlled terminal based on a server corresponding to the controlled terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total number of display screens corresponding to the controlled terminal;
the remote control information includes the target data.
9. A multi-screen based remote control device, configured in a controlled terminal, comprising:
the total display screen quantity determining module is used for acquiring the total display screen quantity corresponding to the controlled terminal when the remote control information sent based on the server is received;
The display screen to be controlled determining module is used for determining at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen quantity;
the remote control information comprises target data determined by the control terminal, wherein the target data comprises target quantity of the control terminal using the display screen.
10. The remote control system based on the multiple screens is characterized by comprising a control terminal and a controlled terminal;
the control terminal includes: the system comprises a target data acquisition module, a remote control information generation module and a remote control information transmission module; the target data acquisition module is used for acquiring target data in a target area when triggering remote control operation is detected; the target data comprise target quantity of the control terminal using the display screen;
the remote control information generation module is used for generating remote control information based on the target data when the target data is within a preset data range;
a remote control information sending module, configured to send the remote control information to a controlled terminal based on a server corresponding to the controlled terminal, so that the controlled terminal determines at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total number of display screens corresponding to the controlled terminal;
The remote control information comprises the target data;
the controlled terminal includes: the display screen control system comprises a total display screen quantity determining module and a display screen to be controlled determining module;
the total display screen quantity determining module is used for acquiring the total display screen quantity corresponding to the controlled terminal when the remote control information sent based on the server is received;
the display screen to be controlled determining module is used for determining at least one display screen to be controlled corresponding to the controlled terminal based on the remote control information and the total display screen quantity;
the remote control information comprises target data determined by the control terminal, wherein the target data comprises target quantity of the control terminal using the display screen.
CN201911355623.XA 2019-12-25 2019-12-25 Remote control method, device and system based on multiple screens Active CN111142820B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911355623.XA CN111142820B (en) 2019-12-25 2019-12-25 Remote control method, device and system based on multiple screens

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911355623.XA CN111142820B (en) 2019-12-25 2019-12-25 Remote control method, device and system based on multiple screens

Publications (2)

Publication Number Publication Date
CN111142820A CN111142820A (en) 2020-05-12
CN111142820B true CN111142820B (en) 2023-09-19

Family

ID=70519938

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911355623.XA Active CN111142820B (en) 2019-12-25 2019-12-25 Remote control method, device and system based on multiple screens

Country Status (1)

Country Link
CN (1) CN111142820B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080018061A (en) * 2006-08-23 2008-02-27 주식회사 로직플랜트 User interface method for controlling remote computer
CN102779020A (en) * 2011-05-12 2012-11-14 北京牡丹电子集团有限责任公司 Ultra high definition liquid crystal display device
CN103268208A (en) * 2013-05-06 2013-08-28 北京神州彩虹科技发展有限公司 Wireless control system and wireless control method for performing interactive operations on multiple display screens
WO2014013579A1 (en) * 2012-07-19 2014-01-23 Necディスプレイソリューションズ株式会社 Multi-screen display system and display method
CN103701908A (en) * 2013-12-28 2014-04-02 华为技术有限公司 Method, device and system for remote interaction
CN104780418A (en) * 2015-03-20 2015-07-15 四川长虹电器股份有限公司 Method for synchronously playing different films on smart television in split-screen way
CN105573180A (en) * 2014-10-14 2016-05-11 深圳Tcl数字技术有限公司 Control method and system of terminal
CN107643884A (en) * 2017-09-05 2018-01-30 北京仁光科技有限公司 For at least two computers and the method and system of a screen interaction

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108388142A (en) * 2018-04-10 2018-08-10 百度在线网络技术(北京)有限公司 Methods, devices and systems for controlling home equipment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080018061A (en) * 2006-08-23 2008-02-27 주식회사 로직플랜트 User interface method for controlling remote computer
CN102779020A (en) * 2011-05-12 2012-11-14 北京牡丹电子集团有限责任公司 Ultra high definition liquid crystal display device
WO2014013579A1 (en) * 2012-07-19 2014-01-23 Necディスプレイソリューションズ株式会社 Multi-screen display system and display method
CN103268208A (en) * 2013-05-06 2013-08-28 北京神州彩虹科技发展有限公司 Wireless control system and wireless control method for performing interactive operations on multiple display screens
CN103701908A (en) * 2013-12-28 2014-04-02 华为技术有限公司 Method, device and system for remote interaction
CN105573180A (en) * 2014-10-14 2016-05-11 深圳Tcl数字技术有限公司 Control method and system of terminal
CN104780418A (en) * 2015-03-20 2015-07-15 四川长虹电器股份有限公司 Method for synchronously playing different films on smart television in split-screen way
CN107643884A (en) * 2017-09-05 2018-01-30 北京仁光科技有限公司 For at least two computers and the method and system of a screen interaction

Also Published As

Publication number Publication date
CN111142820A (en) 2020-05-12

Similar Documents

Publication Publication Date Title
US11314568B2 (en) Message processing method and apparatus, storage medium, and computer device
US6542165B1 (en) System, apparatus and method of relating annotation data to an application window
US10452249B2 (en) Tooltip feedback for zoom using scroll wheel
US20140176585A1 (en) System and method for handling remote drawing commands
CN107341016B (en) Focus state implementation method and device under split screen mechanism, terminal and storage medium
CN111866537B (en) Information display method and device in live broadcast room, storage medium and electronic equipment
CN108055304B (en) Remote data synchronization method, device, server, equipment and storage medium
US9525716B2 (en) Ensuring availability and parameter format of URL scheme commands
US20230036515A1 (en) Control method for game accounts, apparatus, medium, and electronic device
CN111263175A (en) Interaction control method and device for live broadcast platform, storage medium and electronic equipment
CN107817962B (en) Remote control method, device, control server and storage medium
CN106027631B (en) Data transmission method and device
CN109302639B (en) Bullet screen message distribution method, bullet screen message distribution device, terminal and storage medium
US11233853B1 (en) System and method for controlling remote sessions executing on other devices
CN109274978B (en) Cooperative guiding method, device, terminal and storage medium for live broadcast room
US9037981B2 (en) Information processing apparatus, control method therefor, and storage medium for displaying cursors from other sites in dedicated windows
CN111142820B (en) Remote control method, device and system based on multiple screens
CN109831673B (en) Live broadcast room data processing method, device, equipment and storage medium
US20200348838A1 (en) Method, device, electronic device, and storage medium for sending and receiving message
CN107390981B (en) Global menu control method, device, equipment and storage medium
CN109327726B (en) Barrage message processing method and device, terminal and storage medium
CN113329250A (en) Control method of playing system and playing system
CN111158566A (en) Event processing method, device, equipment and storage medium
CN112202864B (en) Context switching system, method, device, equipment and medium
CN111084985B (en) Parameter adjusting method and device of input equipment, terminal equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 201807 Shanghai City, north of the city of Jiading District Road No. 2258

Applicant after: Shanghai Lianying Medical Technology Co.,Ltd.

Address before: 201807 Shanghai City, north of the city of Jiading District Road No. 2258

Applicant before: SHANGHAI UNITED IMAGING HEALTHCARE Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant