WO2021003749A1 - Method, device, and system for remove desktop control, device, and storage medium - Google Patents

Method, device, and system for remove desktop control, device, and storage medium Download PDF

Info

Publication number
WO2021003749A1
WO2021003749A1 PCT/CN2019/095651 CN2019095651W WO2021003749A1 WO 2021003749 A1 WO2021003749 A1 WO 2021003749A1 CN 2019095651 W CN2019095651 W CN 2019095651W WO 2021003749 A1 WO2021003749 A1 WO 2021003749A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
remote desktop
projection
same
terminal
Prior art date
Application number
PCT/CN2019/095651
Other languages
French (fr)
Chinese (zh)
Inventor
卢启伟
刘胜强
赵鹏祥
Original Assignee
深圳市鹰硕技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市鹰硕技术有限公司 filed Critical 深圳市鹰硕技术有限公司
Priority to PCT/CN2019/095651 priority Critical patent/WO2021003749A1/en
Priority to CN201980001185.9A priority patent/CN110582749B/en
Publication of WO2021003749A1 publication Critical patent/WO2021003749A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/452Remote windowing, e.g. X-Window System, desktop virtualisation

Definitions

  • the present invention relates to the technical field of the same screen, in particular to a remote desktop control method, device and system, intelligent equipment and storage medium based on the same screen.
  • Remote desktop is a technology that uses the control end (local) computer to operate the controlled end (remote) computer. Its principle is to redirect the desktop of the controlled end computer to the control end computer, and the user can operate the virtual The desktop can be equivalent to the desktop of the controlled end computer.
  • the functions of portable devices such as tablet computers, smart phones, and notebook computers are becoming more abundant and have gradually penetrated into all aspects of people's work and life.
  • mobile terminals are limited by the screen size and cannot share content with others well.
  • the same screen technology solves this problem well.
  • the mobile terminal can project the small screen content of the mobile terminal to the large screen device connected to the same screen device, or even the same screen. Multiple other mobile terminals.
  • the same screen technology has been widely used in conferences, training, classroom teaching, games and other fields.
  • the technology that teachers’ tablets use the same-screen equipment to project the contents of the teaching tablets to the large-screen display and to the students’ tablets on the same screen has been implemented and applied.
  • teachers use the teacher’s tablet for the same screen, they often encounter the problem that the teacher’s tablet cannot open some files or some files are too large to be stored on the teacher’s tablet, which leads to the problem that these files cannot be shared in the classroom.
  • the purpose of the present invention is to provide a remote desktop control method, device, smart device, and storage medium based on the same screen to solve the problems raised in the background art.
  • a remote desktop control method based on the same screen which is applied to a projection terminal, and includes:
  • the method further includes:
  • the screen content sent by the devices on the same screen is received, and the screen content and the preset remote operation touch bar are displayed side by side in the remote desktop window.
  • the remote desktop control instruction includes a first touch instruction triggered by a user on a remote operation touch bar and a second touch instruction triggered on the screen content.
  • the remote desktop control instruction includes a first touch instruction triggered by a user on a remote operation touch bar and a second touch instruction triggered on the screen content.
  • the first touch command includes a display desktop command, a right mouse button command, an open shared folder command, a PPT operation command, and a remote desktop close command.
  • the method further includes:
  • a remote desktop control method based on the same screen is provided, which is applied to a device on the same screen, and includes:
  • the method further includes:
  • the method further includes:
  • Establish a projection connection with the projection terminal receive the screen content sent by the projection terminal, and display the screen content in the projection window.
  • the method further includes:
  • a remote desktop control terminal device based on the same screen, including:
  • the remote desktop request module is used to receive remote desktop instructions input by the user, stop the screen projection, disconnect the projection connection with the same-screen device, and initiate a remote desktop request to the same-screen device;
  • the remote desktop display module is used to establish a split-screen connection with the same-screen device, receive the screen content sent by the same-screen device, and display the screen content in the remote desktop window;
  • the remote desktop control module is used to receive a remote desktop control instruction input by a user, and send the remote desktop control instruction to the same-screen device.
  • the remote desktop control terminal device is used to perform operations for implementing any one of the above-mentioned remote desktop control methods based on the same screen applied to a screen projection terminal.
  • a remote desktop control terminal device including a memory and a processor, wherein:
  • Memory used to store instructions
  • the processor is configured to execute the instructions, so that the remote desktop control terminal device executes operations that implement any one of the above-mentioned remote desktop control methods applied to a screen projection terminal.
  • a remote desktop controlled end device based on the same screen, including:
  • the remote desktop receiving module is used to receive the remote desktop request sent by the projection terminal and hide the projection window;
  • the screen content sending module is used to establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal;
  • the control simulation module is used to receive remote desktop control instructions sent by the projection terminal, and execute corresponding simulation operations according to the remote desktop control instructions.
  • the remote desktop controlled terminal device is used to perform operations for implementing any one of the above-mentioned remote desktop control methods based on the same screen applied to the same screen device.
  • a remote desktop controlled end device including a memory and a processor, wherein:
  • Memory used to store instructions
  • the processor is configured to execute the instructions so that the remote desktop controlled end device executes operations that implement any one of the foregoing remote desktop control methods applied to the same-screen device.
  • a smart device including the remote desktop control terminal device or the remote desktop controlled terminal device described in any one of the above.
  • a remote desktop control system based on the same screen including:
  • Screen projection terminal used to receive remote desktop instructions input by the user, stop projection work, disconnect the projection connection with the same screen device; initiate a remote desktop request to the same screen device; establish a split screen connection with the same screen device, and receive the same screen
  • the screen content sent by the device is displayed on the remote desktop window; the remote desktop control instruction input by the user is received, and the remote desktop control instruction is sent to the same-screen device;
  • the same-screen device used to receive remote desktop requests sent by the projection terminal, hide the projection window; establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal; receive the projection terminal
  • the sent remote desktop control instruction executes a corresponding simulation operation according to the remote desktop control instruction.
  • the system further includes multiple split-screen terminals,
  • the multiple split-screen terminals are used to establish a split-screen connection with the same-screen device, and receive and display the screen content sent by the same-screen device.
  • the screen projection terminal is used to perform any of the operations of the remote desktop control method based on the same screen applied to the screen projection terminal, and the same screen device is used to perform any of the above The operation of the remote desktop control method based on the same screen applied to the same screen device.
  • a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, it realizes any one of the above-mentioned remote desktop control based on the same screen applied to a projection terminal
  • the operation or execution of the method realizes the operation of any one of the above-mentioned remote desktop control methods based on the same screen applied to the same screen device.
  • the embodiment of the present invention introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the screen projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation , Store the files that the projection terminal may need to use in the process of the same screen, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also share the screen content to each split screen. terminal. Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.
  • Figure 1 is a schematic diagram of the implementation environment of a remote desktop control method based on the same screen provided by the present invention
  • FIG. 2 is a flowchart of a remote desktop control method based on the same screen in an embodiment of the present invention
  • FIG. 3 is a schematic diagram of the screen display of a projection terminal in a remote desktop state in an embodiment of the present invention
  • FIG. 4 is a schematic diagram of screen display content and communication connection status of the projection terminal, the large screen and the split screen terminal when the projection terminal is in the remote desktop state and the projection state in an embodiment of the present invention
  • FIG. 5 is a flowchart of a remote desktop control method based on the same screen in another embodiment of the present invention.
  • FIG. 6 is a structural diagram of a remote desktop control terminal device based on the same screen in an embodiment of the present invention.
  • FIG. 7 is a structural diagram of a remote desktop controlled end device based on the same screen in an embodiment of the present invention.
  • FIG. 8 is a structural diagram of a remote desktop control device based on the same screen or a remote desktop control device based on the same screen in another embodiment of the present invention.
  • Fig. 9 is a structural diagram of a remote desktop controlled end system based on the same screen in an embodiment of the present invention.
  • FIG. 1 it is a schematic diagram of the implementation environment of a remote desktop control method based on the same screen of the present invention, including a projection terminal 100, a same screen device 200, a large screen 300 and multiple split screen terminals 400, among which, the same screen
  • the device 200 and the large screen 300 can be combined into one device, such as an all-in-one machine, which contains corresponding modules of the same-screen device.
  • the present invention implements remote desktop control based on the same screen. More specifically, the remote desktop of the present invention is a remote desktop command initiated by a user in the same screen state.
  • the screen projection terminal 100 and the same screen device 200 pass through the same screen. The technology switches from the same screen state to the remote desktop state. Further, the screen projection terminal 100 transmits the remote desktop control command input by the user to the same screen device 200, and the same screen device 200 simulates the corresponding mouse operation or function according to the remote desktop control command operating.
  • the following is a brief description of the same screen process.
  • the QR code scanning main window is displayed on the large screen 300, and the screen projection port and the split screen port are simultaneously monitored.
  • the projection terminal 100 scans the QR code on the large screen 300 to establish a communication connection with the projection port of the same-screen device 200, and starts the screen recording program, encodes the recorded screen content and sends it to the same-screen device 200, the same-screen device 200
  • the screen content of the projection terminal 100 is parsed and displayed on the large screen 300 to realize the projection from the small screen to the large screen.
  • the content of the projection terminal 100 also needs to be screened to multiple split-screen terminals, such as , The teacher will share the contents of his tablet to each student's tablet. Further, multiple split-screen terminals 400 establish communication connections with the split-screen ports of the same-screen device 200 by scanning a two-dimensional code or other methods.
  • the same-screen device 200 monitors that the split-screen port is connected by a split-screen terminal, it starts the screen recording program, encodes the recorded screen content and sends it to each split-screen terminal 400, and each split-screen terminal 400 sends the screen to the same-screen device 200
  • the content is parsed and displayed on the respective screens to realize one-to-many simultaneous screen from the projection terminal 100 to the multiple split-screen terminals 400.
  • the encoding methods used by the projection terminal 100 and the same-screen device 200 for the recorded screen content can be different. Generally speaking, the encoding quality used by the projection terminal 100 is higher than that of the same-screen device 200 quality.
  • FIG. 2 it is a flowchart of a remote desktop control method based on the same screen in an embodiment of the present invention.
  • the method in the embodiment of the present invention is executed by the remote desktop control terminal device in the projection terminal, and the method includes the following steps:
  • Step S201 Receive the remote desktop instruction input by the user, stop the screen projection work, disconnect the screen projection connection with the same-screen device, and initiate a remote desktop request to the same-screen device.
  • the projection terminal When the projection terminal is in the same screen state, after receiving the remote desktop instruction input by the user, it stops the projection work. Specifically, stop recording the current screen content, stop sending the recorded screen content to the same-screen device, and disconnect the projection connection with the same-screen device, and then initiate a remote desktop request to the same-screen device.
  • the user inputs a remote desktop instruction in the form of voice or touch.
  • Step S202 Establish a split screen connection with the same-screen device, receive the screen content sent by the same-screen device, and display the screen content in the remote desktop window.
  • the working mode of the same screen device is to obtain the screen content from the screen projection port and display it on the large screen, record its own screen content, and send its own screen content to each split screen terminal that establishes a communication connection with the split screen port.
  • the projection terminal disconnects from the projection port of the same screen device and establishes a communication connection with the split screen port, the projection terminal turns into a "split screen terminal", and together with other split screen terminals receive the screen sent by the same screen device content.
  • the screen content of the same-screen device is its own desktop content.
  • the same-screen device records its own screen and sends the recorded screen content to the split-screen port. All split-screen terminals connected by communication, including projection terminals transformed into "split-screen terminals”.
  • a remote operation touch bar is provided in the remote desktop window.
  • the remote operation touch bar and the screen content of the same-screen device are displayed side by side in the remote desktop window, with a "desktop” button, a “sharing” button, a “menu” button and a “PPT” button set on it.
  • the remote operation touch bar is displayed on the left, right or upper side of the screen content of the same-screen device.
  • Step S203 Receive the remote desktop control instruction input by the user, and send the remote desktop control instruction to the same-screen device.
  • the user can input remote desktop control instructions by voice or touch.
  • the remote desktop control instruction includes a first touch instruction triggered by the user on the remote operation touch bar and a second touch instruction triggered on the screen content.
  • the first touch command includes a display desktop command, a right mouse button command, an open shared folder command, a PPT operation command, and a remote desktop close command.
  • click the "Desktop” button to trigger the display desktop command to switch between the desktop and the previous active window
  • click the "Share” button to trigger the open shared folder command to open the preset shared folder directory
  • the method further includes:
  • FIG. 4 shows a schematic diagram of the screen display content and communication connection of the projection terminal, the large screen and the split screen terminal when the projection terminal is in the projection state and the remote desktop state respectively.
  • the screen display content of the projection terminal, the large screen and the split-screen terminal are consistent; in the projection state, the The display content is simultaneously screened to the large screen and split screen terminal; in the remote desktop state, the display content of the same screen device is simultaneously screened to the projection terminal and split screen terminal.
  • the above embodiment introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation. Stores the files that the projection terminal may need to use during the same screen process, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also simultaneously screen the screen content to each split screen terminal . Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.
  • FIG. 5 it is a flowchart of a remote desktop control method based on the same screen in another embodiment of the present invention.
  • the method in the embodiment of the present invention is executed by the remote desktop controlled end device in the same-screen device, and the method includes the following steps:
  • Step S501 Receive the remote desktop request sent by the screen projection terminal, and hide the screen projection window.
  • the same-screen device After the same-screen device receives the remote desktop request sent by the projection terminal, it hides the windows related to the projection and displays its desktop on the large screen. Specifically, the screen projection window is hidden, and if the QR code scanning main window is open, the QR code scanning main window is minimized.
  • Step S502 Establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal.
  • the same-screen device After the same-screen device is turned on, it monitors the projection port and the split-screen port in real time. If a terminal is connected to the projection port, the screen content is received from the terminal and displayed on the large screen; if a terminal is connected To the split-screen port, start the screen recording program, record the screen itself, and send the recorded screen content to each terminal connected to the split-screen port. It should be noted that as long as the split screen port has a terminal connection, the screen recording program of the same screen device will continue to run.
  • the same-screen device actually records its own desktop and sends the recorded desktop content to the projection terminal and each split-screen terminal.
  • Step S503 Receive a remote desktop control instruction sent by the projection terminal, and execute a corresponding simulation operation according to the remote desktop control instruction.
  • the same screen device receives the desktop display instruction sent by the projection terminal, and simulates the execution of the "Win+D" hot key operation; receives the open shared folder instruction sent by the projection terminal, and simulates the execution of the shell to open the preset shared folder, That is, execute the cmd.exe command of the Windows native machine, open the file manager to the specified file directory; receive the right mouse button command sent by the projection terminal, and simulate the right-click operation; receive the PPT playback command sent by the projection terminal, and simulate execution "Shift+F5" operation; receive the last slide command sent by the projection terminal, and simulate the "PageUp” operation; receive the next slide command sent by the projection terminal, and simulate the "PageDown” operation; receive the projection
  • the PPT sent by the terminal stops playing instructions and simulates the execution of "Escape” operation.
  • the method further includes:
  • Establish a projection connection with the projection terminal receive the screen content sent by the projection terminal, and display the screen content in the projection window.
  • the same-screen device displays the screen projection window and maximizes the main window for scanning the code after receiving the remote desktop closing instruction.
  • the screen projection port is monitored to establish a connection with the screen projection terminal, the screen projection content sent by the screen projection terminal is received, and the screen projection content is decoded and displayed in the projection window.
  • the screen recording program of the same screen device will record the current screen content (that is, the projected screen content), and then send the recorded screen content to each split screen terminal.
  • the above embodiment introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation. Stores the files that the projection terminal may need to use during the same screen process, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also simultaneously screen the screen content to each split screen terminal . Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.
  • Fig. 6 is a structural diagram of a remote desktop control terminal device based on the same screen in an embodiment of the present invention.
  • the remote desktop control terminal device includes a remote desktop request module 61, a remote desktop display module 62, and a remote desktop control module 63, wherein:
  • the remote desktop request module 61 is used to receive remote desktop instructions input by the user, stop the screen projection, disconnect the projection connection with the same-screen device, and initiate a remote desktop request to the same-screen device;
  • the remote desktop display module 62 is configured to establish a split-screen connection with the same-screen device, receive the screen content sent by the same-screen device, and display the screen content in the remote desktop window;
  • the remote desktop control module 63 is configured to receive a remote desktop control instruction input by a user, and send the remote desktop control instruction to the same-screen device.
  • the projection terminal When the projection terminal is in the same screen state, after receiving the remote desktop instruction input by the user, it stops the projection work. Specifically, stop recording the current screen content, stop sending the recorded screen content to the same screen device, and disconnect the screen projection connection with the same screen device, and then initiate a remote desktop request to the same screen device.
  • the user inputs a remote desktop instruction in the form of voice or touch.
  • the working mode of the same screen device is to obtain the screen content from the screen projection port and display it on the large screen, record its own screen content, and send its own screen content to each split screen terminal that establishes a communication connection with the split screen port.
  • the projection terminal disconnects from the projection port of the same screen device and establishes a communication connection with the split screen port, the projection terminal turns into a "split screen terminal", and together with other split screen terminals receive the screen sent by the same screen device content.
  • the screen content of the same-screen device is its own desktop content.
  • the same-screen device records its own screen and sends the recorded screen content to the split-screen port. All split-screen terminals connected by communication, including projection terminals transformed into "split-screen terminals”.
  • a remote operation touch bar is provided in the remote desktop window.
  • the remote operation touch bar and the screen content of the same-screen device are displayed side by side in the remote desktop window, with a "desktop” button, a “sharing” button, a “menu” button and a “PPT” button set on it.
  • the remote operation touch bar is displayed on the left, right or upper side of the screen content of the same-screen device.
  • the user can input remote desktop control instructions by voice or touch.
  • the remote desktop control instruction includes a first touch instruction triggered by the user on the remote operation touch bar and a second touch instruction triggered on the screen content.
  • the first touch command includes a display desktop command, a right mouse button command, an open shared folder command, a PPT operation command, and a remote desktop close command.
  • click the "Desktop” button to trigger the display desktop command to switch between the desktop and the previous active window
  • click the "Share” button to trigger the open shared folder command to open the preset shared folder directory
  • the method further includes:
  • FIG. 4 shows a schematic diagram of the screen display content and communication connection of the projection terminal, the large screen and the split screen terminal when the projection terminal is in the projection state and the remote desktop state respectively.
  • the projection terminal is in the projection state or the remote desktop state, the screen display content of the projection terminal, the large screen and the split-screen terminal are consistent; in the projection state, the The content displayed by itself is shared to the large screen and split screen terminal; in the remote desktop state, the desktop content of the same screen device is shared to the projection terminal and split screen terminal.
  • the remote desktop control terminal device is used to perform operations for implementing the remote desktop control method described in the foregoing embodiment (the embodiment of FIG. 2).
  • the above embodiment introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation. Stores the files that the projection terminal may need to use during the same screen process, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also simultaneously screen the screen content to each split screen terminal . Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.
  • FIG. 7 is a structural diagram of a remote desktop controlled end device based on the same screen in an embodiment of the present invention.
  • the remote desktop controlled terminal device includes a remote desktop receiving module 71, a screen content sending module 72, and a control simulation module 73, wherein:
  • the remote desktop receiving module 71 is used to receive the remote desktop request sent by the projection terminal and hide the projection window;
  • the screen content sending module 72 is used to establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal;
  • the control simulation module 73 is configured to receive a remote desktop control instruction sent by the screen projection terminal, and execute a corresponding simulation operation according to the remote desktop control instruction.
  • the same-screen device After the same-screen device receives the remote desktop request sent by the projection terminal, it hides the windows related to the projection and displays its desktop on the large screen. Specifically, the screen projection window is hidden, and if the QR code scanning main window is open, the QR code scanning main window is minimized.
  • the same-screen device After the same-screen device is turned on, it monitors the projection port and the split-screen port in real time. If a terminal is connected to the projection port, the screen content is received from the terminal and displayed on the large screen; if a terminal is connected To the split-screen port, start the screen recording program, record the screen itself, and send the recorded screen content to each terminal connected to the split-screen port. It should be noted that as long as the split screen port has a terminal connection, the screen recording program of the same screen device will continue to run.
  • the same-screen device actually records its own desktop and sends the recorded desktop content to the projection terminal and each split-screen terminal.
  • the same screen device receives the desktop display instruction sent by the projection terminal, and simulates the execution of the "Win+D" hot key operation; receives the open shared folder instruction sent by the projection terminal, and simulates the execution of the shell to open the preset shared folder, That is, execute the cmd.exe command of the Windows native machine, open the file manager to the specified file directory; receive the right mouse button command sent by the projection terminal, and simulate the right-click operation; receive the PPT playback command sent by the projection terminal, and simulate execution "Shift+F5" operation; receive the last slide command sent by the projection terminal, and simulate the "PageUp” operation; receive the next slide command sent by the projection terminal, and simulate the "PageDown” operation; receive the projection
  • the PPT sent by the terminal stops playing instructions and simulates the execution of "Escape” operation.
  • the method further includes:
  • Establish a projection connection with the projection terminal receive the screen content sent by the projection terminal, and display the screen content in the projection window.
  • the same-screen device displays the screen projection window and maximizes the main window for scanning the code after receiving the remote desktop closing instruction.
  • the screen projection port is monitored to establish a connection with the screen projection terminal, the screen projection content sent by the screen projection terminal is received, and the screen projection content is decoded and displayed in the projection window.
  • the screen recording program of the same screen device will record the current screen content (that is, the projected screen content), and then send the recorded screen content to each split screen terminal.
  • the remote desktop controlled terminal device is used to perform operations for implementing the remote desktop control method described in the foregoing embodiment (the embodiment of FIG. 5).
  • the above embodiment introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation. Stores the files that the projection terminal may need to use during the same screen process, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also simultaneously screen the screen content to each split screen terminal . Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.
  • FIG. 8 is a structural diagram of a remote desktop control terminal device or a remote desktop controlled terminal device in another embodiment of the present invention, including a memory 81 and a processor 82, wherein:
  • the memory 81 is used to store a computer program that can run on the processor 82.
  • the processor 82 is configured to execute a computer program, so that the remote desktop control terminal device executes operations that implement the remote desktop control method described in the embodiment of FIG. 2 or the remote desktop controlled terminal device executes the remote desktop control described in the embodiment of FIG. 5 Method of operation.
  • a smart device including the remote desktop control terminal device described in FIG. 6 or FIG. 8 or the remote desktop control terminal device described in FIG. 7 or FIG. 8.
  • smart devices include but are not limited to mobile phones, tablets, notebook computers, all-in-one computers, and desktop computers.
  • Figure 9 is a structural diagram of a remote desktop control system based on the same screen in an embodiment of the present invention, including:
  • the projection terminal 91 is used to receive remote desktop instructions input by the user, stop the projection work, and disconnect the projection connection with the same-screen device; initiate a remote desktop request to the same-screen device; establish a split-screen connection with the same-screen device and receive the same The screen content sent by the screen device, displaying the screen content in the remote desktop window; receiving the remote desktop control instruction input by the user, and sending the remote desktop control instruction to the same-screen device;
  • the same screen device 92 used to receive remote desktop requests sent by the projection terminal, hide the projection window; establish a split-screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal; receive the projection screen
  • the remote desktop control instruction sent by the terminal executes a corresponding simulation operation according to the remote desktop control instruction.
  • the system further includes a plurality of split-screen terminals, the plurality of split-screen terminals are used to establish a split-screen connection with the same-screen device, receive and display the screen content sent by the same-screen device .
  • the screen projection terminal 91 is used to perform operations for implementing the remote desktop control method based on the same screen described in the embodiment of FIG. 2, and the same screen device 92 is used to perform the operations described in the embodiment of FIG. Operation based on the remote desktop control method of the same screen.
  • a computer-readable storage medium a computer-readable storage medium
  • the computer-readable storage medium stores a computer program, and when the computer program is executed by a memory, any of the above
  • the remote desktop control method based on the same screen described in an embodiment (the embodiment of FIG. 2 or FIG. 5) can be applied to a smart device; the technical solution of the foregoing embodiment is essentially or a part that contributes to the prior art Or all or part of the technical solution can be embodied in the form of a software product.
  • the computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal computer, a server, a mobile device, or a network).
  • a device, etc.) or a processor (processor) executes all or part of the steps of the method described in this embodiment.
  • the aforementioned storage medium includes: U disk, mobile hard disk, Read Only Memory (ROM, Random Access Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes.
  • the remote desktop control device based on the same screen and the remote desktop control device based on the same screen described above can be implemented as general-purpose processors, programmable logic controllers (PLCs), and digital devices for performing the functions described in this application.
  • PLCs programmable logic controllers
  • DSP Signal processor
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • the program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments.
  • the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.
  • the embodiment of the present invention introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the screen projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation , Store the files that the projection terminal may need to use in the process of the same screen, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also share the screen content to each split screen. terminal. Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.

Abstract

Disclosed are a method, device, and system for duplicate screen-based remote desktop control, a smart device, and a storage medium. The method comprises: receiving a remote desktop command inputted by a user, stopping a screen projection work, disconnecting a screen projection connection with a duplicate screen device, launching a remote desktop request to the duplicate screen device; establishing a split screen connection with the duplicate screen device, receiving a screen content transmitted by the duplicate screen device, displaying the screen content in a remote desktop window; receiving a remote desktop control command inputted by the user, and transmitting the remote desktop control command to the duplicate screen device. The present invention introduces a remote desktop technique to a duplicate screen process, greatly extends the functionality of a mobile terminal, allows a screen-projecting terminal to open and present a file that could not be opened, has a small research and development investment, and provides strong scalability.

Description

一种远程桌面控制方法、装置和系统、设备及存储介质Remote desktop control method, device, system, equipment and storage medium 技术领域Technical field
本发明涉及同屏技术领域,尤其涉及一种基于同屏的远程桌面控制方法、装置和系统、智能设备及存储介质。The present invention relates to the technical field of the same screen, in particular to a remote desktop control method, device and system, intelligent equipment and storage medium based on the same screen.
背景技术Background technique
远程桌面是一种利用控制端(本端)计算机操作受控端(远端)计算机的技术,其原理是将受控端计算机的桌面重定向到控制端计算机,用户通过操作控制端计算机的虚拟桌面可等同操作受控端计算机的桌面。Remote desktop is a technology that uses the control end (local) computer to operate the controlled end (remote) computer. Its principle is to redirect the desktop of the controlled end computer to the control end computer, and the user can operate the virtual The desktop can be equivalent to the desktop of the controlled end computer.
目前,智能移动终端如平板电脑、智能手机以及笔记本电脑等的便携式设备的功能日益丰富,已经逐渐渗透到人们工作和生活的各个方面。但移动终端受限于屏幕大小,不能很好地与他人分享内容。同屏技术很好地解决了这一问题,移动终端通过与同屏设备建立通讯连接,可以将移动终端的小屏内容投屏到与同屏设备相连接的大屏装置上,甚至同屏到多个其他移动终端。目前,同屏技术在会议、培训、课堂教学、游戏等领域已得到广泛应用。在课堂教学领域,教师平板通过同屏设备将教学平板内容投屏到大屏显示器,并同屏到各学生平板的技术已经实现并应用。老师在使用教师平板进行同屏时,经常会遇到教师平板无法打开某些文件或者某些文件太大,不方便存储在教师平板的情况,从而导致这些文件无法在课堂进行分享的问题。At present, the functions of portable devices such as tablet computers, smart phones, and notebook computers are becoming more abundant and have gradually penetrated into all aspects of people's work and life. However, mobile terminals are limited by the screen size and cannot share content with others well. The same screen technology solves this problem well. By establishing a communication connection with the same screen device, the mobile terminal can project the small screen content of the mobile terminal to the large screen device connected to the same screen device, or even the same screen. Multiple other mobile terminals. At present, the same screen technology has been widely used in conferences, training, classroom teaching, games and other fields. In the field of classroom teaching, the technology that teachers’ tablets use the same-screen equipment to project the contents of the teaching tablets to the large-screen display and to the students’ tablets on the same screen has been implemented and applied. When teachers use the teacher’s tablet for the same screen, they often encounter the problem that the teacher’s tablet cannot open some files or some files are too large to be stored on the teacher’s tablet, which leads to the problem that these files cannot be shared in the classroom.
发明内容Summary of the invention
本发明的目的在于提供一种基于同屏的远程桌面控制方法、装置、智能设备及存储介质,以解决上述背景技术中提出的问题。The purpose of the present invention is to provide a remote desktop control method, device, smart device, and storage medium based on the same screen to solve the problems raised in the background art.
根据本发明的一个方面,提供一种基于同屏的远程桌面控制方法,应用于投屏终端,包括:According to one aspect of the present invention, there is provided a remote desktop control method based on the same screen, which is applied to a projection terminal, and includes:
接收用户输入的远程桌面指令,停止投屏工作,与同屏设备断开投屏连接,向同屏设备发起远程桌面请求;Receive remote desktop instructions entered by the user, stop screen projection, disconnect the screen projection connection with the same screen device, and initiate a remote desktop request to the same screen device;
与同屏设备建立分屏连接,接收同屏设备发送的屏幕内容,将所述屏幕内容显示在远程桌面窗口;Establish a split-screen connection with the same-screen device, receive the screen content sent by the same-screen device, and display the screen content in the remote desktop window;
接收用户输入的远程桌面控制指令,将所述远程桌面控制指令发送至同屏设备。Receive the remote desktop control instruction input by the user, and send the remote desktop control instruction to the same-screen device.
在本发明的一个实施例中,所述方法还包括:In an embodiment of the present invention, the method further includes:
接收同屏设备发送的屏幕内容,将所述屏幕内容与预设的远程操作触控条并排显示在远程桌面窗口。The screen content sent by the devices on the same screen is received, and the screen content and the preset remote operation touch bar are displayed side by side in the remote desktop window.
在本发明的一个实施例中,所述远程桌面控制指令包括用户在远程操作触控条上触发的第一触控指令和在所述屏幕内容上触发的第二触控指令。In an embodiment of the present invention, the remote desktop control instruction includes a first touch instruction triggered by a user on a remote operation touch bar and a second touch instruction triggered on the screen content.
在本发明的一个实施例中,所述远程桌面控制指令包括用户在远程操作触控条上触发的第一触控指令和在所述屏幕内容上触发的第二触控指令。In an embodiment of the present invention, the remote desktop control instruction includes a first touch instruction triggered by a user on a remote operation touch bar and a second touch instruction triggered on the screen content.
在本发明的一个实施例中,所述第一触控指令包括显示桌面指令、鼠标右键指令、打开共享文件夹指令、PPT操作指令和远程桌面关闭指令。In an embodiment of the present invention, the first touch command includes a display desktop command, a right mouse button command, an open shared folder command, a PPT operation command, and a remote desktop close command.
在本发明的一个实施例中,所述方法还包括:In an embodiment of the present invention, the method further includes:
接收用户输入的远程桌面关闭指令,关闭远程桌面窗口,与同屏设备断开分屏连接;Receive the remote desktop close command entered by the user, close the remote desktop window, and disconnect the split-screen connection with the same-screen device;
将远程桌面关闭指令发送至同屏设备;Send the remote desktop close command to the same screen device;
与同屏设备建立投屏连接,开启投屏工作,录制当前屏幕内容,将录制的屏幕内容发送至同屏设备。Establish a projection connection with the same screen device, start the projection job, record the current screen content, and send the recorded screen content to the same screen device.
根据本发明的一个方面,提供一种基于同屏的远程桌面控制方法,应用于同屏设备,包括:According to one aspect of the present invention, a remote desktop control method based on the same screen is provided, which is applied to a device on the same screen, and includes:
接收投屏终端发送的远程桌面请求,隐藏投屏窗口;Receive the remote desktop request sent by the projection terminal and hide the projection window;
与投屏终端建立分屏连接,录制当前屏幕内容,将录制的屏幕内容发送至投屏终端;Establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal;
接收投屏终端发送的远程桌面控制指令,根据所述远程桌面控制指令执行相应的模拟操作。Receive the remote desktop control instruction sent by the projection terminal, and execute the corresponding simulation operation according to the remote desktop control instruction.
在本发明的一个实施例中,所述方法还包括:In an embodiment of the present invention, the method further includes:
接收投屏终端发送的显示桌面指令,模拟执行“Win+D”热键操作;Receive the desktop display command sent by the projection terminal, and simulate the "Win+D" hotkey operation;
接收投屏终端发送的打开共享文件夹指令,模拟执行shell打开预设的共享文件夹;Receive the open shared folder instruction sent by the projection terminal, and simulate executing the shell to open the preset shared folder;
接收投屏终端发送的鼠标右键指令,模拟执行鼠标右键单击操作;Receive the right mouse button instruction sent by the projection terminal, and simulate the right mouse click operation;
接收投屏终端发送的PPT播放指令,模拟执行“Shift+F5”操作;Receive the PPT playback command sent by the projection terminal, and simulate the "Shift+F5" operation;
接收投屏终端发送的播放上一个幻灯片指令,模拟执行“PageUp”操作;Receive the last slide show instruction sent by the projection terminal, and simulate the execution of "PageUp" operation;
接收投屏终端发送的播放下一个幻灯片指令,模拟执行“PageDown”操作;Receive the next slide instruction sent by the projection terminal, and simulate the execution of the "PageDown" operation;
接收投屏终端发送的PPT停止播放指令,模拟执行“Escape”操作。Receive the PPT stop playback instruction sent by the projection terminal, and simulate the "Escape" operation.
在本发明的一个实施例中,所述方法还包括:In an embodiment of the present invention, the method further includes:
接收投屏终端发送的远程桌面关闭指令,显示投屏窗口;Receive the remote desktop close command sent by the projection terminal, and display the projection window;
与投屏终端建立投屏连接,接收投屏终端发送的屏幕内容,将所述屏幕内容显示在投屏窗口。Establish a projection connection with the projection terminal, receive the screen content sent by the projection terminal, and display the screen content in the projection window.
在本发明的一个实施例中,所述方法还包括:In an embodiment of the present invention, the method further includes:
录制当前屏幕内容,将录制的屏幕内容发送至与其建立分屏连接的多个分屏终端。Record the current screen content and send the recorded screen content to multiple split-screen terminals with which it has established split-screen connections.
根据本发明的一个方面,提供一种基于同屏的远程桌面控制端装置,包括:According to one aspect of the present invention, there is provided a remote desktop control terminal device based on the same screen, including:
远程桌面请求模块,用于接收用户输入的远程桌面指令,停止投屏工作,与同屏设备断开投屏连接,向同屏设备发起远程桌面请求;The remote desktop request module is used to receive remote desktop instructions input by the user, stop the screen projection, disconnect the projection connection with the same-screen device, and initiate a remote desktop request to the same-screen device;
远程桌面显示模块,用于与同屏设备建立分屏连接,接收同屏设备发送的屏幕内容,将所述屏幕内容显示在远程桌面窗口;The remote desktop display module is used to establish a split-screen connection with the same-screen device, receive the screen content sent by the same-screen device, and display the screen content in the remote desktop window;
远程桌面操控模块,用于接收用户输入的远程桌面控制指令,将所述远程桌面控制指令发送至同屏设备。The remote desktop control module is used to receive a remote desktop control instruction input by a user, and send the remote desktop control instruction to the same-screen device.
在本发明的一个实施例中,所述远程桌面控制端装置用于执行实现上述任一项应用于投屏终端的基于同屏的远程桌面控制方法的操作。In an embodiment of the present invention, the remote desktop control terminal device is used to perform operations for implementing any one of the above-mentioned remote desktop control methods based on the same screen applied to a screen projection terminal.
根据本发明的一个方面,提供一种远程桌面控制端装置,包括存储器和 处理器,其中:According to one aspect of the present invention, a remote desktop control terminal device is provided, including a memory and a processor, wherein:
存储器,用于存储指令;Memory, used to store instructions;
处理器,用于执行所述指令,使得所述远程桌面控制端装置执行实现上述任一项应用于投屏终端的远程桌面控制方法的操作。The processor is configured to execute the instructions, so that the remote desktop control terminal device executes operations that implement any one of the above-mentioned remote desktop control methods applied to a screen projection terminal.
根据本发明的一个方面,提供一种基于同屏的远程桌面受控端装置,包括:According to one aspect of the present invention, there is provided a remote desktop controlled end device based on the same screen, including:
远程桌面接收模块,用于接收投屏终端发送的远程桌面请求,隐藏投屏窗口;The remote desktop receiving module is used to receive the remote desktop request sent by the projection terminal and hide the projection window;
屏幕内容发送模块,用于与投屏终端建立分屏连接,录制当前屏幕内容,将录制的屏幕内容发送至投屏终端;The screen content sending module is used to establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal;
操控模拟模块,用于接收投屏终端发送的远程桌面控制指令,根据所述远程桌面控制指令执行相应的模拟操作。The control simulation module is used to receive remote desktop control instructions sent by the projection terminal, and execute corresponding simulation operations according to the remote desktop control instructions.
在本发明的一个实施例中,所述远程桌面受控端装置用于执行实现上述任一项应用于同屏设备的基于同屏的远程桌面控制方法的操作。In an embodiment of the present invention, the remote desktop controlled terminal device is used to perform operations for implementing any one of the above-mentioned remote desktop control methods based on the same screen applied to the same screen device.
根据本发明的一个方面,提供一种远程桌面受控端装置,包括存储器和处理器,其中:According to one aspect of the present invention, there is provided a remote desktop controlled end device, including a memory and a processor, wherein:
存储器,用于存储指令;Memory, used to store instructions;
处理器,用于执行所述指令,使得所述远程桌面受控端装置执行实现上述任一项应用于同屏设备的远程桌面控制方法的操作。The processor is configured to execute the instructions so that the remote desktop controlled end device executes operations that implement any one of the foregoing remote desktop control methods applied to the same-screen device.
根据本发明的一个方面,提供一种智能设备,包括上述任一项所述的远程桌面控制端装置或远程桌面受控端装置。According to one aspect of the present invention, a smart device is provided, including the remote desktop control terminal device or the remote desktop controlled terminal device described in any one of the above.
根据本发明的一个方面,提供一种基于同屏的远程桌面控制系统,包括:According to one aspect of the present invention, a remote desktop control system based on the same screen is provided, including:
投屏终端,用于接收用户输入的远程桌面指令,停止投屏工作,与同屏设备断开投屏连接;向同屏设备发起远程桌面请求;与同屏设备建立分屏连接,接收同屏设备发送的屏幕内容,将所述屏幕内容显示在远程桌面窗口;接收用户输入的远程桌面控制指令,将所述远程桌面控制指令发送至同屏设备;Screen projection terminal, used to receive remote desktop instructions input by the user, stop projection work, disconnect the projection connection with the same screen device; initiate a remote desktop request to the same screen device; establish a split screen connection with the same screen device, and receive the same screen The screen content sent by the device is displayed on the remote desktop window; the remote desktop control instruction input by the user is received, and the remote desktop control instruction is sent to the same-screen device;
同屏设备,用于接收投屏终端发送的远程桌面请求,隐藏投屏窗口;与投屏终端建立分屏连接,录制当前屏幕内容,将录制的屏幕内容发送至投屏终端;接收投屏终端发送的远程桌面控制指令,根据所述远程桌面控制指令执行相应的模拟操作。The same-screen device, used to receive remote desktop requests sent by the projection terminal, hide the projection window; establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal; receive the projection terminal The sent remote desktop control instruction executes a corresponding simulation operation according to the remote desktop control instruction.
在本发明的一个实施例中,所述系统还包括多个分屏终端,In an embodiment of the present invention, the system further includes multiple split-screen terminals,
所述多个分屏终端,用于与同屏设备建立分屏连接,接收同屏设备发送的屏幕内容并进行显示。The multiple split-screen terminals are used to establish a split-screen connection with the same-screen device, and receive and display the screen content sent by the same-screen device.
在本发明的一个实施例中,所述投屏终端用于执行上述任一项应用于投屏终端的基于同屏的远程桌面控制方法的操作,所述同屏设备用于执行上述任一项应用于同屏设备的基于同屏的远程桌面控制方法的操作。In an embodiment of the present invention, the screen projection terminal is used to perform any of the operations of the remote desktop control method based on the same screen applied to the screen projection terminal, and the same screen device is used to perform any of the above The operation of the remote desktop control method based on the same screen applied to the same screen device.
根据本发明的一个方面,提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现上述任一项应用于投屏终端的基于同屏的远程桌面控制方法的操作或者执行时实现上述任一项应用于同屏设备的基于同屏的远程桌面控制方法的操作。According to one aspect of the present invention, there is provided a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, it realizes any one of the above-mentioned remote desktop control based on the same screen applied to a projection terminal The operation or execution of the method realizes the operation of any one of the above-mentioned remote desktop control methods based on the same screen applied to the same screen device.
实施本发明实施例,将具有如下有益效果:Implementing the embodiments of the present invention will have the following beneficial effects:
本发明实施例在同屏过程中引入远程桌面技术,大大延伸了移动终端的功能,使得投屏终端借助同屏设备可以将原本无法打开的文件进行打开演示,或者将同屏设备作为一个临时工作站,存储投屏终端在同屏过程中可能需要使用的文件,使得投屏终端在投屏时可随时通过远程桌面进行打开演示,进一步地,同屏设备还可将屏幕内容同屏至各分屏终端。由于本发明是利用现有的同屏技术采用自定义协议和指令实现的远程桌面技术,研发投入小,可扩展性强。The embodiment of the present invention introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the screen projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation , Store the files that the projection terminal may need to use in the process of the same screen, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also share the screen content to each split screen. terminal. Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.
附图说明Description of the drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.
其中:among them:
图1为本发明提供的一种基于同屏的远程桌面控制方法的实施环境示意图;Figure 1 is a schematic diagram of the implementation environment of a remote desktop control method based on the same screen provided by the present invention;
图2为本发明一个实施例中一种基于同屏的远程桌面控制方法的流程图;2 is a flowchart of a remote desktop control method based on the same screen in an embodiment of the present invention;
图3为本发明一个实施例中处于远程桌面状态的投屏终端屏幕显示示意图;3 is a schematic diagram of the screen display of a projection terminal in a remote desktop state in an embodiment of the present invention;
图4为本发明一个实施例中投屏终端分别处于远程桌面状态和投屏状态时投屏终端、大屏及分屏终端的屏幕显示内容及通讯连接情况示意图;4 is a schematic diagram of screen display content and communication connection status of the projection terminal, the large screen and the split screen terminal when the projection terminal is in the remote desktop state and the projection state in an embodiment of the present invention;
图5为本发明另一个实施例中一种基于同屏的远程桌面控制方法的流程图;5 is a flowchart of a remote desktop control method based on the same screen in another embodiment of the present invention;
图6为本发明一个实施例中一种基于同屏的远程桌面控制端装置的结构图;FIG. 6 is a structural diagram of a remote desktop control terminal device based on the same screen in an embodiment of the present invention;
图7为本发明一个实施例中一种基于同屏的远程桌面受控端装置的结构图;FIG. 7 is a structural diagram of a remote desktop controlled end device based on the same screen in an embodiment of the present invention;
图8为本发明另一个实施例中一种基于同屏的远程桌面控制端装置或一种基于同屏的远程桌面受控端装置的结构图;8 is a structural diagram of a remote desktop control device based on the same screen or a remote desktop control device based on the same screen in another embodiment of the present invention;
图9为本发明一个实施例中一种基于同屏的远程桌面受控端系统的结构图。Fig. 9 is a structural diagram of a remote desktop controlled end system based on the same screen in an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.
如图1所示,为本发明一种基于同屏的远程桌面控制方法的实施环境示意图,包括投屏终端100,同屏设备200,大屏300和多个分屏终端400,其中,同屏设备200和大屏300可以合并为一个设备,如一体机,该一体机内 部包含有同屏设备的相应模块。As shown in Figure 1, it is a schematic diagram of the implementation environment of a remote desktop control method based on the same screen of the present invention, including a projection terminal 100, a same screen device 200, a large screen 300 and multiple split screen terminals 400, among which, the same screen The device 200 and the large screen 300 can be combined into one device, such as an all-in-one machine, which contains corresponding modules of the same-screen device.
本发明是基于同屏来实现远程桌面控制的,更具体地,本发明的远程桌面是在同屏状态下,用户发起的远程桌面指令,投屏终端100和同屏设备200之间通过同屏技术由同屏状态切换到远程桌面状态,进一步,由投屏终端100将用户输入的远程桌面控制指令传递到同屏设备200,同屏设备200根据远程桌面控制指令模拟执行相应的鼠标操作或功能操作。以下对同屏的流程进行简要描述。The present invention implements remote desktop control based on the same screen. More specifically, the remote desktop of the present invention is a remote desktop command initiated by a user in the same screen state. The screen projection terminal 100 and the same screen device 200 pass through the same screen. The technology switches from the same screen state to the remote desktop state. Further, the screen projection terminal 100 transmits the remote desktop control command input by the user to the same screen device 200, and the same screen device 200 simulates the corresponding mouse operation or function according to the remote desktop control command operating. The following is a brief description of the same screen process.
同屏设备200开启后,在大屏300上显示二维码扫码主窗口,同时监听投屏端口和分屏端口。投屏终端100扫描大屏300上的二维码与同屏设备200的投屏端口建立通讯连接,并启动屏幕录制程序,将录制的屏幕内容编码后发送至同屏设备200,同屏设备200将投屏终端100的屏幕内容解析后显示在大屏300上,实现从小屏到大屏的投屏。实际应用中,比如会议、课堂教学、培训等场景,除了将投屏终端100的屏幕内容投到大屏300之外,还需要将投屏终端100的内容同屏到多个分屏终端,比如,老师将自身平板内容同屏到各学生平板。进一步地,多个分屏终端400通过扫描二维码或其他方式与同屏设备200的分屏端口建立通讯连接。同屏设备200监听到分屏端口有分屏终端接入时,启动屏幕录制程序,将录制的屏幕内容编码后发送至各分屏终端400,各分屏终端400对同屏设备200发送的屏幕内容进行解析后显示在各自的屏幕上,实现从投屏终端100到多个分屏终端400的一对多同屏。需要说明的是,投屏终端100和同屏设备200对录制后的屏幕内容采用的编码方式是可以不同的,一般来说,投屏终端100采用的编码质量高于同屏设备200采用的编码质量。After the same-screen device 200 is turned on, the QR code scanning main window is displayed on the large screen 300, and the screen projection port and the split screen port are simultaneously monitored. The projection terminal 100 scans the QR code on the large screen 300 to establish a communication connection with the projection port of the same-screen device 200, and starts the screen recording program, encodes the recorded screen content and sends it to the same-screen device 200, the same-screen device 200 The screen content of the projection terminal 100 is parsed and displayed on the large screen 300 to realize the projection from the small screen to the large screen. In practical applications, such as conferences, classroom teaching, training, etc., in addition to projecting the screen content of the projection terminal 100 to the large screen 300, the content of the projection terminal 100 also needs to be screened to multiple split-screen terminals, such as , The teacher will share the contents of his tablet to each student's tablet. Further, multiple split-screen terminals 400 establish communication connections with the split-screen ports of the same-screen device 200 by scanning a two-dimensional code or other methods. When the same-screen device 200 monitors that the split-screen port is connected by a split-screen terminal, it starts the screen recording program, encodes the recorded screen content and sends it to each split-screen terminal 400, and each split-screen terminal 400 sends the screen to the same-screen device 200 The content is parsed and displayed on the respective screens to realize one-to-many simultaneous screen from the projection terminal 100 to the multiple split-screen terminals 400. It should be noted that the encoding methods used by the projection terminal 100 and the same-screen device 200 for the recorded screen content can be different. Generally speaking, the encoding quality used by the projection terminal 100 is higher than that of the same-screen device 200 quality.
如图2所示,为本发明一个实施例中一种基于同屏的远程桌面控制方法的流程图。优选的,本发明实施例的方法由投屏终端中的远程桌面控制端装置进行执行,该方法包括以下步骤:As shown in FIG. 2, it is a flowchart of a remote desktop control method based on the same screen in an embodiment of the present invention. Preferably, the method in the embodiment of the present invention is executed by the remote desktop control terminal device in the projection terminal, and the method includes the following steps:
步骤S201,接收用户输入的远程桌面指令,停止投屏工作,与同屏设备断开投屏连接,向同屏设备发起远程桌面请求。Step S201: Receive the remote desktop instruction input by the user, stop the screen projection work, disconnect the screen projection connection with the same-screen device, and initiate a remote desktop request to the same-screen device.
投屏终端在同屏状态下,接收到用户输入的远程桌面指令后,停止投屏工作。具体的,停止录制当前屏幕内容,停止发送录制的屏幕内容至同屏设 备,并与同屏设备断开投屏连接,然后向同屏设备发起远程桌面请求。When the projection terminal is in the same screen state, after receiving the remote desktop instruction input by the user, it stops the projection work. Specifically, stop recording the current screen content, stop sending the recorded screen content to the same-screen device, and disconnect the projection connection with the same-screen device, and then initiate a remote desktop request to the same-screen device.
在本发明的一个实施例中,用户通过语音或者触摸的形式输入远程桌面指令。In an embodiment of the present invention, the user inputs a remote desktop instruction in the form of voice or touch.
步骤S202,与同屏设备建立分屏连接,接收同屏设备发送的屏幕内容,将所述屏幕内容显示在远程桌面窗口。Step S202: Establish a split screen connection with the same-screen device, receive the screen content sent by the same-screen device, and display the screen content in the remote desktop window.
如图1所述,同屏设备的工作模式是从投屏端口获取投屏内容显示到大屏,录制自身屏幕内容,并将自身屏幕内容发送到与分屏端口建立通讯连接的各分屏终端。当投屏终端与同屏设备的投屏端口断开连接,与分屏端口建立通讯连接后,则投屏终端转变为“分屏终端”,与其他分屏终端一起接收同屏设备发送的屏幕内容。此时,同屏设备的投屏端口无任何终端与之连接,同屏设备的屏幕内容即自身桌面内容,同屏设备对自身屏幕进行录制,并将录制的屏幕内容发送到与分屏端口建立通讯连接的各分屏终端,包括转变为“分屏终端”的投屏终端。As shown in Figure 1, the working mode of the same screen device is to obtain the screen content from the screen projection port and display it on the large screen, record its own screen content, and send its own screen content to each split screen terminal that establishes a communication connection with the split screen port. . When the projection terminal disconnects from the projection port of the same screen device and establishes a communication connection with the split screen port, the projection terminal turns into a "split screen terminal", and together with other split screen terminals receive the screen sent by the same screen device content. At this time, there is no terminal connected to the projection port of the same-screen device, and the screen content of the same-screen device is its own desktop content. The same-screen device records its own screen and sends the recorded screen content to the split-screen port. All split-screen terminals connected by communication, including projection terminals transformed into "split-screen terminals".
在本发明的一个实施例中,在远程桌面窗口设置有远程操作触控条。如图3所示,该远程操作触控条和同屏设备的屏幕内容并排显示在远程桌面窗口,其上设置有“桌面”按键、“共享”按键、“菜单”按键和“PPT”按键。优选的,远程操作触控条显示在同屏设备的屏幕内容的左侧、右侧或上侧。In an embodiment of the present invention, a remote operation touch bar is provided in the remote desktop window. As shown in Figure 3, the remote operation touch bar and the screen content of the same-screen device are displayed side by side in the remote desktop window, with a "desktop" button, a "sharing" button, a "menu" button and a "PPT" button set on it. Preferably, the remote operation touch bar is displayed on the left, right or upper side of the screen content of the same-screen device.
步骤S203,接收用户输入的远程桌面控制指令,将所述远程桌面控制指令发送至同屏设备。Step S203: Receive the remote desktop control instruction input by the user, and send the remote desktop control instruction to the same-screen device.
在本发明的一个实施例中,用户可通过语音或触摸的方式输入远程桌面控制指令。In an embodiment of the present invention, the user can input remote desktop control instructions by voice or touch.
在本发明的一个实施例中,远程桌面控制指令包括用户在远程操作触控条上触发的第一触控指令和在所述屏幕内容上触发的第二触控指令。其中,第一触控指令包括显示桌面指令、鼠标右键指令、打开共享文件夹指令、PPT操作指令和远程桌面关闭指令。具体的,点击“桌面”按键,触发显示桌面指令,在桌面及上一个活动窗口进行切换;点击“共享”按键,触发打开共享文件夹指令,打开预设的共享文件夹目录;点击“菜单”按键,触发鼠标右键指令;点击“PPT”按键,打开或关闭PPT的4个操作热键。In an embodiment of the present invention, the remote desktop control instruction includes a first touch instruction triggered by the user on the remote operation touch bar and a second touch instruction triggered on the screen content. Among them, the first touch command includes a display desktop command, a right mouse button command, an open shared folder command, a PPT operation command, and a remote desktop close command. Specifically, click the "Desktop" button to trigger the display desktop command to switch between the desktop and the previous active window; click the "Share" button to trigger the open shared folder command to open the preset shared folder directory; click "Menu" Press the button to trigger the right mouse button instruction; click the "PPT" button to turn on or off the 4 operation hot keys of the PPT.
在本发明的一个实施例中,所述方法还包括:In an embodiment of the present invention, the method further includes:
接收用户输入的远程桌面关闭指令,关闭远程桌面窗口,与同屏设备断开分屏连接;Receive the remote desktop close command entered by the user, close the remote desktop window, and disconnect the split-screen connection with the same-screen device;
将远程桌面关闭指令发送至同屏设备;Send the remote desktop close command to the same screen device;
与同屏设备建立投屏连接,开启投屏工作,录制当前屏幕内容,将录制的屏幕内容发送至同屏设备。Establish a projection connection with the same screen device, start the projection job, record the current screen content, and send the recorded screen content to the same screen device.
实际应用中,投屏和远程桌面两个状态是互斥的,投屏终端在进行远程桌面时,停止投屏工作,连接到同屏设备的分屏端口;投屏终端在进行投屏时,停止远程桌面,连接到同屏设备的投屏端口。如图4所示为投屏终端分别处于投屏状态和远程桌面状态时投屏终端、大屏及分屏终端的屏幕显示内容及通讯连接情况示意图。从图中可看出,不论投屏终端处于投屏状态还是处于远程桌面状态,投屏终端、大屏及分屏终端的屏幕显示内容都是一致的;在投屏状态下,投屏终端的显示内容被同屏到大屏和分屏终端;在远程桌面状态下,同屏设备的显示内容被同屏到投屏终端和分屏终端。In actual applications, the two states of projection and remote desktop are mutually exclusive. When the projection terminal is performing remote desktop, it stops the projection work and connects to the split screen port of the same screen device; when the projection terminal is performing projection, Stop the remote desktop and connect to the projection port of the same screen device. Figure 4 shows a schematic diagram of the screen display content and communication connection of the projection terminal, the large screen and the split screen terminal when the projection terminal is in the projection state and the remote desktop state respectively. It can be seen from the figure that whether the projection terminal is in the projection state or the remote desktop state, the screen display content of the projection terminal, the large screen and the split-screen terminal are consistent; in the projection state, the The display content is simultaneously screened to the large screen and split screen terminal; in the remote desktop state, the display content of the same screen device is simultaneously screened to the projection terminal and split screen terminal.
上述实施例在同屏过程中引入远程桌面技术,大大延伸了移动终端的功能,使得投屏终端借助同屏设备可以将原本无法打开的文件进行打开演示,或者将同屏设备作为一个临时工作站,存储投屏终端在同屏过程中可能需要使用的文件,使得投屏终端在投屏时可随时通过远程桌面进行打开演示,进一步地,同屏设备还可将屏幕内容同屏至各分屏终端。由于本发明是利用现有的同屏技术采用自定义协议和指令实现的远程桌面技术,研发投入小,可扩展性强。The above embodiment introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation. Stores the files that the projection terminal may need to use during the same screen process, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also simultaneously screen the screen content to each split screen terminal . Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.
如图5所示,为本发明另一个实施例中一种基于同屏的远程桌面控制方法的流程图。优选的,本发明实施例的方法由同屏设备中的远程桌面受控端装置进行执行,该方法包括以下步骤:As shown in FIG. 5, it is a flowchart of a remote desktop control method based on the same screen in another embodiment of the present invention. Preferably, the method in the embodiment of the present invention is executed by the remote desktop controlled end device in the same-screen device, and the method includes the following steps:
步骤S501,接收投屏终端发送的远程桌面请求,隐藏投屏窗口。Step S501: Receive the remote desktop request sent by the screen projection terminal, and hide the screen projection window.
同屏设备接收到投屏终端发送的远程桌面请求后,将与投屏相关的窗口进行隐藏,将自身的桌面显示在大屏上。具体的,隐藏投屏窗口,若二维码扫码主窗口处于打开状态,则最小化二维码扫码主窗口。After the same-screen device receives the remote desktop request sent by the projection terminal, it hides the windows related to the projection and displays its desktop on the large screen. Specifically, the screen projection window is hidden, and if the QR code scanning main window is open, the QR code scanning main window is minimized.
步骤S502,与投屏终端建立分屏连接,录制当前屏幕内容,将录制的屏幕内容发送至投屏终端。Step S502: Establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal.
同屏设备开启后,对投屏端口和分屏端口进行实时监听,若监听到有终端连接到投屏端口,则从所述终端接收投屏内容显示在大屏上;若监听到有终端连接到分屏端口,则启动屏幕录制程序,对自身屏幕进行录制,并将录制的屏幕内容发送至连接到分屏端口的各终端。需要说明的是,只要分屏端口有终端连接,同屏设备的屏幕录制程序就是持续运行的。After the same-screen device is turned on, it monitors the projection port and the split-screen port in real time. If a terminal is connected to the projection port, the screen content is received from the terminal and displayed on the large screen; if a terminal is connected To the split-screen port, start the screen recording program, record the screen itself, and send the recorded screen content to each terminal connected to the split-screen port. It should be noted that as long as the split screen port has a terminal connection, the screen recording program of the same screen device will continue to run.
因此,在远程桌面状态下,同屏设备实际上是对自身桌面进行录制,并将录制的桌面内容发送至投屏终端及各分屏终端。Therefore, in the remote desktop state, the same-screen device actually records its own desktop and sends the recorded desktop content to the projection terminal and each split-screen terminal.
步骤S503,接收投屏终端发送的远程桌面控制指令,根据所述远程桌面控制指令执行相应的模拟操作。Step S503: Receive a remote desktop control instruction sent by the projection terminal, and execute a corresponding simulation operation according to the remote desktop control instruction.
具体的,同屏设备接收投屏终端发送的显示桌面指令,模拟执行“Win+D”热键操作;接收投屏终端发送的打开共享文件夹指令,模拟执行shell打开预设的共享文件夹,即执行Windows本机的cmd.exe指令,打开文件管理器到指定文件目录;接收投屏终端发送的鼠标右键指令,模拟执行鼠标右键单击操作;接收投屏终端发送的PPT播放指令,模拟执行“Shift+F5”操作;接收投屏终端发送的播放上一个幻灯片指令,模拟执行“PageUp”操作;接收投屏终端发送的播放下一个幻灯片指令,模拟执行“PageDown”操作;接收投屏终端发送的PPT停止播放指令,模拟执行“Escape”操作。Specifically, the same screen device receives the desktop display instruction sent by the projection terminal, and simulates the execution of the "Win+D" hot key operation; receives the open shared folder instruction sent by the projection terminal, and simulates the execution of the shell to open the preset shared folder, That is, execute the cmd.exe command of the Windows native machine, open the file manager to the specified file directory; receive the right mouse button command sent by the projection terminal, and simulate the right-click operation; receive the PPT playback command sent by the projection terminal, and simulate execution "Shift+F5" operation; receive the last slide command sent by the projection terminal, and simulate the "PageUp" operation; receive the next slide command sent by the projection terminal, and simulate the "PageDown" operation; receive the projection The PPT sent by the terminal stops playing instructions and simulates the execution of "Escape" operation.
在本发明的一个实施例中,所述方法还包括:In an embodiment of the present invention, the method further includes:
接收投屏终端发送的远程桌面关闭指令,显示投屏窗口;Receive the remote desktop close command sent by the projection terminal, and display the projection window;
与投屏终端建立投屏连接,接收投屏终端发送的屏幕内容,将所述屏幕内容显示在投屏窗口。Establish a projection connection with the projection terminal, receive the screen content sent by the projection terminal, and display the screen content in the projection window.
与开启远程桌面的流程相对应,同屏设备接收到远程桌面关闭指令后,显示投屏窗口,以及最大化扫码主窗口。监听到投屏端口有投屏终端建立连接时,接收投屏终端发送的投屏内容,将所述投屏内容解码后显示在投屏窗口。同时,若此时分屏端口有终端连接,则同屏设备的屏幕录制程序对当前屏幕内容(即投屏内容)进行录制,再将录制的屏幕内容发送至各分屏终端。Corresponding to the process of opening the remote desktop, the same-screen device displays the screen projection window and maximizes the main window for scanning the code after receiving the remote desktop closing instruction. When the screen projection port is monitored to establish a connection with the screen projection terminal, the screen projection content sent by the screen projection terminal is received, and the screen projection content is decoded and displayed in the projection window. At the same time, if there is a terminal connection at the split screen port at this time, the screen recording program of the same screen device will record the current screen content (that is, the projected screen content), and then send the recorded screen content to each split screen terminal.
上述实施例在同屏过程中引入远程桌面技术,大大延伸了移动终端的功能,使得投屏终端借助同屏设备可以将原本无法打开的文件进行打开演示,或者将同屏设备作为一个临时工作站,存储投屏终端在同屏过程中可能需要使用的文件,使得投屏终端在投屏时可随时通过远程桌面进行打开演示,进一步地,同屏设备还可将屏幕内容同屏至各分屏终端。由于本发明是利用现有的同屏技术采用自定义协议和指令实现的远程桌面技术,研发投入小,可扩展性强。The above embodiment introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation. Stores the files that the projection terminal may need to use during the same screen process, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also simultaneously screen the screen content to each split screen terminal . Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.
如图6所示为本发明一个实施例中一种基于同屏的远程桌面控制端装置的结构图。具体的,所述远程桌面控制端装置包括远程桌面请求模块61、远程桌面显示模块62、远程桌面操控模块63,其中:Fig. 6 is a structural diagram of a remote desktop control terminal device based on the same screen in an embodiment of the present invention. Specifically, the remote desktop control terminal device includes a remote desktop request module 61, a remote desktop display module 62, and a remote desktop control module 63, wherein:
远程桌面请求模块61,用于接收用户输入的远程桌面指令,停止投屏工作,与同屏设备断开投屏连接,向同屏设备发起远程桌面请求;The remote desktop request module 61 is used to receive remote desktop instructions input by the user, stop the screen projection, disconnect the projection connection with the same-screen device, and initiate a remote desktop request to the same-screen device;
远程桌面显示模块62,用于与同屏设备建立分屏连接,接收同屏设备发送的屏幕内容,将所述屏幕内容显示在远程桌面窗口;The remote desktop display module 62 is configured to establish a split-screen connection with the same-screen device, receive the screen content sent by the same-screen device, and display the screen content in the remote desktop window;
远程桌面操控模块63,用于接收用户输入的远程桌面控制指令,将所述远程桌面控制指令发送至同屏设备。The remote desktop control module 63 is configured to receive a remote desktop control instruction input by a user, and send the remote desktop control instruction to the same-screen device.
投屏终端在同屏状态下,接收到用户输入的远程桌面指令后,停止投屏工作。具体的,停止录制当前屏幕内容,停止发送录制的屏幕内容至同屏设备,并与同屏设备断开投屏连接,然后向同屏设备发起远程桌面请求。When the projection terminal is in the same screen state, after receiving the remote desktop instruction input by the user, it stops the projection work. Specifically, stop recording the current screen content, stop sending the recorded screen content to the same screen device, and disconnect the screen projection connection with the same screen device, and then initiate a remote desktop request to the same screen device.
在本发明的一个实施例中,用户通过语音或者触摸的形式输入远程桌面指令。In an embodiment of the present invention, the user inputs a remote desktop instruction in the form of voice or touch.
如图1所述,同屏设备的工作模式是从投屏端口获取投屏内容显示到大屏,录制自身屏幕内容,并将自身屏幕内容发送到与分屏端口建立通讯连接的各分屏终端。当投屏终端与同屏设备的投屏端口断开连接,与分屏端口建立通讯连接后,则投屏终端转变为“分屏终端”,与其他分屏终端一起接收同屏设备发送的屏幕内容。此时,同屏设备的投屏端口无任何终端与之连接,同屏设备的屏幕内容即自身桌面内容,同屏设备对自身屏幕进行录制,并将录制的屏幕内容发送到与分屏端口建立通讯连接的各分屏终端,包括转变为 “分屏终端”的投屏终端。As shown in Figure 1, the working mode of the same screen device is to obtain the screen content from the screen projection port and display it on the large screen, record its own screen content, and send its own screen content to each split screen terminal that establishes a communication connection with the split screen port. . When the projection terminal disconnects from the projection port of the same screen device and establishes a communication connection with the split screen port, the projection terminal turns into a "split screen terminal", and together with other split screen terminals receive the screen sent by the same screen device content. At this time, there is no terminal connected to the projection port of the same-screen device, and the screen content of the same-screen device is its own desktop content. The same-screen device records its own screen and sends the recorded screen content to the split-screen port. All split-screen terminals connected by communication, including projection terminals transformed into "split-screen terminals".
在本发明的一个实施例中,在远程桌面窗口设置有远程操作触控条。如图3所示,该远程操作触控条和同屏设备的屏幕内容并排显示在远程桌面窗口,其上设置有“桌面”按键、“共享”按键、“菜单”按键和“PPT”按键。优选的,远程操作触控条显示在同屏设备的屏幕内容的左侧、右侧或上侧。In an embodiment of the present invention, a remote operation touch bar is provided in the remote desktop window. As shown in Figure 3, the remote operation touch bar and the screen content of the same-screen device are displayed side by side in the remote desktop window, with a "desktop" button, a "sharing" button, a "menu" button and a "PPT" button set on it. Preferably, the remote operation touch bar is displayed on the left, right or upper side of the screen content of the same-screen device.
在本发明的一个实施例中,用户可通过语音或触摸的方式输入远程桌面控制指令。In an embodiment of the present invention, the user can input remote desktop control instructions by voice or touch.
在本发明的一个实施例中,远程桌面控制指令包括用户在远程操作触控条上触发的第一触控指令和在所述屏幕内容上触发的第二触控指令。其中,第一触控指令包括显示桌面指令、鼠标右键指令、打开共享文件夹指令、PPT操作指令和远程桌面关闭指令。具体的,点击“桌面”按键,触发显示桌面指令,在桌面及上一个活动窗口进行切换;点击“共享”按键,触发打开共享文件夹指令,打开预设的共享文件夹目录;点击“菜单”按键,触发鼠标右键指令;点击“PPT”按键,打开或关闭PPT的4个操作热键。In an embodiment of the present invention, the remote desktop control instruction includes a first touch instruction triggered by the user on the remote operation touch bar and a second touch instruction triggered on the screen content. Among them, the first touch command includes a display desktop command, a right mouse button command, an open shared folder command, a PPT operation command, and a remote desktop close command. Specifically, click the "Desktop" button to trigger the display desktop command to switch between the desktop and the previous active window; click the "Share" button to trigger the open shared folder command to open the preset shared folder directory; click "Menu" Press the button to trigger the right mouse button instruction; click the "PPT" button to turn on or off the 4 operation hot keys of the PPT.
在本发明的一个实施例中,所述方法还包括:In an embodiment of the present invention, the method further includes:
接收用户输入的远程桌面关闭指令,关闭远程桌面窗口,与同屏设备断开分屏连接;Receive the remote desktop close command entered by the user, close the remote desktop window, and disconnect the split-screen connection with the same-screen device;
将远程桌面关闭指令发送至同屏设备;Send the remote desktop close command to the same screen device;
与同屏设备建立投屏连接,开启投屏工作,录制当前屏幕内容,将录制的屏幕内容发送至同屏设备。Establish a projection connection with the same screen device, start the projection job, record the current screen content, and send the recorded screen content to the same screen device.
实际应用中,投屏和远程桌面两个状态是互斥的,投屏终端在进行远程桌面时,停止投屏工作,连接到同屏设备的分屏端口;投屏终端在进行投屏时,停止远程桌面,连接到同屏设备的投屏端口。如图4所示为投屏终端分别处于投屏状态和远程桌面状态时投屏终端、大屏及分屏终端的屏幕显示内容及通讯连接情况示意图。从图中可看出,不论投屏终端处于投屏状态还是处于远程桌面状态,投屏终端、大屏及分屏终端的屏幕显示内容都是一致的;在投屏状态下,投屏终端的自身显示内容被同屏到大屏和分屏终端;在远程桌面状态下,同屏设备的桌面内容被同屏到投屏终端和分屏终端。In actual applications, the two states of projection and remote desktop are mutually exclusive. When the projection terminal is performing remote desktop, it stops the projection work and connects to the split screen port of the same screen device; when the projection terminal is performing projection, Stop the remote desktop and connect to the projection port of the same screen device. Figure 4 shows a schematic diagram of the screen display content and communication connection of the projection terminal, the large screen and the split screen terminal when the projection terminal is in the projection state and the remote desktop state respectively. It can be seen from the figure that whether the projection terminal is in the projection state or the remote desktop state, the screen display content of the projection terminal, the large screen and the split-screen terminal are consistent; in the projection state, the The content displayed by itself is shared to the large screen and split screen terminal; in the remote desktop state, the desktop content of the same screen device is shared to the projection terminal and split screen terminal.
在本发明的一个实施例中,所述远程桌面控制端装置用于执行实现上述施例(图2实施例)所述的远程桌面控制方法的操作。In an embodiment of the present invention, the remote desktop control terminal device is used to perform operations for implementing the remote desktop control method described in the foregoing embodiment (the embodiment of FIG. 2).
上述实施例在同屏过程中引入远程桌面技术,大大延伸了移动终端的功能,使得投屏终端借助同屏设备可以将原本无法打开的文件进行打开演示,或者将同屏设备作为一个临时工作站,存储投屏终端在同屏过程中可能需要使用的文件,使得投屏终端在投屏时可随时通过远程桌面进行打开演示,进一步地,同屏设备还可将屏幕内容同屏至各分屏终端。由于本发明是利用现有的同屏技术采用自定义协议和指令实现的远程桌面技术,研发投入小,可扩展性强。The above embodiment introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation. Stores the files that the projection terminal may need to use during the same screen process, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also simultaneously screen the screen content to each split screen terminal . Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.
如图7所示为本发明一个实施例中一种基于同屏的远程桌面受控端装置的结构图。具体的,所述远程桌面受控端装置包括远程桌面接收模块71、屏幕内容发送模块72、操控模拟模块73,其中:FIG. 7 is a structural diagram of a remote desktop controlled end device based on the same screen in an embodiment of the present invention. Specifically, the remote desktop controlled terminal device includes a remote desktop receiving module 71, a screen content sending module 72, and a control simulation module 73, wherein:
远程桌面接收模块71,用于接收投屏终端发送的远程桌面请求,隐藏投屏窗口;The remote desktop receiving module 71 is used to receive the remote desktop request sent by the projection terminal and hide the projection window;
屏幕内容发送模块72,用于与投屏终端建立分屏连接,录制当前屏幕内容,将录制的屏幕内容发送至投屏终端;The screen content sending module 72 is used to establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal;
操控模拟模块73,用于接收投屏终端发送的远程桌面控制指令,根据所述远程桌面控制指令执行相应的模拟操作。The control simulation module 73 is configured to receive a remote desktop control instruction sent by the screen projection terminal, and execute a corresponding simulation operation according to the remote desktop control instruction.
同屏设备接收到投屏终端发送的远程桌面请求后,将与投屏相关的窗口进行隐藏,将自身的桌面显示在大屏上。具体的,隐藏投屏窗口,若二维码扫码主窗口处于打开状态,则最小化二维码扫码主窗口。After the same-screen device receives the remote desktop request sent by the projection terminal, it hides the windows related to the projection and displays its desktop on the large screen. Specifically, the screen projection window is hidden, and if the QR code scanning main window is open, the QR code scanning main window is minimized.
同屏设备开启后,对投屏端口和分屏端口进行实时监听,若监听到有终端连接到投屏端口,则从所述终端接收投屏内容显示在大屏上;若监听到有终端连接到分屏端口,则启动屏幕录制程序,对自身屏幕进行录制,并将录制的屏幕内容发送至连接到分屏端口的各终端。需要说明的是,只要分屏端口有终端连接,同屏设备的屏幕录制程序就是持续运行的。After the same-screen device is turned on, it monitors the projection port and the split-screen port in real time. If a terminal is connected to the projection port, the screen content is received from the terminal and displayed on the large screen; if a terminal is connected To the split-screen port, start the screen recording program, record the screen itself, and send the recorded screen content to each terminal connected to the split-screen port. It should be noted that as long as the split screen port has a terminal connection, the screen recording program of the same screen device will continue to run.
因此,在远程桌面状态下,同屏设备实际上是对自身桌面进行录制,并将录制的桌面内容发送至投屏终端及各分屏终端。Therefore, in the remote desktop state, the same-screen device actually records its own desktop and sends the recorded desktop content to the projection terminal and each split-screen terminal.
具体的,同屏设备接收投屏终端发送的显示桌面指令,模拟执行“Win+D”热键操作;接收投屏终端发送的打开共享文件夹指令,模拟执行shell打开预设的共享文件夹,即执行Windows本机的cmd.exe指令,打开文件管理器到指定文件目录;接收投屏终端发送的鼠标右键指令,模拟执行鼠标右键单击操作;接收投屏终端发送的PPT播放指令,模拟执行“Shift+F5”操作;接收投屏终端发送的播放上一个幻灯片指令,模拟执行“PageUp”操作;接收投屏终端发送的播放下一个幻灯片指令,模拟执行“PageDown”操作;接收投屏终端发送的PPT停止播放指令,模拟执行“Escape”操作。Specifically, the same screen device receives the desktop display instruction sent by the projection terminal, and simulates the execution of the "Win+D" hot key operation; receives the open shared folder instruction sent by the projection terminal, and simulates the execution of the shell to open the preset shared folder, That is, execute the cmd.exe command of the Windows native machine, open the file manager to the specified file directory; receive the right mouse button command sent by the projection terminal, and simulate the right-click operation; receive the PPT playback command sent by the projection terminal, and simulate execution "Shift+F5" operation; receive the last slide command sent by the projection terminal, and simulate the "PageUp" operation; receive the next slide command sent by the projection terminal, and simulate the "PageDown" operation; receive the projection The PPT sent by the terminal stops playing instructions and simulates the execution of "Escape" operation.
在本发明的一个实施例中,所述方法还包括:In an embodiment of the present invention, the method further includes:
接收投屏终端发送的远程桌面关闭指令,显示投屏窗口;Receive the remote desktop close command sent by the projection terminal, and display the projection window;
与投屏终端建立投屏连接,接收投屏终端发送的屏幕内容,将所述屏幕内容显示在投屏窗口。Establish a projection connection with the projection terminal, receive the screen content sent by the projection terminal, and display the screen content in the projection window.
与开启远程桌面的流程相对应,同屏设备接收到远程桌面关闭指令后,显示投屏窗口,以及最大化扫码主窗口。监听到投屏端口有投屏终端建立连接时,接收投屏终端发送的投屏内容,将所述投屏内容解码后显示在投屏窗口。同时,若此时分屏端口有终端连接,则同屏设备的屏幕录制程序对当前屏幕内容(即投屏内容)进行录制,再将录制的屏幕内容发送至各分屏终端。Corresponding to the process of opening the remote desktop, the same-screen device displays the screen projection window and maximizes the main window for scanning the code after receiving the remote desktop closing instruction. When the screen projection port is monitored to establish a connection with the screen projection terminal, the screen projection content sent by the screen projection terminal is received, and the screen projection content is decoded and displayed in the projection window. At the same time, if there is a terminal connection at the split screen port at this time, the screen recording program of the same screen device will record the current screen content (that is, the projected screen content), and then send the recorded screen content to each split screen terminal.
在本发明的一个实施例中,所述远程桌面受控端装置用于执行实现上述施例(图5实施例)所述的远程桌面控制方法的操作。In an embodiment of the present invention, the remote desktop controlled terminal device is used to perform operations for implementing the remote desktop control method described in the foregoing embodiment (the embodiment of FIG. 5).
上述实施例在同屏过程中引入远程桌面技术,大大延伸了移动终端的功能,使得投屏终端借助同屏设备可以将原本无法打开的文件进行打开演示,或者将同屏设备作为一个临时工作站,存储投屏终端在同屏过程中可能需要使用的文件,使得投屏终端在投屏时可随时通过远程桌面进行打开演示,进一步地,同屏设备还可将屏幕内容同屏至各分屏终端。由于本发明是利用现有的同屏技术采用自定义协议和指令实现的远程桌面技术,研发投入小,可扩展性强。The above embodiment introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation. Stores the files that the projection terminal may need to use during the same screen process, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also simultaneously screen the screen content to each split screen terminal . Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.
如图8所示为本发明另一个实施例中一种远程桌面控制端装置或远程桌面受控端装置的结构图,包括存储器81和处理器82,其中:FIG. 8 is a structural diagram of a remote desktop control terminal device or a remote desktop controlled terminal device in another embodiment of the present invention, including a memory 81 and a processor 82, wherein:
存储器81,用于存储可在处理器82上运行的计算机程序。The memory 81 is used to store a computer program that can run on the processor 82.
处理器82,用于执行计算机程序,使得远程桌面控制端装置执行实现图2实施例所述的远程桌面控制方法的操作或远程桌面受控端装置执行实现图5实施例所述的远程桌面控制方法的操作。The processor 82 is configured to execute a computer program, so that the remote desktop control terminal device executes operations that implement the remote desktop control method described in the embodiment of FIG. 2 or the remote desktop controlled terminal device executes the remote desktop control described in the embodiment of FIG. 5 Method of operation.
根据本发明的另一方面,提供一种智能设备,包括图6或图8所述的远程桌面控制端装置或者图7或图8所述的远程桌面受控端装置。其中,智能设备包括但不限于手机、平板、笔记本电脑、一体机、台式机。According to another aspect of the present invention, a smart device is provided, including the remote desktop control terminal device described in FIG. 6 or FIG. 8 or the remote desktop control terminal device described in FIG. 7 or FIG. 8. Among them, smart devices include but are not limited to mobile phones, tablets, notebook computers, all-in-one computers, and desktop computers.
如图9所示为本发明一个实施例中一种基于同屏的远程桌面控制系统的结构图,包括:Figure 9 is a structural diagram of a remote desktop control system based on the same screen in an embodiment of the present invention, including:
投屏终端91,用于接收用户输入的远程桌面指令,停止投屏工作,与同屏设备断开投屏连接;向同屏设备发起远程桌面请求;与同屏设备建立分屏连接,接收同屏设备发送的屏幕内容,将所述屏幕内容显示在远程桌面窗口;接收用户输入的远程桌面控制指令,将所述远程桌面控制指令发送至同屏设备;The projection terminal 91 is used to receive remote desktop instructions input by the user, stop the projection work, and disconnect the projection connection with the same-screen device; initiate a remote desktop request to the same-screen device; establish a split-screen connection with the same-screen device and receive the same The screen content sent by the screen device, displaying the screen content in the remote desktop window; receiving the remote desktop control instruction input by the user, and sending the remote desktop control instruction to the same-screen device;
同屏设备92,用于接收投屏终端发送的远程桌面请求,隐藏投屏窗口;与投屏终端建立分屏连接,录制当前屏幕内容,将录制的屏幕内容发送至投屏终端;接收投屏终端发送的远程桌面控制指令,根据所述远程桌面控制指令执行相应的模拟操作。The same screen device 92, used to receive remote desktop requests sent by the projection terminal, hide the projection window; establish a split-screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal; receive the projection screen The remote desktop control instruction sent by the terminal executes a corresponding simulation operation according to the remote desktop control instruction.
在本发明的一个实施例中,所述系统还包括多个分屏终端,所述多个分屏终端,用于与同屏设备建立分屏连接,接收同屏设备发送的屏幕内容并进行显示。In an embodiment of the present invention, the system further includes a plurality of split-screen terminals, the plurality of split-screen terminals are used to establish a split-screen connection with the same-screen device, receive and display the screen content sent by the same-screen device .
在本发明的一个实施例中,投屏终端91用于执行实现图2实施例所述的基于同屏的远程桌面控制方法的操作,同屏设备92用于执行实现图5实施例所述的基于同屏的远程桌面控制方法的操作。In an embodiment of the present invention, the screen projection terminal 91 is used to perform operations for implementing the remote desktop control method based on the same screen described in the embodiment of FIG. 2, and the same screen device 92 is used to perform the operations described in the embodiment of FIG. Operation based on the remote desktop control method of the same screen.
根据本发明的另一方面,提供一种计算机可读存储介质,一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被储器执行时实现如上述任一实施例(图2或图5实施例)所述的基于同屏的远程桌面控制方法,可以应用于智能设备中;前述实施例的技术方案本质 上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,移动设备或者网络设备等)或processor(处理器)执行本实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。According to another aspect of the present invention, there is provided a computer-readable storage medium, a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a memory, any of the above The remote desktop control method based on the same screen described in an embodiment (the embodiment of FIG. 2 or FIG. 5) can be applied to a smart device; the technical solution of the foregoing embodiment is essentially or a part that contributes to the prior art Or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal computer, a server, a mobile device, or a network). A device, etc.) or a processor (processor) executes all or part of the steps of the method described in this embodiment. The aforementioned storage medium includes: U disk, mobile hard disk, Read Only Memory (ROM, Random Access Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes.
在上述描述的基于同屏的远程桌面控制端装置和基于同屏的远程桌面受控端装置可以实现为用于执行本申请所描述功能的通用处理器、可编程逻辑控制器(PLC)、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件或者其任意适当组合。The remote desktop control device based on the same screen and the remote desktop control device based on the same screen described above can be implemented as general-purpose processors, programmable logic controllers (PLCs), and digital devices for performing the functions described in this application. Signal processor (DSP), application specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component or any appropriate combination thereof.
上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The sequence numbers of the foregoing embodiments of the present invention are only for description, and do not represent the superiority of the embodiments.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments. Wherein, the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.
以上所揭露的仅为本发明较佳实施例而已,当然不能以此来限定本发明之权利范围,因此依本发明权利要求所作的等同变化,仍属本发明所涵盖的范围。The above-disclosed are only preferred embodiments of the present invention. Of course, the scope of rights of the present invention cannot be limited by this. Therefore, equivalent changes made according to the claims of the present invention still fall within the scope of the present invention.
工业实用性Industrial applicability
本发明实施例在同屏过程中引入远程桌面技术,大大延伸了移动终端的功能,使得投屏终端借助同屏设备可以将原本无法打开的文件进行打开演示,或者将同屏设备作为一个临时工作站,存储投屏终端在同屏过程中可能需要使用的文件,使得投屏终端在投屏时可随时通过远程桌面进行打开演示,进一步地,同屏设备还可将屏幕内容同屏至各分屏终端。由于本发明是利用现 有的同屏技术采用自定义协议和指令实现的远程桌面技术,研发投入小,可扩展性强。The embodiment of the present invention introduces remote desktop technology during the same screen process, which greatly extends the functions of the mobile terminal, so that the screen projection terminal can use the same screen device to open a file that cannot be opened originally, or use the same screen device as a temporary workstation , Store the files that the projection terminal may need to use in the process of the same screen, so that the projection terminal can open the demonstration through the remote desktop at any time during the projection. Furthermore, the same screen device can also share the screen content to each split screen. terminal. Since the present invention utilizes the existing same-screen technology and adopts the remote desktop technology realized by the self-defined protocol and instructions, the R&D investment is small and the scalability is strong.

Claims (20)

  1. 一种基于同屏的远程桌面控制方法,其特征在于,所述方法包括:A remote desktop control method based on the same screen, characterized in that the method includes:
    接收用户输入的远程桌面指令,停止投屏工作,与同屏设备断开投屏连接,向同屏设备发起远程桌面请求;Receive remote desktop instructions entered by the user, stop screen projection, disconnect the screen projection connection with the same screen device, and initiate a remote desktop request to the same screen device;
    与同屏设备建立分屏连接,接收同屏设备发送的屏幕内容,将所述屏幕内容显示在远程桌面窗口;Establish a split-screen connection with the same-screen device, receive the screen content sent by the same-screen device, and display the screen content in the remote desktop window;
    接收用户输入的远程桌面控制指令,将所述远程桌面控制指令发送至同屏设备。Receive the remote desktop control instruction input by the user, and send the remote desktop control instruction to the same-screen device.
  2. 如权利要求1所述的方法,其特征在于,所述方法还包括:The method of claim 1, wherein the method further comprises:
    接收同屏设备发送的屏幕内容,将所述屏幕内容与预设的远程操作触控条并排显示在远程桌面窗口。The screen content sent by the devices on the same screen is received, and the screen content and the preset remote operation touch bar are displayed side by side in the remote desktop window.
  3. 如权利要求3所述的方法,其特征在于,所述远程桌面控制指令包括用户在远程操作触控条上触发的第一触控指令和在所述屏幕内容上触发的第二触控指令。The method of claim 3, wherein the remote desktop control instruction includes a first touch instruction triggered by a user on a remote operation touch bar and a second touch instruction triggered on the screen content.
  4. 如权利要求3所述的方法,其特征在于,所述第一触控指令包括显示桌面指令、鼠标右键指令、打开共享文件夹指令、PPT操作指令和远程桌面关闭指令。The method of claim 3, wherein the first touch command includes a display desktop command, a right mouse button command, an open shared folder command, a PPT operation command, and a remote desktop close command.
  5. 如权利要求1至4任意一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 1 to 4, wherein the method further comprises:
    接收用户输入的远程桌面关闭指令,关闭远程桌面窗口,与同屏设备断开分屏连接;Receive the remote desktop close command entered by the user, close the remote desktop window, and disconnect the split-screen connection with the same-screen device;
    将远程桌面关闭指令发送至同屏设备;Send the remote desktop close command to the same screen device;
    与同屏设备建立投屏连接,开启投屏工作,录制当前屏幕内容,将录制的屏幕内容发送至同屏设备。Establish a projection connection with the same screen device, start the projection job, record the current screen content, and send the recorded screen content to the same screen device.
  6. 一种基于同屏的远程桌面控制方法,其特征在于,所述方法包括:A remote desktop control method based on the same screen, characterized in that the method includes:
    接收投屏终端发送的远程桌面请求,隐藏投屏窗口;Receive the remote desktop request sent by the projection terminal and hide the projection window;
    与投屏终端建立分屏连接,录制当前屏幕内容,将录制的屏幕内容发送 至投屏终端;Establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal;
    接收投屏终端发送的远程桌面控制指令,根据所述远程桌面控制指令执行相应的模拟操作。Receive the remote desktop control instruction sent by the projection terminal, and execute the corresponding simulation operation according to the remote desktop control instruction.
  7. 如权利要求6所述的方法,其特征在于,所述方法还包括:The method of claim 6, wherein the method further comprises:
    接收投屏终端发送的显示桌面指令,模拟执行“Win+D”热键操作;Receive the desktop display command sent by the projection terminal, and simulate the "Win+D" hotkey operation;
    接收投屏终端发送的打开共享文件夹指令,模拟执行shell打开预设的共享文件夹;Receive the open shared folder instruction sent by the projection terminal, and simulate executing the shell to open the preset shared folder;
    接收投屏终端发送的鼠标右键指令,模拟执行鼠标右键单击操作;Receive the right mouse button instruction sent by the projection terminal, and simulate the right mouse click operation;
    接收投屏终端发送的PPT播放指令,模拟执行“Shift+F5”操作;Receive the PPT playback command sent by the projection terminal, and simulate the "Shift+F5" operation;
    接收投屏终端发送的播放上一个幻灯片指令,模拟执行“PageUp”操作;Receive the last slide show instruction sent by the projection terminal, and simulate the execution of "PageUp" operation;
    接收投屏终端发送的播放下一个幻灯片指令,模拟执行“PageDown”操作;Receive the next slide instruction sent by the projection terminal, and simulate the execution of the "PageDown" operation;
    接收投屏终端发送的PPT停止播放指令,模拟执行“Escape”操作。Receive the PPT stop playback instruction sent by the projection terminal, and simulate the "Escape" operation.
  8. 如权利要求6所述的方法,其特征在于,所述方法还包括:The method of claim 6, wherein the method further comprises:
    接收投屏终端发送的远程桌面关闭指令,显示投屏窗口;Receive the remote desktop close command sent by the projection terminal, and display the projection window;
    与投屏终端建立投屏连接,接收投屏终端发送的屏幕内容,将所述屏幕内容显示在投屏窗口。Establish a projection connection with the projection terminal, receive the screen content sent by the projection terminal, and display the screen content in the projection window.
  9. 如权利要求6至8任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 6 to 8, characterized in that the method further comprises:
    录制当前屏幕内容,将录制的屏幕内容发送至与其建立分屏连接的多个分屏终端。Record the current screen content and send the recorded screen content to multiple split-screen terminals with which it has established split-screen connections.
  10. 一种基于同屏的远程桌面控制端装置,其特征在于,包括:A remote desktop control terminal device based on the same screen, characterized in that it comprises:
    远程桌面请求模块,用于接收用户输入的远程桌面指令,停止投屏工作,与同屏设备断开投屏连接,向同屏设备发起远程桌面请求;The remote desktop request module is used to receive remote desktop instructions input by the user, stop the screen projection, disconnect the projection connection with the same-screen device, and initiate a remote desktop request to the same-screen device;
    远程桌面显示模块,用于与同屏设备建立分屏连接,接收同屏设备发送的屏幕内容,将所述屏幕内容显示在远程桌面窗口;The remote desktop display module is used to establish a split-screen connection with the same-screen device, receive the screen content sent by the same-screen device, and display the screen content in the remote desktop window;
    远程桌面操控模块,用于接收用户输入的远程桌面控制指令,将所述远 程桌面控制指令发送至同屏设备。The remote desktop control module is used to receive remote desktop control instructions input by the user, and send the remote desktop control instructions to the same-screen device.
  11. 如权利要求10所述的装置,其特征在于,所述装置用于执行实现权利要求1-5任一项所述的基于同屏的远程桌面控制方法的操作。The device according to claim 10, wherein the device is configured to perform operations for implementing the remote desktop control method based on the same screen according to any one of claims 1-5.
  12. 一种基于同屏的远程桌面控制端装置,其特征在于,包括存储器和处理器,其中:A remote desktop control terminal device based on the same screen, which is characterized by comprising a memory and a processor, wherein:
    存储器,用于存储指令;Memory, used to store instructions;
    处理器,用于执行所述指令,使得所述装置执行实现权利要求1-5任一项所述的基于同屏的远程桌面控制方法的操作。The processor is configured to execute the instruction, so that the device executes the operation for realizing the remote desktop control method based on the same screen according to any one of claims 1-5.
  13. 一种基于同屏的远程桌面受控端装置,其特征在于,包括:A remote desktop controlled end device based on the same screen, which is characterized in that it includes:
    远程桌面接收模块,用于接收投屏终端发送的远程桌面请求,隐藏投屏窗口;The remote desktop receiving module is used to receive the remote desktop request sent by the projection terminal and hide the projection window;
    屏幕内容发送模块,用于与投屏终端建立分屏连接,录制当前屏幕内容,将录制的屏幕内容发送至投屏终端;The screen content sending module is used to establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal;
    操控模拟模块,用于接收投屏终端发送的远程桌面控制指令,根据所述远程桌面控制指令执行相应的模拟操作。The control simulation module is used to receive remote desktop control instructions sent by the projection terminal, and execute corresponding simulation operations according to the remote desktop control instructions.
  14. 如权利要求13所述的装置,其特征在于,所述装置用于执行实现权利要求6-9任一项所述的基于同屏的远程桌面控制方法的操作。The device according to claim 13, wherein the device is configured to perform operations for implementing the remote desktop control method based on the same screen according to any one of claims 6-9.
  15. 一种基于同屏的远程桌面受控端装置,其特征在于,包括存储器和处理器,其中:A remote desktop controlled terminal device based on the same screen, which is characterized by comprising a memory and a processor, wherein:
    存储器,用于存储指令;Memory, used to store instructions;
    处理器,用于执行所述指令,使得所述装置执行实现权利要求6-9任一项所述的基于同屏的远程桌面控制方法的操作。The processor is configured to execute the instructions, so that the device executes operations for realizing the remote desktop control method based on the same screen according to any one of claims 6-9.
  16. 一种智能设备,其特征在于,包括权利要求10-12任一项所述的远程桌面控制端装置或者权利要求13-15任一项所述的远程桌面受控端装置。An intelligent device, characterized by comprising the remote desktop control terminal device according to any one of claims 10-12 or the remote desktop control terminal device according to any one of claims 13-15.
  17. 一种基于同屏的远程桌面控制系统,其特征在于,包括:A remote desktop control system based on the same screen is characterized in that it includes:
    投屏终端,用于接收用户输入的远程桌面指令,停止投屏工作,与同屏设备断开投屏连接;向同屏设备发起远程桌面请求;与同屏设备建立分屏连 接,接收同屏设备发送的屏幕内容,将所述屏幕内容显示在远程桌面窗口;接收用户输入的远程桌面控制指令,将所述远程桌面控制指令发送至同屏设备;Screen projection terminal, used to receive remote desktop instructions input by the user, stop projection work, disconnect the projection connection with the same screen device; initiate a remote desktop request to the same screen device; establish a split screen connection with the same screen device, and receive the same screen The screen content sent by the device is displayed on the remote desktop window; the remote desktop control instruction input by the user is received, and the remote desktop control instruction is sent to the same-screen device;
    同屏设备,用于接收投屏终端发送的远程桌面请求,隐藏投屏窗口;与投屏终端建立分屏连接,录制当前屏幕内容,将录制的屏幕内容发送至投屏终端;接收投屏终端发送的远程桌面控制指令,根据所述远程桌面控制指令执行相应的模拟操作。The same-screen device, used to receive remote desktop requests sent by the projection terminal, hide the projection window; establish a split screen connection with the projection terminal, record the current screen content, and send the recorded screen content to the projection terminal; receive the projection terminal The sent remote desktop control instruction executes a corresponding simulation operation according to the remote desktop control instruction.
  18. 如权利要求17所述的系统,其特征在于,所述系统还包括多个分屏终端,The system of claim 17, wherein the system further comprises a plurality of split-screen terminals,
    所述多个分屏终端,用于与同屏设备建立分屏连接,接收同屏设备发送的屏幕内容并进行显示。The multiple split-screen terminals are used to establish a split-screen connection with the same-screen device, and receive and display the screen content sent by the same-screen device.
  19. 如权利要求17或18所述的系统,其特征在于,所述投屏终端用于执行实现权利要求1-5任一项所述的基于同屏的远程桌面控制方法的操作,所述同屏设备用于执行实现权利要求6-9任一项所述的基于同屏的远程桌面控制方法的操作。The system according to claim 17 or 18, wherein the screen projection terminal is used to perform operations for implementing the remote desktop control method based on the same screen according to any one of claims 1-5, and the same screen The device is used to perform operations for implementing the remote desktop control method based on the same screen as described in any one of claims 6-9.
  20. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1-9任一项所述的方法的步骤。A computer-readable storage medium with a computer program stored thereon, wherein the computer program implements the steps of any one of claims 1-9 when the computer program is executed by a processor.
PCT/CN2019/095651 2019-07-11 2019-07-11 Method, device, and system for remove desktop control, device, and storage medium WO2021003749A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2019/095651 WO2021003749A1 (en) 2019-07-11 2019-07-11 Method, device, and system for remove desktop control, device, and storage medium
CN201980001185.9A CN110582749B (en) 2019-07-11 2019-07-11 Remote desktop control method, device and system, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/095651 WO2021003749A1 (en) 2019-07-11 2019-07-11 Method, device, and system for remove desktop control, device, and storage medium

Publications (1)

Publication Number Publication Date
WO2021003749A1 true WO2021003749A1 (en) 2021-01-14

Family

ID=68815597

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/095651 WO2021003749A1 (en) 2019-07-11 2019-07-11 Method, device, and system for remove desktop control, device, and storage medium

Country Status (2)

Country Link
CN (1) CN110582749B (en)
WO (1) WO2021003749A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112804323A (en) * 2021-01-11 2021-05-14 上海智能交通有限公司 Remote vehicle-mounted terminal desktop control system and method
CN113189920A (en) * 2021-05-28 2021-07-30 重庆长安汽车股份有限公司 Android-based remote control method for vehicle-mounted entertainment information system
CN113746979A (en) * 2021-08-26 2021-12-03 上汽通用五菱汽车股份有限公司 Mobile phone screen splitting method, system, equipment and medium based on mobile phone Internet of vehicles application
CN114007125A (en) * 2021-10-15 2022-02-01 杭州逗酷软件科技有限公司 Volume control method, mobile terminal, target device and storage medium
CN114501120A (en) * 2022-01-11 2022-05-13 烽火通信科技股份有限公司 Multi-terminal wireless screen projection switching method and electronic equipment
WO2023024889A1 (en) * 2021-08-25 2023-03-02 华为技术有限公司 First electronic device, second electronic device, and method for screen-casting

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111880756A (en) * 2020-06-30 2020-11-03 广州华多网络科技有限公司 Online classroom screen projection method and device, electronic equipment and storage medium
CN111984215A (en) * 2020-08-19 2020-11-24 Oppo广东移动通信有限公司 Multimedia data playing method, terminal and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103595759A (en) * 2013-10-15 2014-02-19 北京航空航天大学 Desktop presenting method based on cloud
CN103701908A (en) * 2013-12-28 2014-04-02 华为技术有限公司 Method, device and system for remote interaction
US20150067035A1 (en) * 2009-04-15 2015-03-05 Roshan Sullad Method and apparatus for extending capabilities of a virtualization domain to support features available in a normal desktop application
CN104836852A (en) * 2015-04-22 2015-08-12 深圳市邦彦信息技术有限公司 Multi-linked screen desktop sharing method and system
CN107770255A (en) * 2017-09-27 2018-03-06 北京机电工程研究所 Terminal device data sharing master control device and method for collaborative work
CN108415645A (en) * 2018-01-19 2018-08-17 广州视源电子科技股份有限公司 Operating method, device and the intelligent interaction tablet of intelligent interaction tablet
CN108958678A (en) * 2017-05-25 2018-12-07 阿里巴巴集团控股有限公司 Throw screen method, the sharing method of screen content and device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105160951B (en) * 2015-08-31 2019-04-30 深圳信息职业技术学院 A kind of mobile device-based blank teaching method and system
US10331394B1 (en) * 2017-12-21 2019-06-25 Logmein, Inc. Manipulating shared screen content
CN109327728B (en) * 2018-11-23 2021-10-15 深圳市鹰硕技术有限公司 One-to-many same-screen method, device and system, same-screen equipment and storage medium
CN109684025A (en) * 2019-01-08 2019-04-26 深圳市网心科技有限公司 A kind of remote communication method and relevant apparatus

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150067035A1 (en) * 2009-04-15 2015-03-05 Roshan Sullad Method and apparatus for extending capabilities of a virtualization domain to support features available in a normal desktop application
CN103595759A (en) * 2013-10-15 2014-02-19 北京航空航天大学 Desktop presenting method based on cloud
CN103701908A (en) * 2013-12-28 2014-04-02 华为技术有限公司 Method, device and system for remote interaction
CN104836852A (en) * 2015-04-22 2015-08-12 深圳市邦彦信息技术有限公司 Multi-linked screen desktop sharing method and system
CN108958678A (en) * 2017-05-25 2018-12-07 阿里巴巴集团控股有限公司 Throw screen method, the sharing method of screen content and device
CN107770255A (en) * 2017-09-27 2018-03-06 北京机电工程研究所 Terminal device data sharing master control device and method for collaborative work
CN108415645A (en) * 2018-01-19 2018-08-17 广州视源电子科技股份有限公司 Operating method, device and the intelligent interaction tablet of intelligent interaction tablet

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
SHE, YOUJUN: "Non-official translation: Method for remotely controlling slides from a mobile device", CHINA INFORMATION TECHNOLOGY EDUCATION, no. 7, 15 April 2017 (2017-04-15), ISSN: 1674-2117, DOI: 20200326091024A *
ZHANG, BAO ET AL.: "Non-official translation: Implementation of technology in improving classroom interaction efficiency by using mobile devices", NON-OFFICIAL TRANSLATION: INFORMATION TECHNOLOGY EDUCATION IN PRIMARY AND SECONDARY SCHOOLS, no. 1,, 31 January 2018 (2018-01-31), ISSN: 1671-7384, DOI: 20200326090222X *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112804323A (en) * 2021-01-11 2021-05-14 上海智能交通有限公司 Remote vehicle-mounted terminal desktop control system and method
CN112804323B (en) * 2021-01-11 2022-11-18 上海智能交通有限公司 Remote vehicle-mounted terminal desktop control system and method
CN113189920A (en) * 2021-05-28 2021-07-30 重庆长安汽车股份有限公司 Android-based remote control method for vehicle-mounted entertainment information system
WO2023024889A1 (en) * 2021-08-25 2023-03-02 华为技术有限公司 First electronic device, second electronic device, and method for screen-casting
CN113746979A (en) * 2021-08-26 2021-12-03 上汽通用五菱汽车股份有限公司 Mobile phone screen splitting method, system, equipment and medium based on mobile phone Internet of vehicles application
CN113746979B (en) * 2021-08-26 2023-05-12 上汽通用五菱汽车股份有限公司 Mobile phone split screen method, system, equipment and medium based on mobile phone Internet of vehicles application
CN114007125A (en) * 2021-10-15 2022-02-01 杭州逗酷软件科技有限公司 Volume control method, mobile terminal, target device and storage medium
CN114501120A (en) * 2022-01-11 2022-05-13 烽火通信科技股份有限公司 Multi-terminal wireless screen projection switching method and electronic equipment
CN114501120B (en) * 2022-01-11 2023-06-09 烽火通信科技股份有限公司 Multi-terminal wireless screen switching method and electronic equipment

Also Published As

Publication number Publication date
CN110582749B (en) 2022-06-24
CN110582749A (en) 2019-12-17

Similar Documents

Publication Publication Date Title
WO2021003749A1 (en) Method, device, and system for remove desktop control, device, and storage medium
US11422951B2 (en) Electronic tool and methods for meetings between two users
WO2020168499A1 (en) Screen-sharing teaching method, apparatus and system, and smart device and storage medium
CN110874959B (en) Multi-terminal same-screen teaching system and teaching method
US7908325B1 (en) System and method for event-based collaboration
US6928464B2 (en) Systems and methods for unified remote control access
CN105573609B (en) Content sharing method and device
US10050800B2 (en) Electronic tool and methods for meetings for providing connection to a communications network
EP2756667B1 (en) Electronic tool and methods for meetings
CN110597774A (en) File sharing method, system, device, computing equipment and terminal equipment
CN112769582A (en) Electronic tool and method for conferencing
US10965480B2 (en) Electronic tool and methods for recording a meeting
US20100077055A1 (en) Remote user interface in a terminal server environment
US10628183B2 (en) State synchronized interactive software demonstration
WO2023103586A1 (en) Remote collaboration method and system based on sharing of auxiliary stream of video conference, and storage device
CN109308175A (en) The electronic device and method of Display on the same screen are carried out using mobile device and display equipment
CN208985138U (en) Electronic device, computer equipment and the data processing system of Display on the same screen
WO2020215704A1 (en) Instant messaging method capable of implementing desktop sharing and related devices
CN201859429U (en) Projector control system for simultaneously displaying multi-computer desktops
EP3320663B1 (en) Multi-network mirroring systems and methods
US9741257B1 (en) System and method for coordinated learning and teaching using a videoconference system
WO2015184877A1 (en) Method and system for operating presentation document, control apparatus, and presentation apparatus
US8019824B2 (en) Remotely operating computer software applications using low bandwidth
Hagiwara et al. CamCutter: Impromptu vision-based cross-device application sharing
CN212302757U (en) Teaching system capable of moving teaching

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19937120

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 19937120

Country of ref document: EP

Kind code of ref document: A1