CN114237531A - Remote screen projection control method and system - Google Patents

Remote screen projection control method and system Download PDF

Info

Publication number
CN114237531A
CN114237531A CN202111129540.6A CN202111129540A CN114237531A CN 114237531 A CN114237531 A CN 114237531A CN 202111129540 A CN202111129540 A CN 202111129540A CN 114237531 A CN114237531 A CN 114237531A
Authority
CN
China
Prior art keywords
information
controlled
screen projection
equipment
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111129540.6A
Other languages
Chinese (zh)
Inventor
陈明超
于富昌
李宝超
张运江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Software Co Ltd
Original Assignee
Inspur Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Software Co Ltd filed Critical Inspur Software Co Ltd
Priority to CN202111129540.6A priority Critical patent/CN114237531A/en
Publication of CN114237531A publication Critical patent/CN114237531A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/146Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/161Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • User Interface Of Digital Computer (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The invention discloses a control method and a system for remote screen projection, belonging to the field of remote screen projection; the system specifically comprises a connection establishing module, a screen projection display module, a monitoring conversion module and a bidirectional interaction module; the system establishes connection with one or more target controlled devices in the local area network through the main control device; the master control equipment receives screen projection information transmitted by the controlled equipment through connection and displays the screen projection information into a window; the master control equipment monitors input operation information of screen projection interactive interfaces of all controlled equipment and converts the information into a control instruction; and sending the control instruction to corresponding controlled equipment, and executing corresponding operation by the controlled terminal equipment according to the appointed instruction.

Description

Remote screen projection control method and system
Technical Field
The invention discloses a method and a system for controlling remote screen projection, and relates to the technical field of remote screen projection.
Background
With the high development of the internet, smart devices (such as mobile phones, tablet computers, smart televisions and computers) increasingly enter people's lives. There is an increasing interest in the mutual control and content sharing between different smart devices. Along with the development needs of application scenes such as remote office, remote education, remote maintenance, remote assistance and the like, remote operation and control technologies are attracting more and more attention.
However, the existing remote control technology has the following problems:
the master control equipment and the controlled equipment are in one-to-one correspondence, and one master control equipment cannot control a plurality of controlled equipment at the same time;
when the master control device controls the controlled device, the master control device needs to be used for sending the control instruction to the extranet server, and the extranet server forwards the control instruction to the controlled device, so that the user data safety and the control reliability are poor. Meanwhile, the requirement on the network speed is high due to the fact that the public network environment is required, and the construction cost and the operation flexibility are greatly poor;
bidirectional multimedia file sharing cannot be performed between the master control equipment and the controlled equipment;
therefore, a method and a system for controlling remote screen projection are provided to solve the above problems.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a control method and a system for remote screen projection, and the adopted technical scheme is as follows: a control method for remote screen projection comprises the following specific steps:
s1, the main control device establishes connection with one or more target controlled devices in the local area network;
s2, the main control device receives screen projection information transmitted by the controlled device through connection and displays the screen projection information into a window;
s3, the main control device monitors the input operation information of different screen projection interactive interfaces and converts the information into a control instruction;
s4 the master device remotely obtains the multimedia files in the controlled device and shares the multimedia files to the controlled device.
The specific steps of the S1 master control device establishing connection with one or more target controlled devices in the local area network are as follows:
s101, networking the master control equipment and all the controlled equipment and placing the master control equipment and all the controlled equipment in the same local area network environment;
s102, filling IP information of all controlled devices in the main control device as marking information;
s103, the main control device establishes a TCP transmission channel through the IP information of the controlled device.
The screen projection information in the S2 comprises screen recording and screen capturing information of a current operation interface of the controlled equipment; when the main control equipment is connected with the controlled equipment, screen projection information of different controlled equipment is displayed in different windows.
The specific steps of monitoring input operation information of different screen projection interactive interfaces by the main control equipment of S3 and converting the information into a control instruction are as follows:
s301, the main control device monitors the user interface input information of each controlled device;
s302, aiming at the relative position information of the current window, converting the information of the touch event including the gesture, the touch position and the like into instruction operation;
s303, the controlled terminal receives the instruction information and executes corresponding operation.
A control system for remote screen projection specifically comprises a connection establishing module, a screen projection display module, a monitoring conversion module and a bidirectional interaction module:
a connection establishment module: the method comprises the steps that a main control device establishes connection with one or more target controlled devices in a local area network;
the screen projection display module: the master control equipment receives screen projection information transmitted by the controlled equipment through connection and displays the screen projection information into a window;
a monitoring conversion module: the main control equipment monitors input operation information of different screen projection interactive interfaces and converts the information into a control instruction;
a bidirectional interaction module: the master control equipment remotely obtains the multimedia files in the controlled equipment and shares the multimedia files to the controlled equipment.
The connection establishing module specifically comprises a network setting module, an information marking module and a channel establishing module:
a network setting module: the master control equipment and all the controlled equipment are networked and are in the same local area network environment;
an information marking module: filling IP information of all controlled devices in the main control device as marking information;
a channel establishing module: the main control device establishes a TCP transmission channel through the IP information of the controlled device.
The screen projection information of the screen projection display module comprises screen recording and screen capturing information of a current operation interface of the controlled equipment; when the main control equipment is connected with the controlled equipment, screen projection information of different controlled equipment is displayed in different windows.
The monitoring conversion module specifically comprises an input monitoring module, an information conversion module and an instruction execution module:
the input monitoring module: the master control equipment monitors the user interface input information of each controlled equipment;
the information conversion module: aiming at the relative position information of the current window, converting the information of the touch event including the gesture, the touch position and the like into instruction operation;
the instruction execution module: and the controlled terminal receives the instruction information and executes corresponding operation.
The invention has the beneficial effects that: the main control device establishes connection with one or more target controlled devices in the local area network; the master control equipment receives screen projection information transmitted by the controlled equipment through connection and displays the screen projection information into a window; the master control equipment monitors input operation information of screen projection interactive interfaces of all controlled equipment and converts the information into a control instruction; sending the control instruction to corresponding controlled equipment, and executing corresponding operation by the controlled terminal equipment according to the appointed instruction; the main control device can remotely acquire the multimedia files in the controlled device and can share the multimedia files to the controlled device.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flow chart of the method of the present invention; FIG. 2 is a schematic diagram of the system of the present invention; fig. 3 is a flow chart of an embodiment of the method of the present invention.
Detailed Description
The present invention is further described below in conjunction with the following figures and specific examples so that those skilled in the art may better understand the present invention and practice it, but the examples are not intended to limit the present invention.
The first embodiment is as follows:
a control method for remote screen projection comprises the following specific steps:
s1, the main control device establishes connection with one or more target controlled devices in the local area network;
s2, the main control device receives screen projection information transmitted by the controlled device through connection and displays the screen projection information into a window;
s3, the main control device monitors the input operation information of different screen projection interactive interfaces and converts the information into a control instruction;
s4, the main control device remotely obtains the multimedia files in the controlled device and shares the multimedia files to the controlled device;
the method of the invention establishes connection with one or more target controlled devices in the local area network through the main control device; the master control equipment receives screen projection information transmitted by the controlled equipment through connection and displays the screen projection information into a window; the master control equipment monitors input operation information of screen projection interactive interfaces of all controlled equipment and converts the information into a control instruction; sending the control instruction to corresponding controlled equipment, and executing corresponding operation by the controlled terminal equipment according to the appointed instruction; the master control equipment can remotely acquire the multimedia files in the controlled equipment and can share the multimedia files to the controlled equipment;
further, the specific steps of the S1 method for establishing a connection between the master control device and one or more target controlled devices in the local area network are as follows:
s101, networking the master control equipment and all the controlled equipment and placing the master control equipment and all the controlled equipment in the same local area network environment;
s102, filling IP information of all controlled devices in the main control device as marking information;
s103, the main control device establishes a TCP transmission channel through the IP information of the controlled device;
the master control device and all the controlled devices are networked and located in the same local area network environment, and the identification information of all the controlled devices is filled in the master control device, preferably, the identification information is the IP of the controlled devices. Then the master control device establishes a TCP transmission channel through the IP information of the controlled device;
the screen projection information in the S2 comprises screen recording and screen capturing information of a current operation interface of the controlled equipment; when the master control equipment is connected with a plurality of controlled equipment, screen projection information of a plurality of different controlled equipment is displayed in different windows;
after the transmission channel is established, the controlled equipment sends screen projection information of the current operation interface to the main control equipment, wherein the screen projection information comprises screen recording or screen capturing information and the like;
after the master control device and the controlled device establish a TCP transmission channel, the master control device monitors the TCP transmission channel, the controlled device starts to record the current device operation interface, and screen recording data are sent to the master control device through the TCP transmission channel; the main control equipment receives screen recording data of a plurality of controlled equipment and displays the screen recording data to different windows in a video stream mode;
further, the specific steps of monitoring input operation information on different screen projection interactive interfaces by the main control device of S3 and converting the information into a control instruction are as follows:
s301, the main control device monitors the user interface input information of each controlled device;
s302, aiming at the relative position information of the current window, converting the information of the touch event including the gesture, the touch position and the like into instruction operation;
s303, the controlled terminal receives the instruction information and executes corresponding operation.
The method comprises the steps that mapping relation between appointed instruction information and operation events between a master control device and a controlled device, and the controlled device monitors a transmission channel port; performing touch events (long press, click, single-finger sliding and multi-finger sliding) or operating on external equipment such as a mouse, a keyboard and the like on the main control equipment; the master control equipment converts the monitored operation event into instruction information, and sends the instruction to the controlled equipment through a transmission channel; after receiving the instruction, the controlled equipment analyzes and executes a corresponding operation event;
further, the S4 master control device remotely obtains the multimedia file in the controlled device, and shares the multimedia file to the controlled device;
the master control device opens a multimedia file manager in the device, selects multimedia files and sends the secondary files to the controlled device through a transmission channel in a file stream mode; the master control equipment sends an instruction to open a file manager of the controlled equipment through a transmission channel, and sends the file to the master control equipment through the transmission channel after selecting the file so as to complete file sharing between the master control equipment and the controlled equipment;
each screen projection information display window on the main control equipment respectively monitors input information of a user interface, wherein the input information comprises a touch event, an input event of external equipment and the like; and generating an instruction by monitoring the input information of the user interface, and sending the instruction to the controlled equipment through a TCP transmission channel. The controlled equipment receives the remote control instruction information and executes corresponding operation according to the instruction information;
the main control equipment can open a multimedia file manager in the equipment per se and send a specific multimedia file per se to specific controlled equipment through a transmission channel in a file stream mode;
the main control device can open the multimedia file manager of the controlled device through an instruction and send the selected file to the main control device through a transmission channel in a file stream mode.
Example two:
a control system for remote screen projection specifically comprises a connection establishing module, a screen projection display module, a monitoring conversion module and a bidirectional interaction module:
a connection establishment module: the method comprises the steps that a main control device establishes connection with one or more target controlled devices in a local area network;
the screen projection display module: the master control equipment receives screen projection information transmitted by the controlled equipment through connection and displays the screen projection information into a window;
a monitoring conversion module: the main control equipment monitors input operation information of different screen projection interactive interfaces and converts the information into a control instruction;
a bidirectional interaction module: the method comprises the steps that a main control device remotely obtains a multimedia file in a controlled device and shares the multimedia file to the controlled device;
further, the connection establishing module specifically includes a network setting module, an information marking module and a channel establishing module:
a network setting module: the master control equipment and all the controlled equipment are networked and are in the same local area network environment;
an information marking module: filling IP information of all controlled devices in the main control device as marking information;
a channel establishing module: the master control equipment establishes a TCP transmission channel through the IP information of the controlled equipment;
further, the screen projection information of the screen projection display module comprises screen recording and screen capturing information of a current operation interface of the controlled equipment; when the master control equipment is connected with a plurality of controlled equipment, screen projection information of a plurality of different controlled equipment is displayed in different windows;
still further, the monitoring conversion module specifically includes an input monitoring module, an information conversion module, and an instruction execution module:
the input monitoring module: the master control equipment monitors the user interface input information of each controlled equipment;
the information conversion module: aiming at the relative position information of the current window, converting the information of the touch event including the gesture, the touch position and the like into instruction operation;
the instruction execution module: and the controlled terminal receives the instruction information and executes corresponding operation.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (8)

1. A control method for remote screen projection is characterized by comprising the following specific steps:
s1, the main control device establishes connection with one or more target controlled devices in the local area network;
s2, the main control device receives screen projection information transmitted by the controlled device through connection and displays the screen projection information into a window;
s3, the main control device monitors the input operation information of different screen projection interactive interfaces and converts the information into a control instruction;
s4 the master device remotely obtains the multimedia files in the controlled device and shares the multimedia files to the controlled device.
2. The method as claimed in claim 1, wherein the step of establishing the connection between the S1 master device and the one or more target slave devices in the lan comprises:
s101, networking the master control equipment and all the controlled equipment and placing the master control equipment and all the controlled equipment in the same local area network environment;
s102, filling IP information of all controlled devices in the main control device as marking information;
s103, the main control device establishes a TCP transmission channel through the IP information of the controlled device.
3. The method as claimed in claim 2, wherein the screen projection information in S2 includes screen recording and screen capturing information of the current operation interface of the controlled device; when the main control equipment is connected with the controlled equipment, screen projection information of different controlled equipment is displayed in different windows.
4. The method as claimed in claim 3, wherein the step of the S3 main control device monitoring the input operation information of different screen-projecting interactive interfaces and converting the information into the control command comprises:
s301, the main control device monitors the user interface input information of each controlled device;
s302, aiming at the relative position information of the current window, converting the information of the touch event including the gesture, the touch position and the like into instruction operation;
s303, the controlled terminal receives the instruction information and executes corresponding operation.
5. A control system for remote screen projection is characterized by specifically comprising a connection establishing module, a screen projection display module, a monitoring conversion module and a bidirectional interaction module:
a connection establishment module: the method comprises the steps that a main control device establishes connection with one or more target controlled devices in a local area network;
the screen projection display module: the master control equipment receives screen projection information transmitted by the controlled equipment through connection and displays the screen projection information into a window;
a monitoring conversion module: the main control equipment monitors input operation information of different screen projection interactive interfaces and converts the information into a control instruction;
a bidirectional interaction module: the master control equipment remotely obtains the multimedia files in the controlled equipment and shares the multimedia files to the controlled equipment.
6. The system according to claim 5, wherein the connection establishing module specifically comprises a network setting module, an information marking module, and a channel establishing module:
a network setting module: the master control equipment and all the controlled equipment are networked and are in the same local area network environment;
an information marking module: filling IP information of all controlled devices in the main control device as marking information;
a channel establishing module: the main control device establishes a TCP transmission channel through the IP information of the controlled device.
7. The system of claim 6, wherein the screen projection information of the screen projection display module includes screen recording and screen capturing information of a current operation interface of the controlled device; when the main control equipment is connected with the controlled equipment, screen projection information of different controlled equipment is displayed in different windows.
8. The system of claim 7, wherein the monitoring conversion module specifically comprises an input monitoring module, an information conversion module and an instruction execution module:
the input monitoring module: the master control equipment monitors the user interface input information of each controlled equipment;
the information conversion module: aiming at the relative position information of the current window, converting the information of the touch event including the gesture, the touch position and the like into instruction operation;
the instruction execution module: and the controlled terminal receives the instruction information and executes corresponding operation.
CN202111129540.6A 2021-09-26 2021-09-26 Remote screen projection control method and system Pending CN114237531A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111129540.6A CN114237531A (en) 2021-09-26 2021-09-26 Remote screen projection control method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111129540.6A CN114237531A (en) 2021-09-26 2021-09-26 Remote screen projection control method and system

Publications (1)

Publication Number Publication Date
CN114237531A true CN114237531A (en) 2022-03-25

Family

ID=80743118

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111129540.6A Pending CN114237531A (en) 2021-09-26 2021-09-26 Remote screen projection control method and system

Country Status (1)

Country Link
CN (1) CN114237531A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115408093A (en) * 2022-10-31 2022-11-29 统信软件技术有限公司 Remote connection method, remote connection system, computing device, and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115408093A (en) * 2022-10-31 2022-11-29 统信软件技术有限公司 Remote connection method, remote connection system, computing device, and storage medium

Similar Documents

Publication Publication Date Title
CN103248952B (en) A kind of intelligent terminal and intelligent TV set multi-screen interaction method
CN102591493B (en) Mouse cursor synchronization method for internet protocol K virtual machine (IPKVM) system
KR20160069442A (en) Service error detection apparatus for cloud streaming service, end to end service monitoring system and method thereof
CN103150132A (en) Screen transmission method and electronic equipment
CN103281580A (en) Television set remote control method for separating user interface and system thereof
CN114296670B (en) Display device and control method for same-screen display of multi-device screen throwing
CN113766305A (en) Display device and mirror image screen projection audio output control method
CN110851063A (en) Method for carrying out safe fusion interaction on multi-network and multi-system application interface
CN114237531A (en) Remote screen projection control method and system
CN114510205B (en) Display interaction method, display device, electronic device and storage medium
CN106603537A (en) System and method for marking video signal source of mobile intelligent terminal
CN105812912B (en) data sharing method and data sharing system
CN102811241A (en) Remote management method and remote management system
CN114443192B (en) Multi-window virtual application method and device based on cloud desktop
CN111083226A (en) Remote task processing system and method
EP4234057A1 (en) Game control method, apparatus, and storage medium
KR20050056041A (en) Method and system for controlling object in order to share resource between heterogeneous devices
KR102168948B1 (en) Mobile video control system and and operation method thereof
CN105278901A (en) Remote management method
CN113301146A (en) Information transfer equipment, digital exhibition hall operation management method and device
CN109309765B (en) Communication interaction system based on remote control and controlled terminal
CN112714272A (en) Inter-device control method, terminal, and computer-readable storage medium
CN111045522A (en) Intelligent interaction system
CN213122917U (en) KVM multi-system combined control device based on OSD
CN114339315A (en) Program playing method, system, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination