CN111427524A - Remote control method, device, computer equipment and storage medium - Google Patents
Remote control method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN111427524A CN111427524A CN202010122187.8A CN202010122187A CN111427524A CN 111427524 A CN111427524 A CN 111427524A CN 202010122187 A CN202010122187 A CN 202010122187A CN 111427524 A CN111427524 A CN 111427524A
- Authority
- CN
- China
- Prior art keywords
- real time
- mouse
- remote control
- controlled equipment
- received
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000012544 monitoring process Methods 0.000 claims abstract description 20
- 238000004590 computer program Methods 0.000 claims description 15
- 238000005516 engineering process Methods 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 16
- 238000010586 diagram Methods 0.000 description 6
- 238000011161 development Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F3/0383—Signal control means within the pointing device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephonic Communication Services (AREA)
Abstract
The application discloses a remote control method, a remote control device, computer equipment and a storage medium, which are applied to the field of terminal control and used for reducing the engineering quantity of program development for realizing the remote control technology. The method provided by the application comprises the following steps: configuring the identity of the controlled equipment in the browser page according to the received configuration instruction; when a remote control instruction is received through a browser page, a request message of remote control is sent to the controlled equipment; receiving screen display content of the controlled equipment fed back by the controlled equipment in real time according to the request message; converting the received screen display content of the controlled equipment into picture frames in real time, and displaying the picture frames in real time in a browser page; and monitoring the mouse coordinates and the mouse events in the picture frame region in real time, and sending the monitored mouse coordinates and the mouse events to the controlled equipment corresponding to the identity in real time, so that the controlled equipment can execute the corresponding mouse events at the received positions of the mouse coordinates.
Description
Technical Field
The present invention relates to the field of terminal control technologies, and in particular, to a method and an apparatus for remote control, a computer device, and a storage medium.
Background
Based on the special requirements of the user, sometimes the user needs to control other devices through a mobile phone or a computer, for example, when the remote control assists in processing the transaction on the opposite computer, the user needs to trigger the control through a remote control button in the APP application program.
The existing remote control method, no matter whether a mobile phone controls a mobile phone, a computer controls a computer, or a mobile phone controls a computer, requires that the same APP is installed on the main control device and the controlled device, and because the main control device and the controlled device may use different operating systems, for example, the main control device installs an operating system of a Mac apple, and the controlled device installs a Windows system, program developers are required to respectively develop the same APP on different operating systems, the existing remote control method limits the use conditions of remote control, and increases unnecessary program development.
Disclosure of Invention
The embodiment of the invention provides a remote control method, a remote control device, computer equipment and a storage medium, and aims to solve the technical problem of large program development engineering quantity in the prior art of realizing remote control.
A method for remote control, the method is applied to a master control device, and the method comprises the following steps:
configuring the identity of the controlled equipment in the browser page according to the received configuration instruction;
when a remote control instruction is received through the browser page, a request message of remote control is sent to the controlled equipment;
receiving screen display content of the controlled equipment fed back by the controlled equipment in real time according to the request message;
converting the received screen display content of the controlled equipment into picture frames in real time, and displaying the picture frames in the browser page in real time;
and monitoring the mouse coordinates and the mouse events in the picture frame region in real time, and sending the monitored mouse coordinates and the monitored mouse events to the controlled equipment corresponding to the identity identification in real time, so that the controlled equipment can execute the corresponding mouse events at the received positions of the mouse coordinates.
A remotely controlled apparatus, the apparatus comprising:
the configuration module is used for configuring the identity of the controlled equipment in the browser page according to the received configuration instruction;
the request message sending module is used for sending a request message of remote control to the controlled equipment when receiving a remote control instruction through the browser page;
the receiving module is used for receiving the screen display content of the controlled equipment fed back by the controlled equipment in real time according to the request message;
the display module is used for converting the received screen display content of the controlled equipment into picture frames in real time and displaying the picture frames in the browser page in real time;
and the monitoring module is used for monitoring the mouse coordinates and the mouse events in the picture frame region in real time, and sending the monitored mouse coordinates and the monitored mouse events to the controlled equipment corresponding to the identity identification in real time, so that the controlled equipment can execute the corresponding mouse events at the received positions of the mouse coordinates.
A computer device comprising a memory, a processor and a computer program stored in said memory and executable on said processor, said processor implementing the steps of the above-mentioned method of remote control when executing said computer program.
A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method of remote control.
The remote control method, the device, the computer equipment and the storage medium enable a user to remotely control the controlled equipment by utilizing a browser page in the main control equipment, and since browsers are installed in general terminal equipment, the remote control method enables the user to realize a remote control function of the controlled equipment without additionally installing other application programs, does not limit whether an operating system used by the main control equipment and the controlled equipment is the same or not, saves the flow and time for the user to install the application programs and saves the memory of the terminal equipment on the one hand, and enables developers to develop the functions of the browsers only by saving the development of unnecessary application programs by programmers on the other hand, and can be used in L inux systems, thereby improving the applicability and the development efficiency of the remote control of the terminal equipment.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
FIG. 1 is a diagram illustrating an application environment of a remote control method according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of remote control according to an embodiment of the present invention;
FIG. 3 is a flow chart of a method of remote control according to an embodiment of the present invention;
FIG. 4 is an interaction diagram of a method of remote control according to an embodiment of the invention;
FIG. 5 is a schematic diagram of a remote control device according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a computer device according to an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The remote control method provided by the application can be applied to the application environment shown in fig. 1, and the master control device and the controlled device communicate through a network. The master control device includes but is not limited to various personal computers, notebook computers, smart phones, tablet computers and the like, and the controlled device includes but is not limited to personal computers, notebook computers, smart phones, tablet computers and portable wearable devices.
In an embodiment, as shown in fig. 2, a method for remote control is provided, which is described by taking the method as an example applied to the master control terminal in fig. 1, and includes the following steps S101 to S105.
S101, configuring the identity of the controlled equipment in the browser page according to the received configuration instruction.
In this embodiment, the browser includes, but is not limited to, a Firefox browser, Google browser, IE (Internet Explorer) browser, and the like. The identity of the controlled device identifies, for example, an IP (Internet Protocol) address of the controlled device.
The configuration instruction, for example, receives an instruction of adding an IP address of the controlled device, and the user may add the IP address of the terminal device in the page of the browser so that the corresponding terminal device can be controlled.
In one embodiment, the step of configuring, according to the received configuration instruction, the identity of the controlled device in the browser page includes:
receiving an Internet Protocol (IP) address of a controlled device;
and configuring the device corresponding to the IP address of the Internet protocol as the controlled device.
Further, the main control device may be a terminal device having a display screen and a touch function, such as a mobile phone, a Personal Computer (PC), a tablet Computer, and the like.
And S102, sending a remote control request message to the controlled equipment when receiving the remote control instruction through the browser page.
The controlled device can be a mobile phone, a PC, a tablet computer, a wearable electronic device, or other terminal device with a display screen. When the user clicks the button of the 'start control' in the browser page, the main control device receives the instruction of the remote control.
S103, receiving screen display content of the controlled device fed back by the controlled device in real time according to the request message.
In one embodiment, the controlled device starts a minicap process, which reads the current screen frame information from the cache of the controlled device and sends the information to the master device. In this embodiment, the minicap process can read the current screen frame information at different frequencies according to different processing capabilities of the master control device, and the reading speed of the frame information can be about 30-60 times per second.
And S104, converting the received screen display content of the controlled equipment into picture frames in real time, and displaying the picture frames in real time in the browser page.
In one embodiment, when the resolution of the master device is greater than or equal to the resolution of the controlled device, the size of the picture frame is the same as the size of the received resolution of the controlled device.
In one embodiment, the master device may start a minicap receiver in the background to receive the frame information sent by the controlled device in real time and convert the frame information into a jpeg format picture in real time to form a picture frame. A websocket client is newly built in a browser page to link with websocket service of a background, and a jpeg-format picture frame is sent to the browser page through the websocket.
In this embodiment, each of the picture frames corresponds to each of the frame information, i.e., the picture frames are converted the same number of times per second as the frame information is received. The frequency of the picture frames obtained by this step may also be around 30-60 frames per second.
The browser page displays the picture frame in the jpeg format through the pre-created canvas component, so that the content in the screen of the controlled equipment is displayed in real time by the page.
S105, monitoring the mouse coordinates and the mouse events in the picture frame region in real time, and sending the monitored mouse coordinates and the monitored mouse events to the controlled equipment corresponding to the identity in real time, so that the controlled equipment can execute the corresponding mouse events at the received positions of the mouse coordinates.
The monitoring of the mouse coordinates and the mouse events of the main control device in the browser page does not limit that the main control device must include a mouse, but only represents that the main control device has an operable function.
In this embodiment, the mouse coordinates and mouse events in the effective area represent mouse coordinates and mouse events in the display area of the picture frame.
In one embodiment, the monitored mouse coordinates and mouse events can be sent to the background server through the websocket, and the background server sends the information to the controlled device. The controlled device starts a minibutton process to receive and execute the mouse coordinate and the mouse event, and therefore the operation of controlling the mobile phone from the page is achieved.
According to the remote control method, the user can remotely control the controlled device by utilizing the browser page in the main control device, the browsers are installed on common terminal devices, the remote control method enables the user to realize the remote control function of the controlled device without additionally installing other application programs, whether the operating systems used by the main control device and the controlled device are the same or not is not limited, on one hand, the flow and time for the user to install the application programs are saved, the memory of the terminal device is saved, on the other hand, developers only need to develop the functions of the browsers, unnecessary application programs are omitted, the remote control method can be used in an L inux system, and the applicability and the development efficiency of the remote control of the terminal devices are improved.
In one embodiment, the step of displaying the picture frame in the browser page in real time includes:
creating a first view component in the browser page according to the received first creation instruction, and displaying the picture frame in real time through the first view component;
the step of monitoring the mouse coordinates and mouse events in the picture frame region in real time comprises:
creating a second view component on the upper layer of the first view component according to the received second creating instruction, wherein the size of the second view component is the same as that of the first view component and is overlapped with the first view component;
setting the transparency of the second view component to be transparent according to the received transparency setting instruction, and further, setting the transparency of the second view component to be 100%;
and monitoring the mouse coordinates and the mouse events in the picture frame region in real time in the second view component.
In one embodiment, the first view component and the second view component are canvas components.
Fig. 3 is a flowchart of a remote control method according to an embodiment of the present invention, as shown in fig. 3, the remote control method further includes, on the basis of steps S101 to S105:
receiving the resolution of the controlled equipment fed back by the controlled equipment according to the request message;
and determining the size of the picture frame according to the resolution of the controlled equipment.
Further, step S103 is specifically step S1031:
and S1031, receiving the resolution of the controlled device fed back by the controlled device according to the request message and the screen display content of the controlled device fed back in real time.
The step S104 is specifically the step S1041:
s1041, converting the received screen display content of the controlled device into a picture frame in real time, determining the size of the picture frame according to the resolution of the controlled device, and displaying the picture frame in real time in the browser page.
In one embodiment, the step of converting the received screen display content of the controlled device into picture frames in real time further includes:
and converting the received screen display content of the controlled device into a picture frame with the same size as the resolution of the controlled device in real time.
Further, when the resolution of the master device is smaller than that of the controlled device, the method includes:
and determining the expansion coefficient of the picture frame and the expansion coefficient of the mouse coordinate according to the ratio of the resolution of the main control device to the resolution of the controlled device.
In one embodiment, the product of the expansion coefficient and the stretch coefficient is 1.
The step of displaying the picture frame in the browser page in real time specifically includes:
scaling the converted picture frame according to the expansion coefficient;
and displaying the zoomed picture frame in the browser page in real time.
The step of sending the monitored mouse coordinates and mouse events to the controlled equipment corresponding to the identity identification in real time comprises the following steps:
and amplifying the monitored mouse coordinates in real time according to the expansion coefficient and then sending the amplified mouse coordinates to the controlled equipment corresponding to the identity identification.
One usage scenario according to the present embodiment is for example: the method comprises the steps of converting received screen display content of the controlled equipment into picture frames in real time, reducing the picture frames to be half of the original size, displaying the picture frames in a first view component, monitoring mouse coordinates and mouse events through a preset second view component, increasing the monitored mouse coordinates to be twice of the original mouse coordinates, and sending the increased mouse coordinates and mouse events to the controlled equipment corresponding to the identity identification.
Fig. 4 is an interaction diagram of a remote control method in an embodiment of the present invention, and a usage scenario according to this embodiment is as shown in fig. 4, where a master device configures an identity of a controlled device in a browser page, and when receiving a remote control instruction, sends a request message for remote control to the controlled device, and the controlled device feeds back a resolution of the controlled device and a real-time display content of a screen of the controlled device to the master device after receiving the request message, the master device converts the screen display content of the controlled device into a picture frame in real time, determines a size of the picture frame according to the resolution of the controlled device, and displays the picture frame in real time in the browser page, and the master device monitors a mouse coordinate and a mouse event in the picture frame region in real time, and can send the monitored mouse coordinate and mouse event to a background server through a websocket, and the background server side sends the monitored mouse coordinates and the mouse events to the corresponding controlled equipment in real time. The controlled device starts a minibutton process to receive and execute the mouse coordinate and the mouse event, and executes the corresponding mouse event at the position of the received mouse coordinate, so that the operation of controlling the mobile phone from the page is realized.
In this embodiment, by adjusting the display size of the picture frame, and performing corresponding conversion on the monitored mouse coordinate and then sending the converted image to the controlled device, even if the screen resolution of the master control device is smaller than that of the controlled device (for example, the master control device is a mobile phone, and the controlled device is a notebook computer), the method for performing remote control through a browser provided by the present application can still be implemented, and the application range of the present application is further improved.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
In one embodiment, a remote control device is provided, and the remote control device corresponds to the remote control method in the above embodiments one to one. As shown in fig. 5, the remote controlled device includes a configuration module 11, a message transmission module 12, a reception module 13, a display module 14, and a monitoring module 15. The functional modules are explained in detail as follows:
and the configuration module 11 is configured to configure the identity of the controlled device in the browser page according to the received configuration instruction.
In this embodiment, the browser includes, but is not limited to, a Firefox browser, Google browser, IE browser, and the like. The identity of the controlled device identifies, for example, an IP address of the controlled device.
The configuration instruction, for example, receives an instruction of adding an IP address of the controlled device, and the user may add the IP address of the terminal device in the page of the browser so that the corresponding terminal device can be controlled.
And a message sending module 12, configured to send a request message for remote control to the controlled device when receiving the remote control instruction through the browser page.
The controlled device can be a mobile phone, a PC, a tablet computer, a wearable electronic device, or other terminal device with a display screen. When the user clicks the button of the 'start control' in the browser page, the main control device receives the instruction of the remote control.
And the receiving module 13 is configured to receive the screen display content of the controlled device fed back by the controlled device in real time according to the request message.
In one embodiment, the controlled device starts a minicap process, which reads the current screen frame information from the cache of the controlled device and sends the information to the master device. In this embodiment, the minicap process can read the current screen frame information at different frequencies according to different processing capabilities of the master control device, and the reading speed of the frame information can be about 30-60 times per second.
And the display module 14 is configured to convert the received screen display content of the controlled device into a picture frame in real time, and display the picture frame in the browser page in real time.
In one embodiment, when the resolution of the master device is greater than or equal to the resolution of the controlled device, the size of the picture frame is the same as the size of the received resolution of the controlled device.
In one embodiment, the master device may start a minicap receiver in the background to receive the frame information sent by the controlled device in real time and convert the frame information into a jpeg format picture in real time to form a picture frame. A websocket client is newly built in a browser page to link with websocket service of a background, and a jpeg-format picture frame is sent to the browser page through the websocket.
In this embodiment, each of the picture frames corresponds to each of the frame information, i.e., the picture frames are converted the same number of times per second as the frame information is received. The frequency of the picture frames obtained by this step may also be around 30-60 frames per second.
The browser page displays the picture frame in the jpeg format through the pre-created canvas component, so that the content in the screen of the controlled equipment is displayed in real time by the page.
And the monitoring module 15 is configured to monitor a mouse coordinate and a mouse event in the picture frame region in real time, and send the monitored mouse coordinate and mouse event to the controlled device corresponding to the identity in real time, so that the controlled device executes the corresponding mouse event at the received position of the mouse coordinate.
The monitoring of the mouse coordinates and the mouse events of the main control device in the browser page does not limit that the main control device must include a mouse, but only represents that the main control device has an operable function.
In this embodiment, the mouse coordinates and mouse events in the effective area represent mouse coordinates and mouse events in the display area of the picture frame.
In one embodiment, the monitored mouse coordinates and mouse events can be sent to the background server through the websocket, and the background server sends the information to the controlled device. The controlled device starts a minibutton process to receive and execute the mouse coordinate and the mouse event, and therefore the operation of controlling the mobile phone from the page is achieved.
In one embodiment, the remote control device further comprises:
the first creating unit is used for creating a first view component in the browser page according to the received first creating instruction, and displaying the picture frame in real time through the first view component;
a second creating module, configured to create a second view component on an upper layer of the first view component according to a received second creating instruction, where the size of the second view component is the same as and coincides with the size of the first view component;
a transparency setting module, configured to set a transparency of the second view component to transparent according to the received transparency setting instruction, and further, may set the transparency of the second view component to 100%;
the monitoring module is specifically configured to monitor mouse coordinates and mouse events in the picture frame region in real time in the second view component.
In one embodiment, the first view component and the second view component are canvas components.
In one embodiment: the receiving module 13 is further configured to receive the resolution of the controlled device fed back by the controlled device according to the request message; the display module 14 is further configured to determine the size of the picture frame according to the resolution of the controlled device.
In one embodiment, the display module 14 is specifically configured to convert the received screen display content of the controlled device into a picture frame with a size equal to a resolution of the controlled device in real time.
In one embodiment, when the resolution of the master device is smaller than that of the controlled device, the apparatus for remote control further includes:
and the coefficient determining module is used for determining the expansion coefficient of the picture frame and the expansion coefficient of the mouse coordinate according to the ratio of the resolution of the main control device to the resolution of the controlled device.
In one embodiment, the product of the expansion coefficient and the expansion coefficient is 1
Further, the display module 14 specifically includes:
the scaling unit is used for scaling the converted picture frame according to the expansion coefficient;
and the display unit is used for displaying the zoomed picture frame in the browser page in real time.
Further, the monitoring module 15 is specifically configured to amplify the monitored mouse coordinate in real time according to the expansion coefficient and send the amplified mouse coordinate to the controlled device corresponding to the identity.
One usage scenario according to the present embodiment is for example: the display module converts the received screen display content of the controlled equipment into a picture frame in real time, reduces the picture frame to be half of the original size, displays the picture frame in a first view component, monitors a mouse coordinate and a mouse event through a preset second view component, increases the monitored mouse coordinate to be twice of the original mouse coordinate, and sends the increased mouse coordinate and mouse event to the controlled equipment corresponding to the identity identification.
In one embodiment, the configuration module 11 further comprises:
the IP address receiving unit is used for receiving the Internet protocol IP address of the controlled equipment;
and the configuration unit is used for configuring the equipment corresponding to the Internet protocol IP address as the controlled equipment.
For specific limitations of the device under remote control, reference may be made to the above limitations of the method under remote control, which are not described herein again. The respective modules in the above-described remote-controlled apparatus may be wholly or partially implemented by software, hardware, and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 6. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with the controlled device through network connection. The computer program is executed by a processor to implement a method of remote control.
In one embodiment, a computer device is provided, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the steps of the method of remote control in the above embodiments are implemented, for example, steps 101 to 105 shown in fig. 2. Alternatively, the processor, when executing the computer program, realizes the functions of the respective modules/units of the apparatus for remote control in the above-described embodiments, such as the functions of the modules 11 to 15 shown in fig. 5. To avoid repetition, further description is omitted here.
In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which, when being executed by a processor, implements the steps of the method of remote control in the above-described embodiments, such as the steps 101 to 105 shown in fig. 2. Alternatively, the computer program realizes the functions of the respective modules/units of the apparatus for remote control in the above-described embodiments, such as the functions of the modules 11 to 15 shown in fig. 5, when executed by the processor. To avoid repetition, further description is omitted here.
According to the remote control method, the remote control device, the computer equipment and the storage medium, a user can remotely control the controlled equipment by utilizing a browser page in the main control equipment, and since browsers are installed in general terminal equipment, the remote control method provided by the application enables the user to realize a remote control function of the controlled equipment without additionally installing other application programs, whether an operating system used by the main control equipment and the controlled equipment is the same or not is not limited, on one hand, the flow and time for the user to install the application programs are saved, the memory of the terminal equipment is saved, on the other hand, developers only need to develop the functions of the browsers, unnecessary application programs of the programmers are saved, the remote control method provided by the application can be used in an L inux system, and the applicability and the development efficiency of the remote control of the terminal equipment are improved.
It will be understood by those of ordinary skill in the art that all or a portion of the processes of the methods of the embodiments described above may be implemented by a computer program that may be stored on a non-volatile computer-readable storage medium, which when executed, may include the processes of the embodiments of the methods described above, wherein any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (10)
1. A remote control method is applied to a master control device and is characterized by comprising the following steps:
configuring the identity of the controlled equipment in the browser page according to the received configuration instruction;
when a remote control instruction is received through the browser page, a request message of remote control is sent to the controlled equipment;
receiving screen display content of the controlled equipment fed back by the controlled equipment in real time according to the request message;
converting the received screen display content of the controlled equipment into picture frames in real time, and displaying the picture frames in the browser page in real time;
and monitoring the mouse coordinates and the mouse events in the picture frame region in real time, and sending the monitored mouse coordinates and the monitored mouse events to the controlled equipment corresponding to the identity identification in real time, so that the controlled equipment can execute the corresponding mouse events at the received positions of the mouse coordinates.
2. The method of claim 1, wherein the step of displaying the picture frame in real time in the browser page comprises:
creating a first view component in the browser page according to the received first creation instruction, and displaying the picture frame in real time through the first view component;
the step of monitoring the mouse coordinates and mouse events in the picture frame region in real time comprises:
creating a second view component on the upper layer of the first view component according to the received second creating instruction, wherein the size of the second view component is the same as that of the first view component and is overlapped with the first view component;
setting the transparency of the second view component to be transparent according to the received transparency setting instruction;
and monitoring the mouse coordinates and the mouse events in the picture frame region in real time in the second view component.
3. The method of remote control according to claim 1, further comprising:
receiving the resolution of the controlled equipment fed back by the controlled equipment according to the request message;
and determining the size of the picture frame according to the resolution of the controlled equipment.
4. The method of claim 3, wherein the step of converting the received screen display content of the controlled device into picture frames in real time further comprises:
and converting the received screen display content of the controlled device into a picture frame with the same size as the resolution of the controlled device in real time.
5. The method of claim 3, wherein when the resolution of the master device is smaller than the resolution of the controlled device, the method comprises:
determining a telescopic coefficient of the picture frame and an expansion coefficient of the mouse coordinate according to the ratio of the resolution of the main control device to the resolution of the controlled device;
the step of displaying the picture frame in the browser page in real time specifically includes:
scaling the converted picture frame according to the expansion coefficient;
displaying the zoomed picture frame in the browser page in real time;
the step of sending the monitored mouse coordinates and mouse events to the controlled equipment corresponding to the identity identification in real time comprises the following steps:
and amplifying the monitored mouse coordinates in real time according to the expansion coefficient and then sending the amplified mouse coordinates to the controlled equipment corresponding to the identity identification.
6. The remote control method according to claim 1, wherein the step of configuring the identity of the controlled device in the browser page according to the received configuration command comprises:
receiving an Internet Protocol (IP) address of a controlled device;
and configuring the device corresponding to the IP address of the Internet protocol as the controlled device.
7. A remotely controlled apparatus, the apparatus comprising:
the configuration module is used for configuring the identity of the controlled equipment in the browser page according to the received configuration instruction;
the message sending module is used for sending a request message of remote control to the controlled equipment when receiving a remote control instruction through the browser page;
the receiving module is used for receiving the screen display content of the controlled equipment fed back by the controlled equipment in real time according to the request message;
the display module is used for converting the received screen display content of the controlled equipment into picture frames in real time and displaying the picture frames in the browser page in real time;
and the monitoring module is used for monitoring the mouse coordinates and the mouse events in the picture frame region in real time, and sending the monitored mouse coordinates and the monitored mouse events to the controlled equipment corresponding to the identity identification in real time, so that the controlled equipment can execute the corresponding mouse events at the received positions of the mouse coordinates.
8. The remotely controlled apparatus according to claim 7, further comprising:
the first creating unit is used for creating a first view component in the browser page according to the received first creating instruction, and displaying the picture frame in real time through the first view component;
a second creating module, configured to create a second view component on an upper layer of the first view component according to a received second creating instruction, where the size of the second view component is the same as and coincides with the size of the first view component;
the transparency setting module is used for setting the transparency of the second view component to be transparent according to the received transparency setting instruction;
the monitoring module is specifically configured to monitor mouse coordinates and mouse events in the picture frame region in real time in the second view component.
9. Computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor realizes the steps of the method of remote control according to any of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method of remote control according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010122187.8A CN111427524A (en) | 2020-02-27 | 2020-02-27 | Remote control method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010122187.8A CN111427524A (en) | 2020-02-27 | 2020-02-27 | Remote control method, device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111427524A true CN111427524A (en) | 2020-07-17 |
Family
ID=71547203
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010122187.8A Pending CN111427524A (en) | 2020-02-27 | 2020-02-27 | Remote control method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111427524A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113014996A (en) * | 2021-02-18 | 2021-06-22 | 上海哔哩哔哩科技有限公司 | Video generation method and device |
| CN113253891A (en) * | 2021-05-13 | 2021-08-13 | 展讯通信（上海）有限公司 | Terminal control method and device, storage medium and terminal |
| CN113282488A (en) * | 2021-05-13 | 2021-08-20 | 展讯通信（上海）有限公司 | Terminal test method and device, storage medium and terminal |
| CN113765889A (en) * | 2021-08-06 | 2021-12-07 | 深圳市华磊迅拓科技有限公司 | Remote centralized control method, system, device and storage medium |
| CN115801771A (en) * | 2023-02-10 | 2023-03-14 | 深圳依时货拉拉科技有限公司 | Remote operation method, device, computer equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101815096A (en) * | 2010-03-26 | 2010-08-25 | 方小祥 | Remote-operated mobile phone system and visualized operation method thereof by utilizing webpage |
| CN102915114A (en) * | 2012-09-05 | 2013-02-06 | 广东威创视讯科技股份有限公司 | Remote control method of PPT (Power Point) |
| CN103530096A (en) * | 2012-07-03 | 2014-01-22 | 索尼公司 | Remote control method, remote control equipment and display equipment |
| CN103605491A (en) * | 2013-11-08 | 2014-02-26 | 天脉聚源(北京)传媒科技有限公司 | Method, mobile terminal and system of remote control display device |
| CN103631893A (en) * | 2013-11-15 | 2014-03-12 | 北京奇虎科技有限公司 | Browser control method and browser |
| CN107770253A (en) * | 2017-09-22 | 2018-03-06 | 西安万像电子科技有限公司 | Long-range control method and system |
| CN108228125A (en) * | 2017-12-29 | 2018-06-29 | 广州酷狗计算机科技有限公司 | The long-range control method and system of smart machine |
| CN109766163A (en) * | 2019-01-17 | 2019-05-17 | 网易（杭州）网络有限公司 | Synchronous display method and device, storage medium and electronic device |
-
2020
- 2020-02-27 CN CN202010122187.8A patent/CN111427524A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101815096A (en) * | 2010-03-26 | 2010-08-25 | 方小祥 | Remote-operated mobile phone system and visualized operation method thereof by utilizing webpage |
| CN103530096A (en) * | 2012-07-03 | 2014-01-22 | 索尼公司 | Remote control method, remote control equipment and display equipment |
| CN102915114A (en) * | 2012-09-05 | 2013-02-06 | 广东威创视讯科技股份有限公司 | Remote control method of PPT (Power Point) |
| CN103605491A (en) * | 2013-11-08 | 2014-02-26 | 天脉聚源(北京)传媒科技有限公司 | Method, mobile terminal and system of remote control display device |
| CN103631893A (en) * | 2013-11-15 | 2014-03-12 | 北京奇虎科技有限公司 | Browser control method and browser |
| CN107770253A (en) * | 2017-09-22 | 2018-03-06 | 西安万像电子科技有限公司 | Long-range control method and system |
| CN108228125A (en) * | 2017-12-29 | 2018-06-29 | 广州酷狗计算机科技有限公司 | The long-range control method and system of smart machine |
| CN109766163A (en) * | 2019-01-17 | 2019-05-17 | 网易（杭州）网络有限公司 | Synchronous display method and device, storage medium and electronic device |
Non-Patent Citations (2)
| Title |
|---|
| JOSWIG, J.C. ET AL.: "Flexible command and control interfaces for teleoperations", IEEE * |
| 朱正礼;: "计算机远程控制系统的设计与实现", 信息技术, no. 12 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113014996A (en) * | 2021-02-18 | 2021-06-22 | 上海哔哩哔哩科技有限公司 | Video generation method and device |
| CN113253891A (en) * | 2021-05-13 | 2021-08-13 | 展讯通信（上海）有限公司 | Terminal control method and device, storage medium and terminal |
| CN113282488A (en) * | 2021-05-13 | 2021-08-20 | 展讯通信（上海）有限公司 | Terminal test method and device, storage medium and terminal |
| CN113253891B (en) * | 2021-05-13 | 2022-10-25 | 展讯通信（上海）有限公司 | Terminal control method and device, storage medium and terminal |
| CN113765889A (en) * | 2021-08-06 | 2021-12-07 | 深圳市华磊迅拓科技有限公司 | Remote centralized control method, system, device and storage medium |
| CN115801771A (en) * | 2023-02-10 | 2023-03-14 | 深圳依时货拉拉科技有限公司 | Remote operation method, device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111427524A (en) | Remote control method, device, computer equipment and storage medium | |
| CN110704136B (en) | Method for rendering applet components, client, electronic device and storage medium | |
| CN110928511A (en) | Screen projection method and device and electronic equipment | |
| CN111240620A (en) | Intelligent terminal screen projection processing method and device, computer equipment and medium | |
| KR20120042883A (en) | Method and apparatus for providing mobile device interoperability | |
| CN107509051A (en) | Long-range control method, device, terminal and computer-readable recording medium | |
| US20140361991A1 (en) | Method and electronic device for controlling mouse module | |
| CN113784049B (en) | Camera calling method of android system virtual machine, electronic equipment and storage medium | |
| CN103607654A (en) | A mobile terminal auxiliary input apparatus based on a multi-screen cooperation system and a method | |
| CN113655975B (en) | Image display method, image display device, electronic apparatus, and medium | |
| CN111078104A (en) | Redirection method of multi-point touch equipment on cloud desktop and computer equipment | |
| CN115309470B (en) | Method, device, equipment and storage medium for loading widget | |
| CN111897502A (en) | Split screen control system and method | |
| CN103473035A (en) | Screen capturing method and device | |
| CN108052401B (en) | System attribute monitoring method, terminal device and computer readable storage medium | |
| CN111767176A (en) | Method and device for remotely controlling terminal equipment | |
| CN111143017A (en) | Cloud operating system interaction processing method, client and cloud operating system | |
| CN108737337B (en) | Equipment processing method, device, server and system | |
| CN113038251B (en) | Control method and control device | |
| US20150271431A1 (en) | Information Transmission Method and Wireless Display System | |
| WO2017181657A1 (en) | Control method and apparatus for download notification bar | |
| CN111382039A (en) | Method, device, electronic equipment and storage medium for reporting user behavior event | |
| CN113779122B (en) | Method and device for exporting data | |
| CN104468505A (en) | Safety audit log playing method and device | |
| CN115202779A (en) | Remote control method and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |