CN111078428A - Remote control method and device, storage medium and terminal equipment - Google Patents
Remote control method and device, storage medium and terminal equipment Download PDFInfo
- Publication number
- CN111078428A CN111078428A CN201911230009.0A CN201911230009A CN111078428A CN 111078428 A CN111078428 A CN 111078428A CN 201911230009 A CN201911230009 A CN 201911230009A CN 111078428 A CN111078428 A CN 111078428A
- Authority
- CN
- China
- Prior art keywords
- display content
- terminal
- category
- data
- remote control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/0418—Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Telephone Function (AREA)
Abstract
The invention discloses a remote control method and a device thereof, a storage medium and a terminal device, which can quickly obtain the display content fed back by touch screen operation when a user remotely controls the display content of another mobile terminal through a network, thereby ensuring the operation accuracy and avoiding the misoperation of a touch screen.
Description
Technical Field
The invention belongs to the technical field of mobile terminals, and particularly relates to a remote control method and device, a storage medium and terminal equipment.
Background
With the progress of society and the continuous improvement of scientific technology, more and more mobile terminals (such as mobile phones) are rapidly developed, and the quantity of mobile terminals owned by users is greatly increased. The mobile terminal is related to the related applications of the mobile terminal in daily life, study and work from the old to children. Especially the elderly, due to limited knowledge reserves and finger dexterity, often experience problems when using mobile terminals, where young users skilled in using mobile terminals are required for help. In the prior art, one mobile terminal can operate by remotely controlling another mobile terminal. In the operation process, the current display content of the controlled mobile terminal is actually sent to the main control mobile terminal, and once the display of the controlled mobile terminal changes, the current display content needs to be sent to the main control mobile terminal again.
As is well known, the display screens of current mobile terminals are large, so that the display contents are also large. The touch operation is usually flexible, and after the master control mobile terminal performs the remote touch operation, because the display content of the controlled mobile terminal is more, a delay time is required to obtain the effect of the controlled mobile terminal operating through the touch screen at this time on the master control mobile terminal, which may cause the occurrence of the condition of the misoperation of the touch screen caused by the delay of the display content.
Therefore, the prior art has defects and needs to be improved and developed.
Disclosure of Invention
In the embodiment of the invention, a remote control method and a device thereof, a storage medium and a terminal device are provided, so that when a user remotely controls display content of another mobile terminal through a network, the feedback display content of touch screen operation can be quickly obtained, the operation accuracy is ensured, and misoperation of a touch screen is avoided.
According to a first aspect of the present invention, there is provided a remote control method comprising the steps of: the first terminal sends an operation instruction to the second terminal through a remote control connection; the first terminal acquires a data packet transmitted by the second terminal, wherein the data packet is self display content of the second terminal after the operation instruction is effective, and the second terminal sends the self display content to the first terminal according to different display content types; and the first terminal displays corresponding display content according to different display content types in the data packet.
In an embodiment of the present invention, the data packet at least includes the display content category and display content data corresponding to the display content category; the display content category is used for identifying the category of the display content, and the display content data is specific data of the display content.
In an embodiment of the present invention, the display content categories at least include: a first type of display content and a second type of display content; when the display content category is a first type of display content, the display content data is the whole screen display content currently displayed by the second terminal; and when the display content category is a second type display content, the display content is information of at least one area which is displayed and updated compared with the previous display currently displayed by the second terminal.
In an embodiment of the present invention, the information of the at least one region includes a region position and display content data corresponding to the region position; wherein the region position is determined from two coordinate points.
In an embodiment of the present invention, in the step of the first terminal performing corresponding display content display according to different display content categories in the data packet, the method further includes: judging the display content category; when the display content type is judged to be the first type of display content, the first terminal directly displays the display content data in the data packet; and when the display content type is judged to be the second type of display content, the first terminal displays corresponding display content data in the area according to the area information in the display content data of the data packet.
According to a second aspect of the present invention, there is also provided a remote control device comprising: the operation instruction sending module is used for sending an operation instruction to the second terminal through a remote control connection; the data packet acquisition module is connected with the operation instruction sending module and is used for acquiring a data packet transmitted by the second terminal, wherein the data packet is self display content of the second terminal after the operation instruction takes effect and is sent by the second terminal according to different display content types; and the display content display module is connected with the data packet acquisition module and is used for displaying corresponding display contents according to different display content categories in the data packet.
In an embodiment of the present invention, the data packet at least includes the display content category and display content data corresponding to the display content category; the display content category is used for identifying the category of the display content, and the display content data is specific data of the display content.
In an embodiment of the present invention, the display content categories at least include: a first type of display content and a second type of display content; when the display content category is a first type of display content, the display content data is the whole screen display content currently displayed by the second terminal; and when the display content category is a second type display content, the display content is information of at least one area which is displayed and updated compared with the previous display currently displayed by the second terminal.
In an embodiment of the present invention, the information of the at least one region includes a region position and display content data corresponding to the region position; wherein the region position is determined from two coordinate points.
In an embodiment of the present invention, the display content display module further includes: a category judgment unit for judging a category of the display content; the first display unit is connected with the category judgment unit and is used for directly displaying the display content data in the data packet when the category of the display content is judged to be the first category of display content; and the second display unit is connected with the category judgment unit and is used for displaying corresponding display content data in the area according to the area information in the display content data of the data packet when the category of the display content is judged to be the second category of display content.
According to a third aspect of the present invention, there is also provided a storage medium having stored therein a plurality of instructions adapted to be loaded by a processor to perform a remote control method as described above.
According to a fourth aspect of the present invention, the present invention further provides a terminal device, including a processor and a memory, where the processor is electrically connected to the memory, the memory is used for storing instructions and data, and the processor is used for executing the steps in the remote control method.
Compared with the prior art, the remote control method provided by the invention has the advantages that the remote control operation is started through the master control mobile terminal and the controlled mobile terminal, the controlled mobile terminal receives the touch screen operation instruction sent by the master control mobile terminal, then the self display content is sent to the master control mobile terminal to be displayed after the instruction takes effect, and the display content is sent according to one screen when being sent; the method comprises the steps that when a master control mobile terminal receives a screen display content transmitted by a controlled mobile terminal, a corresponding data packet is obtained, and then the data of the screen display content is judged to be a first type display content or a second type display content according to the display content type in the data packet; if the first type of display content is the first type of display content, processing according to a rule corresponding to the first type of display content; and if the second type of display content is the display content, processing according to the rule corresponding to the second type of display content. When a user remotely controls the display content of another mobile terminal through a network, the display content fed back by the touch screen operation can be quickly obtained, so that the accuracy of the operation is ensured, and the misoperation of the touch screen is avoided.
Drawings
The technical solution and other advantages of the present application will become apparent from the detailed description of the embodiments of the present application with reference to the accompanying drawings.
Fig. 1 is a schematic flowchart illustrating steps of a remote control method according to an embodiment of the present invention.
Fig. 2 is a flowchart illustrating the sub-steps of step S130 shown in fig. 1.
Fig. 3 is a schematic structural diagram of a first terminal according to an embodiment of the present invention.
Fig. 4 is a schematic structural diagram of the display content display module 130 shown in fig. 3.
Fig. 5 is an operation diagram of the first terminal shown in fig. 3.
Fig. 6 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
Fig. 7 is another schematic structural diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "first," "second," "third," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the objects so described are interchangeable under appropriate circumstances. Furthermore, the terms "comprising" and "having," as well as any variations thereof, are intended to cover non-exclusive inclusions.
In particular embodiments, the drawings discussed below and the embodiments used to describe the principles of the present disclosure are by way of illustration only and should not be construed to limit the scope of the present disclosure. Those skilled in the art will understand that the principles of the present invention may be implemented in any suitably arranged system. Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. Further, a terminal according to an exemplary embodiment will be described in detail with reference to the accompanying drawings. Like reference symbols in the various drawings indicate like elements.
The terminology used in the detailed description is for the purpose of describing particular embodiments only and is not intended to be limiting of the inventive concepts. Unless the context clearly dictates otherwise, expressions used in the singular form encompass expressions in the plural form. In the present specification, it is to be understood that terms such as "comprising," "having," and "containing" are intended to specify the presence of stated features, integers, steps, acts, or combinations thereof, as taught in the present specification, and are not intended to preclude the presence or addition of one or more other features, integers, steps, acts, or combinations thereof. Like reference symbols in the various drawings indicate like elements.
Referring to fig. 1, the present invention provides a remote control method, including the steps of:
step S110: the first terminal sends an operation instruction to the second terminal through a remote control connection.
Step S120: and the first terminal acquires a data packet transmitted by the second terminal, wherein the data packet is self display content of the second terminal after the operation instruction takes effect and is sent by the second terminal according to different display content types.
Step S130: and the first terminal displays corresponding display content according to different display content types in the data packet.
Specifically, before step S110, the method may further include: the first terminal and the second terminal establish remote control connection.
The first terminal and the second terminal can be mobile terminals, such as mobile phones, tablet computers, wearable devices (e.g., smart band, smart watch), and the like, which can perform wireless communication, and the terminal devices have touch screens. Hereinafter, the first terminal and the second terminal both refer to mobile terminals having touch screens. In addition, the first terminal and the second terminal may be the same type of mobile terminal (for example, both the first terminal and the second terminal are mobile phones), or may be different types of mobile terminals (for example, the first terminal is a tablet computer, and the second terminal is a mobile phone), and are not limited herein.
The first terminal and the second terminal can establish remote control connection with each other through wireless communication modes respectively. For example, the first terminal actively initiates a remote control connection request to the second terminal in a wireless communication manner, and the second terminal receives the remote control connection request in a wireless communication manner and responds to the remote control connection request to establish a remote control connection. The wireless communication mode can be Bluetooth, WLAN, 5G/4G/3G or Zigbee, etc. The wireless communication method of the first terminal and the wireless communication method of the second terminal may be the same or different, and are not limited herein.
In step S110, the first terminal sends an operation command to the second terminal through the remote control connection. That is, the first terminal is used as the master mobile terminal, and the second terminal is used as the controlled mobile terminal, which is the same as the case below. The manner in which the first terminal 10 and the second terminal 20 communicate with each other is shown in fig. 3.
The operation instruction is a touch screen operation instruction which is sent to the controlled mobile terminal as the main control mobile terminal.
In step S120, the first terminal obtains a data packet transmitted by the second terminal, where the data packet is a self-display content of the second terminal 20 after the operation instruction is validated, and the self-display content is sent by the second terminal 20 according to different display content categories.
Specifically, the second terminal 20, which is a controlled mobile terminal, transmits its own display content to the first terminal 10, which is a master mobile terminal, for display after the operation instruction is validated. Wherein, the display content is transmitted in one screen (screen) at the time of transmission. The format of each screen display content at least comprises a data packet.
The data packet may include a display content category and display content data corresponding to the display content category. The display content category is used for identifying the category of the display content, and the display content data is specific data of the display content.
In this embodiment, the display content categories at least include: a first type of display content and a second type of display content. The display content category may identify a first type of display content and a second type of display content with 1 and 0, respectively. Of course, a and B may be used to identify the first type of display content and the second type of display content, respectively. The manner for identifying the first type of display content and the second type of display content is not limited thereto.
When the display content category is the first type of display content, the display content data is the entire screen display content currently displayed by the second terminal 20. When the display content category is a second type of display content, the display content is information of at least one area which is displayed more recently than a previous display for the second terminal 20.
That is, the display contents for each screen transmitted by the second terminal 20 may be classified into two types including a first type display content and a second type display content. If the display content type is the first type display content, the whole screen display content as the controlled mobile terminal needs to be transmitted during transmission. If the display content type is the second type display content, the display content which is used as some local area on the controlled mobile terminal screen only needs to be sent when being sent.
Therefore, in this embodiment, if the display content type is the second type of display content, the display content data in the data packet includes information of at least one region at the time of transmission.
Further, the information of the at least one region includes a region position and display content data corresponding to the region position. For example, the format of the display content data is specifically as follows:
position of region 1: display content data of area 1: position of region 2: display content data of area 2: position of region 3: display content data of area 3: position of region 4: display content data of area 4: … location of region N: display content data of the region N.
The position of the region x (x is 1,2,3 … N) is determined by two coordinate points, for example, one region position is determined by coordinates (xe1, ye1), (xe2, ye2), coordinates (x, y) satisfying xe1 ≦ x ≦ xe2, and ye1 ≦ y ≦ ye2 are all located in the region.
For example, the second terminal 20, which is a controlled mobile terminal, displays updated information of a plurality of areas of the current one-screen display content compared with the previous one-screen display content, including: if the area determined by the lower left corner coordinates (100, 156) and the upper right corner coordinates (200, 199) has the display content of display content 1, and the area determined by the lower left corner coordinates (800, 156) and the upper right corner coordinates (900, 299) has the display content of display content 2, the display content data is specifically in the following format: (100, 156),(200, 199): display content 1: (800, 156),(900, 299): content 2 is displayed.
In addition, the second terminal 20 may be configured to determine that one screen of display content is the first type of display content or the second type of display content, that is, determine the display content category. When the display update of the second terminal 20 is performed according to the entire screen, the display content category is the first type of display content. When the display update of the second terminal 20 is performed by the local area, the display content category is the second type of display content.
In step S130: the first terminal displays corresponding display contents according to different display content categories in the data packet, and further may perform the following steps, as shown in fig. 2: step S131: judging the display content category; step S132: when the display content type is judged to be the first type of display content, the first terminal directly displays the display content data in the data packet; and step S133: and when the display content type is judged to be the second type of display content, the first terminal displays corresponding display content data in the area according to the area information in the display content data of the data packet.
Specifically, the first terminal 10, which is a master mobile terminal, acquires a packet when receiving one-screen display content transmitted as a slave mobile terminal. And judging whether the display content of the screen is the first type display content or the second type display content according to the display content type in the data packet. When the display content type is judged to be the first type of display content, the first terminal 10 directly displays the display content data in the data packet as the whole screen display content of the controlled mobile terminal. When the display content type is judged to be the second type of display content, the first terminal 10 acquires the area information in the display content data of the data packet, and then displays the corresponding display content data in the area. If a plurality of area information exist, the following operations are performed in sequence: and acquiring the area position in the area information, and then displaying the corresponding display content data in the corresponding area position until the whole display content data is processed.
Therefore, the invention provides a remote control method, the method starts remote control operation through a main control mobile terminal and a controlled mobile terminal, the controlled mobile terminal receives a touch screen operation instruction sent by the main control mobile terminal, then the self display content is sent to the main control mobile terminal to be displayed after the instruction takes effect, and the display content is sent according to one screen when being sent; the method comprises the steps that when a master control mobile terminal receives a screen display content transmitted by a controlled mobile terminal, a corresponding data packet is obtained, and then the data of the screen display content is judged to be a first type display content or a second type display content according to the display content type in the data packet; and if the display content is the first type display content, processing according to the rule corresponding to the first type display content, and if the display content is the second type display content, processing according to the rule corresponding to the second type display content. When a user remotely controls the display content of another mobile terminal through a network, the display content fed back by the touch screen operation can be quickly obtained, so that the accuracy of the operation is ensured, and the misoperation of the touch screen is avoided.
The present invention also provides a remote control apparatus, comprising: an operation instruction sending module 110, a data packet obtaining module 120 and a display content display module 130.
In this embodiment, the operation instruction sending module 110, the data packet obtaining module 120 and the display content displaying module may be disposed in the first terminal 10 having a remote control function, as shown in fig. 3. That is, the first terminal 10 includes an operation instruction transmitting module 110, a packet acquiring module 120, and a display content displaying module 130. The first terminal 10 is connected to the second terminal 20 by a remote control connection, such as a wireless communication means, as shown in fig. 5.
Further, the operation instruction sending module 110 is configured to send an operation instruction to the second terminal 20 through a remote control connection. The data packet obtaining module 120 is connected to the operation instruction sending module 110. The data packet obtaining module 120 is configured to obtain a data packet transmitted by the second terminal 20, where the data packet is a self-display content of the second terminal 20 after the operation instruction is valid, and the data packet is sent by the second terminal 20 according to different display content categories. The display content display module 130 is connected to the data packet obtaining module 120. The display content display module 130 is configured to display corresponding display content according to different display content categories in the data packet.
Further, the data packet includes at least the display content category and display content data corresponding to the display content category. The display content category is used for identifying the category of the display content, and the display content data is specific data of the display content.
In this embodiment, the display content categories at least include: a first type of display content and a second type of display content. The display content category may identify a first type of display content and a second type of display content with 1 and 0, respectively. Of course, a and B may be used to identify the first type of display content and the second type of display content, respectively. The manner for identifying the first type of display content and the second type of display content is not limited thereto.
When the display content category is the first type of display content, the display content data is the entire screen display content currently displayed by the second terminal 20. When the display content category is a second type of display content, the display content is information of at least one area which is displayed more recently than a previous display for the second terminal 20. That is, the display contents for each screen transmitted by the second terminal 20 may be classified into two types including a first type display content and a second type display content. If the display content type is the first type display content, the whole screen display content as the controlled mobile terminal needs to be transmitted during transmission. If the display content type is the second type display content, the display content which is used as some local area on the controlled mobile terminal screen only needs to be sent when being sent. If the display content type is the second type display content, the display content data in the data packet comprises information of at least one area when the display content is sent.
In this embodiment, the information of the at least one region includes a region position and display content data corresponding to the region position. Wherein the region position is determined from two coordinate points.
In this embodiment, as shown in fig. 4, the display content display module 130 further includes: a category determination unit 131 for determining a display content category; a first display unit 132, connected to the category determining unit 131, where the first display unit 132 is configured to directly display the display content data in the data packet when it is determined that the display content category is the first category of display content; and a second display unit 133, connected to the category determining unit 131, where the second display unit 133 is configured to, when it is determined that the category of the display content is the second category of display content, display corresponding display content data in the area according to area information in the display content data of the data packet.
Referring to fig. 6, an embodiment of the present invention further provides a terminal device 200. The terminal device 200 may be a mobile phone, a tablet, a computer, or the like. As shown in fig. 6, the terminal device 200 includes a processor 201 and a memory 202. The processor 201 is electrically connected to the memory 202.
The processor 201 is a control center of the terminal device 200, connects various parts of the entire terminal device by using various interfaces and lines, and performs various functions of the terminal device and processes data by running or loading an application program stored in the memory 202 and calling data stored in the memory 202, thereby performing overall monitoring of the terminal device.
In this embodiment, the terminal device 200 is provided with a plurality of memory partitions, the plurality of memory partitions includes a system partition and a target partition, the processor 201 in the terminal device 200 loads instructions corresponding to processes of one or more application programs into the memory 202 according to the following steps, and the processor 201 runs the application programs stored in the memory 202, so as to implement various functions:
the first terminal sends an operation instruction to the second terminal through a remote control connection;
a first terminal acquires a data packet transmitted by a second terminal, wherein the data packet is self display content of the second terminal after the operation instruction takes effect, and the second terminal sends the self display content to the first terminal according to different display content types; and
and the first terminal displays corresponding display content according to different display content types in the data packet.
Fig. 7 is another schematic structural diagram of a terminal device 300 according to an embodiment of the present invention, where the terminal device 300 may be used to implement the remote control method provided in the foregoing embodiment. The terminal device 300 may be a mobile phone or a tablet.
The RF circuit 310 is used for receiving and transmitting electromagnetic waves, and performing interconversion between the electromagnetic waves and electrical signals, thereby communicating with a communication network or other devices. RF circuitry 310 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and so forth. RF circuit 310 may communicate with various networks such as the internet, an intranet, a wireless network, or with other devices over a wireless network. The wireless network may comprise a cellular telephone network, a wireless local area network, or a metropolitan area network. The Wireless network may use various Communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Mobile Communication (EDGE), Wideband Code Division Multiple Access (WCDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (Wi-Fi) (e.g., IEEE802.11 a, IEEE802.11 b, IEEE802.1 g and/or IEEE802.1 n), Voice over Internet Protocol (VoIP), world wide Internet Protocol (Microwave Access for Wireless communications, Wi-Max), and other short message protocols, as well as any other suitable communication protocols, and may even include those that have not yet been developed.
The memory 320 may be used to store software programs and modules, such as program instructions/modules corresponding to the remote control method in the above-mentioned embodiment, and the processor 380 executes various functional applications and data processing by running the software programs and modules stored in the memory 320, so as to implement the functions of remote control. The memory 320 may include high speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, memory 320 may further include memory located remotely from processor 380, which may be connected to terminal device 300 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input unit 330 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, the input unit 330 may include a touch-sensitive surface 331 as well as other input devices 332. The touch-sensitive surface 331, also referred to as a touch screen or touch pad, may collect touch operations by a user on or near the touch-sensitive surface 331 (e.g., operations by a user on or near the touch-sensitive surface 331 using a finger, a stylus, or any other suitable object or attachment), and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface 331 may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 380, and can receive and execute commands sent by the processor 380. In addition, the touch-sensitive surface 331 may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 330 may comprise other input devices 332 in addition to the touch sensitive surface 331. In particular, other input devices 332 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The display unit 340 may be used to display information input by or provided to the user and various graphic user interfaces of the terminal apparatus 300, which may be configured by graphics, text, icons, video, and any combination thereof. The Display unit 340 may include a Display panel 341, and optionally, the Display panel 341 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, touch-sensitive surface 331 may overlay display panel 341, and when touch-sensitive surface 331 detects a touch operation thereon or thereabout, communicate to processor 380 to determine the type of touch event, and processor 380 then provides a corresponding visual output on display panel 341 in accordance with the type of touch event. Although in FIG. 7, touch-sensitive surface 331 and display panel 341 are implemented as two separate components for input and output functions, in some embodiments, touch-sensitive surface 331 and display panel 341 may be integrated for input and output functions.
The terminal device 300 may also include at least one sensor 350, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel 341 according to the brightness of ambient light, and a proximity sensor that may turn off the display panel 341 and/or the backlight when the terminal device 300 is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal device 300, detailed descriptions thereof are omitted.
The terminal device 300 may assist the user in e-mail, web browsing, streaming media access, etc. through the transmission module 370 (e.g., a Wi-Fi module), which provides the user with wireless broadband internet access. Although fig. 7 shows the transmission module 370, it is understood that it does not belong to the essential constitution of the terminal device 300, and may be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 380 is a control center of the terminal device 300, connects various parts of the entire mobile phone using various interfaces and lines, and performs various functions of the terminal device 300 and processes data by running or executing software programs and/or modules stored in the memory 320 and calling data stored in the memory 320, thereby performing overall monitoring of the mobile phone. Optionally, processor 380 may include one or more processing cores; in some embodiments, processor 380 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 380.
Terminal device 300 also includes a power supply 390 (e.g., a battery) for powering the various components, which may be logically coupled to processor 380 via a power management system in some embodiments to manage charging, discharging, and power consumption management functions via the power management system. The power supply 390 may also include any component including one or more of a dc or ac power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
Although not shown, the terminal device 300 may further include a camera (e.g., a front camera, a rear camera), a bluetooth module, and the like, which are not described in detail herein. Specifically, in this embodiment, the display unit of the terminal device is a touch screen display, the terminal device further includes a memory, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for:
the first terminal sends an operation instruction to the second terminal through a remote control connection;
a first terminal acquires a data packet transmitted by a second terminal, wherein the data packet is self display content of the second terminal after the operation instruction takes effect, and the second terminal sends the self display content to the first terminal according to different display content types; and
and the first terminal displays corresponding display content according to different display content types in the data packet.
In specific implementation, the above modules may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and specific implementation of the above modules may refer to the foregoing method embodiments, which are not described herein again.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.
To this end, the embodiment of the present invention provides a storage medium, in which a plurality of instructions are stored, and the instructions can be loaded by a processor to execute the steps in any one of the remote control methods provided by the embodiment of the present invention.
Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the instructions stored in the storage medium can execute the steps in any remote control method provided in the embodiment of the present invention, the beneficial effects that can be achieved by any remote control method provided in the embodiment of the present invention can be achieved, which are detailed in the foregoing embodiments and will not be described herein again. The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
The embodiment of the invention realizes that the display content fed back by the operation of the touch screen can be quickly obtained when the user remotely controls the display content of another mobile terminal through a network, thereby ensuring the operation accuracy and avoiding the misoperation of the touch screen.
The remote control method, the remote control device, the storage medium and the terminal device provided by the embodiments of the present invention are described in detail above, and a specific example is applied in the present disclosure to explain the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (12)
1. A remote control method, characterized in that the method comprises:
the first terminal sends an operation instruction to the second terminal through a remote control connection;
the first terminal acquires a data packet transmitted by the second terminal, wherein the data packet is self display content of the second terminal after the operation instruction is effective, and the second terminal sends the self display content to the first terminal according to different display content types; and
and the first terminal displays corresponding display contents according to different display content categories in the data packet.
2. The remote control method according to claim 1, wherein the data packet includes at least the display content category and display content data corresponding to the display content category; the display content category is used for identifying the category of the display content, and the display content data is specific data of the display content.
3. The remote control method according to claim 1 or 2, wherein the display content category includes at least: a first type of display content and a second type of display content; when the display content category is a first type of display content, the display content data is the whole screen display content currently displayed by the second terminal; and when the display content category is a second type display content, the display content is information of at least one area which is displayed and updated compared with the previous display currently displayed by the second terminal.
4. The remote control method according to claim 3, wherein the information of the at least one region includes a region position and display content data corresponding to the region position; wherein the region position is determined from two coordinate points.
5. The remote control method according to claim 1, wherein in the step of displaying the corresponding display content by the first terminal according to different display content categories in the data packet, the method further comprises:
judging the display content category;
when the display content type is judged to be the first type of display content, the first terminal directly displays the display content data in the data packet; and
and when the display content type is judged to be the second type of display content, the first terminal displays corresponding display content data in the area according to the area information in the display content data of the data packet.
6. A remote control apparatus, comprising:
the operation instruction sending module is used for sending an operation instruction to the second terminal through a remote control connection;
the data packet acquisition module is connected with the operation instruction sending module and is used for acquiring a data packet transmitted by the second terminal, wherein the data packet is self display content of the second terminal after the operation instruction takes effect and is sent by the second terminal according to different display content types; and
and the display content display module is connected with the data packet acquisition module and is used for displaying corresponding display contents according to different display content categories in the data packet.
7. The remote control apparatus according to claim 6, wherein the data packet includes at least the display content category and display content data corresponding to the display content category; the display content category is used for identifying the category of the display content, and the display content data is specific data of the display content.
8. The remote control apparatus according to claim 6 or 7, wherein the display content categories include at least: a first type of display content and a second type of display content; when the display content category is a first type of display content, the display content data is the whole screen display content currently displayed by the second terminal; and when the display content category is a second type display content, the display content is information of at least one area which is displayed and updated compared with the previous display currently displayed by the second terminal.
9. The remote control apparatus according to claim 8, wherein the information of the at least one area includes an area position and display content data corresponding to the area position; wherein the region position is determined from two coordinate points.
10. The remote control apparatus according to claim 6, wherein the display content display module further comprises:
a category judgment unit for judging a category of the display content;
the first display unit is connected with the category judgment unit and is used for directly displaying the display content data in the data packet when the category of the display content is judged to be the first category of display content; and
and the second display unit is connected with the category judgment unit and is used for displaying corresponding display content data in the area according to the area information in the display content data of the data packet when the category of the display content is judged to be the second category of display content.
11. A storage medium having stored therein a plurality of instructions adapted to be loaded by a processor to perform the remote control method of any of claims 1 to 5.
12. A terminal device comprising a processor and a memory, the processor being electrically connected to the memory, the memory being configured to store instructions and data, the processor being configured to perform the steps of the remote control method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911230009.0A CN111078428A (en) | 2019-12-04 | 2019-12-04 | Remote control method and device, storage medium and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911230009.0A CN111078428A (en) | 2019-12-04 | 2019-12-04 | Remote control method and device, storage medium and terminal equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111078428A true CN111078428A (en) | 2020-04-28 |
Family
ID=70312848
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911230009.0A Pending CN111078428A (en) | 2019-12-04 | 2019-12-04 | Remote control method and device, storage medium and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111078428A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114374726A (en) * | 2022-01-07 | 2022-04-19 | 阿里巴巴（中国）有限公司 | Cloud desktop processing method and system |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120065802A1 (en) * | 2010-09-14 | 2012-03-15 | Joulex, Inc. | System and methods for automatic power management of remote electronic devices using a mobile device |
| CN104184805A (en) * | 2014-08-13 | 2014-12-03 | Tcl通讯（宁波）有限公司 | Method and system for carrying out remote real-time control on mobile terminals |
| CN104852959A (en) * | 2015-04-09 | 2015-08-19 | 福建星网视易信息系统有限公司 | Data transmission method and system for remote service |
| US20150282106A1 (en) * | 2012-10-24 | 2015-10-01 | Zte Corporation | Terminal and synchronization control method among terminals |
| CN105511676A (en) * | 2015-12-11 | 2016-04-20 | Tcl移动通信科技（宁波）有限公司 | Touch screen coordinate transformation method and mobile terminal |
| CN105912170A (en) * | 2016-06-06 | 2016-08-31 | Tcl移动通信科技（宁波）有限公司 | Mobile terminal and touch control method thereof |
| CN107509051A (en) * | 2017-08-14 | 2017-12-22 | 宇龙计算机通信科技(深圳)有限公司 | Long-range control method, device, terminal and computer-readable recording medium |
| CN109144450A (en) * | 2018-08-27 | 2019-01-04 | 惠州Tcl移动通信有限公司 | A kind of remote operation control method, mobile terminal and storage medium |
| CN109698853A (en) * | 2017-10-20 | 2019-04-30 | 北京仁光科技有限公司 | Long-range control method, device, equipment, system and computer readable storage medium |
-
2019
- 2019-12-04 CN CN201911230009.0A patent/CN111078428A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120065802A1 (en) * | 2010-09-14 | 2012-03-15 | Joulex, Inc. | System and methods for automatic power management of remote electronic devices using a mobile device |
| US20150282106A1 (en) * | 2012-10-24 | 2015-10-01 | Zte Corporation | Terminal and synchronization control method among terminals |
| CN104184805A (en) * | 2014-08-13 | 2014-12-03 | Tcl通讯（宁波）有限公司 | Method and system for carrying out remote real-time control on mobile terminals |
| CN104852959A (en) * | 2015-04-09 | 2015-08-19 | 福建星网视易信息系统有限公司 | Data transmission method and system for remote service |
| CN105511676A (en) * | 2015-12-11 | 2016-04-20 | Tcl移动通信科技（宁波）有限公司 | Touch screen coordinate transformation method and mobile terminal |
| CN105912170A (en) * | 2016-06-06 | 2016-08-31 | Tcl移动通信科技（宁波）有限公司 | Mobile terminal and touch control method thereof |
| CN107509051A (en) * | 2017-08-14 | 2017-12-22 | 宇龙计算机通信科技(深圳)有限公司 | Long-range control method, device, terminal and computer-readable recording medium |
| CN109698853A (en) * | 2017-10-20 | 2019-04-30 | 北京仁光科技有限公司 | Long-range control method, device, equipment, system and computer readable storage medium |
| CN109144450A (en) * | 2018-08-27 | 2019-01-04 | 惠州Tcl移动通信有限公司 | A kind of remote operation control method, mobile terminal and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114374726A (en) * | 2022-01-07 | 2022-04-19 | 阿里巴巴（中国）有限公司 | Cloud desktop processing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108255378B (en) | Display control method and mobile terminal | |
| CN109407921B (en) | Application processing method and terminal device | |
| CN107786424B (en) | Audio and video communication method, terminal and server | |
| CN109683764B (en) | Icon management method and terminal | |
| US11653227B2 (en) | Method of controlling radio resource management measurement of neighboring cell, mobile communication terminal, and network side device | |
| CN110691168A (en) | Screen control method and device of mobile terminal and storage medium | |
| CN111104012B (en) | Distance measuring method and device, storage medium and terminal equipment | |
| CN107479799B (en) | Method and device for displaying window | |
| CN111064847B (en) | False touch prevention method and device, storage medium and electronic equipment | |
| CN112243259A (en) | Network disconnection method, device, storage medium and mobile terminal | |
| CN111368238A (en) | Status bar adjusting method and device, mobile terminal and storage medium | |
| CN108649716B (en) | Signal transmission method, receiving end, sending end and terminal equipment | |
| CN111026457A (en) | Hardware configuration method and device, storage medium and terminal equipment | |
| CN111078428A (en) | Remote control method and device, storage medium and terminal equipment | |
| CN115348256A (en) | Posting data downloading method and device, storage medium and electronic equipment | |
| CN111355991B (en) | Video playing method and device, storage medium and mobile terminal | |
| CN111308303B (en) | Method and device for detecting radio frequency power amplifier of mobile terminal | |
| CN110995324B (en) | Bluetooth communication method, device, storage medium and terminal equipment | |
| CN114442346A (en) | Ghost shadow calculation method and device of display panel, storage medium and terminal equipment | |
| CN110618798A (en) | Multi-screen display method, multi-screen device, storage medium and terminal equipment | |
| CN112286849A (en) | Wireless charging base data switching method and system, storage medium and terminal equipment | |
| CN111048056A (en) | Terminal equipment brightness adjusting method and system, storage medium and terminal equipment | |
| CN111026259A (en) | Control method and device of mobile terminal and storage medium | |
| CN108111553B (en) | Method and device for providing service | |
| CN106033358B (en) | Batch installation method and device of application programs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |