CN111314442B - Terminal control method and device based on time-sharing control, terminal and computer equipment - Google Patents

Terminal control method and device based on time-sharing control, terminal and computer equipment Download PDF

Info

Publication number
CN111314442B
CN111314442B CN202010070600.0A CN202010070600A CN111314442B CN 111314442 B CN111314442 B CN 111314442B CN 202010070600 A CN202010070600 A CN 202010070600A CN 111314442 B CN111314442 B CN 111314442B
Authority
CN
China
Prior art keywords
terminal
interface
touch
control
touch operation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010070600.0A
Other languages
Chinese (zh)
Other versions
CN111314442A (en
Inventor
赵宁
许仁
周枫
王伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vitalink Industry Shenzhen Co ltd
Original Assignee
Vitalink Industry Shenzhen Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vitalink Industry Shenzhen Co ltd filed Critical Vitalink Industry Shenzhen Co ltd
Priority to CN202010070600.0A priority Critical patent/CN111314442B/en
Publication of CN111314442A publication Critical patent/CN111314442A/en
Application granted granted Critical
Publication of CN111314442B publication Critical patent/CN111314442B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q9/00Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application relates to a terminal control method, a device, a terminal, a computer device and a storage medium based on time-sharing control, wherein the method comprises the following steps: the method comprises the steps of obtaining an interactive interface of a controlled terminal, displaying the interactive interface, responding to touch operation of a user on the interactive interface, obtaining touch operation data, wherein the touch operation data comprise touch operation time, sending the touch operation data to the controlled terminal, obtaining a touch response interface of the controlled terminal, displaying the touch response interface, and sequentially responding to the touch operation data by the controlled terminal according to the touch operation time. The application also provides a terminal control method, a device, computer equipment and a storage medium based on time-sharing control. According to the scheme, the user does not need to carry the controlled terminal, and the user operates on the interactive interface of the control terminal, so that the remote control of the controlled terminal is realized, the convenience is improved, and the occurrence of operation conflict phenomenon can be reduced.

Description

Terminal control method and device based on time-sharing control, terminal and computer equipment
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method and apparatus for controlling a terminal based on time-sharing control, a terminal, a computer device, and a storage medium.
Background
With the vigorous development of internet technology, the remote control of terminals is becoming popular. The smart home which is popular in the following is an embodiment of the internet of things under the influence of the internet. The intelligent home realizes remote control, and the control terminal also issues operation information to the intelligent gateway of the Internet of things, and then the intelligent gateway of the Internet of things operates the intelligent terminal of the Internet of things to realize remote control.
Currently, portability of communication terminals such as smartphones has become a necessary trend. But currently there are few remote control technologies concerning communication terminals. If the user goes out and needs to operate the smart phone, the user still needs to carry the main body of the smart phone at the same time, and if more communication terminals need to be operated, the user is more inconvenient.
Therefore, the communication terminal device is still faced with the problem of low convenience brought by the lack of portability in the development process.
Disclosure of Invention
In view of the above, it is necessary to provide a terminal control method, apparatus, terminal, computer device, and storage medium based on time-sharing control, which can improve convenience.
A terminal control method based on time-sharing control includes:
acquiring an interactive interface of a controlled terminal, and displaying the interactive interface, wherein the interactive interface is an interface currently controlled by at least two control terminals;
responding to touch operation of a user on an interactive interface to obtain touch operation data, wherein the touch operation data comprises touch operation time;
transmitting touch operation data to a controlled terminal;
and acquiring a touch response interface of the controlled terminal, displaying the touch response interface, and sequentially responding each touch operation data by the controlled terminal according to the touch operation time to generate the touch response interface.
In one embodiment, obtaining an interactive interface of a controlled terminal, and displaying the interactive interface includes:
and acquiring a plurality of interactive interfaces of the controlled terminal, and carrying out split-screen display on each interactive interface, wherein each interactive interface is an interface of the controlled terminal which is currently independently controlled by each control terminal.
In one embodiment, before obtaining the interaction interface of the controlled terminal, the method further includes:
sending a control request to a controlled terminal, wherein the control request carries identity authentication information;
and receiving a connection permission message fed back by the controlled terminal according to the identity authentication information, and establishing connection with the controlled terminal.
In one embodiment, obtaining an interactive interface of a controlled terminal includes:
program operation window data of the controlled terminal are obtained;
processing the program running window data to obtain interactive interface configuration data;
and configuring a corresponding interactive interface according to the interactive interface configuration data.
In one embodiment, obtaining a touch response interface of a controlled terminal includes:
acquiring touch response window data displayed by a controlled terminal after responding to touch operation data;
processing the touch response window data to obtain touch response interface configuration data;
and configuring a touch response interface according to the touch response interface configuration data.
In one embodiment, the displayed interactive interface and the displayed touch response interface match the screen size of the control terminal.
In one embodiment, further comprising:
the control center is used for forwarding data transmitted by the control terminal to the controlled terminal and forwarding the data transmitted by the controlled terminal to the control terminal, so that the communication between the control terminal and the controlled terminal is realized.
A terminal control device based on time-sharing control, the device includes:
the first interface display module is used for acquiring an interactive interface of the controlled terminal, displaying the interactive interface, wherein the interactive interface is an interface currently controlled by at least two control terminals;
The touch operation response module is used for responding to the touch operation of the user on the interactive interface to obtain touch operation data, wherein the touch operation data comprises touch operation time;
the touch operation data sending module is used for sending the touch operation data to the controlled terminal;
the second interface display module is used for acquiring a touch response interface of the controlled terminal and displaying the touch response interface, and the touch response interface is generated by the controlled terminal according to the touch operation time and sequentially responding to the touch operation data.
A terminal, comprising: the touch display device comprises a communication module, a touch display module and a processor;
the communication module is connected with the controlled terminal, the processor acquires an interactive interface of the controlled terminal, the interactive interface is sent to the touch display module, the touch display module receives and displays the interactive interface, the touch display module responds to touch operation of a user on the interactive interface to obtain touch operation data, the touch operation data are sent to the processor, the touch operation data comprise touch operation time, the processor acquires and sends the touch operation data to the controlled terminal, the touch response interface of the controlled terminal is acquired, the touch response interface is sent to the touch display module, and the touch display module receives and displays the touch response interface, wherein the touch response interface is generated by the controlled terminal according to the touch operation time in sequence in response to the touch operation data.
A computer device comprising a memory storing a computer program and a processor implementing the steps of the above described time-sharing control based terminal control method when the processor executes the computer program.
A computer readable storage medium having stored thereon a computer program which when executed by a processor realizes the steps in the above-described terminal control method based on time sharing control.
According to the terminal control method, device, terminal, computer equipment and storage medium based on time-sharing control, connection between a plurality of control terminals and one controlled terminal is established, the control terminals acquire an interactive interface of the controlled terminal and display the interactive interface, touch operation data carrying touch operation time are sent to the controlled terminal through responding to touch operation of a user on the interactive interface, and a touch response interface generated after the controlled terminal sequentially performs touch response according to the touch operation time is acquired. According to the scheme, the controlled terminal does not need to be carried, so that a user can operate on the interactive interfaces of the plurality of control terminals, the multi-to-one remote control of the controlled terminal can be realized, and the convenience is improved.
A terminal control method based on time-sharing control includes:
acquiring a control request of a control terminal, wherein the control request carries identity authentication information of the control terminal;
when the identity authentication of the control terminal is finished according to the identity authentication information, an interactive interface is sent to the control terminal, wherein the interactive interface is an interface currently controlled by at least two control terminals;
receiving touch operation data, which are sent by each control terminal and are sent by a user for each interactive interface, wherein the touch operation data comprise touch operation time;
and sequentially responding to the touch operation data according to the touch operation time, and generating and sending a corresponding touch response interface to each control terminal.
In one embodiment, after sending the corresponding touch response interface to each control terminal, the method further includes:
and sending operator information to each control terminal, wherein the operator information comprises a data sender for generating touch operation data of the corresponding touch response interface.
In one embodiment, receiving touch operation data sent by each control terminal and directed to each interactive interface by a user includes:
when touch operation data of a user for the interactive interface, which is sent by any control terminal, is received, the unique operation authority of the control terminal for the interactive interface in the current time period is locked.
A terminal control device based on time-sharing control, the device includes:
the control request acquisition module is used for acquiring a control request of the control terminal, wherein the control request carries identity authentication information of the control terminal;
the data transmission module is used for establishing connection with each control terminal to transmit an interactive interface to the control terminal when the identity authentication of the control terminal is completed according to the identity authentication information, wherein the interactive interface is an interface currently controlled by at least two control terminals;
the data receiving module is used for receiving touch operation data, which are sent by each control terminal and are sent by a user for each interactive interface, wherein the touch operation data comprise touch operation time;
the data response module is used for sequentially responding to the touch operation data according to the touch operation time, generating and sending corresponding touch response interfaces to the control terminals.
A computer device comprising a memory storing a computer program and a processor implementing the steps of the above described time-sharing control based terminal control method when the processor executes the computer program.
A computer readable storage medium having stored thereon a computer program which when executed by a processor realizes the steps in the above-described terminal control method based on time sharing control.
In the terminal control method, the device, the computer equipment and the storage medium based on time-sharing control, when the identity authentication of the control terminal is completed according to the identity authentication information, the interactive interface is sent to the control terminal, the touch operation data carrying the touch operation time and sent by each control terminal are received, each control terminal of the corresponding touch response interface is generated and sent according to the touch operation time in turn in response to each touch response operation data. According to the scheme, the controlled terminal responds according to the touch operation time, the occurrence of operation conflict is reduced, a user does not need to carry the controlled terminal, and the controlled terminal operates on the interactive interfaces of the plurality of control terminals, so that the multi-to-one remote control of the controlled terminal is realized, and the convenience is improved.
Drawings
Fig. 1 is an application environment diagram of a terminal control method based on time-sharing control in one embodiment;
fig. 2 is a flow chart of a terminal control method based on time-sharing control in one embodiment;
FIG. 3 is an application scenario diagram of a plurality of control terminals controlling a controlled terminal in one embodiment;
fig. 4 is a flow chart of a terminal control method based on time-sharing control in another embodiment;
Fig. 5 is an application environment diagram of a terminal control method based on time-sharing control in another embodiment;
FIG. 6 is a software architecture diagram of a terminal control method based on time-sharing control in one embodiment;
fig. 7 is a flow chart of a terminal control method based on time-sharing control in another embodiment;
FIG. 8 is a block diagram of a terminal in one embodiment;
fig. 9 is a detailed structural block diagram of a terminal in another embodiment;
fig. 10 is a block diagram of a terminal control device based on time-sharing control in one embodiment;
fig. 11 is a block diagram of a terminal control apparatus based on time-sharing control in another embodiment;
fig. 12 is a block diagram of a terminal control device based on time-sharing control in another embodiment;
fig. 13 is an internal structural view of a computer device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
The terminal control method based on time-sharing control can be applied to an application environment shown in fig. 1. In this application environment, a control terminal 202 and a controlled terminal 204 are included. The control terminal 202 has touch and display functions. The touch function is that a user controls an operation interface through touching or writing by a writing pen on a touch screen, the display function comprises an operation interface and a touch response interface, and the touch response interface is an interface for displaying corresponding touch response after touch operation. The number of the control terminals 202 is plural, the controlled terminals 204 are terminals controlled by the plural control terminals 202, the controlled terminals 204 perform wireless communication with the control terminals 202, the controlled terminals 204 transmit the operation interface to the control terminals 202 through a wireless link, and for the touch operation of the control terminals 202, touch response is made, and the touch response interface is transmitted to the control terminals 202 through the wireless link. Among them, the control terminal 202 and the controlled terminal 204 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices.
In one embodiment, as shown in fig. 2, a terminal control method based on time-sharing control is provided, and the method is applied to the control terminal 202 in fig. 1 for illustration, and includes the following steps:
step S200, an interactive interface of the controlled terminal is obtained, the interactive interface is displayed, and the interactive interface is an interface currently controlled by at least two control terminals.
In practical applications, the number of control terminals 202 is at least two, and the control terminals 202 and the controlled terminals 204 are both preset with remote control systems or remote operation applications, through which the controlled terminals can be controlled. The control terminal 202 and the controlled terminal 204 can establish connection through wireless communication modes such as 3G, 4G, 2.4G, 5G, wi-Fi (Wireless Fidelity ) communication or bluetooth communication.
The interactive interface may be an operation interface shared by at least two control terminals 202 displayed on the controlled terminal 204, or may be a background interface that the controlled terminal 204 enters a computer-like "safe mode" by running a corresponding remote operation process after authorizing each control terminal 202 to remotely operate, or may be an operation interface of an application program running in the background of the controlled terminal 204 that each control terminal 202 is controlling, for example, an operation window interface of a WeChat application program running in the background of the controlled terminal 204 is controlled by the control terminal a, and an operation window interface of a QQ application program running in the background of the controlled terminal 204 is controlled by the control terminal B. Further, the background interface is not displayed on the current interface of the controlled terminal 204, so that the user of the controlled terminal 204 can operate autonomously without being affected when the controlled terminal 204 is remotely controlled by the controlled terminal 202. Furthermore, the interactive interface can also be an interface for controlling regeneration and comprising information of each control terminal for controlling the controlled terminal. In specific implementation, an operation Interface image of the controlled terminal 204 may be intercepted, and the operation Interface image is used as an interactive Interface, or data such as UI (User Interface) data, screen size, resolution and the like of the controlled terminal 204 may be intercepted, and the interactive Interface may be obtained according to the data. For example, for the controlled terminal 204, the screen capturing operation may be performed on the entire operation interface, and the screen capturing result is used as the interaction interface. Alternatively, the operation interface parameters of the controlled terminal 204 may be read to obtain a resolution 2048×1536 pixels, and when the upper left corner of the operation interface is the origin of coordinates, the software icon (e.g., the WeChat icon) is located at the pixels of coordinates (1600, 600), and the interactive interface may be obtained according to the resolution, the icon type and the icon position. After the interactive interface of the controlled terminal 204 is obtained, the interactive interface can be directly displayed, or the interactive interface can be subjected to certain zooming, intercepting, filling and other treatments or rendering treatments according to the screen resolution and the screen size, so as to obtain the interactive interface matched with the screen size data of the control terminal 202, and then the interactive interface matched with the screen size data of the control terminal 202 is displayed. Further, the user may adjust the size of each displayed interactive interface.
Step S400, responding to the touch operation of the user on the interactive interface to obtain touch operation data.
The touch operation is an operation of controlling an operation interface by a user through touching or writing with a writing pen on an interactive interface of the control terminal 202. In specific implementation, a user may click a software icon on an interactive interface of the control terminal 202 through a finger or a writing pen to open the software, click various controls in the software after the software is opened, or perform a touch operation through writing in an operation interface after the software is opened, where the touch operation may include operations such as clicking, long pressing, sliding, zooming, and multi-touch. For example, there may be a micro-letter icon in the interactive interface of the control terminal 202 at a location of the pixel (1600,600), and the user may click on the micro-letter icon and click on the controls in the micro-letter that is running, or enter text in the micro-letter dialog. After performing the above touch operation, the control terminal 202 receives the above touch operation, and records the user touch operation time, coordinates of the touch point, touch duration, touch pressure information, and the like, to obtain touch operation data. For example, if the smart tablet is a control terminal 202, the tablet is a controlled terminal 204. The resolution of a first interaction interface of the tablet personal computer is 2048 multiplied by 1536 pixels, the resolution of a second interaction interface of the intelligent hand board 302 is 1024 multiplied by 768 pixels, when a user needs to open a WeChat, a WeChat icon is clicked at the position of a second interaction interface coordinate (500,200), touch operation data are converted into clicking operation at the position of the first interaction interface coordinate (1000,400) according to the proportion of the first interaction interface to the second interaction interface, then the touch operation data are sent to the tablet personal computer through a network, and the tablet personal computer performs touch response at the position of the first interaction interface (1000,400).
Step S600, the touch operation data is sent to the controlled terminal.
After obtaining the touch operation data carrying the touch operation time, each control terminal 202 may send the touch operation data to the controlled terminal 204 in real time, so that the controlled terminal 204 performs time-sharing control according to the touch operation time, and sequentially responds to the touch operation data.
Step S800, a touch response interface of the controlled terminal is obtained, the touch response interface is displayed, and the touch response interface is generated by the controlled terminal according to the touch operation time and sequentially responding to the touch operation data.
The touch response interface may be an interface generated in real time after the controlled terminal 204 sequentially performs touch response on the touch operation data according to the touch operation time. In another embodiment, the touch response interface of the controlled terminal 204 may be a final touch response interface obtained after all the touch operation data are responded, or may be a plurality of touch response interfaces obtained by responding to the touch operation data each time and sent in real time. In a specific implementation, the touch response interface may be obtained by capturing a touch response interface image of the controlled terminal 204, using the touch response interface image as the first touch response interface, or reading information such as resolution, color, text, etc. of the touch response interface of the controlled terminal 204, and obtaining the first touch response interface according to the information. For example, for the controlled terminal 204, the screen capturing operation may be performed on the entire touch response interface, and the screen capturing result is used as the first touch response interface. Or, the touch response interface information of the controlled terminal 204 is read, which includes resolution 2048×1536 pixels, text content and position displayed in the touch response, image color and position displayed in the touch response, and the like, and the first touch response interface is obtained according to the touch response interface information. After the first touch response interface is obtained, the first touch response interface may be scaled in equal proportion according to the resolution of the interface of the control terminal 202 to obtain a second touch response interface. For example, when the resolution of the interface of the control terminal 202 is not equal to that of the first touch response interface, the first touch response interface may be scaled in equal proportion, then operations such as intercepting or filling are performed according to the scaling result, so as to obtain a second touch response interface, and then the second touch response interface is displayed; if the resolutions are equal in proportion, the first touch response interface can be directly scaled into an interface matched with the screen in size to obtain a second touch response interface, the second touch response interface is displayed in the corresponding split screen area, and if the resolutions are exactly matched, the first touch response interface can be directly used as the second touch response interface, and the second touch response interface is displayed. Referring to fig. 3, an application scenario diagram of a plurality of control terminals controlling one controlled terminal may further be referred to as a user adjusting the size of each touch response interface. If the user wants to continue to operate the controlled terminal 204, the user can perform the touch operation on the touch response interface again, and then the control terminal 202 sends the touch operation data to the controlled terminal 204 again, and the touch response interface (different from the previous touch response interface) sent by the controlled terminal 204 is received again, which is slightly different from the manner in which the user performs the touch operation on the mobile terminal such as a mobile phone.
The following describes an example of displaying a touch response interface on a control terminal, assuming that a smart tablet is the control terminal and a tablet computer is the controlled terminal. And after receiving the WeChat opening operation, the tablet computer performs touch response to obtain a WeChat opening interface, namely a first touch response interface of the controlled terminal. And sending the first touch response interface to the intelligent palm through a network. The resolution of the first touch response interface is 2048 multiplied by 1536 pixels, and if the resolution of the interface of the intelligent hand board is 1024 multiplied by 768 pixels, the first touch response interface can be reduced to 50% of the original one in an equal proportion, so as to obtain a second touch response interface; if the resolution of the intelligent hand-board interface is 700×384 pixels, the first touch response interface can be reduced to 50% of the original one in equal proportion, the first touch response interface is displayed at the center of the intelligent hand-board interface, and then black is filled in the non-displayed part to obtain the second touch response interface. And then, the intelligent palm displays a second touch response interface. If the user wants to continue to operate the controlled terminal, the user can perform the touch operation on the touch response interface again, then the control terminal 202 sends the touch operation data to the controlled terminal 204 again, and the touch response interface (different from the previous touch response interface) sent by the controlled terminal 204 is received again, which is similar to the operation mode that the user performs the touch operation on the mobile terminal such as a mobile phone.
In the terminal control method based on time-sharing control, connection between a plurality of control terminals and one controlled terminal is established, the control terminals acquire an interactive interface of the controlled terminal and display the interactive interface, and further touch operation data carrying touch operation time is sent to the controlled terminal by responding to touch operation of a user on the interactive interface, and a touch response interface after the controlled terminal responds to touch response in sequence according to the touch operation time is acquired. According to the scheme, the controlled terminal does not need to be carried, and the interaction between the control terminal and the controlled terminal is used for replacing the direct operation of the control terminal, so that a user can operate on the interaction interfaces of a plurality of control terminals, the many-to-one remote control of the controlled terminal is realized, the convenience is improved, and the occurrence of the phenomenon of operation conflict can be reduced.
In one embodiment, as shown in fig. 4, before obtaining the interaction interface of the controlled terminal, the method further includes: step S100, a control request is sent to the controlled terminal, the control request carries identity authentication information, a connection permission message fed back by the controlled terminal according to the identity authentication information is received, and connection with the controlled terminal is established.
In specific implementation, the process of establishing connection between the control terminal 202 and the controlled terminal 204 may be: the control terminal 202 may select a specific controlled terminal to be connected, for example, a smart device such as a mobile phone, a computer, and a smart bracelet. The smart device may be a smart device in a history of remote control or a new terminal device to which the control terminal 202 has been previously connected.
In practical application, the control terminal 202 may start up to enter a display interface, a user opens a history connection device record, selects a specific controlled terminal to be connected from the history connection device record to connect, or searches a currently connectable controlled terminal, and then selects a specific controlled terminal to be connected from the history connection device record to connect through touch operation, at this time, the control terminal 202 responds to the touch operation of the user, sends a control request carrying identity authentication information to the controlled terminal 204, the controlled terminal 204 receives the request, reads the identity authentication information in the request, and performs identity authentication or pairing authentication based on the identity authentication information, and if the verification is passed, sends a connection permission message to the control terminal 202 to establish connection with the control terminal 202. Specifically, the verification method includes, but is not limited to, character string password verification, fingerprint verification, face verification, iris verification, and other verification methods. After receiving the correct authentication information, the controlled terminal 204 may automatically send the interactive interface to the control terminal 202 without the need for the user to click for confirmation.
Further, the controlled terminal 204 may also set the control authority of the control terminal 202, and for some operations related to privacy sensitivity or importance, the control terminal 202 needs to be verified again, or a different access authority is required to be accessible. Specifically, the connection with the controlled terminal can be established through 3G, 4G, 5G, 2.4G, wi-Fi, bluetooth or custom wireless protocol. In a specific implementation, the communication distance between the control terminal 202 and the controlled terminal 204 is within the Wi-Fi or bluetooth communication range, and both implement data transmission through Wi-Fi, bluetooth or custom wireless protocols. Because the universal platform such as Wi-Fi or Bluetooth is used or the custom wireless protocol is used, the completely open operating environment can be kept, any controlled terminal is allowed to develop application software at any time, and the increasingly complex and various functional requirements of communication products can be met. In this embodiment, after verification by the controlled terminal, connection is allowed to be established, so that normalization and security of remote operation can be ensured.
In one embodiment, as shown in fig. 4, obtaining an interactive interface of a controlled terminal, and displaying the interactive interface includes: step S220, a plurality of interactive interfaces of the controlled terminal are obtained, split-screen display is carried out on each interactive interface, and each interactive interface is an interface of the controlled terminal which is currently independently controlled by each control terminal.
The split screen display processing means that a split screen technology is adopted, a screen of the control terminal is divided into a plurality of split screen areas, and then the obtained interaction interfaces of the controlled terminal are displayed in the corresponding split screen areas, so that the control interfaces of the control terminals can be comprehensively checked through the screen of the control terminal. In this embodiment, the control terminal currently being used by the user may be a control terminal with a higher operation authority, which is capable of viewing or operating the control interface of other control terminals. Further, the control terminal with higher operation authority may also select one or more interactive interfaces sent by the controlled terminal 204 to perform sharing operation or viewing. In addition, the control interfaces of the control terminal 202 except the terminal itself for the controlled terminal 204 are interfaces that are controlled independently, for example, the control terminal a controls an operation window interface (interactive interface a) of a WeChat application program that is operated in the background of the controlled terminal 204, and the control terminal B controls an operation window interface (interactive interface B) of a QQ application program that is operated in the background of the controlled terminal 204.
In a specific implementation, the split-screen display process may be to obtain a screenshot of multiple operation interfaces of the controlled terminal 204 being independently controlled by other control terminals 202, use the screenshot as an interactive interface (regarded as a first interactive interface), obtain data such as screen UI data, screen size, resolution and the like of the interactive interface intercepted by the controlled terminal, perform scaling or rendering on the interactive interface in equal proportion by combining the screen resolution of the data to obtain a second interactive interface, and then display the second interactive interface in a corresponding split-screen area. Specifically, reference is made to fig. 3 for a schematic view of a split screen display. More specifically, when the resolution of the control terminal 202 is not equal to the resolution of the first interactive interface, the first interactive interface may be scaled equally, then operations such as interception or filling may be performed according to the scaling result, so as to obtain a second interactive interface, and further display the second interactive interface; if the resolution is equal in proportion, the first interactive interface can be directly scaled into an interface matched with the size of the split screen area, and a second interactive interface is obtained; if the resolutions are exactly matched, the first interactive interface can be directly used as a second interactive interface, and then the second interactive interface is displayed in the corresponding split screen area. For example, if the first interface resolution is 2048×1536 pixels and the control terminal 202 interface resolution is 1024×768 pixels, the first interface can be scaled down to 50% of the original one to obtain the second interface; if the interface resolution of the control terminal 202 is 1024×800 pixels, the first interactive interface may be scaled down to 50% of the original interface, displayed at the center of the interface of the control terminal 202, and then black is filled in the blank portion to obtain the second interactive interface. Further, in order to facilitate the user to intuitively check which controlled terminal corresponds to the second interactive interface displayed on which split screen area, the identity of the controlled terminal may be displayed on the split screen area, for example, words such as "interface in which you are operating XXX (identity information)" may be displayed. In another embodiment, the display of the interactive interface may be a sliding switch, in addition to a split screen display, and each interactive interface may be switched by a sliding operation.
In one embodiment, the split screen display processing for each interactive interface includes: the method comprises the steps of obtaining the number of the interaction interfaces and the identity information of each control terminal, determining the number of the split screen areas according to the number of the interaction interfaces, dividing a screen into the split screen areas corresponding to the number of the split screen areas, and displaying each interaction interface in each split screen area according to the identity information of the control terminal.
In practical application, in order to ensure the accuracy of split-screen display, the split-screen display processing on the interactive interface may be: counting the number of interactive interfaces (corresponding to each control terminal) sent by the controlled terminal 204 or the number of control terminals which are controlling the controlled terminal except the control terminal, acquiring identity information (including equipment number, MAC (Media Access Control Address, media access control address) address and other information capable of uniquely identifying the controlled terminal) of the control terminal except the control terminal, determining the number of split screen areas according to the number of interactive interfaces or the number of other controlling the controlled terminal 204, dividing the screen into split screen areas corresponding to the number of split screen areas, and if the number of the received interactive interfaces or the number of the control terminals which are controlling the controlled terminal is 2,3 or 4, dividing the screen correspondence into 1×2, 1×3 and 2×2. After the screen splitting is completed, displaying each interactive interface in the corresponding split screen area according to the identity information of the control terminal. Specifically, the corresponding relation between the preset identity mark and the split screen area may be that the split screen area 1 (for example, coordinates (0, 0) to (512,384) are the corresponding control terminal a of the split screen area 1), the split screen area 2 is corresponding to the control terminal B, and according to the relation and the identity mark information carried by each interactive interface, the distribution display of each interactive interface is completed, or the split screen display may be sequentially performed according to the sequence of receiving the interactive interfaces, so as to obtain the corresponding relation between the split screen area and the controlled terminal (that is, the corresponding relation between the control terminal and the coordinate range). After obtaining the corresponding relation between the split screen area and the control terminal 202, the corresponding relation between the split screen area and the control terminal 202 may also be sent to other control terminals, so that the other control terminals can determine which coordinate range section the other control terminals specifically correspond to.
In addition, the user may touch a plurality of split screen areas during one touch operation, for example, a large sliding operation, and the action position of the user may relate to a plurality of split screens, so the user may perform processing in the following two ways: firstly, a touch operation can be preset in a control terminal to control one split screen at the same time, when a plurality of split screens are operated, the split screen with the earliest touch action can be selected, the split screen is used as the operated split screen, and other split screens are not processed; the second control terminal is not limited, and all related split screens can be used as the action objects of touch operation and processed successively according to the touch time. In this embodiment, the split screen display of the interactive interface is completed through the number of other control terminals or the interactive interfaces and the identity information of other control terminals, so that the split screen display can be flexibly and accurately performed according to different situations.
In one embodiment, obtaining an interactive interface of a controlled terminal includes: program operation window data of the controlled terminal are obtained, the program operation window data are processed to obtain a plurality of interactive interface configuration data, and corresponding interactive interfaces are configured according to the interactive interface configuration data.
In a specific implementation, the obtaining of the interactive interface may be obtaining screenshot data of a currently displayed interface sent by the controlled terminal 204, or may be obtaining current program running window data of the controlled terminal 204 or program running window data that is being controlled by other control terminals, where the program running window data includes page information of an operation interface of an application program that is currently displayed by the controlled terminal 204 or is running in the background, including various attribute information and configuration data of the page, screen UI data, screen size, resolution, and the like, to the control terminal 202. Then, the control terminal 202 may perform processes such as scaling, intercepting or filling on the program running window data according to the size of the split screen area or the screen size, so as to obtain interactive interface configuration data, configure a corresponding interactive interface according to the interactive interface configuration data, and further display the interactive interface. In this embodiment, the interactive interface of the controlled terminal 204 may be page configuration data other than screen capturing data, and the interactive interface of the corresponding controlled terminal 204 can be accurately configured and displayed.
In one embodiment, obtaining a touch response interface of a controlled terminal includes: and acquiring touch response window data displayed after the corresponding controlled terminal responds to the touch operation data, processing the touch response window data to obtain touch response interface configuration data, and configuring a touch response interface according to the touch response interface configuration data.
After the controlled terminal 204 sequentially performs touch response on the touch operation data according to the touch operation time, a touch response interface may be correspondingly generated and sent to each control terminal 202, specifically, screenshot data of the touch response interface may be sent, or touch response window data, that is, page information of the displayed operation interface after the controlled terminal 204 performs touch response, including various attribute information and configuration data of the page, screen UI data, screen size, resolution, and the like, may be sent to the control terminal 202. Then, the control terminal 202 may perform scaling, intercepting or filling on the touch response window data according to the size of the split screen area or the screen size, so as to obtain touch response interface configuration data, configure a corresponding touch response interface according to the touch response interface configuration data, and further display the touch response interface. In this embodiment, the touch response interface of the controlled terminal 204 may be page configuration data other than screen capturing data, so that the touch response interface of the corresponding controlled terminal 204 can be accurately configured and displayed.
In one embodiment, the displayed interactive interface and the displayed touch response interface match the size of the corresponding split screen region.
In implementation, each split screen area (split screen interface) correspondingly displays an interactive interface and a touch response interface of the controlled terminal 204. For example, 3 controlled terminals connected by the control terminal 202 are respectively controlled terminal a, controlled terminal B and controlled terminal C, then the control terminal also has 3 split screen interfaces, namely a split screen a, a split screen B and a split screen B, the interactive interface a displayed on the split screen a is an interface after rendering the acquired initial interactive interface of the controlled terminal a, the interface is matched with the size of the split screen area, the interactive interface B displayed on the split screen B is an interface after rendering the acquired initial interactive interface of the controlled terminal B, the interface is matched with the size of the split screen area, the interactive interface C displayed on the split screen C is an interface after rendering the acquired initial interactive interface of the controlled terminal C, and the interface is matched with the size of the split screen area. Specifically, the action of rendering may be performed by either the controlled terminal or the control terminal. In this embodiment, the interface is rendered into the interface matching with the size of the split screen area, so that the interface data can be displayed more reasonably, and the use feeling of the user can be improved.
In one embodiment, further comprising: the control center is used for forwarding data transmitted by the control terminal to the controlled terminal and forwarding the data transmitted by the controlled terminal to the control terminal, so that the communication between the control terminal and the controlled terminal is realized.
As shown in fig. 5, in the terminal control method based on time-sharing control provided by the present application, the communication manner between the controlled terminal 204 and the plurality of control terminals 202 may also be that connection is established through the control center 206, that is, the control center 206 is used for forwarding data between the control terminal and the controlled terminal, the control center 206 may be a server, a cloud (cloud computing server), a computer host, etc., the control center 206 may also be multiple, each control center 206 operates independently, the control center 206 and the control center 206 may be mutually independent or connected, in addition, each control center 206 may also be implemented by an independent server or a server cluster formed by multiple servers, etc.
In particular, the controlled terminal 204 may be connected to the control center 206 in advance, and the controlled terminal 204 may backup data in the control center 206 in advance and set it to an accessible state, or the controlled terminal 204 may be in a controllable state by a remote operation application/operating system installed in advance. The control terminal 202 may send its identity code to the control center 206, and the control center 206 establishes a connection with the control terminal 202 after receiving and completing verification of the identity code. The control terminal 202 obtains one or more interactive interfaces sent by the controlled terminal 204 through the control center 206, and then performs display or split screen display processing on the interactive interfaces correspondingly. The user performs touch operation on the displayed interactive interface, software such as a browser portal and the like for receiving the touch operation of the user is preset in the control terminal 202, the control terminal 202 receives the touch operation of the user on the specific interactive interface, records information such as the touch operation time, the touch coordinates, the touch duration and the touch pressure of the user, obtains touch operation data, and forwards the touch operation data to the controlled terminal 204 through the control center 206. The controlled terminal 204 generates a touch response interface after performing touch response according to the received touch operation data, and sends the touch response interface to the control terminal 202 through the control center 206. In this embodiment, the control center establishes a connection with the controlled terminal, so that the data storage space can be reduced, and remote control can be performed based on the data backed up by the controlled terminal by the control center.
Fig. 6 is a schematic software architecture diagram of a terminal control method based on time-sharing control according to an embodiment, which includes a smart card 702, a cloud computing server 704 and a tablet 706, wherein the smart card 702 is a control terminal, the cloud computing server 704 is a control center, and the tablet 706 is a controlled terminal. Cloud computing server 704 includes message middleware 708, front-end services 709, back-end services 712, and database 714, among other things.
Referring to fig. 6, software running data such as block screen UI and touch events on tablet 706 establishes a connection with cloud computing server 704 via a 4G/5G network, carrying proprietary protocol data over TCP (Transmission Control Protocol )/IP (Internet Protocol Address, internet interconnection protocol). In cloud computing server 704, message middleware 708 efficiently distributes data, and back-end service 712 and front-end service 709 communicate bi-directionally via Websocket protocols. Specifically, when the cloud computing server 704 performs information transmission with the smart palm 702 and the tablet 706, specifically, the cloud computing server receives an operation interface (including an interactive interface and a touch response interface) sent by the tablet 706 by using a message middleware 708 to communicate with the tablet 706 through a TCP/IP protocol, the message middleware 708 transmits the operation interface to a back-end service 712 through the TCP/IP protocol, the back-end service 712 transmits the operation interface to a front-end service 709 through a Websocket protocol, the front-end service 709 performs rendering processing on the operation interface according to the resolution of the smart palm 702, the size of the control interface, and the like, so that the rendered image is adapted to the smart palm 702, the smart palm 702 actively acquires the rendered image from the front-end service 709 through an HTTP protocol, the cloud computing server 704 receives touch operation data including touch time, touch coordinates, touch duration, and the like, which are obtained by performing touch operation on the interface displayed by a user of the smart palm 702 through the HTTP or a Restful interface, and the back-end service 712 forwards the touch operation data to the tablet 706 through the message middleware 708 in a package with the TCP/IP protocol. The backend service 712 then sends the received touch response interface sent by the tablet 706 to the smart palm 702 via the message middleware 708.
In an embodiment, as shown in fig. 7, the present application further provides a terminal control method based on time-sharing control, and the method may still be applied to the application environment diagram shown in fig. 1. Taking the controlled terminal 204 in fig. 1 as an example, the method is applied to the following steps:
step S300, a control request of a control terminal is obtained, wherein the control request carries identity authentication information of the control terminal;
step S500, when the identity authentication of the control terminal is completed according to the identity authentication information, an interactive interface is sent to the control terminal, wherein the interactive interface is an interface currently controlled by at least two control terminals;
step S700, receiving touch operation data, which are sent by each control terminal and are sent by a user for each interactive interface, wherein the touch operation data comprise touch operation time;
step S900, responding to each touch operation data in turn according to the touch operation time, and generating and transmitting a corresponding touch response interface to each control terminal.
In the implementation, a control request carrying identity authentication information sent by a control terminal A is received, and when pairing authentication or identity authentication of the control terminal A is completed according to the identity authentication information, an interactive interface which is being controlled by at least two control terminals is sent to the control terminal A. It can be understood that, the control terminals that establish a connection with the controlled terminal 204 before the control terminal a are all the interactive interfaces sent by the controlled terminal 204 in the same manner. Likewise, several manifestations of the interactive interface are described in detail in the foregoing embodiments, and are not described herein. Each control terminal responds to the touch operation of the interactive interface displayed by the user, generates touch operation data, the touch operation data carries touch operation time, then the touch operation data are respectively sent to the controlled terminal 204, the controlled terminal 204 receives one or more touch operation data, responds to each touch operation data in sequence according to the touch operation time, executes corresponding operation according to the information such as touch coordinates, touch duration, touch pressure and the like in the touch operation data, updates the corresponding operation interface (program operation window), generates a corresponding touch response interface, and sends the touch response interface to each control terminal so that each control terminal can synchronously receive the latest operation interface. Specifically, the touch response interface generated by the controlled terminal 204 may be one final touch response interface obtained after all the touch operation data are responded, or may be a plurality of touch response interfaces obtained by responding to the touch operation data one by one and sent in real time. And after the touch response operation is completed, synchronously updating the self interactive interface. The pairing authentication or identity authentication is also not limited to the authentication modes such as character string password authentication, fingerprint authentication, face authentication, iris authentication and the like.
In particular, the response touch operation includes a plurality of situations. Taking the ordered touch operations as touch operation 1, touch operation 2, touch operation 3 and … in sequence as an example, the following description is made:
in case 1, if no conflict is detected between the received touch operations, the touch operations 1 to n can be sequentially executed according to the sequence, and a final interface n generated after the touch operation n is executed is used as a first touch response interface; or the interface generated by each touch operation (namely interface 1 and interface 2 … interface n) is used as a touch response interface and is sequentially sent to each control terminal;
in case 2, if a conflict exists between the received touch operations, only the touch operation 1 with the earliest touch time is responded, and the generated interface 1 is used as a touch response interface. Or responding to the first few conflict-free operations to generate a response interface, for example, the first 1-5 operations have no conflict, and the conflict is generated when the touch operation 6 is reached, and only the touch operations 1-5 are responded at the moment. Before the current control terminal a does not send the touch operation data, the controlled terminal 204 may receive the touch operations of other control terminals in real time, respond to the touch operations, and send the interface after the response to the control terminal a as a touch response interface.
In the terminal control method based on time-sharing control, when the identity authentication of the control terminal is completed according to the identity authentication information, the interactive interface is sent to the control terminal, touch operation data carrying touch operation time and sent by each control terminal are received, each control terminal of the corresponding touch response interface is generated and sent according to the touch operation time in turn in response to each touch response operation data. According to the scheme, the controlled terminal does not need to be carried, and the interaction between the control terminal and the controlled terminal is used for replacing the direct operation of the control terminal, so that a user can operate on the interaction interfaces of a plurality of control terminals, the multi-to-one remote control of the controlled terminal is realized, and the convenience is improved.
In one embodiment, after sending the corresponding touch response interface to each control terminal, the method further includes: and sending operator information to each control terminal, wherein the operator information comprises a data sender for generating touch operation data of the corresponding touch response interface.
In practical application, in addition to sending the corresponding touch response interface to the control terminal, operator information may also be sent, where the operator information includes a data sender that generates touch operation data of the corresponding touch response interface, so that each control terminal knows which related operations are performed by each control terminal. In addition, identity information of the control terminals that transmit the touch operation data in the current time period (i.e., identity information of the other control terminals at present) may also be transmitted, so that each control terminal can know other control terminals that are currently manipulating the controlled terminal 204 except itself.
In one embodiment, receiving touch operation data sent by each control terminal and directed to each interactive interface by a user includes: when touch operation data of a user for the interactive interface, which is sent by any control terminal, is received, the unique operation authority of the control terminal for the interactive interface in the current time period is locked.
In practical application, for touch operation on the same interactive interface sent by a plurality of different control terminals in a short time, in order to reduce conflict of touch operation data, when touch operation data sent by any control terminal for a certain interactive interface is received, unique operation permission of the control terminal for the interactive interface in a current time period can be locked, and other control terminals can stop receiving the touch operation data sent by the other control terminals, further, an operation prohibition message can be sent to the other control terminals, so that the user of the other control terminals stops operating the interactive interface, when the user stops touch operation on the interactive interface, the unique operation permission is released, touch operation data sent by the other control terminals are allowed to be received, and further, an operation permission message can be sent to the other control terminals, so that the user of the other control terminals can operate in time. In this embodiment, by locking the operation authority, the conflict of touch operation data can be reduced, and the fluency of data interaction is ensured.
It should be understood that, although the steps in the flowcharts of fig. 2, 4, and 7 are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least a portion of the steps of fig. 2, 4, and 7 may include a plurality of steps or stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the execution of the steps or stages is not necessarily sequential, but may be performed in turn or alternately with at least a portion of the steps or stages of other steps or steps.
In one embodiment, as shown in fig. 8, there is provided a terminal including: the communication module 510, the touch display module 520, and the processor 530, wherein:
the communication module 510 is connected with the controlled terminal, the processor 530 acquires an interactive interface of the controlled terminal, the interactive interface is sent to the touch display module 520, the touch display module 520 receives and displays the interactive interface, the touch display module responds to the touch operation of the interactive interface by a user to obtain touch operation data, the touch operation data is sent to the processor 530, the touch operation data comprises touch operation time, the processor 530 acquires and sends the touch operation data to the controlled terminal, acquires a touch response interface of the controlled terminal, and sends the touch response interface to the touch display module 520, and the touch display module 520 receives and displays the touch response interface, wherein the touch response interface is sequentially generated by the controlled terminal according to the touch operation time in response to the touch operation data.
In another embodiment, as shown in fig. 9, the communication module 510 includes a wireless communication interface 1616, and the touch display module 520 may be a touch display 1602. Specifically, referring to fig. 11, the wireless communication interface 1616 may be a 3G/4G/5G network or Wi-Fi antenna interface, the touch display screen 1602 may be an OLED (Organic Light-Emitting Diode) and a glass (or sapphire) cover plate, and the processor may be equipped with a high-pass APQ8053 on a PCBA (Printed Circuit Board +assembly, printed circuit board Assembly). In addition, the terminal further includes a separator 1604, a battery 1608 (capacity 1000mah,1.0 mm), a USB interface 1610 (Type C), a stainless steel middle frame 1612 and a back cover 1614, and the back cover 1614 may be an OLED and glass (or sapphire) cover. Because the microphone, the camera and other components are not designed, the dialogue function can be realized through the Bluetooth headset, and the photographing can be realized through the wristwatch.
More specifically, the thickness of the terminal may be 4mm, and the early stage may use a Wi-Fi and BT (Bit Torrent) communication interface to perform interaction, and the later stage may use an autonomous protocol to perform interaction. For the hand board terminals such as various extensions (such as biological detection) of network mobile phones, network video screen terminals, game terminals and intelligent watches, 5-6 inch screens can be adopted; for intelligent home terminals such as a home management board, a reading board, a game board, a WeChat board, a social board, an operation board and the like, 7-14 inches of screen can be adopted; for intelligent teaching, conference, aviation and high-speed rail terminals such as teaching boards, textbook boards, examination boards, conference boards, aviation boards, high-speed rail boards and unidirectional secret information boards, 7-14 inch screens can be adopted; for intelligent surface terminals such as office desks, projection display panels, ordering boards, bus boards, household appliance boards, intelligent furniture boards, bar interactive boards, outdoor natural scene film and television interactive boards, concert athletic movement focusing boards and the like, 5-105 inches of screens can be adopted.
The terminal can ensure good realization of touch control and display functions, realize functions such as data processing and storage through the controlled terminal and/or the control center, and functionally separate touch control and display from other functions. Because the functions of data processing, storage and the like do not need to be realized, compared with the traditional terminal, the terminal can realize various complex functions with lighter weight, smaller volume and thinner thickness, and solves the problems of larger weight and volume and poorer portability of the terminal in the traditional communication system.
Furthermore, as the terminal uses the open communication platform, the terminal can directly communicate through the wireless communication network or the cloud and other open platforms without depending on any mobile phone brand or being licensed by an operator, and the complex problem caused by the existing terminal brand and the operator configuration threshold is avoided.
In one embodiment, as shown in fig. 10, there is provided a terminal control device based on time-sharing control, including: the first interface display module 610, the touch operation response module 620, the touch operation data transmission module 630, and the second interface display module 640, wherein:
the first interface display module 610 is configured to obtain an interactive interface of the controlled terminal, display the interactive interface, where the interactive interface is an interface currently controlled by at least two control terminals;
The touch operation response module 620 is configured to respond to a touch operation of the user on the interactive interface, and obtain touch operation data, where the touch operation data includes touch operation time;
the touch operation data sending module 630 is configured to send touch operation data to the controlled terminal;
the second interface display module 640 is configured to obtain a touch response interface of the controlled terminal, display the touch response interface, and sequentially respond to each touch operation data according to the touch operation time by the controlled terminal.
In one embodiment, the first interface display module 610 is further configured to obtain a plurality of interactive interfaces of the controlled terminal, and perform split-screen display on each interactive interface, where the interactive interfaces are interfaces where the controlled terminal is currently controlled by each control terminal independently.
In one embodiment, as shown in fig. 11, the apparatus further includes a data connection module 650, configured to send a manipulation request to the controlled terminal, where the manipulation request carries identity authentication information, receive a connection permission message fed back by the controlled terminal according to the identity authentication information, and establish a connection with the controlled terminal.
In one embodiment, as shown in fig. 11, the apparatus further includes an interface configuration module 660, configured to obtain program running window data of the controlled terminal, process the program running window data to obtain a plurality of interactive interface configuration data, and configure a corresponding interactive interface according to each interactive interface configuration data.
In one embodiment, the configuration module 660 is further configured to obtain touch response window data displayed after the corresponding controlled terminal responds to the touch operation data, process the touch response window data to obtain touch response interface configuration data, and configure the touch response interface according to the touch response interface configuration data.
In one embodiment, the data connection module 650 is further configured to establish a connection with the controlled terminal through a control center, where the control center is configured to forward data transmitted by the control terminal to the controlled terminal, and forward data transmitted by the controlled terminal to the control terminal, so as to implement communication between the control terminal and the controlled terminal.
For specific limitations of the terminal control apparatus based on the time-sharing control, reference may be made to the above limitations of the terminal control method based on the time-sharing control, and detailed descriptions thereof will be omitted. The above-mentioned respective modules in the terminal control device based on the time-sharing control may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
In one embodiment, as shown in fig. 12, there is provided a terminal control device based on time-sharing control, including: a manipulation request acquisition module 710, a data transmission module 720, a data reception module 730, and a data response module 740, wherein:
the control request acquisition module 710 is configured to acquire a control request of the control terminal, where the control request carries identity authentication information of the control terminal;
the data sending module 720 is configured to establish a connection with each control terminal to send an interactive interface to the control terminal when the identity authentication of the control terminal is completed according to the identity authentication information, where the interactive interface is an interface currently controlled by at least two control terminals;
the data receiving module 730 is configured to receive touch operation data for each interactive interface, which is sent by each control terminal and includes touch operation time;
the data response module 740 is configured to sequentially respond to each touch operation data according to the touch operation time, and generate and send a corresponding touch response interface to each control terminal.
In one embodiment, the data sending module 720 is further configured to send operator information to each control terminal, where the operator information includes a data sender generating touch operation data of the corresponding touch response interface.
In one embodiment, the data response module 740 is further configured to lock the unique operation authority of the control terminal to the interactive interface in the current time period when receiving the touch operation data sent by any control terminal and directed to the interactive interface by the user.
In one embodiment, a computer device is provided, which may be a terminal, and the internal structure thereof may be as shown in fig. 13. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless mode can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program, when executed by a processor, implements a terminal control method based on time-sharing control. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
It will be appreciated by those skilled in the art that the structure shown in fig. 12 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, including a memory and a processor, where the memory stores a computer program, and the processor implements the steps in the above-mentioned terminal control method based on time-sharing control when executing the computer program.
In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, which when executed by a processor implements the steps of the above described time-sharing control based terminal control method.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, or the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.

Claims (15)

1. A terminal control method based on time-sharing control, the method comprising:
acquiring an interactive interface of a controlled terminal, and displaying the interactive interface, wherein the interactive interface comprises an operation interface of a plurality of application programs which are operated by each control terminal in the background of the controlled terminal currently;
responding to touch operation of a user on the interactive interface to obtain touch operation data, wherein the touch operation data comprises touch operation time;
The touch operation data are sent to the controlled terminal;
and acquiring a touch response interface of the controlled terminal, and displaying the touch response interface, wherein the touch response interface is generated by the controlled terminal according to the touch operation time and sequentially responding to each touch operation data.
2. The method of claim 1, wherein the obtaining an interactive interface of the controlled terminal, displaying the interactive interface comprises:
and acquiring a plurality of interactive interfaces of the controlled terminal, and carrying out split-screen display on each interactive interface, wherein the interactive interfaces are interfaces of the controlled terminal which are independently controlled by each control terminal at present.
3. The method according to claim 1, further comprising, prior to the obtaining the interaction interface of the controlled terminal:
sending a control request to the controlled terminal, wherein the control request carries identity authentication information;
and receiving a connection permission message fed back by the controlled terminal according to the identity authentication information, and establishing connection with the controlled terminal.
4. The method according to claim 1, wherein the acquiring the interaction interface of the controlled terminal comprises:
acquiring program operation window data of the controlled terminal;
Processing the program operation window data to obtain interactive interface configuration data;
and configuring a corresponding interactive interface according to the interactive interface configuration data.
5. The method of claim 1, wherein the obtaining a touch response interface of the controlled terminal comprises:
acquiring touch response window data displayed after the controlled terminal responds to the touch operation data;
processing the touch response window data to obtain touch response interface configuration data;
and configuring the touch response interface according to the touch response interface configuration data.
6. The method according to any one of claims 1 to 5, wherein the displayed interactive interface and the displayed touch response interface match the screen size of the control terminal.
7. The method according to any one of claims 1 to 5, further comprising:
the control center is used for forwarding data transmitted by the control terminal to the controlled terminal and forwarding the data transmitted by the controlled terminal to the control terminal, so that the communication between the control terminal and the controlled terminal is realized.
8. A terminal control method based on time-sharing control includes:
acquiring a control request of a control terminal, wherein the control request carries identity authentication information of the control terminal;
when the identity authentication of the control terminal is completed according to the identity authentication information, an interactive interface is sent to the control terminal, wherein the interactive interface comprises an operation interface of a plurality of application programs which are operated by the background of the controlled terminal currently operated by each control terminal;
receiving touch operation data, which are sent by each control terminal and are sent by a user, aiming at each interactive interface, wherein the touch operation data comprise touch operation time;
and sequentially responding to the touch operation data according to the touch operation time, and generating and sending a corresponding touch response interface to each control terminal.
9. The method of claim 8, wherein the receiving the touch operation data sent by each control terminal and directed to the interactive interface by the user comprises:
when touch operation data of a user for the interactive interface, which is sent by any control terminal, is received, the unique operation authority of the control terminal for the interactive interface in the current time period is locked.
10. The method of claim 8, further comprising, after sending the corresponding touch response interface to each control terminal:
And transmitting operator information to each control terminal, wherein the operator information comprises a data sender generating touch operation data of the corresponding touch response interface.
11. A terminal control device based on time-sharing control, the device comprising:
the first interface display module is used for acquiring an interactive interface of the controlled terminal and displaying the interactive interface, wherein the interactive interface comprises an operation interface of a plurality of application programs which are operated by the controlled terminal in the background currently operated by each control terminal;
the touch operation response module is used for responding to the touch operation of the user on the interactive interface to obtain touch operation data, wherein the touch operation data comprises touch operation time;
the touch operation data sending module is used for sending the touch operation data to the controlled terminal;
the second interface display module is used for acquiring a touch response interface of the controlled terminal, displaying the touch response interface, and sequentially responding to each touch operation data by the controlled terminal according to the touch operation time to generate the touch response interface.
12. A terminal control device based on time-sharing control, the device comprising:
The control request acquisition module is used for acquiring a control request of a control terminal, wherein the control request carries identity authentication information of the control terminal;
the data sending module is used for sending an interactive interface to the control terminal when the identity authentication of the control terminal is completed according to the identity authentication information, wherein the interactive interface comprises operation interfaces of a plurality of application programs which are operated by the control terminal in the background of the controlled terminal currently operated by each control terminal;
the data receiving module is used for receiving touch operation data, which are sent by each control terminal and are sent by a user, of each interactive interface, wherein the touch operation data comprise touch operation time;
and the data response module is used for sequentially responding to the touch operation data according to the touch operation time, generating and sending a corresponding touch response interface to each control terminal.
13. A terminal, comprising: the touch display device comprises a communication module, a touch display module and a processor;
the communication module is connected with the controlled terminals, the processor acquires the interactive interfaces of the controlled terminals, sends the interactive interfaces to the touch display module, receives and displays the interactive interfaces, responds to the touch operation of a user on the interactive interfaces, acquires touch operation data, and sends the touch operation data to the processor, wherein the touch operation data comprises touch operation time, the processor acquires and sends the touch operation data to the controlled terminals, acquires touch response interfaces of the controlled terminals, sends the touch response interfaces to the touch display module, and receives and displays the touch response interfaces, wherein the touch response interfaces are generated by the controlled terminals according to the touch operation time, and comprise operation interfaces of a plurality of application programs running on the background of the controlled terminals currently operated by the control terminals.
14. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any one of claims 1 to 10 when the computer program is executed by the processor.
15. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 10.
CN202010070600.0A 2020-01-21 2020-01-21 Terminal control method and device based on time-sharing control, terminal and computer equipment Active CN111314442B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010070600.0A CN111314442B (en) 2020-01-21 2020-01-21 Terminal control method and device based on time-sharing control, terminal and computer equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010070600.0A CN111314442B (en) 2020-01-21 2020-01-21 Terminal control method and device based on time-sharing control, terminal and computer equipment

Publications (2)

Publication Number Publication Date
CN111314442A CN111314442A (en) 2020-06-19
CN111314442B true CN111314442B (en) 2023-07-18

Family

ID=71148210

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010070600.0A Active CN111314442B (en) 2020-01-21 2020-01-21 Terminal control method and device based on time-sharing control, terminal and computer equipment

Country Status (1)

Country Link
CN (1) CN111314442B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113923633B (en) * 2021-09-29 2024-05-24 亿咖通(湖北)技术有限公司 Intelligent cabin control method, system and equipment integrating mobile terminal

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106572139A (en) * 2015-10-13 2017-04-19 阿里巴巴集团控股有限公司 Multi-terminal control method and system, terminal, and server
CN108401453A (en) * 2017-12-27 2018-08-14 深圳前海达闼云端智能科技有限公司 A kind of method, apparatus and intelligent terminal of control display screen
CN108668153A (en) * 2017-03-28 2018-10-16 Lg 电子株式会社 Intelligent control device and its control method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201239730A (en) * 2011-03-24 2012-10-01 Acer Inc Method for customizing user interface and electronic device thereof
CN103561220A (en) * 2013-10-28 2014-02-05 三星电子(中国)研发中心 Television terminal and multi-screen display and control method thereof
CN104808905A (en) * 2015-05-15 2015-07-29 京东方科技集团股份有限公司 Display processing method and device, and electronic equipment
CN109698853A (en) * 2017-10-20 2019-04-30 北京仁光科技有限公司 Long-range control method, device, equipment, system and computer readable storage medium
CN109583178B (en) * 2018-10-09 2023-03-10 创新先进技术有限公司 Conference collaborative participation method and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106572139A (en) * 2015-10-13 2017-04-19 阿里巴巴集团控股有限公司 Multi-terminal control method and system, terminal, and server
CN108668153A (en) * 2017-03-28 2018-10-16 Lg 电子株式会社 Intelligent control device and its control method
CN108401453A (en) * 2017-12-27 2018-08-14 深圳前海达闼云端智能科技有限公司 A kind of method, apparatus and intelligent terminal of control display screen

Also Published As

Publication number Publication date
CN111314442A (en) 2020-06-19

Similar Documents

Publication Publication Date Title
CN111290695B (en) Terminal control method and device based on priority control and terminal
CN111309226B (en) Terminal control method and device based on communication quality, terminal and computer equipment
US11509825B2 (en) Image management system, image management method, and computer program product
CN111314441B (en) Terminal control method and device based on multi-region control and terminal
US11146695B2 (en) Communication management system, communication system, communication control method, and recording medium
CN111324248A (en) Terminal control method, terminal control device, terminal, computer equipment and storage medium
EP3547697A1 (en) Live-broadcasting room video stream pushing control method, and corresponding server and mobile terminal
US9596431B2 (en) Transmission system and program
US10420011B2 (en) Communication system, transmission terminal, communication method, and medium
US20230066450A1 (en) Communication management system, communication system, communication management device, image processing method, and non-transitory computer-readable medium
CN111273850B (en) Terminal control method and device, computer equipment and storage medium
US11947998B2 (en) Display method and device
US20150249696A1 (en) Transmission terminal, transmission system, transmission method, and recording medium storing transmission control program
US11394757B2 (en) Communication terminal, communication system, and method of sharing data
US20220086204A1 (en) Communication system, communication terminal, and screen sharing method
CN111314442B (en) Terminal control method and device based on time-sharing control, terminal and computer equipment
CN107924298A (en) For the interactive sharing application between touch screen computer and data method and be used for realization the computer program of this method
US20160241631A1 (en) Image management system, communication system, non-transitory recording medium, and image management method
US20150249695A1 (en) Transmission terminal, transmission system, transmission method, and recording medium storing transmission control program
KR20120079636A (en) Method for sharing document work in multilateral conference
CN111263004B (en) Terminal control method and device, computer equipment and storage medium
CN112163200A (en) Picture processing method and device and electronic equipment
WO2021072974A1 (en) Terminal control method, system and apparatus, computer device, and storage medium
US20220035958A1 (en) Communication terminal, system, control method, and recording medium
CN113867592A (en) Information display method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant