CN112306610A - Terminal control method and device and electronic equipment - Google Patents

Terminal control method and device and electronic equipment Download PDF

Info

Publication number
CN112306610A
CN112306610A CN202011204820.4A CN202011204820A CN112306610A CN 112306610 A CN112306610 A CN 112306610A CN 202011204820 A CN202011204820 A CN 202011204820A CN 112306610 A CN112306610 A CN 112306610A
Authority
CN
China
Prior art keywords
controlled terminal
terminal
data
controlled
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011204820.4A
Other languages
Chinese (zh)
Inventor
陈亮
刘波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN202011204820.4A priority Critical patent/CN112306610A/en
Publication of CN112306610A publication Critical patent/CN112306610A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The embodiment of the disclosure discloses a terminal control method and device and electronic equipment. One embodiment of the method comprises: acquiring operation data of a user for executing a preset operation on a control terminal, wherein the operation data is used for controlling the controlled terminal to execute the preset operation; and sending the operation data to the controlled terminal so that the controlled terminal executes a preset operation based on the operation data. The embodiment realizes that the controlled terminal executes the predetermined operation under the control of the control terminal.

Description

Terminal control method and device and electronic equipment
Technical Field
The embodiment of the disclosure relates to the technical field of computers, in particular to a terminal control method and device and electronic equipment.
Background
In some scenarios, it is desirable to perform the same operation on multiple terminals. For example, an operation of opening the same Application (APP) is performed for a plurality of terminals. For another example, an operation of opening the same folder is performed for a plurality of terminals.
In the related art, a user is required to sequentially perform the same operation on a plurality of terminals.
Disclosure of Invention
This disclosure is provided to introduce concepts in a simplified form that are further described below in the detailed description. This disclosure is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
The embodiment of the disclosure provides a terminal control method, a terminal control device and electronic equipment, which realize that a controlled terminal executes a preset operation under the control of a control terminal.
In a first aspect, an embodiment of the present disclosure provides a terminal control method, where the method includes: acquiring operation data of a user for executing a preset operation on a control terminal, wherein the operation data is used for controlling the controlled terminal to execute the preset operation; and sending the operation data to the controlled terminal so that the controlled terminal executes the preset operation based on the operation data.
In a second aspect, an embodiment of the present disclosure provides a terminal control apparatus, including: the device comprises an acquisition unit, a processing unit and a control unit, wherein the acquisition unit is used for acquiring operation data of a user for executing a preset operation on a control terminal, and the operation data is used for controlling the controlled terminal to execute the preset operation; and the sending unit is used for sending the operation data to the controlled terminal so that the controlled terminal executes the preset operation based on the operation data.
In a third aspect, an embodiment of the present disclosure provides an electronic device, including: one or more processors; storage means for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the terminal control method according to the first aspect.
In a fourth aspect, an embodiment of the present disclosure provides a computer-readable medium, on which a computer program is stored, which when executed by a processor, implements the steps of the terminal control method according to the first aspect.
The terminal control method, the terminal control device and the electronic equipment provided by the embodiment of the disclosure can acquire operation data of a user executing a predetermined operation on the control terminal. In practice, the above operation data is used to control the controlled terminal to perform a predetermined operation. Further, the operation data may be transmitted to the controlled terminal so that the controlled terminal performs the predetermined operation based on the operation data. Thereby, the controlled terminal is realized to execute the predetermined operation under the control of the control terminal. It can be seen that, if the predetermined operation is performed on a plurality of controlled terminals, the user only needs to perform the predetermined operation on the control terminal, and does not need to perform the predetermined operation on the plurality of controlled terminals in sequence. Thus, it is possible to improve the efficiency of performing predetermined operations on a plurality of controlled terminals.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.
Fig. 1 is a flow chart of some embodiments of a terminal control method according to the present disclosure;
fig. 2 is a flowchart of a control terminal transmitting operation data to a controlled terminal in some embodiments of a terminal control method according to the present disclosure;
fig. 3 is a flow chart for determining whether a process of responding to a predetermined operation by a controlled terminal satisfies a target requirement in some embodiments of a terminal control method according to the present disclosure;
FIG. 4 is a schematic block diagram of some embodiments of a terminal control apparatus according to the present disclosure;
fig. 5 is an exemplary system architecture to which the terminal control method of some embodiments of the present disclosure may be applied;
fig. 6 is a schematic diagram of a basic structure of an electronic device provided in accordance with some embodiments of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
Referring to fig. 1, a flow of some embodiments of a terminal control method according to the present disclosure is shown. As shown in fig. 1, the terminal control method includes the following steps:
step 101, obtaining operation data of a user executing a predetermined operation on a control terminal.
In the present embodiment, a control terminal (e.g., the control terminal 501 shown in fig. 5) can acquire operation data in which a user performs a predetermined operation on the control terminal.
It is understood that the control terminal may be a terminal that controls the controlled terminal. That is, the controlled terminal may be a terminal controlled by the control terminal.
In some scenarios, the models of the control terminal and the controlled terminal are the same, and/or the applications installed on the control terminal and the controlled terminal are the same.
The operation data may be data representing that the user performs the predetermined operation on the control terminal. In practice, the operation data is used to control the controlled terminal to perform the predetermined operation.
And 102, sending operation data to the controlled terminal so that the controlled terminal executes a preset operation based on the operation data.
In this embodiment, the control terminal may send the operation data to the controlled terminal. Further, the controlled terminal may perform the predetermined operation based on the operation data.
In some scenarios, the control terminal may forward the operation data to the controlled terminal through the server. In practice, after the user performs the predetermined operation, the control terminal may transmit operation data of the user performing the predetermined operation to the server. Further, the server may forward the operation data to the controlled terminal.
In some scenarios, the predetermined operation may include a trigger operation performed by a user on a predetermined key of the control terminal. In practice, the predetermined keys may include, for example, a volume adjustment key, a brightness adjustment key, and the like. Here, the operation data may be data representing that a user performs a trigger operation on a predetermined key of the control terminal. At this time, the controlled terminal may perform a trigger operation on its own predetermined key according to the received operation data. Therefore, the controlled terminal can execute the triggering operation on the preset key under the control of the control terminal.
It should be noted that, in the present disclosure, the controlled terminal executing the predetermined operation means that the controlled terminal simulates the user to execute the predetermined operation. As described in the background art, in order to implement the same operation performed on a plurality of terminals, in the related art, it is necessary for a user to sequentially perform the same operation on a plurality of terminals. On the one hand, the process of performing the same operation on multiple terminals may be cumbersome. On the other hand, the total time period for performing the same operation on a plurality of terminals may be extended. It is seen that performing the same operation on a plurality of terminals in sequence by the user may cause inefficiency in performing the same operation on the plurality of terminals.
In this embodiment, the control terminal may acquire operation data on which a user performs a predetermined operation. In practice, the operation data may be used to control the controlled terminal to perform the predetermined operation described above. Further, the control terminal may transmit the above operation data to the controlled terminal. Still further, the controlled terminal may perform the predetermined operation based on the operation data. Thus, the controlled terminal can perform a predetermined operation under the control of the control terminal. It is not difficult to find that the user only needs to perform the predetermined operation on the control terminal, and does not need to perform the predetermined operation on a plurality of controlled terminals in sequence. Thus, on the one hand, the flow of performing predetermined operations on a plurality of controlled terminals can be simplified. On the other hand, the total time period for performing the predetermined operation on the plurality of controlled terminals can be shortened. Further, it is possible to improve the efficiency of performing predetermined operations on a plurality of controlled terminals.
In some embodiments, the controlled terminal and the controlling terminal belong to the same multicast group. In practice, there may be one or more controlled terminals in the multicast group. The control terminal may be a multicast source that sends operational data to the individual controlled terminals in the multicast group.
At this time, the control terminal may execute the above step 102 according to the flow shown in fig. 2. The flow includes step 1021 as follows.
Step 1021, sending the operation data to the controlled terminal belonging to the multicast group by means of multicast.
In some scenarios, the control terminal may send the aforementioned operational data to the target router. Further, the target router may forward the operation data to each controlled terminal in the multicast group. In practice, the target router may be a router providing a local area network to each controlled terminal in the multicast group.
Therefore, the control terminal sends the operation data to the controlled terminal in a multicast mode.
In the related art, a control terminal transmits operation data to a controlled terminal in a unicast or broadcast manner. Thus, the control terminal may transmit the operation data to some terminals that do not need to receive the operation data in the process of transmitting the operation data to the controlled terminal. Thus, network bandwidth may be wasted.
In practice, a multicast group may be viewed as a definite set of nodes. Therefore, the control terminal sends the operation data to the members in the multicast group, and it can be understood that the control terminal sends the operation data to the nodes in a certain node combination. Therefore, the control terminal can avoid sending the operation data to the members not belonging to the multicast group in the process of sending the operation data to the controlled terminal. Thus, the waste of network bandwidth can be reduced.
In some embodiments, the multicast Address of the multicast group is bound to an Internet Protocol Address (IP Address) of the target lan.
The target lan may be a pre-designated lan.
The controlled terminal and the control terminal join the multicast group in the following manner.
Specifically, in response to detecting the target local area network, the multicast group indicated by the multicast address bound by the internet protocol address of the target local area network is added.
Therefore, the multicast address of the multicast group and the internet protocol address of the target local area network are bound in advance. When the control terminal and the controlled terminal detect the target local area network, the control terminal and the controlled terminal can join the multicast group indicated by the multicast address bound by the internet protocol address of the target local area network.
In some embodiments, the controlled terminal may perform the following steps before receiving the operation data.
Specifically, in response to an initialization operation, an initial interface is presented.
In practice, the control terminal presents the initial interface before the user performs the predetermined operation.
The upper initialization operation may be an operation of initializing an interface presented by the terminal.
Therefore, before the controlled terminal is controlled by the control terminal to execute the preset operation, the controlled terminal and the control terminal can display the same interface. Thus, the controlled terminal can be ensured to smoothly execute the predetermined operation under the control of the control terminal.
In some embodiments, the predetermined operation comprises at least one of: touch operation executed by a user on a screen of the control terminal; and triggering operation executed by a user on a preset key of the control terminal.
In practice, the touch operation may include a single click, a double click, a long press, a slide, and the like performed by the user on the screen of the control terminal.
In some embodiments, the operation data includes screen coordinates passed by the control terminal during the touch operation.
The screen coordinates may be coordinates passed through the screen of the control terminal during the touch operation performed by the user. In practice, one or more screen coordinates may be included in the operation data.
At this time, the controlled terminal may perform the above-described predetermined operation in the following manner.
Specifically, touch operation is performed based on the screen coordinates included in the operation data.
In some scenarios, the controlled terminal may determine, in its own screen, an operation path formed by screen coordinates included in the operation data. Further, the controlled terminal may execute the touch operation along the determined operation path.
In other scenarios, the controlled terminal may determine, in its own screen, an operation region formed by screen coordinates included in the operation data. Further, the controlled terminal may perform the touch operation in the determined operation area.
Therefore, the controlled terminal can accurately determine the approximate position of the touch operation executed in the screen of the controlled terminal based on the screen coordinates included in the operation data sent by the control device terminal. Therefore, the accuracy of the controlled terminal in performing touch operation on the screen under the control of the control terminal can be improved.
In some embodiments, the controlled terminal may also perform the steps in the flow shown in fig. 3. The flow includes steps 301 and 302 as follows.
Step 301, target data is acquired.
The target data reflects the response process of the controlled terminal to the preset operation.
In practice, the controlled terminal may respond to a predetermined operation. For example, the predetermined operation is a trigger operation of an icon of the application a, and in response to the trigger operation, the controlled terminal may open the application a.
In some scenarios, the monitoring terminal may be used to monitor the process of the controlled terminal responding to the predetermined operation. It is understood that the data monitored by the monitoring terminal can reflect the response process of the controlled terminal to the predetermined operation. At this time, the controlled terminal may acquire the target data from the monitoring terminal.
Step 302, based on the target data, determining whether the response process of the controlled terminal to the predetermined operation meets the target requirement.
In some scenarios, the controlled terminal may locally determine whether the response procedure of the predetermined operation meets the target requirement.
For example, the target data may include a start time and an end time of the controlled terminal in response to the predetermined operation. At this time, the controlled terminal may take the difference between the termination time and the start time as a response time period to a predetermined operation. Further, in response to the response time period being less than or equal to the preset time period, the controlled terminal may determine that the response process to the predetermined operation satisfies the target requirement. In response to the response duration being greater than the preset duration, the controlled terminal may determine that the response process to the predetermined operation does not meet the target requirement.
Therefore, after the controlled terminal executes the preset operation under the control of the control terminal, whether the response process of the controlled terminal to the preset operation meets the target requirement is further determined.
In some embodiments, the target data includes at least one of: the controlled terminal records the video obtained by the screen in the response process of the preset operation; and the controlled terminal captures the obtained image in the response process of the preset operation.
It will be understood that the video recorded by the controlled terminal may reflect the response process thereof to the predetermined operation. Similarly, the image intercepted by the controlled terminal can reflect the response process of the controlled terminal to the preset operation. In practice, the image intercepted by the controlled terminal may comprise one or more images.
In some scenarios, the controlled terminal may determine whether its response process to a predetermined operation satisfies a target requirement based on the recorded video and/or the captured image.
As an example, the controlled terminal may determine the total duration of the recorded video. Further, in response to the determined total duration being less than or equal to the preset duration, the controlled terminal may determine that its response process to the predetermined operation satisfies the target requirement. In response to the determined total duration being greater than the preset duration, the controlled terminal may determine that its response process to the predetermined operation does not meet the target requirement.
It should be understood that the total time length of the video recorded by the controlled terminal is the time length of the controlled terminal responding to the predetermined operation. In other scenarios, the controlled terminal may send the video and/or images to a server. Further, the server may determine whether or not a response procedure of the controlled terminal to a predetermined operation satisfies a target requirement based on the above-mentioned video and/or image transmitted by the controlled terminal.
As an example, the server may store a video obtained by screen recording during a response of the control terminal to a predetermined operation. The server can extract first features from pixel points contained in image frames in videos recorded by the controlled terminal, and can also extract second features from pixel points contained in image frames in videos recorded by the control terminal. Further, in response to the similarity between the first feature and the second feature being greater than or equal to a preset threshold, the server may determine that the process of the controlled terminal responding to the predetermined operation and the process of the control terminal responding to the predetermined operation are consistent. In response to the similarity between the first feature and the second feature being less than the preset threshold, the server may determine that the process of the controlled terminal responding to the predetermined operation and the process of the control terminal responding to the predetermined operation are not consistent.
As still another example, the server may store an image obtained by screen-capturing during a response of the control terminal to a predetermined operation. The server can extract the third feature from the pixel point contained in the image intercepted by the controlled terminal, and can also extract the fourth feature from the pixel point contained in the image intercepted by the control terminal. Further, in response to the similarity between the third feature and the fourth feature being greater than or equal to a preset threshold, the server may determine that the process of the controlled terminal responding to the predetermined operation and the process of the control terminal responding to the predetermined operation are consistent. In response to the similarity between the third feature and the fourth feature being less than the preset threshold, the server may determine that the process of the controlled terminal responding to the predetermined operation and the process of the control terminal responding to the predetermined operation are inconsistent.
In some embodiments, the controlled terminal may perform step 302 as follows.
Specifically, the target data is transmitted to a server (for example, the server 503 shown in fig. 5) so that the server determines whether or not a response procedure of the controlled terminal to a predetermined operation satisfies the target requirement based on the target data.
In some scenarios, the target data may include a start time and an end time of the controlled terminal in response to the predetermined operation. At this time, the server may take the difference between the termination time and the start time as a response time period to a predetermined operation. Further, in response to the response time length being less than or equal to the preset time length, the server may determine that the response process of the controlled terminal to the predetermined operation meets the target requirement. In response to the response time length being greater than the preset time length, the server may determine that the response process of the controlled terminal to the predetermined operation does not meet the target requirement.
Therefore, after the controlled terminal executes the preset operation under the control of the control terminal, whether the response process of the controlled terminal to the preset operation meets the target requirement or not is determined through the server.
In practice, if a plurality of controlled terminals perform a predetermined operation under the control of the control terminal, it may be determined by the server whether or not the response procedure of each controlled terminal to the predetermined operation satisfies the target requirement.
In some embodiments, the server determines whether a response procedure of the controlled terminal to the predetermined operation satisfies the target requirement by performing the following processing steps. The processing steps include step S1 and step S2 shown below.
In step S1, it is determined whether the response procedure of the controlled terminal to the predetermined operation and the response procedure of the control terminal to the predetermined operation coincide with each other based on the target data.
In some scenarios, the server may store therein data reflecting a response procedure of the control terminal to a predetermined operation. At this time, the server may determine the similarity of the data and the target data. Further, in response to the determined similarity being greater than or equal to the preset threshold, the server may determine that the controlled terminal and the control terminal are consistent in the process of responding to the predetermined operation. In response to the determined similarity being less than the preset threshold, the server may determine that a response procedure of the controlled terminal to the predetermined operation is inconsistent with a response procedure of the control terminal to the predetermined operation.
And step S2, in response to the fact that the response process of the controlled terminal to the preset operation is consistent with the response process of the control terminal to the preset operation, determining that the response process of the controlled terminal to the preset operation meets the target requirement.
In practice, the response procedure of the control terminal to the predetermined operation usually meets the target requirements. Therefore, on the premise that the process of the controlled terminal responding to the preset operation is consistent with the process of the control terminal responding to the preset operation, the response process of the controlled terminal to the preset operation can be determined to meet the target requirement.
In some embodiments, the above processing steps may further include step S3 shown below.
And step S3, in response to the inconsistency between the response process of the controlled terminal to the preset operation and the response process of the control terminal to the preset operation, determining that the response process of the controlled terminal to the preset operation does not meet the target requirement.
Therefore, on the premise that the response process of the controlled terminal to the preset operation is inconsistent with the response process of the control terminal to the preset operation, the response process of the controlled terminal to the preset operation can be determined not to meet the target requirement.
With further reference to fig. 4, as an implementation of the methods shown in the above-mentioned figures, the present disclosure provides some embodiments of a terminal control apparatus, which correspond to the method embodiment shown in fig. 1, and which may be applied in various electronic devices.
As shown in fig. 4, the terminal control apparatus of the present embodiment includes an acquisition unit 401 and a transmission unit 402. The obtaining unit 401 is configured to: and acquiring operation data of a user for executing a preset operation on the control terminal, wherein the operation data is used for controlling the controlled terminal to execute the preset operation. The sending unit 402 is configured to: and sending the operation data to the controlled terminal so that the controlled terminal executes a preset operation based on the operation data.
In this embodiment, specific processing of the obtaining unit 401 and the sending unit 402 of the terminal control apparatus and technical effects thereof may refer to related descriptions of step 101 and step 102 in the corresponding embodiment of fig. 1, which are not described herein again.
In some embodiments, the controlled terminal and the controlling terminal are members of the same multicast group. The sending unit 402 is further configured to: and transmitting the operation data to the controlled terminals belonging to the multicast group in a multicast mode.
In some embodiments, the multicast address of the multicast group is bound to an internet protocol address of the target local area network. The terminal control device described above further includes a joining unit (not shown in fig. 4). Wherein the adding unit is used for: and responding to the detection of the target local area network, and joining the multicast group indicated by the multicast address bound by the internet protocol address of the target local area network.
In some embodiments, the controlled terminal performs the following steps before receiving the operation data: and responding to the initialization operation, and displaying an initial interface, wherein the initial interface is displayed before the control terminal sends the operation data to the controlled terminal.
In some embodiments, the predetermined operation comprises at least one of: touch operation executed by a user on a screen of the control terminal; and triggering operation executed by a user on a preset key of the control terminal.
In some embodiments, the operation data includes screen coordinates passed by the control terminal during the touch operation. The controlled terminal performs a predetermined operation by: and executing touch operation based on the screen coordinates included in the operation data.
In some embodiments, the controlled terminal performs the following steps: and acquiring target data, wherein the target data reflects the response process of the controlled terminal to the preset operation. The determination unit is used for: and determining whether the response process of the controlled terminal to the preset operation meets the target requirement or not based on the target data.
In some embodiments, the target data includes at least one of: the controlled terminal records the video obtained by the screen in the response process of the preset operation; and the controlled terminal captures the obtained image in the response process of the preset operation.
In some embodiments, the controlled terminal determines whether the response procedure of the predetermined operation satisfies the target requirement by: and sending the target data to the server so that the server determines whether the response process of the controlled terminal to the preset operation meets the target requirement or not based on the target data.
In some embodiments, the server determines whether the response procedure of the controlled terminal to the predetermined operation satisfies the target requirement by performing the following processing steps: determining whether the response process of the controlled terminal to the preset operation is consistent with the response process of the control terminal to the preset operation or not based on the target data; and determining that the response process of the controlled terminal to the preset operation meets the target requirement in response to the consistency of the response process of the controlled terminal to the preset operation and the response process of the control terminal to the preset operation.
In some embodiments, the processing step further comprises: and determining that the response process of the controlled terminal to the preset operation does not meet the target requirement in response to the fact that the response process of the controlled terminal to the preset operation is inconsistent with the response process of the control terminal to the preset operation.
With further reference to fig. 5, fig. 5 illustrates an exemplary system architecture to which the terminal control methods of some embodiments of the present disclosure may be applied.
As shown in fig. 5, the system architecture may include a control terminal 501, a controlled terminal 502, and a server 503. In practice, the control terminal 501, the controlled terminal 502, and the server 503 may communicate with each other through a network. The network may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
The control terminal 501 and the controlled terminal 502 may be hardware or software. When the control terminal 501 and the controlled terminal 502 are hardware, they may be various electronic devices having a display screen and supporting information interaction, including but not limited to a smart phone, a tablet computer, a laptop portable computer, a desktop computer, and the like. When the control terminal 501 and the controlled terminal 502 are software, they can be installed in the electronic devices listed above. It may be implemented as multiple pieces of software or software modules, or as a single piece of software or software module. And is not particularly limited herein.
In some scenarios, a user may perform a predetermined operation on the control terminal. Further, the control terminal 501 may transmit operation data to the controlled terminal 502. Still further, the control terminal 501 may perform a predetermined operation according to the operation data. Thus, the controlled terminal 502 can perform a predetermined operation under the control of the control terminal 501.
The server 503 may be hardware or software. When the server 503 is hardware, it may be implemented as a distributed server cluster composed of multiple servers, or may be implemented as a single server. When the server 503 is software, it may be implemented as multiple pieces of software or software modules (e.g., multiple pieces of software or software modules used to provide distributed services), or as a single piece of software or software module. And is not particularly limited herein.
In some scenarios, the controlled terminal 502 may transmit target data reflecting its response procedure to a predetermined operation to the server 503. Further, the server 503 may determine whether the response procedure of the controlled terminal 502 to the predetermined operation satisfies the target requirement based on the target data.
In practice, the server 503 may determine whether the response procedure of the controlled terminal 502 to the predetermined operation satisfies the target requirement in various ways. In some scenarios, the control terminal 501 may send data reflecting its response procedure to a predetermined operation to the server 503. At this time, the server 503 may determine whether the response procedure of the controlled terminal 502 to the predetermined operation satisfies the target requirement based on the data transmitted by the control terminal 501 and the above-described target data.
It should be noted that the controlled terminal 502 may locally determine whether its response process to the predetermined operation satisfies the target requirement based on the target data. At this time, the system architecture shown in fig. 5 may not include the server 503.
It should be further noted that the terminal control method provided by the embodiment of the present disclosure may be executed by the control terminal 501, and accordingly, the terminal control device may be provided in the control terminal 501.
It should be understood that the number of control terminals, controlled terminals, and servers in fig. 5 is merely illustrative. There may be any number of control terminals, controlled terminals, and servers, as desired for implementation.
Referring now to fig. 6, a schematic diagram of an electronic device (e.g., control terminal 501 in fig. 5) suitable for use in implementing some embodiments of the present disclosure is shown. The terminal in some embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle-mounted terminal (e.g., a car navigation terminal), and the like, and a fixed terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 6, the electronic device may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 601, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)602 or a program loaded from a storage means 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data necessary for the operation of the electronic apparatus are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
Generally, the following devices may be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 607 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 608 including, for example, tape, hard disk, etc.; and a communication device 609. The communication means 609 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 illustrates an electronic device having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided. Each block shown in fig. 6 may represent one device or may represent multiple devices as desired.
In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flow diagrams may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 609, or may be installed from the storage means 608, or may be installed from the ROM 602. The computer program, when executed by the processing device 601, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
It should be noted that the computer readable medium described in some embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In some embodiments of the disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be included in the electronic device or may exist separately without being incorporated in the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring operation data of a user for executing a preset operation on a control terminal, wherein the operation data is used for controlling the controlled terminal to execute the preset operation; and sending the operation data to the controlled terminal so that the controlled terminal executes a preset operation based on the operation data.
Computer program code for carrying out operations for embodiments of the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, Python, gold, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in some embodiments of the present disclosure may be implemented by software, and may also be implemented by hardware. Here, the names of these units do not constitute a limitation to the unit itself in some cases, and for example, the acquisition unit may also be described as a unit that acquires "operation data for a user to perform a predetermined operation on the control terminal".
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure in the embodiments of the present disclosure is not limited to the particular combination of the above-described features, but also encompasses other embodiments in which any combination of the above-described features or their equivalents is possible without departing from the scope of the present disclosure. For example, the above features may be interchanged with other features disclosed in this disclosure (but not limited to) those having similar functions.

Claims (14)

1. A terminal control method, characterized in that the method comprises:
acquiring operation data of a user for executing a preset operation on a control terminal, wherein the operation data is used for controlling the controlled terminal to execute the preset operation;
and sending the operation data to the controlled terminal so that the controlled terminal executes the predetermined operation based on the operation data.
2. The method according to claim 1, wherein the controlled terminal and the control terminal belong to the same multicast group; and
the sending the operation data to the controlled terminal includes:
and sending the operation data to the controlled terminal belonging to the multicast group in a multicast mode.
3. The method of claim 2, wherein the multicast address of the multicast group is bound to an internet protocol address of a target local area network; and
the controlled terminal and the control terminal join the multicast group by the following mode:
and in response to the detection of the target local area network, adding a multicast group indicated by the multicast address bound by the Internet protocol address of the target local area network.
4. The method according to claim 1, wherein the controlled terminal performs the following steps before receiving the operation data:
and responding to the initialization operation, and displaying an initial interface, wherein the initial interface is displayed by the control terminal before the user performs the preset operation.
5. The method of claim 1, wherein the predetermined operation comprises at least one of:
touch operation executed by a user on a screen of the control terminal;
and triggering operation executed by the user on a preset key of the control terminal.
6. The method according to claim 5, wherein the operation data includes screen coordinates passed by the control terminal during the touch operation; and
the controlled terminal executes the predetermined operation by:
and executing the touch operation based on the screen coordinates included in the operation data.
7. The method according to claim 1, characterized in that the controlled terminal performs the steps of:
acquiring target data, wherein the target data reflects a response process of the controlled terminal to the preset operation;
and determining whether the response process of the controlled terminal to the preset operation meets the target requirement or not based on the target data.
8. The method of claim 7, wherein the target data comprises at least one of:
the controlled terminal records the video obtained by the screen in the response process of the preset operation;
and the controlled terminal captures the obtained image in the response process of the preset operation.
9. The method according to claim 7, wherein the controlled terminal determines whether the response procedure of the predetermined operation satisfies the target requirement by:
and sending the target data to a server so that the server determines whether the response process of the controlled terminal to the predetermined operation meets the target requirement based on the target data.
10. The method according to claim 9, wherein the server determines whether the response procedure of the controlled terminal to the predetermined operation satisfies the target requirement by performing the following processing steps:
determining whether the response process of the controlled terminal to the preset operation is consistent with the response process of the control terminal to the preset operation or not based on the target data;
and determining that the response process of the controlled terminal to the preset operation meets the target requirement in response to the fact that the response process of the controlled terminal to the preset operation is consistent with the response process of the control terminal to the preset operation.
11. The method of claim 10, wherein the processing step further comprises:
and determining that the response process of the controlled terminal to the predetermined operation does not meet the target requirement in response to the fact that the response process of the controlled terminal to the predetermined operation is inconsistent with the response process of the control terminal to the predetermined operation.
12. A terminal control apparatus, comprising:
the device comprises an acquisition unit, a processing unit and a control unit, wherein the acquisition unit is used for acquiring operation data of a user for executing a preset operation on a control terminal, and the operation data is used for controlling the controlled terminal to execute the preset operation;
a sending unit, configured to send the operation data to the controlled terminal, so that the controlled terminal executes the predetermined operation based on the operation data.
13. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-11.
14. A computer-readable medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-11.
CN202011204820.4A 2020-11-02 2020-11-02 Terminal control method and device and electronic equipment Pending CN112306610A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011204820.4A CN112306610A (en) 2020-11-02 2020-11-02 Terminal control method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011204820.4A CN112306610A (en) 2020-11-02 2020-11-02 Terminal control method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN112306610A true CN112306610A (en) 2021-02-02

Family

ID=74333597

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011204820.4A Pending CN112306610A (en) 2020-11-02 2020-11-02 Terminal control method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN112306610A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103455265A (en) * 2012-06-01 2013-12-18 腾讯科技（深圳）有限公司 Controlled equipment, control method and control system thereof and mobile terminal
CN103472949A (en) * 2013-09-03 2013-12-25 小米科技有限责任公司 Method and device for remote-control processing of touch screen terminal and terminal
WO2016019495A1 (en) * 2014-08-04 2016-02-11 华为技术有限公司 Terminal, server, and terminal control method
KR20160093877A (en) * 2015-01-30 2016-08-09 엔트릭스 주식회사 Virtual client, cloud streaming server, cloud streaming server test system comprising the same, control method thereof and computer readable medium having computer program recorded therefor
US20160249216A1 (en) * 2015-02-25 2016-08-25 Screenovate Technologies Ltd. Method for method for authenticating direct mirroring connection between a target screen device and a mobile device
CN107817962A (en) * 2017-10-26 2018-03-20 百度在线网络技术（北京）有限公司 A kind of long-range control method, device, control server and storage medium
CN110796094A (en) * 2019-10-30 2020-02-14 上海商汤智能科技有限公司 Control method and device based on image recognition, electronic equipment and storage medium
CN111273850A (en) * 2020-01-21 2020-06-12 维达力实业(深圳)有限公司 Terminal control method and device, computer equipment and storage medium
CN111641857A (en) * 2020-05-29 2020-09-08 北京字节跳动网络技术有限公司 Interaction method and device of controlled equipment, interaction method and device of main control equipment, terminal and storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103455265A (en) * 2012-06-01 2013-12-18 腾讯科技（深圳）有限公司 Controlled equipment, control method and control system thereof and mobile terminal
CN103472949A (en) * 2013-09-03 2013-12-25 小米科技有限责任公司 Method and device for remote-control processing of touch screen terminal and terminal
WO2016019495A1 (en) * 2014-08-04 2016-02-11 华为技术有限公司 Terminal, server, and terminal control method
KR20160093877A (en) * 2015-01-30 2016-08-09 엔트릭스 주식회사 Virtual client, cloud streaming server, cloud streaming server test system comprising the same, control method thereof and computer readable medium having computer program recorded therefor
US20160249216A1 (en) * 2015-02-25 2016-08-25 Screenovate Technologies Ltd. Method for method for authenticating direct mirroring connection between a target screen device and a mobile device
CN107817962A (en) * 2017-10-26 2018-03-20 百度在线网络技术（北京）有限公司 A kind of long-range control method, device, control server and storage medium
CN110796094A (en) * 2019-10-30 2020-02-14 上海商汤智能科技有限公司 Control method and device based on image recognition, electronic equipment and storage medium
CN111273850A (en) * 2020-01-21 2020-06-12 维达力实业(深圳)有限公司 Terminal control method and device, computer equipment and storage medium
CN111641857A (en) * 2020-05-29 2020-09-08 北京字节跳动网络技术有限公司 Interaction method and device of controlled equipment, interaction method and device of main control equipment, terminal and storage medium

Similar Documents

Publication Publication Date Title
CN110795022B (en) Terminal testing method, system and storage medium
EP4262214A1 (en) Screen projection method and apparatus, and electronic device and storage medium
CN110809189B (en) Video playing method and device, electronic equipment and computer readable medium
US20190051147A1 (en) Remote control method, apparatus, terminal device, and computer readable storage medium
CN112383787B (en) Live broadcast room creating method and device, electronic equipment and storage medium
CN111459364B (en) Icon updating method and device and electronic equipment
CN111784712B (en) Image processing method, device, equipment and computer readable medium
CN112311656B (en) Message aggregation and display method and device, electronic equipment and computer readable medium
CN112312222A (en) Video sending method and device and electronic equipment
CN111309617A (en) Application program control method and device, storage medium and electronic equipment
CN112351222A (en) Image special effect processing method and device, electronic equipment and computer readable storage medium
CN111596991A (en) Interactive operation execution method and device and electronic equipment
CN111432001A (en) Method, apparatus, electronic device, and computer-readable medium for jumping scenes
CN113144620A (en) Detection method, device, platform, readable medium and equipment for frame synchronization game
CN110781066B (en) User behavior analysis method, device, equipment and storage medium
CN112218034A (en) Video processing method, system, terminal and storage medium
CN111209432A (en) Information acquisition method and device, electronic equipment and computer readable medium
CN112732457B (en) Image transmission method, image transmission device, electronic equipment and computer readable medium
CN110334763B (en) Model data file generation method, model data file generation device, model data file identification device, model data file generation apparatus, model data file identification apparatus, and model data file identification medium
CN111258582B (en) Window rendering method and device, computer equipment and storage medium
CN112306610A (en) Terminal control method and device and electronic equipment
CN114187169A (en) Method, device and equipment for generating video special effect package and storage medium
CN114125485A (en) Image processing method, apparatus, device and medium
CN111367592B (en) Information processing method and device
CN113766178A (en) Video control method, device, terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination