CN112860144A

CN112860144A - Control method and system

Info

Publication number: CN112860144A
Application number: CN202011628997.7A
Authority: CN
Inventors: 邝宇豪; 尹春林; 陶晓风; 刘浩宇
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2020-12-31
Filing date: 2020-12-31
Publication date: 2021-05-28
Anticipated expiration: 2040-12-31
Also published as: CN112860144B

Abstract

The application provides a control method, comprising: if the master control device establishes a first connection with the central control device and the central control device establishes a second connection with the controlled device, outputting display content related to the controlled device on a control interface of the master control device; if the main control equipment obtains the input operation acting on the display content, controlling the controlled equipment to respond to the input operation according to the determined control strategy; wherein the first connection and the second connection are the same or different, and the control strategy is related to an operation state of the controlled device. Meanwhile, the application also provides a control system.

Description

Control method and system

Technical Field

The present application relates to remote control technologies, and in particular, to a control method and system.

Background

In actual development work, remote reproduction and debugging of remote equipment are often needed, however, some problems can only be reproduced when the controlled equipment is disconnected from the network, and once the controlled equipment is connected to the network, the problems can not be reproduced, so that the software machine is generally required to be recharged, and thus, a long time is needed. In addition, in the process of remotely controlling the controlled device, the controlled device needs to disconnect the network and reconnect the network, but once the network of the controlled device is disconnected, the remote connection is also disconnected, so that the controlled device cannot be remotely reproduced.

Disclosure of Invention

In one aspect of the present application, a control method is provided, including:

if the master control device establishes a first connection with the central control device and the central control device establishes a second connection with the controlled device, outputting display content related to the controlled device on a control interface of the master control device;

if the main control equipment obtains the input operation acting on the display content, controlling the controlled equipment to respond to the input operation according to the determined control strategy;

wherein the first connection and the second connection are the same or different, and the control strategy is related to an operation state of the controlled device.

In the above scheme, outputting the display content related to the controlled device on the control interface of the main control device includes:

receiving image data which is sent by the central control equipment and is obtained by an image acquisition component of the central control equipment and is about the controlled equipment, and displaying and outputting the image data to the control interface as the display content, wherein the image data comprises display output data and/or appearance image data of the controlled equipment;

or receiving display output data of the controlled equipment, which is sent by the central control equipment and obtained through the second connection, and displaying the display output data on the control interface as the display content; or, obtaining display output data and/or appearance image data about the controlled equipment and displayed on the control interface of the central control equipment;

or receiving self-display output data sent by the controlled equipment, and outputting the self-display output data serving as the display content to the control interface in a display mode.

In the above solution, controlling the controlled device to respond to the input operation according to the determined control strategy includes:

if the controlled equipment is in a first running state or a second running state and the main control equipment obtains the input operation acting on the display content, controlling the controlled equipment to respond to the input operation through the central control equipment;

or, if the controlled device is in a third operating state and the main control device obtains an input operation acting on the display content, controlling the controlled device to respond to the input operation;

wherein the first operating state, the second operating state, and the third operating state are different from each other.

In the above solution, the controlling, by the central control device, the controlled device to respond to the input operation includes:

if the display content is appearance image data of the controlled equipment and the input operation is a starting operation of a physical starting key in the appearance image data, sending a starting instruction for the controlled equipment to the central control equipment through the first connection so that the central control equipment controls the controlled equipment to execute the starting operation based on the starting instruction;

or, if the display content is appearance image data about the controlled device and the input operation is a power-on operation for a virtual power-on key on the appearance image data, sending a power-on instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the power-on operation based on the power-on instruction;

or, if the display content is display output data of the controlled device and the input operation is a boot operation for a boot control in the display output data, sending a boot instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the boot operation based on the boot instruction;

or if the input operation is a starting operation of a virtual starting control related to the controlled equipment in the control interface, sending a starting instruction for the controlled equipment to the central control equipment so that the central control equipment controls the controlled equipment to execute the starting operation based on the starting instruction;

or if the input operation is a power-on instruction input operation acting on the control interface, sending a power-on instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the power-on operation based on the power-on instruction.

if the display content is appearance image data of the controlled device and the input operation is a networking operation of a network card physical switch in the appearance image data, sending a networking instruction for the controlled device to the central control device through the first connection so that the central control device controls the controlled device to execute a network connection operation based on the networking instruction;

or, if the display content is display output data about the controlled device and the input operation is a networking operation for a network card virtual switch in the display output data, sending a networking instruction for the controlled device to the central control device through the first connection so that the central control device controls the controlled device to execute a network connection operation based on the networking instruction;

or, if the input operation is a networking operation of a network state setting control acting on the controlled equipment in the control interface, sending a networking instruction aiming at the controlled equipment to the central control equipment through the first connection, so that the central control equipment controls the controlled equipment to execute a network connection operation based on the networking instruction;

or, if the input operation is an input operation of a networking instruction acting on the control interface, sending the networking instruction aiming at the controlled equipment to the central control equipment through the first connection, so that the central control equipment controls the controlled equipment to execute a network connection operation based on the networking instruction.

In the above scheme, the method further comprises:

if the controlled equipment is switched from a network disconnection state to a network connection state, establishing a third connection between the main control equipment and the controlled equipment so as to control the controlled equipment to respond to input operation through the third connection, wherein the first connection and the second connection are in a disconnection state after the third connection is established;

or if the controlled equipment is switched from the network disconnection state to the networking state and/or the controlled equipment is switched from the power-off state to the power-on state, adjusting the type of the second connection so as to control the controlled equipment to respond to the input operation in the adjusted connection mode.

In the above scheme, the method further comprises:

and if the controlled equipment is switched from the network disconnection state to the networking state and/or the controlled equipment is switched from the power-off state to the power-on state, adjusting the running state of the central control equipment according to the determined adjustment strategy.

In the above scheme, the method further comprises:

if a plurality of main control devices establish first connection with one central control device and one central control device establishes second connection with one controlled device, outputting display contents related to the controlled device on control interfaces of the plurality of main control devices;

if the target main control equipment in the plurality of main control equipment obtains the input operation acting on the display content, controlling the controlled equipment to respond to the input operation according to the determined control strategy; the target master control device represents a device with control authority in the plurality of master control devices;

or if one master control device establishes a first connection with a plurality of central control devices and a plurality of central control devices establishes a second connection with a plurality of controlled devices, outputting display contents related to the plurality of controlled devices on a control interface of the master control device, wherein one central control device corresponds to one controlled device;

if the main control equipment obtains the input operation of the display content acting on the target controlled equipment, controlling the target controlled equipment to respond to the input operation according to the determined control strategy;

or if one master control device establishes a first connection with one central control device and one central control device establishes a second connection with a plurality of controlled devices, outputting display contents related to at least one controlled device on a control interface of the master control device;

and if the main control equipment obtains the input operation of the display content acting on the target controlled equipment, controlling the target controlled equipment to respond to the input operation according to the determined control strategy.

In the above solution, the receiving of the image data about the controlled device, which is sent by the central control device and obtained by the image acquisition component thereof, includes:

if the image anti-shake parameters of the image acquisition part meet preset parameters, receiving image data which are sent by the central control equipment and are obtained by the image acquisition part and related to the controlled equipment;

or if the image resolution parameter of the image acquisition component meets the preset parameter, receiving the image data which is sent by the central control equipment and is obtained by the image acquisition component of the central control equipment and related to the controlled equipment.

According to another aspect of the present application, there is provided a control system comprising: the system comprises a main control device, a central control device and a controlled device, wherein the main control device and the central control device establish a first connection; the central control equipment and the controlled equipment establish second connection; the first connection and the second connection are the same or different;

outputting display content related to the controlled device through a control interface of the master control device;

if the master control equipment obtains the input operation acting on the display content, the master control equipment sends a control instruction aiming at the controlled equipment to the central control equipment;

and the central control equipment controls the controlled equipment to respond to the input operation based on the control instruction.

According to the control method and the control system, the central control device is additionally arranged between the controlled device and the main control device, the main control device can remotely control the controlled device through the central control device when the controlled device is in a network disconnection state, and the network disconnection of the controlled device does not affect the remote operation of the main control device on the controlled device through the central control device because the central control device and the controlled device are two independent systems.

Drawings

FIG. 1 is a schematic view of a flow implementation of a control method in the present application;

fig. 2 is a first structural diagram of a main control device in the present application;

FIG. 3 is a schematic structural component diagram of a control system according to the present application;

fig. 4 is a schematic structural diagram of a main control device in the present application.

Detailed Description

The technical solution of the present application is further described in detail with reference to the drawings and specific embodiments of the specification.

Fig. 1 is a schematic view of a flow implementation of a control method in the present application, as shown in fig. 1, including:

step 101, if a main control device establishes a first connection with a central control device and the central control device establishes a second connection with a controlled device, outputting display content related to the controlled device on a control interface of the main control device; wherein the first connection and the second connection are the same or different.

In the application, the method is mainly applied to a master control device, the master control device and a central control device can establish a first connection through long-distance communication, the central control device and a controlled device can establish a second connection through short-distance communication, and under the second connection, the controlled device represents a slave device of the central control device, and the central control device represents a master device of the controlled device. For example, the master device, the central device, and the controlled device may be a server, a desktop computer, a notebook computer, a tablet computer, a mobile phone, or an embedded device, etc.

Specifically, when The controlled device is in a network disconnection state, The main control device may establish a first connection with The central control device through The mobile network, and The central control device may establish a second connection with The controlled device through a universal serial bus On-The-Go (USB-OTG). And after the controlled network is repaired, the controlled equipment can be switched to a networking state from a network disconnection state, and at the moment, the central control equipment can be connected with the controlled equipment in a second mode through mobile communication, network cables, WIFI and Bluetooth.

In the application, the master control device, the central control device and the controlled device are further provided with remote control programs, and when the master control device establishes a first connection with the central control device and the central control device establishes a second connection with the controlled device, display contents related to the controlled device can be output on a control interface of the master control device through the remote control programs. The master control device may send a control instruction to the central control device through the first connection, and the central control device may control the controlled device to perform a corresponding operation through the second connection based on the control instruction. Such as networking operations, power-on operations, power-off operations, wake-up operations, sleep operations, and the like.

Here, when the control interface of the master device outputs the display content related to the controlled device, the display content includes, but is not limited to, display output data output through a display unit (e.g., a display screen) of the controlled device, or display output data of the controlled device output through a display unit of the central control device, or appearance image data and/or display output data related to the controlled device collected through an image collecting part of the central control device, and the like.

Specifically, the controlled device may send the display output data output by its display unit to the central control device through the second connection, and then the central control device sends the display output data sent by the controlled device to the main control device through the first connection, and the main control device may receive the display output data of the controlled device sent by the central control device and obtained through the second connection, and display and output the display output data to the control interface of the main control device as the display content of the controlled device; alternatively, the first and second electrodes may be,

the central control equipment is provided with an image acquisition component (such as a camera), and when an image acquisition part of the central control equipment meets a preset condition, the central control equipment can acquire image data of the controlled equipment through the image acquisition component. Wherein the image data comprises display output data and/or appearance image data of the controlled device. Then, the central control device sends the image data to the main control device through the first connection, and the main control device can receive the image data about the controlled device, which is sent by the central control device and obtained through the image acquisition component of the main control device, and display and output the image data to a control interface of the main control device as the display content of the controlled device.

Here, when the image anti-shake parameter of the image capturing component meets a preset parameter, it may be determined that the image capturing component meets a preset condition, and the master control device receives image data about the controlled device, which is sent by the central control device and obtained through the image capturing component; or when the image resolution parameter of the image acquisition component meets the preset parameter, determining that the image acquisition component meets the preset condition, and receiving, by the master control device, the image data, which is sent by the master control device and obtained by the image acquisition component, of the controlled device.

Here, whether the image capturing part satisfies the preset condition may be determined by the central control device, or may be determined by the main control device.

When the central control device judges whether the image acquisition component meets the preset condition, the central control device can obtain the image anti-shake parameters of the image acquisition component, compare the image anti-shake parameters with the preset parameters, determine that the image anti-shake parameters reach the preset parameters according to the comparison result, and then determine that the image acquisition component meets the preset condition. Or, the central control device may obtain the image resolution parameter of the image acquisition component, compare the image resolution parameter with a preset parameter, and determine that the image resolution parameter reaches the preset parameter according to the comparison result, and then determine that the image acquisition component meets the preset condition.

Or, when the main control device determines whether the image acquisition component meets the preset condition, the main control device may compare the image anti-shake parameter of the image acquisition component with the preset parameter by acquiring the image anti-shake parameter of the image acquisition component, and determine that the image anti-shake parameter reaches the preset parameter according to the comparison result, and then determine that the image acquisition component meets the preset condition. Or, the main control device may determine that the image acquisition component meets the preset condition by acquiring the image resolution parameter of the image acquisition component, comparing the image resolution parameter with a preset parameter, and determining that the image resolution parameter reaches the preset parameter according to the comparison result.

In this application, the central control device may further display and output display output data and/or appearance image data about the controlled device through its own control interface, and transmit the display output data and/or appearance image data about the controlled device to the main control device through the first connection. The master control device can also obtain display output data and/or appearance image data about the controlled device, which are displayed and output by the control interface of the central control device, and display the display output data and/or the appearance image data on the control interface of the master control device.

Or, when the controlled device is in the networking state, the controlled device may send its display output data to the main control device, and the main control device may also receive its display output data sent by the controlled device, and display and output the display output data of the controlled device itself as the display content to the control interface of the main control device.

102, if the main control equipment obtains the input operation acting on the display content, controlling the controlled equipment to respond to the input operation according to the determined control strategy; wherein the control strategy is related to an operational state of the controlled device.

In one example, if the controlled device is in the first operation state or the second operation state and the master control device obtains an input operation acting on display content in the control interface of the master control device, the controlled device is controlled by the central control device to respond to the input operation.

Here, the first operating state and the second operating state are different, for example, the first operating state may indicate that the controlled device is in a shutdown state or a hibernation state, and the second operating state may indicate that the controlled device is in a network-off state.

In another example, if the controlled device is in the third operating state and the master device obtains an input operation acting on the display content in the control interface of the master device, the controlled device is directly controlled to respond to the input operation.

Here, the third operating state is different from the first operating state and the second operating state. For example, the third operating state may characterize the controlled device as being in a networking state and/or a power-on state.

Next, taking the controlled device in the third operating state (for example, the power-on state) as an example, the main control device controls the controlled device to respond to the input operation through the central control device:

specifically, when the master control device controls the controlled device to respond to the input operation through the central control device, if the display content is the appearance image data of the controlled device and the input operation is a power-on operation of a physical power-on key which characterizes the controlled device in the appearance image data, the master control device may send a power-on instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the power-on operation based on the power-on instruction;

or, if the display content is appearance image data of the controlled device and the input operation is a power-on operation of a virtual power-on key for characterizing the controlled device on the appearance image data, the main control device sends a power-on instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the power-on operation based on the power-on instruction;

or, if the display content is display output data of the controlled device and the input operation is a boot operation for a boot control in the display output data, the main control device sends a boot instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the boot operation based on the boot instruction; here, the boot control refers to a virtual boot control displayed on a display interface of the controlled device.

Or if the input operation is a starting operation of a virtual starting control related to the controlled equipment in a control interface of the main control equipment, sending a starting instruction aiming at the controlled equipment to the central control equipment so that the central control equipment controls the controlled equipment to execute the starting operation based on the starting instruction; here, the virtual boot control refers to a virtual boot control for the controlled device, which is displayed and output in the control interface of the main control device, that is, the virtual boot control is not a virtual boot control displayed and output through the display unit of the controlled device.

Or, if the input operation is a power-on instruction input operation acting on a control interface of the master control device, the master control device may send a power-on instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the power-on operation based on the power-on instruction. Here, the power-on instruction input operation may be a power-on instruction operation input by an input device (keyboard, mouse, or tablet) to a data input box in a control interface of the main control device, a power-on instruction operation input by a data input box in display output data of the main control device, or a power-on instruction operation input by a voice control (microphone) to the controlled device.

In the following, taking the controlled device in the second operation state (for example, the network disconnection state) as an example, the main control device controls the controlled device to respond to the input operation through the central control device:

specifically, when the master control device controls the controlled device to respond to the input operation through the central control device, if the display content is appearance image data of the controlled device and the input operation is a networking operation of a network card physical switch for representing the controlled device in the appearance image data, the master control device may send a networking instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to perform a network connection operation based on the networking instruction;

or, if the display content is display output data about the controlled device, and the input operation is a networking operation of a network card virtual switch representing the controlled device in the display output data, the master control device may send a networking instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to perform a network connection operation based on the networking instruction;

or, if the input operation is a networking operation acting on a network state setting control of the controlled device in a control interface of the master control device, the master control device may send a networking instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to perform a network connection operation based on the networking instruction; here, the network state setting control may refer to a network state setting control related to the controlled device, which is displayed and output in the control interface of the master device, that is, the network state setting control is not a network state setting control displayed and output through the display unit of the controlled device.

Or, if the input operation is an input operation of a networking instruction acting on the control interface of the master control device, the master control device may send the networking instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to perform a network connection operation based on the networking instruction.

Here, the input operation of the networking instruction may be a networking instruction input for an input box in the display output data of the main control device, a networking instruction input for an input box in a control interface of the main control device, or a voice input operation for a controlled device through a microphone control.

In the following, taking the controlled device in the first operating state (for example, the shutdown state) as an example, the main control device controls the controlled device to respond to the input operation through the central control device:

specifically, when the master control device controls the controlled device to respond to the input operation through the central control device, if the display content is the appearance image data of the controlled device and the input operation is a shutdown operation for a physical shutdown key that characterizes the controlled device in the appearance image data, the master control device may send a shutdown instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the shutdown operation based on the shutdown instruction;

or, if the display content is appearance image data of the controlled device and the input operation is a shutdown operation for a virtual shutdown key representing the controlled device in the appearance image data, the main control device may send a shutdown instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to perform a shutdown operation based on the shutdown instruction;

or, if the display content is display output data of the controlled device and the input operation is a shutdown operation for a shutdown control in the display output data, the main control device may send a shutdown instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the shutdown operation based on the shutdown instruction; here, the shutdown control refers to a virtual shutdown control displayed on a display interface of the controlled device.

Or, if the input operation is a shutdown operation acting on a virtual shutdown control of the controlled device in a control interface of the main control device, sending a shutdown instruction for the controlled device to the central control device, so that the central control device controls the controlled device to execute the shutdown operation based on the shutdown instruction; here, the virtual shutdown control refers to a virtual shutdown control for the controlled device, which is displayed and output in the control interface of the master device, that is, the virtual shutdown control is not a virtual shutdown control displayed and output through the display unit of the controlled device.

Or, if the display content is a shutdown instruction input operation acting on the control interface of the main control device, the main control device may send a shutdown instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute a shutdown operation based on the shutdown instruction. Here, the shutdown instruction input operation may be a shutdown instruction operation input by an input device (a keyboard, a mouse, or a tablet) with respect to a data input box in a control interface of the main control device, may also be a shutdown instruction operation input by a data input box in display output data of the main control device, and may also be a shutdown instruction operation input by a voice control (a microphone) with respect to the controlled device.

In this application, the steps of the controlled device controlling the controlled device to execute the network disconnection operation, the wake-up operation, and the sleep operation by the central control device are similar to the above-mentioned startup operation, networking operation, and shutdown operation, and are not described herein again, and reference may be made to the above description of the startup operation, the networking operation, and the shutdown operation.

Of course, the master control device in the present application may also set an automatic power-on time for the controlled device through the control interface of the master control device before the remote control of the controlled device enters the power-off state, and automatically implement the power-on operation of the controlled device when the current time reaches the automatic power-on time. Here, the auto-wake-up operation is similar to the auto-power-on operation, and is not described in detail.

In addition, when the controlled device is in the networking state, the controlled device can wake up the controlled device by receiving a network data packet sent by the BIOS of the controlled device, so that the controlled device is switched from the sleep state to the normal operation state.

Furthermore, a power connection line can be connected between the central control device and the controlled device to connect to a power interface of the controlled device, and the main control device can control the power connection line of the central control device through a control interface of the main control device to control the controlled device to start up.

In this application, if the controlled device is switched from the network disconnection state to the network connection state, the master control device may further establish a third connection between the master control device and the controlled device, so as to control the controlled device to respond to the input operation through the third connection, where the first connection and the second connection are in the disconnection state after the third connection is established.

Or, if the controlled device is switched from the network disconnection state to the network connection state and the controlled device is switched from the power-off state to the power-on state, the master control device establishes a third connection between the master control device and the controlled device to control the controlled device to respond to the input operation through the third connection, wherein the first connection and the second connection are in the disconnection state after the third connection is established.

Of course, if the controlled device is switched from the networking state to the disconnection state and/or the controlled device is switched from the power-on state to the power-off state, the main control device may further disconnect the third connection between the main control device and the controlled device, and recover the first connection between the main control device and the central control device and the second connection between the central control device and the controlled device, so as to control the controlled device to respond to the input operation through the first connection and the second connection.

In this application, if the controlled device is switched from the network disconnection state to the network connection state and/or the controlled device is switched from the power-off state to the power-on state, the main control device may further adjust the type of the second connection, so as to control the controlled device to respond to the input operation in the adjusted connection manner.

For example, when the controlled device is in the network disconnection state, the controlled device is controlled to respond to the input operation by the connection mode of the USB-OTG between the central control device and the controlled device, and when the controlled device is switched from the network disconnection state to the networking state, the controlled device is controlled to respond to the input operation by the connection mode of the WIFI or the bluetooth between the central control device and the controlled device.

In this application, if the controlled device is switched from the network disconnection state to the networking state and/or the controlled device is switched from the power-off state to the power-on state, the main control device may further adjust the operating state of the central control device according to the determined adjustment policy.

For example, after the third connection is established between the master device and the controlled device, the master device may adjust the current operating state of the central control device to a sleep mode or a low power consumption mode in which only the first connection is maintained between the master device and the central control device.

Because the central control device, the main control device and the controlled device are independent systems, the main control device is not influenced by the network state of the controlled device through the scheme of the application, and the controlled device can be remotely controlled to execute response operation no matter what state the controlled device is in. Therefore, the problem that the controlled equipment can be reproduced only under the condition of network disconnection can be solved without refilling a soft machine, so that the problem reproduction time and the operation complexity are reduced. And for some problems that the controlled equipment needs to be disconnected and then connected with the network, the main control equipment can be always in a state of being capable of remotely controlling the controlled equipment, and the communication connection of the main control equipment for remotely controlling the controlled equipment is not influenced. For some problems that the controlled equipment needs to be dormant for a period of time and then awakened, the awakening operation of the controlled equipment can be directly realized without the assistance of remote workers, so that the personnel participation cost is reduced.

In addition, according to the scheme of the application, the connection can be established between the main control device and the central control device, so that the controlled device can be remotely controlled through the central control device to execute corresponding operations, the main control device in the application does not need to develop remote control software with different versions aiming at an operating system of the controlled device, and the development cost is reduced. In addition, the controlled equipment can be remotely controlled to realize the operations of repeated network disconnection, networking, cold start and the like. And some embedded devices (such as industrial personal computers) which are inconvenient to connect with the network can also realize remote control, so that the application scene of the controlled device is expanded.

In this application, the master control device may have a plurality of master control devices, and the plurality of master control devices may all establish the first connection with one central control device.

Specifically, if a plurality of master control devices establish a first connection with one central control device and one central control device establishes a second connection with one controlled device, display content related to the controlled device may be output on control interfaces of the plurality of master control devices; here, in the control interfaces of the plurality of main control devices, the manner of outputting the display content related to the controlled device may refer to the above-mentioned implementation of outputting the display content related to the controlled device in the control interface of one main control device.

Here, if a target master device among the plurality of master devices obtains an input operation acting on the display content, controlling the controlled device to respond to the input operation according to the determined control policy; the target main control device represents a device with control authority in the plurality of main control devices;

for example, the three master control devices may output a display related to the controlled device on respective control interfaces, and may also perform voice sharing through a voice output function, but only one master control device has a right to remotely control the controlled device, and the remaining two master control devices may only play an auxiliary role. To avoid the problem that multiple devices remotely control the controlled device at the same time to cause system confusion.

According to the method and the device, the problems of the controlled equipment are remotely assisted by the plurality of main control equipment, the problem diagnosis dimensionality of the controlled equipment can be improved, the problem with complexity is solved, and therefore the diagnosis efficiency of the controlled equipment is improved.

In this application, the central control device may have a plurality of devices, and the plurality of central control devices may establish a first connection with one master control device and a second connection with the plurality of controlled devices.

Specifically, if one master control device establishes a first connection with a plurality of central control devices and the plurality of central control devices establishes a second connection with a plurality of controlled devices, display content related to the plurality of controlled devices can be output on a control interface of the master control device, wherein one central control device corresponds to one controlled device. If the master device obtains an input operation acting on the display content of the target controlled device, the master device may control the target controlled device to respond to the input operation according to the determined control policy.

Therefore, the plurality of central control devices are respectively connected with the plurality of controlled devices, and the same main control device is used for remote control, so that the problems of the plurality of controlled devices can be diagnosed and repaired simultaneously, and the problem repairing efficiency of the controlled devices is improved.

In this application, the controlled device may have a plurality of controlled devices, and the plurality of controlled devices may be connected to one central control device in common.

Specifically, if one master control device establishes a first connection with one central control device and the one central control device establishes a second connection with a plurality of controlled devices, the master control device may output display content related to at least one controlled device on a control interface of the master control device; if the master device obtains an input operation acting on the display content of the target controlled device, the target controlled device may be controlled to respond to the input operation according to the determined control policy.

Therefore, one central control device is simultaneously connected with a plurality of controlled devices and is remotely controlled by the same main control device, so that the problem diagnosis efficiency and the problem repair efficiency of the controlled devices can be improved on the basis of reducing the cost of the central control device.

Fig. 2 is a schematic structural diagram of a main control device in the present application, and as shown in fig. 2, the main control device includes:

the display unit 201 is configured to output display content related to a controlled device through a control interface of a master control device when the master control device establishes a first connection with the central control device and the central control device establishes a second connection with the controlled device;

a control unit 202, configured to control the controlled device to respond to an input operation according to a determined control policy when the master device obtains the input operation acting on the display content;

In a preferred embodiment, the main control device further includes:

a receiving unit 203, configured to receive image data about the controlled device, which is sent by the central control device and obtained through an image acquisition component thereof; or, receiving display output data of the controlled device, which is sent by the central control device and obtained through the second connection; or, obtaining display output data and/or appearance image data about the controlled equipment, which are displayed and output by a control interface of the central control equipment; or, receiving self display output data sent by the controlled device,

the display unit 201 is specifically configured to display and output the image data to the control interface as the display content, where the image data includes display output data and/or appearance image data of the controlled device; or, the display output data is used as the display content to be displayed on the control interface; or, the display output data and/or the appearance image data are displayed on the control interface of the user; or, the self display output data is used as the display content to be displayed and output to the control interface.

In a preferred embodiment, the control unit 202 is specifically configured to control, by the central control device, the controlled device to respond to an input operation when the controlled device is in a first operation state or a second operation state and the main control device obtains the input operation acting on the display content; or, when the controlled device is in a third running state and the main control device obtains an input operation acting on the display content, controlling the controlled device to respond to the input operation; wherein the first operating state, the second operating state, and the third operating state are different from each other.

Specifically, in a boot scene for a controlled device, if the display content is appearance image data of the controlled device and the input operation is a boot operation for a physical boot key in the appearance image data, the control unit 202 sends a boot instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to perform a boot operation based on the boot instruction; or, when the display content is appearance image data about the controlled device and the input operation is a power-on operation for a virtual power-on key on the appearance image data, the control unit 202 sends a power-on instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to perform the power-on operation based on the power-on instruction; or when the display content is display output data of the controlled device and the input operation is a power-on operation for a power-on control in the display output data, sending a power-on instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the power-on operation based on the power-on instruction; or when the input operation is a boot operation of a virtual boot control of the controlled device in the control interface, sending a boot instruction for the controlled device to the central control device, so that the central control device controls the controlled device to execute the boot operation based on the boot instruction; or when the input operation is a power-on instruction input operation acting on the control interface, sending a power-on instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the power-on operation based on the power-on instruction.

Specifically, in a networking scenario for a controlled device, if the display content is appearance image data of the controlled device and the input operation is a networking operation for a network card physical switch in the appearance image data, the control unit 202 may send a networking instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to perform a network connection operation based on the networking instruction; or, if the display content is display output data about the controlled device and the input operation is a networking operation for a network card virtual switch in the display output data, the control unit 202 may send a networking instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to perform a network connection operation based on the networking instruction; or, if the input operation is a networking operation acting on a network state setting control of the controlled device in the control interface, the control unit 202 may send a networking instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to perform a network connection operation based on the networking instruction; or, if the input operation is an input operation of a networking instruction acting on the control interface, the control unit 202 may send a networking instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to perform a network connection operation based on the networking instruction.

In a preferred aspect, the electronic device further includes:

the network unit 204 is configured to establish a third connection between the master device and the controlled device when the controlled device switches from a network disconnection state to a network connection state;

the control unit 202 is further configured to control the controlled device to respond to an input operation through the third connection, where the first connection and the second connection are in a disconnected state after the third connection is established.

In a preferred aspect, the electronic device further includes:

an adjusting unit 205, configured to adjust a type of the second connection when the controlled device is switched from a network disconnection state to a network connection state and/or when the controlled device is switched from a power-off state to a power-on state;

the control unit 202 is further configured to control the controlled device to respond to the input operation in the adjusted connection manner.

In a preferred embodiment, the adjusting unit 205 is further configured to adjust the operating state of the central control device according to a determined adjustment policy when the controlled device is switched from a network disconnection state to a network connection state and/or when the controlled device is switched from a power-off state to a power-on state.

For example, the central control device may be put in a low power consumption mode such as sleep or only maintain the connection between the central control device and the main control device after the third connection is established.

It should be noted that: in the above embodiment, when the master device performs remote control on the controlled device, only the division of the program modules is illustrated, and in practical applications, the processing distribution may be completed by different program modules according to needs, that is, the internal structure of the master device is divided into different program modules to complete all or part of the processing described above. In addition, the main control device and the control method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments and are not described herein again.

Fig. 3 is a schematic structural diagram of a control system in the present application, and as shown in fig. 3, the control system includes:

the system comprises a main control device 301, a central control device 302 and a controlled device 303, wherein the main control device 301 and the central control device 302 establish a first connection; the central control device 302 establishes a second connection with the controlled device 303; and the first connection and the second connection may be the same or different;

in particular, the first connection and the second connection may be different when the controlled device is in a network disconnected state and/or a power off state. For example, the first connection is a connection implemented by a mobile communication method, and the second connection may be a connection implemented by a USB-OTG method. And when the controlled device is in a networked state, the first connection and the second connection may be the same. For example, the first connection and the second connection are both connections implemented by mobile communication.

In this application, remote control programs are installed on the main control device 301, the central control device 302, and the controlled device 303, and display contents related to the controlled device 303 can be output through a control interface of the main control device 301. If the master device 301 obtains an input operation acting on the display content, the master device 301 may send a control instruction for the controlled device to the central control device 302; the central control device 302 may control the controlled device 303 to respond to the input operation based on the control instruction.

In a preferred embodiment, the master device 301 may also directly establish a third connection with the controlled device, so as to remotely control the controlled device 303 through the third connection.

Specifically, when the controlled device is in the networking state or is switched from the network disconnection state to the networking state, the master device 301 may establish a third connection with the controlled device 303, and remotely control the controlled device 303 to perform a corresponding operation through the third connection. At this time, the master device 301 may also disconnect the second connection with the central device 302 if the third connection is successfully established.

Of course, when the controlled device 303 switches from the network disconnection state to the network connection state, the master device 301 may adjust the type of the second connection with the central control device 202 to control the controlled device 303 to respond to the input operation in the adjusted connection manner.

For example, when the controlled device 303 is in the network disconnection state, the type of the second connection is USB-OTG, and when the controlled device 303 switches from the network disconnection state to the networking state, the type of the second connection may be one of mobile communication, a network cable, bluetooth, and WIFI.

Of course, the operating state of the central control device 302 may also be adjusted in the case where a third connection is established between the main control device 301 and the controlled device 303.

For example, the operation state of the central control device is adjusted to a low power consumption mode, such as a sleep mode, or a mode in which only the connection with the main control device 301 is maintained.

In a preferred embodiment, the master control device 301, the central control device 302, and the controlled device 303 may have a plurality of devices, wherein when the master control device 301 has a plurality of devices, only one master control device 301 has a remote control right, and the remaining master control devices 301 have only a voice assistance right. When there are multiple central control devices 302, one central control device 302 may correspond to one controlled device 303, one central control device 302 may correspond to multiple controlled devices 303, or multiple central control devices 302 may correspond to multiple controlled devices 303.

It should be noted that: when the control system provided by the above embodiment remotely controls the controlled device through the master control device, the implementation method of the control system and the control method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment and is not described herein again.

An embodiment of the present application further provides a master control device, where the master control device includes: a processor and a memory for storing a computer program capable of running on the processor,

wherein the processor is configured to execute, when running the computer program: if the master control device establishes a first connection with the central control device and the central control device establishes a second connection with the controlled device, outputting display content related to the controlled device on a control interface of the master control device;

The processor is further configured to, when executing the computer program, perform: receiving image data which is sent by the central control equipment and is obtained by an image acquisition component of the central control equipment and is about the controlled equipment, and displaying and outputting the image data to the control interface as the display content, wherein the image data comprises display output data and/or appearance image data of the controlled equipment; or the like, or, alternatively,

receiving display output data of the controlled equipment, which is sent by the central control equipment and obtained through the second connection, and displaying the display output data on the control interface as the display content; or the like, or, alternatively,

obtaining display output data and/or appearance image data which are displayed and output by a control interface of the central control equipment and are related to the controlled equipment, and displaying the display output data and/or the appearance image data on the control interface of the central control equipment; or the like, or, alternatively,

and receiving self-display output data sent by the controlled equipment, and outputting the self-display output data serving as the display content to the control interface.

The processor is further configured to, when executing the computer program, perform: if the controlled equipment is in a first running state or a second running state and the main control equipment obtains the input operation acting on the display content, controlling the controlled equipment to respond to the input operation through the central control equipment; or the like, or, alternatively,

if the controlled equipment is in a third running state and the main control equipment obtains the input operation acting on the display content, controlling the controlled equipment to respond to the input operation;

The processor is further configured to, when executing the computer program, perform: if the display content is appearance image data of the controlled equipment and the input operation is a starting operation of a physical starting key in the appearance image data, sending a starting instruction for the controlled equipment to the central control equipment through the first connection so that the central control equipment controls the controlled equipment to execute the starting operation based on the starting instruction;

or, if the display content is display output data of the controlled device and the input operation is a boot operation for a boot control in the display output data, sending a boot instruction for the controlled device to the central control device through the first connection, so that the central control device controls the controlled device to execute the boot operation based on the boot instruction; or the like, or, alternatively,

if the input operation is a starting operation of a virtual starting control related to the controlled equipment in the control interface, sending a starting instruction aiming at the controlled equipment to the central control equipment so that the central control equipment controls the controlled equipment to execute the starting operation based on the starting instruction;

The processor is further configured to, when executing the computer program, perform: if the display content is appearance image data of the controlled device and the input operation is a networking operation of a network card physical switch in the appearance image data, sending a networking instruction for the controlled device to the central control device through the first connection so that the central control device controls the controlled device to execute a network connection operation based on the networking instruction; or the like, or, alternatively,

if the display content is display output data about the controlled device and the input operation is a networking operation of a network card virtual switch in the display output data, sending a networking instruction for the controlled device to the central control device through the first connection so that the central control device controls the controlled device to execute a network connection operation based on the networking instruction; or the like, or, alternatively,

if the input operation is a networking operation which acts on a network state setting control of the controlled equipment in the control interface, sending a networking instruction aiming at the controlled equipment to the central control equipment through the first connection, so that the central control equipment controls the controlled equipment to execute a network connection operation based on the networking instruction; or the like, or, alternatively,

and if the input operation is the input operation of a networking instruction acting on the control interface, sending the networking instruction aiming at the controlled equipment to the central control equipment through the first connection so as to enable the central control equipment to control the controlled equipment to execute the network connection operation based on the networking instruction.

The processor is further configured to, when executing the computer program, perform: if the controlled equipment is switched from a network disconnection state to a network connection state, establishing a third connection between the main control equipment and the controlled equipment so as to control the controlled equipment to respond to input operation through the third connection, wherein the first connection and the second connection are in a disconnection state after the third connection is established; or the like, or, alternatively,

and if the controlled equipment is switched from the network disconnection state to the networking state and/or the controlled equipment is switched from the power-off state to the power-on state, adjusting the type of the second connection so as to control the controlled equipment to respond to the input operation in an adjusted connection mode.

The processor is further configured to, when executing the computer program, perform: and if the controlled equipment is switched from the network disconnection state to the networking state and/or the controlled equipment is switched from the power-off state to the power-on state, adjusting the running state of the central control equipment according to the determined adjustment strategy.

The processor is further configured to, when executing the computer program, perform: if a plurality of main control devices establish first connection with one central control device and one central control device establishes second connection with one controlled device, outputting display contents related to the controlled device on control interfaces of the plurality of main control devices;

Fig. 4 is a schematic structural component diagram of a main control device 400 in the present application, where the main control device may be a mobile phone, a computer, a digital broadcast terminal, an information transceiver device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like. The master device 400 shown in fig. 4 includes: at least one processor 401, memory 402, at least one network interface 404, and a user interface 403. The various components in master device 400 are coupled together by a bus system 405. It is understood that the bus system 405 is used to enable connection communication between these components. The bus system 405 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 405 in fig. 4.

The user interface 403 may include, among other things, a display, a keyboard, a mouse, a trackball, a click wheel, a key, a button, a touch pad, or a touch screen.

It will be appreciated that the memory 402 can be either volatile memory or nonvolatile memory, and can include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The memory 402 described in embodiments herein is intended to comprise, without being limited to, these and any other suitable types of memory.

The memory 402 in the embodiment of the present application is used to store various types of data to support the operation of the master device 400. Examples of such data include: any computer programs for operating on the main control device 400, such as an operating system 4021 and application programs 4022; contact data; telephone book data; a message; a picture; video, etc. The operating system 4021 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, and is configured to implement various basic services and process hardware-based tasks. The application 7022 may include various applications such as a Media Player (Media Player), a Browser (Browser), and the like, for implementing various application services. A program for implementing the method according to the embodiment of the present application may be included in the application 4022.

The method disclosed in the embodiments of the present application may be applied to the processor 701 or implemented by the processor 401. The processor 401 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 401. The Processor 401 described above may be a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. Processor 401 may implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present application. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium located in the memory 402, and the processor 401 reads the information in the memory 402 and performs the steps of the aforementioned methods in conjunction with its hardware.

In an exemplary embodiment, the main control Device 400 may be implemented by one or more Application Specific Integrated Circuits (ASICs), DSPs, Programmable Logic Devices (PLDs), Complex Programmable Logic Devices (CPLDs), Field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, Micro Controllers (MCUs), microprocessors (microprocessors), or other electronic components for performing the aforementioned methods.

In an exemplary embodiment, the present application further provides a computer-readable storage medium, such as a memory 402, including a computer program, which can be executed by the processor 401 of the main control device 400 to implement the steps of the foregoing method. The computer readable storage medium can be Memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface Memory, optical disk, or CD-ROM; or may be a variety of devices including one or any combination of the above memories, such as a mobile phone, computer, tablet device, personal digital assistant, etc.

A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, performs: if the master control device establishes a first connection with the central control device and the central control device establishes a second connection with the controlled device, outputting display content related to the controlled device on a control interface of the master control device;

The computer program, when executed by the processor, further performs: receiving image data which is sent by the central control equipment and is obtained by an image acquisition component of the central control equipment and is about the controlled equipment, and displaying and outputting the image data to the control interface as the display content, wherein the image data comprises display output data and/or appearance image data of the controlled equipment; or the like, or, alternatively,

The computer program, when executed by the processor, further performs: if the controlled equipment is in a first running state or a second running state and the main control equipment obtains the input operation acting on the display content, controlling the controlled equipment to respond to the input operation through the central control equipment; or the like, or, alternatively,

The computer program, when executed by the processor, further performs: if the display content is appearance image data of the controlled equipment and the input operation is a starting operation of a physical starting key in the appearance image data, sending a starting instruction for the controlled equipment to the central control equipment through the first connection so that the central control equipment controls the controlled equipment to execute the starting operation based on the starting instruction;

The computer program, when executed by the processor, further performs: if the display content is appearance image data of the controlled device and the input operation is a networking operation of a network card physical switch in the appearance image data, sending a networking instruction for the controlled device to the central control device through the first connection so that the central control device controls the controlled device to execute a network connection operation based on the networking instruction; or the like, or, alternatively,

The computer program, when executed by the processor, further performs: if the controlled equipment is switched from a network disconnection state to a network connection state, establishing a third connection between the main control equipment and the controlled equipment so as to control the controlled equipment to respond to input operation through the third connection, wherein the first connection and the second connection are in a disconnection state after the third connection is established; or the like, or, alternatively,

The computer program, when executed by the processor, further performs: and if the controlled equipment is switched from the network disconnection state to the networking state and/or the controlled equipment is switched from the power-off state to the power-on state, adjusting the running state of the central control equipment according to the determined adjustment strategy.

The computer program, when executed by the processor, further performs: if a plurality of main control devices establish first connection with one central control device and one central control device establishes second connection with one controlled device, outputting display contents related to the controlled device on control interfaces of the plurality of main control devices;

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

The methods disclosed in the several method embodiments provided in the present application may be combined arbitrarily without conflict to obtain new method embodiments.

Features disclosed in several of the product embodiments provided in the present application may be combined in any combination to yield new product embodiments without conflict.

The features disclosed in the several method or apparatus embodiments provided in the present application may be combined arbitrarily, without conflict, to arrive at new method embodiments or apparatus embodiments.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A control method, comprising:

2. The method of claim 1, outputting display content about the controlled device at a control interface of the master device, comprising:

receiving image data which is sent by the central control equipment and is obtained by an image acquisition component of the central control equipment and is about the controlled equipment, and displaying and outputting the image data to the control interface as the display content, wherein the image data comprises display output data and/or appearance image data of the controlled equipment; or the like, or, alternatively,

3. The method of claim 2, wherein controlling the controlled device in accordance with the determined control strategy in response to the input operation comprises:

if the controlled equipment is in a first running state or a second running state and the main control equipment obtains the input operation acting on the display content, controlling the controlled equipment to respond to the input operation through the central control equipment; or the like, or, alternatively,

4. The method of claim 3, wherein controlling, by the central control device, the controlled device in response to the input operation comprises:

5. The method of claim 3, wherein controlling, by the central control device, the controlled device in response to the input operation comprises:

if the display content is appearance image data of the controlled device and the input operation is a networking operation of a network card physical switch in the appearance image data, sending a networking instruction for the controlled device to the central control device through the first connection so that the central control device controls the controlled device to execute a network connection operation based on the networking instruction; or the like, or, alternatively,

6. The method of any of claims 1 to 5, further comprising:

if the controlled equipment is switched from a network disconnection state to a network connection state, establishing a third connection between the main control equipment and the controlled equipment so as to control the controlled equipment to respond to input operation through the third connection, wherein the first connection and the second connection are in a disconnection state after the third connection is established; or the like, or, alternatively,

7. The method of claim 6, further comprising:

8. The method of claim 1, further comprising:

9. The method of claim 2, receiving image data about the controlled device sent by the central control device obtained by its image acquisition component, comprising:

10. A control system, comprising: the system comprises a main control device, a central control device and a controlled device, wherein the main control device and the central control device establish a first connection; the central control equipment and the controlled equipment establish second connection; the first connection and the second connection are the same or different;