CN112260907A

CN112260907A - Cross-device control method, device and system

Info

Publication number: CN112260907A
Application number: CN202011003522.9A
Authority: CN
Inventors: 牛亮
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-07-01
Filing date: 2020-07-01
Publication date: 2021-01-22
Also published as: CN113890773A; WO2022002211A1

Abstract

The application is suitable for the technical field of smart home, and provides a cross-device control method, a device and a system, wherein the method comprises the following steps: when the distance between the first electronic device and the second electronic device meets a preset range condition, responding to a touch-and-dash operation triggered by a user aiming at the first electronic device or the second electronic device, and displaying an operation interface in a first area of a display interface of the first electronic device, wherein the operation interface is an interface corresponding to the second electronic device; in response to an operation instruction triggered by a user on an operation interface, the first electronic device controls the second electronic device to execute an operation corresponding to the operation instruction, the control interface displayed by the first electronic device can be utilized without an application program corresponding to the second electronic device, the second electronic device is controlled based on the operation instruction triggered by the user on the control interface, the process that the first electronic device controls the second electronic device can be reduced, and the efficiency and flexibility of the first electronic device in controlling the second electronic device are improved.

Description

Cross-device control method, device and system

Technical Field

The application relates to the technical field of smart home, in particular to a cross-device control method, device and system.

Background

Along with the continuous development of intelligent house, electronic equipment can touch with other electronic equipment (for example, intelligent stereo set) in the intelligent house to establish with other electronic equipment fast and be connected, make electronic equipment and other electronic equipment carry out the linkage, for example, electronic equipment can be connected with intelligent stereo set, through intelligent stereo set broadcast electronic equipment's music.

In the related art, taking an electronic device and an intelligent sound as an example, if a sensor of the electronic device detects a touch with the intelligent sound, the electronic device may search for and establish a Near Field Communication (NFC) connection with the intelligent sound, and play music currently played by the electronic device through the intelligent sound.

However, on the basis that the electronic device is connected to other electronic devices, the electronic device runs an application corresponding to the other electronic devices, and the subsequent electronic devices can control the other electronic devices through the running application according to the interface shown in fig. 1, which results in a complicated process for controlling the other electronic devices by the electronic devices.

Disclosure of Invention

The embodiment of the application provides a cross-device control method, a cross-device control device and a cross-device control system, and can solve the problem that the process of controlling intelligent household equipment by electronic equipment is complex.

In a first aspect, an embodiment of the present application provides a cross-device control method, including:

when the distance between first electronic equipment and second electronic equipment meets a preset range condition, responding to a touch-and-dash operation triggered by a user aiming at the first electronic equipment or the second electronic equipment, and displaying an operation interface in a first area of a display interface of the first electronic equipment, wherein the operation interface is an interface corresponding to the second electronic equipment;

and responding to an operation instruction triggered by the user on the operation interface, and controlling the second electronic equipment to execute the operation corresponding to the operation instruction by the first electronic equipment.

In a first possible implementation manner of the first aspect, the controlling, by the first electronic device, the second electronic device to execute an operation corresponding to the operation instruction includes:

and the first electronic equipment sends a control instruction to the second electronic equipment through a server communicated with the second electronic equipment, wherein the control instruction is used for instructing the second electronic equipment to execute the operation corresponding to the operation instruction.

Based on any one of the foregoing possible implementation manners of the first aspect, in a second possible implementation manner of the first aspect, before displaying an operation interface in a first area of a display interface of the first electronic device, the method further includes:

the first electronic equipment determines the equipment description information of the second electronic equipment;

and the first electronic equipment determines the operation interface according to the equipment description information.

Based on the second possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the displaying, by the first electronic device, an operation interface in a first area of a display interface of the first electronic device according to the device description information includes:

the first electronic equipment determines the application service of the second electronic equipment according to the equipment description information, wherein the application service is used for determining the operation interface;

and the first electronic equipment displays the operation interface in a first area of a display interface of the first electronic equipment after determining the operation interface according to the application service.

Based on the foregoing third possible implementation manner of the first aspect, in a fourth possible implementation manner of the first aspect, the determining, by the first electronic device, the application service of the second electronic device according to the device description information includes:

the first electronic equipment sends a request message to a server, wherein the request message is used for requesting an application service corresponding to the second electronic equipment;

the first electronic device receives the application service from the server.

Based on the second possible implementation manner of the first aspect, in a fifth possible implementation manner of the first aspect, before the first electronic device determines the device description information of the second electronic device, the method further includes:

the first electronic device establishes a close-range communication connection with the second electronic device in response to a touch-and-dash operation triggered by a user for the first electronic device or the second electronic device.

Based on the fifth possible implementation manner of the first aspect, in a sixth possible implementation manner of the first aspect, the close-range communication connection between the first electronic device and the second electronic device includes: one or more of a Near Field Communication (NFC) connection, a Bluetooth connection, or a wireless fidelity (Wi-Fi) network connection.

Based on any one of the foregoing possible implementation manners of the first aspect, in a seventh possible implementation manner of the first aspect, after the first electronic device controls the second electronic device to execute an operation corresponding to an operation instruction in response to the operation instruction triggered by the user on the operation interface, the method further includes:

the first electronic equipment receives a feedback result from the second electronic equipment for the operation instruction;

and the first electronic equipment updates the content displayed by the operation interface according to the feedback result.

In a second aspect, an embodiment of the present application provides a cross-device control apparatus, including:

the display module is used for responding to a touch-and-dash operation triggered by a user aiming at the first electronic equipment or the second electronic equipment when the distance between the first electronic equipment and the second electronic equipment meets a preset range condition, and displaying an operation interface in a first area of a display interface of the first electronic equipment, wherein the operation interface is an interface corresponding to the second electronic equipment;

and the communication module is used for responding to an operation instruction triggered by the user on the operation interface and controlling the second electronic equipment to execute the operation corresponding to the operation instruction.

In a first possible implementation manner of the second aspect, the communication module is further configured to send a control instruction to the second electronic device through a server in communication with the second electronic device, where the control instruction is used to instruct the second electronic device to execute an operation corresponding to the operation instruction.

Based on any one of the foregoing possible implementation manners of the second aspect, in a second possible implementation manner of the second aspect, the apparatus further includes:

the service execution module is used for determining the equipment description information of the second electronic equipment;

the service execution module is further configured to determine the operation interface according to the device description information.

Based on the second possible implementation manner of the second aspect, in a third possible implementation manner of the second aspect, the service execution module is further configured to determine an application service of the second electronic device according to the device description information, where the application service is used to determine the operation interface;

the display module is further configured to display the operation interface in a first area of a display interface of the first electronic device after determining the operation interface according to the application service.

Based on the foregoing third possible implementation manner of the second aspect, in a fourth possible implementation manner of the second aspect, the communication module is further configured to send a request message to a server, where the request message is used to request an application service corresponding to the second electronic device;

the communication module is further configured to receive the application service from the server.

Based on the second possible implementation manner of the second aspect, in a fifth possible implementation manner of the second aspect, the communication module is further configured to establish a near field communication connection with the second electronic device in response to a touch-and-dash operation triggered by a user for the first electronic device or the second electronic device.

Based on the fifth possible implementation manner of the second aspect, in a sixth possible implementation manner of the second aspect, the close-range communication connection between the first electronic device and the second electronic device includes: one or more of a Near Field Communication (NFC) connection, a Bluetooth connection, or a wireless fidelity (Wi-Fi) network connection.

Based on any one of the foregoing possible implementation manners of the second aspect, in a seventh possible implementation manner of the second aspect, the communication module is further configured to receive a feedback result from the second electronic device for the operation instruction;

and the display module is further used for updating the content displayed by the operation interface according to the feedback result.

In a third aspect, an embodiment of the present application provides a cross-device control system, including: the system comprises a first electronic device, a server and a second electronic device;

when the distance between first electronic equipment and second electronic equipment meets a preset range condition, the first electronic equipment responds to a touch-and-dash operation triggered by a user aiming at the first electronic equipment or the second electronic equipment, and displays an operation interface in a first area of a display interface of the first electronic equipment, wherein the operation interface is an interface corresponding to the second electronic equipment;

the first electronic device responds to an operation instruction triggered on the operation interface and sends a control instruction to the server, wherein the control instruction is used for indicating the second electronic device to execute an operation corresponding to the operation instruction;

the server forwards the control instruction to the second electronic equipment;

and the second electronic equipment executes the operation corresponding to the operation instruction according to the control instruction.

In a fourth aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor, when executing the computer program, implements the cross-device control method according to any one of the above first aspects.

In a fifth aspect, the present application provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the computer program implements the cross-device control method according to any one of the above first aspects.

In a sixth aspect, an embodiment of the present application provides a computer program product, which, when run on an electronic device, causes the electronic device to execute the cross-device control method described in any one of the above first aspects.

In a seventh aspect, an embodiment of the present application provides a chip system, where the chip system includes a memory and a processor, and the processor executes a computer program stored in the memory to implement the cross-device control method according to any one of the above first aspects.

The chip system can be a single chip or a chip module consisting of a plurality of chips.

According to the cross-device control method provided by the application, when the distance between the first electronic device and the second electronic device meets the preset range condition, in response to a touch-touch operation triggered by a user aiming at the first electronic device or the second electronic device, an operation interface corresponding to the second electronic device is displayed in a first area of a display interface of the first electronic device, in response to an operation instruction triggered by the user on the operation interface, the first electronic device can control the second electronic device to execute the operation corresponding to the operation instruction, compared with the control of the second electronic device realized after the first electronic device runs an application program corresponding to the second electronic device, the control method can utilize the control interface displayed by the first electronic device without passing the application program corresponding to the second electronic device, and realizes the control of the second electronic device based on the operation instruction triggered by the user on the control interface, therefore, the process that the first electronic device controls the second electronic device can be reduced, and the efficiency and the flexibility of controlling the second electronic device by the first electronic device are improved.

Drawings

Fig. 1 is a schematic interface diagram of an electronic device running an application corresponding to another electronic device in the prior art provided by an embodiment of the present application;

fig. 2 is a schematic diagram of a system architecture to which a cross-device control method provided in an embodiment of the present application is applicable;

fig. 3 is a schematic diagram of a system architecture to which another cross-device control method provided in the embodiment of the present application is applicable;

fig. 4 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

FIG. 5 is a schematic flow chart of a cross-device control method provided in an embodiment of the present application;

fig. 6 is a schematic view of a display operation interface of a first electronic device according to an embodiment of the present disclosure;

fig. 7 is a flowchart illustrating displaying an operation interface in a first area of a display interface of a first electronic device according to an embodiment of the present application;

fig. 8 is a software architecture diagram of a first electronic device according to an embodiment of the present application;

fig. 9 is a schematic diagram of an intelligent audio and operation interface provided in an embodiment of the present application;

FIG. 10 is a schematic diagram of an air conditioner and operation interface according to an embodiment of the present disclosure;

FIG. 11a is a schematic view of an operation interface for song cutting according to an embodiment of the present disclosure;

FIG. 11b is a schematic view of another operation interface for song cutting according to the embodiment of the present application;

fig. 12 is a block diagram of a cross-device control apparatus according to an embodiment of the present disclosure;

fig. 13 is a block diagram of another cross-device control apparatus according to an embodiment of the present disclosure;

fig. 14 is a block diagram of a structure of another cross-device control apparatus according to an embodiment of the present application.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

The terminology used in the following examples is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of this application and the appended claims, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, such as "one or more", unless the context clearly indicates otherwise. It should also be understood that in the embodiments of the present application, "one or more" means one, two, or more than two; "and/or" describes the association relationship of the associated objects, indicating that three relationships may exist; for example, a and/or B, may represent: a alone, both A and B, and B alone, where A, B may be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

The cross-device control method provided by the embodiment of the application can be applied to electronic devices such as a mobile phone, a tablet computer, a wearable device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), and the like, and the specific type of the electronic device is not limited in any way in the embodiment of the application.

By way of example and not limitation, when the electronic device is a wearable device, the wearable device may also be a generic term for intelligently designing daily wear, developing wearable devices, such as glasses, gloves, watches, clothing, shoes, and the like, by applying wearable technology. A wearable device is a portable device that is worn directly on the body or integrated into the clothing or accessories of the user. The wearable device is not only a hardware device, but also realizes powerful functions through software support, data interaction and cloud interaction. The generalized wearable intelligent device has the advantages that the generalized wearable intelligent device is complete in function and large in size, can realize complete or partial functions without depending on a smart phone, such as a smart watch or smart glasses, and only is concentrated on a certain application function, and needs to be matched with other devices such as the smart phone for use, such as various smart bracelets for monitoring physical signs, smart jewelry and the like.

Referring to fig. 2, fig. 2 is a schematic diagram of a system architecture to which a cross-device control method provided in an embodiment of the present application is applicable, where the system architecture may include: a first electronic device 10, a server 20 and a second electronic device 30.

The server 20 is connected with the first electronic device 10 and the second electronic device 30 respectively, and both the first electronic device 10 and the second electronic device 30 can perform data interaction with the server 20. The first electronic device 10 has a near field communication connection with the second electronic device 30. The close range communication connection between the first electronic device and the second electronic device may include: one or more of a Near Field Communication (NFC) connection, a Bluetooth connection, or a wireless fidelity (Wi-Fi) network connection.

The first electronic device 10 in the embodiment of the present application may display an operation interface of the second electronic device 30. Of course, the first electronic device 10 may send a control instruction to the second electronic device 30 based on an operation performed by the user on the operation interface, in addition to displaying the operation interface of the second electronic device 30. On the one hand, if the server 20 is included in the above system, the first electronic device 10 may transmit a control instruction to the second electronic device 30 through the server 20. On the other hand, if the server 20 is not included in the above system, the control command sent from the first electronic device 10 to the second electronic device 30 may not need to be relayed through the server 20.

Moreover, the server 20 has registration information of the second electronic device and an application service corresponding to the second electronic device. Thereafter, the first electronic device 10 may request the application service from the server 20 and display an operation interface of the second electronic device 30 on the first electronic device 10 according to the application service.

Referring to fig. 3 in conjunction with fig. 2, taking a first electronic device as a mobile phone and a second electronic device as an intelligent sound device as an example, fig. 3 is a schematic diagram of a system architecture applicable to another cross-device control method provided in the embodiment of the present application, where the system architecture may include: handset 310, server 320, and smart sound 330.

Among them, the mobile phone 310 may include: the system comprises a display module, a user operation module, a service execution module and a communication module. The display module is used for displaying an interface of the mobile phone 310 and an operation interface for controlling the smart audio 330, the user operation module is used for detecting a control operation triggered by the user operation interface, the service execution module is used for controlling the mobile phone 310 to execute an action of displaying and updating the operation interface, and the communication module is used for performing data interaction with the server 320 and the smart audio 330.

Also, smart sound 330 may include: the system comprises a user operation module, a service execution module and a communication module. The user operation module is used for detecting the operation triggered by the user on the smart sound box 330, the service execution module is used for executing the corresponding operation according to the operation triggered by the user or the instruction sent by the server 320, and the communication module is used for performing data interaction with the mobile phone 310 or the server 320.

It should be noted that, the above description is only given by taking the first electronic device as the mobile phone 310 and the second electronic device as the smart audio, but in practical applications, the first electronic device may also be a tablet computer, a PDA, or other electronic devices convenient for being held by hand, and the second electronic device may also be a television, an intelligent electric lamp, an intelligent soymilk maker, an air conditioner, or other electronic devices, and the first electronic device and the second electronic device are not limited in this embodiment of the application.

In the embodiment of the application, the second electronic device may have a display screen or may not have a display screen, but no matter whether the second electronic device has a display screen, a user may implement management on the second electronic device by means of the display screen of the first electronic device.

Fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device 400 may be a desktop, laptop, tablet, or handheld computer, and may also correspond to a computing device such as a cellular phone, PDA, dedicated media player, consumer electronic device, and so forth. The electronic device may be the first electronic device or the second electronic device, which is not limited in this application. The electronic device 400 includes:

a processor may control the reception and manipulation of input and output data between components of an operating system of the electronic device. The processor is used for determining an application service corresponding to the second electronic device.

The communication module is used for connecting the electronic device 400 to the internet and enabling data communication with a server deployed on the internet, and data interaction between the application service and the server is performed through the communication module, for example, the communication module is used for sending content input by the user, acquired by the input device, to the server. The communication module in the scheme can be used for requesting an application service corresponding to the second electronic device from the server, receiving the application service sent by the server, sending an operation instruction triggered by a user to the server, and receiving a feedback result, forwarded by the server, of the second electronic device for the operation instruction feedback.

A memory, which may be coupled to the processor, for storing operating system, application information, etc., for use by the electronic device 400. The memory may include Read Only Memory (ROM), Random Access Memory (RAM), etc., and the information may also reside on removable storage media, including SD memory cards, and be loaded or installed onto the computer system as needed. In the scheme, the memory is used for storing the device description information and the application service of the second electronic device.

And the display equipment is connected with the processor and used for receiving and displaying the processing result returned by the processor. Display devices typically have a Graphical User Interface (GUI) that provides an easy-to-use user interface between a user of the computer system and the operating system or application running thereon.

And the input device is connected with the processor and used for receiving the operation input by the user. The input device may be a touch pad or touch screen placed on or in front of the display device and may be based on various sensing technologies including, but not limited to, capacitive sensing, resistive sensing, surface acoustic wave sensing, pressure sensing, light sensing, and the like. The touchpad or touchscreen may be integrated with the display device or may be a separate component. The input device may be a single point or a multi-point input device. In the scheme, the input device is used for receiving control operation of a user.

The near field sensing equipment can be an NFC module, a BT module or a Wi-Fi module, and is used for establishing near field communication connection between the first electronic equipment and the second electronic equipment. For example, when a user performs a collision operation, the near-field sensing device may send a device search signal for searching for smart home devices near the electronic device 400, and receive response signals fed back by the smart home devices, so that the electronic device may obtain the device search signal and the response signals, and identify the smart home device that collides with the electronic device 400 by analyzing a time search between the device search signal and the response signals, thereby establishing the near-field communication connection between the first electronic device and the second electronic device.

Fig. 5 is a schematic flowchart of a cross-device control method provided in an embodiment of the present application, and by way of example and not limitation, the method may be applied to the first electronic device, and referring to fig. 5, the method includes:

step 501, when the distance between the first electronic device and the second electronic device meets a preset range condition, responding to a touch-and-dash operation triggered by a user aiming at the first electronic device or the second electronic device, and displaying an operation interface in a first area of a display interface of the first electronic device.

The preset range condition may be that the distance between the first electronic device and the second electronic device is less than or equal to a distance threshold, and the distance threshold may be adjusted according to different modules corresponding to the near-field sensing device of the first electronic device. For example, if the near field sensing device is an NFC module, the distance threshold may be 1 cm; if the near field sensing device is a BT module, the distance threshold may be 10 meters; if the near-field sensing device is a Wi-Fi module, the distance threshold may be set for the number of routers in the local area network and the arrangement position, and the distance threshold is not limited in the embodiment of the present application.

Moreover, the first touch operation may be a touch operation occurring between the first electronic device and the second electronic device, or may be an operation of the user to approach the second electronic device triggered by the first electronic device or an operation of the user to approach the first electronic device triggered by the second electronic device when the distance between the first electronic device and the second electronic device satisfies the range condition, or may also be a shake operation of the user to trigger the first electronic device or the second electronic device when the distance between the first electronic device and the second electronic device satisfies the range condition, of course, the first touch operation may also be an operation of the other first electronic device or the second electronic device, which can sense and is used to establish a near field communication connection between the first electronic device and the second electronic device, and the first touch operation is not limited in the embodiment of the present application.

In addition, the operation interface is an interface corresponding to the second electronic device, and the operation interface may include a plurality of controls. The first electronic device can detect a control operation triggered by a user on the operation interface, so that the first electronic device can control the second electronic device according to the control operation. The operation interface corresponding to the second electronic device is generated according to the application service corresponding to the second electronic device.

It should be noted that the display interface of the first electronic device may be an interface displayed by the first electronic device to a user, the first area in the display interface may be a preset area, and the position of the first area may also be adjusted in the display interface according to an operation triggered by the user.

For example, referring to fig. 6, if the second electronic device is a smart audio, the operation interface 62 corresponding to the smart audio may be displayed in the first area of the display interface 61 of the first electronic device. The operation interface 62 can move in the display interface 61 according to an operation triggered by the user, and the first area of the display interface 61 changes accordingly.

It should be noted that, in practical applications, the display interface of the first electronic device may be displayed through a display screen integrated with the first electronic device, or may be displayed through an external display screen connected to the first electronic device. For example, if the first electronic device is a mobile phone, a display interface of the mobile phone may be displayed through a screen of the mobile phone; if the first electronic device is a computer, the interface of the computer can be displayed through a display connected with the computer host.

In addition, the user may not trigger the control operation on the operation interface displayed by the first electronic device, and then the first electronic device may not perform step 502 any more, and only display the operation interface corresponding to the second electronic device to the user, so that the user may know the information corresponding to the second electronic device according to the operation interface.

Further, the operation interface may also include only the information of the second electronic device, but not the control, for example, the operation interface may only include information of a name, a model, a remaining power, and the like of the smart audio, and the content included in the operation interface is not limited in the embodiment of the present application.

That is, after the first electronic device finishes performing step 502, step 503 is not performed any more, and only the operation interface corresponding to the second electronic device is displayed to the user, so that the user does not trigger a control instruction on the operation interface, and the first electronic device does not control the second electronic device according to the operation instruction triggered by the user.

Step 502, in response to an operation instruction triggered by a user on an operation interface, the first electronic device controls the second electronic device to execute an operation corresponding to the operation instruction.

The operation instruction may be generated by the first electronic device according to a control operation triggered by the user on the operation interface, and the control operation may be a click operation, a sliding operation, or a dragging operation triggered by the user on the operation interface.

After the first electronic device displays the operation interface, when the first electronic device detects a control operation triggered by a user on the operation interface, the first electronic device may generate an operation instruction corresponding to the control operation according to the control operation, and control the second electronic device through the operation instruction, so that the second electronic device may execute the corresponding operation. The first electronic equipment can control the second electronic equipment without starting an application program corresponding to the second electronic equipment, and the efficiency and the flexibility of controlling the second electronic equipment are improved.

In the process that the first electronic device controls the second electronic device, the first electronic device may generate and send a control instruction to the server in response to an operation instruction triggered on the operation interface, the server may forward the control instruction to the second electronic device, and the second electronic device may execute a corresponding operation according to the control instruction, so as to implement control of the first electronic device on the second electronic device.

For example, still taking the example that the second electronic device is an intelligent sound device as an example for description, the first electronic device may control the intelligent sound device to control the play mode, the played song, and the play pause of the song through a triggered click operation; the first electronic equipment can control the intelligent sound equipment to adjust the progress of the played song through triggered sliding operation; the first electronic device can adjust the position of the operation interface displayed in the first electronic device through the triggered dragging operation.

To sum up, according to the cross-device control method provided in the embodiment of the present application, when the distance between the first electronic device and the second electronic device meets the preset range condition, in response to the touch-and-touch operation triggered by the user for the first electronic device or the second electronic device, the operation interface corresponding to the second electronic device is displayed in the first area of the display interface of the first electronic device, in response to the operation instruction triggered by the user in the operation interface, the first electronic device may control the second electronic device to execute the operation corresponding to the operation instruction, compared with the case where the first electronic device implements the control over the second electronic device by running the application corresponding to the second electronic device, the application program corresponding to the second electronic device is not needed, the control interface displayed by the first electronic device can be utilized, based on the operation instruction triggered by the user in the control interface, the control of the second electronic equipment is realized, so that the process that the first electronic equipment controls the second electronic equipment can be reduced, and the efficiency and the flexibility of controlling the second electronic equipment by the first electronic equipment are improved.

Moreover, by displaying the operation interface of the second electronic device on the first electronic device, for the second electronic device without a display screen, it is convenient for a user to clarify content corresponding to the second electronic device (for example, content currently being played by the second electronic device or temperature adjustment operation being performed by the second electronic device) according to the operation interface of the second electronic device displayed on the first electronic device, or to perform related operation on the operation interface of the second electronic device displayed on the first electronic device, so that control over the second electronic device is realized, and convenience in controlling the second electronic device is improved.

Referring to fig. 7, fig. 7 is a flowchart illustrating the first electronic device performing step 501, and as shown in fig. 7, step 501 may include: step 501a, step 501b and step 501 c.

Step 501a, in response to a touch-and-dash operation triggered by a user for a first electronic device or a second electronic device, the first electronic device establishes a near field communication connection with the second electronic device.

The first electronic device may detect a touch-and-dash operation triggered by a user on the first electronic device, and if the touch-and-dash operation triggered by the first electronic device is detected, a near field sensing device of the first electronic device may establish a near field communication connection with the second electronic device, so that in a subsequent step, the first electronic device may obtain device description information of the second electronic device through the near field communication connection.

The near field sensing device of the first electronic device can establish a near field communication connection with the second electronic device in a Wi-Fi, Bluetooth or NFC mode. Correspondingly, the near field communication connection between the first electronic device and the second electronic device may be a near field communication NFC connection, a bluetooth connection, or a wireless fidelity Wi-Fi network connection, which is not limited in this embodiment of the present application.

For example, when the near field sensing device is a bluetooth module, a user may trigger a collision operation between the first electronic device and the second electronic device for the first electronic device, the first electronic device may send a device search signal and receive a response signal fed back by each second electronic device, distances between each second electronic device and the first electronic device are different, and times required for receiving the device search signal and sending the response signal to the first electronic device are also different, the first electronic device may determine the second electronic device closest to the first electronic device according to times of receiving each response signal, and the second electronic device closest to the first electronic device is the second electronic device colliding with the first electronic device, so that the first electronic device may establish a near field communication connection with the determined second electronic device.

When the near field sensing device comprises a Wi-Fi module and an NFC module or a Bluetooth module, a user can trigger a collision operation between the first electronic device and the second electronic device to the first electronic device, then the first electronic device can acquire the MAC address of the second electronic device through the NFC module or the Bluetooth module, and then the MAC address of the second electronic device is sent to a local area network router of the intelligent home system, so that the router can pull the second electronic device into the local area network, and near field communication connection is achieved through Wi-Fi.

It should be noted that, when the connection is established through the bluetooth module or the Wi-Fi module, the first electronic device may start the bluetooth function or the Wi-Fi function according to an operation triggered by a user, so that the near field communication connection may be established with the second electronic device through the started function. If the first electronic device does not start the Bluetooth function or the Wi-Fi function, the connection cannot be established through the Bluetooth module or the Wi-Fi module.

Step 501b, the first electronic device determines device description information of the second electronic device.

The device description information is used to describe the second electronic device, and the device description information may include one or more fields describing the second electronic device.

For example, it is exemplified that the device description information of the second electronic device includes a first field, a second field, and a third field, where the first field may represent an identity of a manufacturer of the second electronic device. The first electronic device may determine, according to the identity of the manufacturer, a data processing module (e.g., APP Router Service) capable of processing the device description information inside the first electronic device. The second field may be an identifier of an operation interface corresponding to the second electronic device. The first electronic device may determine, according to the second field, an application service corresponding to the second electronic device. The third field is for identifying an identity of the second electronic device. For example, the third field may be a physical address (e.g., an Internet Protocol (IP) address and/or a Media Access Control (MAC) address) of the second electronic device, and the first electronic device may initialize the application service according to the third field. Of course, the device description information may further include other fields describing the second electronic device, which is not limited in this embodiment of the application.

If the first electronic device and the second electronic device have established the near field communication connection, which indicates that the first electronic device may perform data interaction with the second electronic device, the first electronic device may determine device description information of the second electronic device based on the near field communication connection between the first electronic device and the second electronic device. That is, the first electronic device may send a request message to the second electronic device, the second electronic device may feed back the device description information to the second electronic device according to the request message, and the first electronic device may receive the device description information, thereby obtaining the device description information of the second electronic device.

Specifically, the first electronic device may send a request to the second electronic device, where the request is used to request the second electronic device for device description information of the second electronic device, and the second electronic device may feed back pre-stored device description information to the first electronic device according to the request.

Accordingly, after the first electronic device sends the request to the second electronic device, the first electronic device may wait for and receive the device description information fed back by the second electronic device. However, if the first electronic device does not receive the device description information sent by the second electronic device within the preset time length, it is indicated that the first electronic device may not establish the near field communication connection with the second electronic device, or the second electronic device may not receive the request sent by the first electronic device, and then the first electronic device may prompt the user that the device description information acquisition fails, and may not control the second electronic device.

It should be noted that the first electronic device may acquire the device description information of the second electronic device in different manners according to different near-field sensing devices. For example, when the near field sensing device of the first electronic device is an NFC module, and in a process that the NFC sensing area of the first electronic device is close to the NFC tag of the second electronic device, if the NFC of the first electronic device scans the NFC tag of the second electronic device, information of the NFC tag, that is, device description information of the second electronic device, may be acquired.

However, when the near field sensing device of the first electronic device is a bluetooth module, the first electronic device may send an information request to the second electronic device in a bluetooth communication manner. The second electronic device may receive the information request, and feed back device description information of the second electronic device to the first electronic device according to the information request. The first electronic device may then receive the device description information sent by the second electronic device.

And when the near field sensing equipment of the first electronic equipment is a Wi-Fi module, the first electronic equipment can send an information request to a router in a local area network through a Wi-Fi wireless network, and the information request is forwarded to the second electronic equipment through the router. The second electronic device may receive the information request forwarded by the router, feed back device description information of the second electronic device to the route according to the information request, and forward the information request to the first electronic device through the router. The first electronic device may then receive the device description information of the second electronic device forwarded by the router.

Step 501c, the first electronic device determines and displays an operation interface in a first area of a display interface of the first electronic device according to the device description information.

The first electronic device may determine whether the first electronic device has the application service corresponding to the second electronic device according to the description information, so as to obtain the application service corresponding to the second electronic device from a local storage space or a server of the first electronic device according to the determination result, and determine and show an operation interface of the second electronic device to a user by running the application service corresponding to the second electronic device.

The application service is used for determining an operation interface, that is, for displaying an operation interface corresponding to the second electronic device. The application service may be pre-stored in the first electronic device, or may be obtained by the first electronic device requesting the server, and the embodiment of the present application does not limit the manner in which the first electronic device obtains the application service.

Also, the application service may include interface information for displaying the operation interface. In the process of displaying the operation interface, the application service may determine, according to the interface information, each control included in the operation interface, a position of each control, and information corresponding to the second electronic device, and then may generate the second electronic device.

For example, the interface information may include one or more interface elements. Taking the second electronic device as an example of the smart audio, the one or more elements may include a plurality of controls such as a play mode, a previous song, a play/pause, a next song, whether to display lyrics, and a progress bar. The first electronic device can obtain an operation interface corresponding to the second electronic device according to the interface information. The description in the prior art may be referred to for a process of how to obtain an operation interface corresponding to the second electronic device according to the interface information, which is not limited in this embodiment of the present application.

In addition, the first electronic device may detect a control operation triggered by the user on the operation interface, and control the second electronic device according to the detected control operation. For example, still taking the example that the second electronic device is an intelligent sound box as an example, the operation interface of the intelligent sound box may include: the intelligent sound box comprises a plurality of controls such as a play mode, a previous song, play/pause, a next song, whether lyrics are displayed or not, a progress bar and the like, and a user can realize control over the intelligent sound box by clicking each control in an operation interface.

Optionally, the first electronic device may determine an application service of the second electronic device according to the device description information, and then display the operation interface in the first area of the display interface of the first electronic device after determining the operation interface according to the application service.

The first electronic device may include a plurality of hardware such as a processor and a memory, and during the operation of the processor, a plurality of functional modules stored in the memory may be operated to determine whether the memory of the first electronic device has an application service corresponding to the second electronic device.

The first electronic device may have an operating system, a data processing module, and a message distribution module therein, and the message distribution module may include at least one distribution module. The data processing module is used for reading the device description information, and the distribution module is used for starting the application service corresponding to the second electronic device and sending information for configuring and initializing the application service to the application service.

In addition, each distribution module may correspond to at least one service application. For example, referring to fig. 8, the first electronic device is provided with 3 distribution modules, where distribution module 1 may correspond to application service a and application service B, distribution module 2 may correspond to application service C, and distribution module 3 may correspond to application service D. If the application service corresponding to the second electronic device is the application service C, the first electronic device may start and initialize the application service C through the distribution module 2, and then may display the operation interface corresponding to the second electronic device through the running application service C.

It should be noted that, in practical applications, both the data processing module and the distribution module of the first electronic device may belong to the same software functional module, or may belong to different software functional modules, which is not limited in this embodiment of the present application. For example, both the data processing module and the distribution module of the first electronic device may belong to an APP Router Service of the first electronic device.

In a possible implementation manner, the operating system of the first electronic device may read a preset field of the device description information, obtain an identifier of a manufacturer of the second electronic device, determine the manufacturer of the second electronic device, compare the identifier of the manufacturer with the identifier of the manufacturer of the first electronic device, and determine whether the first electronic device and the second electronic device belong to the same manufacturer.

If the second electronic device and the first electronic device belong to the same manufacturer, the device description information may be sent to a preset data processing module, and if the second electronic device and the first electronic device belong to different manufacturers, the device description information may be sent to a data processing module corresponding to the manufacturer of the second electronic device.

For example, the manufacturer of the first electronic device is a, and if the manufacturer of the second electronic device is also a, the first electronic device may send device description information to the pre-stored data processing module; if the manufacturer of the second electronic device is B, the first electronic device may send device description information to the data processing module corresponding to B; if the manufacturer of the second electronic device is C, the first electronic device may send device description information to the data processing module corresponding to C.

Then, the data processing module of the first electronic device may read the other fields in the device description information, except for the identity identifying the manufacturer, one by one, determine the application service corresponding to the second electronic device, and obtain configuration information for initializing the application service, so as to start the application service and display an operation interface through the application service.

Further, in the process of acquiring the application service by the first electronic device, the first electronic device may first search whether the application service is stored, and if the application service is stored, the first electronic device may start the application service through the distribution module and initialize the application service through the device description information of the second electronic device.

The following will respectively describe the manner in which the first electronic device obtains the application service of the second electronic device a:

in the mode a, the first electronic device has application services of the second electronic devices. For example, the first electronic device has therein device description information of the respective second electronic devices, and an application service associated with each device description information. After the first electronic device acquires the device description information of the second electronic device a, the first electronic device may determine the application service of the second electronic device a from the application services of the second electronic devices. And then the first electronic equipment displays an operation interface of the second electronic equipment a according to the application service of the second electronic equipment a.

In the mode b, the current smart home scene further includes other first electronic devices (such as a computer, a notebook computer, a tablet computer, or the like) which can store the application service, and after the first electronic device obtains the device description information of the second electronic device a, the first electronic device can request the application service of the second electronic device a from the other first electronic devices, and obtain the application service according to the request.

It should be noted that if the first electronic device obtains the application service of the second electronic device a in the above manner a, the system architecture shown in fig. 1 may not include the server.

However, if the first electronic device does not have the application service of the second electronic device, the first electronic device may request the server for the application service corresponding to the second electronic device according to the device description information. Optionally, the first electronic device may send a request message to the server, and the first electronic device may further receive an application service from the server, where the request message is used to request an application service corresponding to the second electronic device, and the request message may carry device description information of the second electronic device.

For example, if the first electronic device does not have an application service of the second electronic device, the first electronic device may generate a request message according to the device description information and send the request message to the server. The server may receive the request message, determine an application service corresponding to the second electronic device according to the device description information in the request message, and send the application service corresponding to the second electronic device to the first electronic device. Correspondingly, the first electronic device may receive the application service corresponding to the second electronic device sent by the server, so as to achieve acquisition of the application service.

It should be noted that the device description information of the second electronic device, acquired by the first electronic device, may include an address of the server, and the first electronic device may request, according to the device description information, the server for the application service corresponding to the second electronic device. Moreover, the application service corresponding to the second electronic device may also include the address of the server, and then in the process of controlling the second electronic device by the subsequent first electronic device, the first electronic device may control the second electronic device according to the address in the application service.

And then, the first electronic device may run the application service, generate an operation interface of the second electronic device through the application service in combination with interface information included in the application service, and display the operation interface in a first area of a display interface of the first electronic device, so that the first electronic device may control the second electronic device through the operation interface.

It should be noted that, in practical applications, not only the controls but also information related to linkage between the second electronic device and the first electronic device may be displayed in the operation interface of the first electronic device, for example, if the second electronic device is an intelligent audio, the operation interface may also display a name of a song currently being played by the intelligent audio, lyrics, and a singer.

Referring to fig. 9, fig. 9 shows a display interface 92 displayed by the smart audio 91 and the first electronic device, where the display interface 92 may include an operation interface 921, and the operation interface 921 may include: a plurality of controls such as a play mode 921a, a previous song 921b, a play/pause 921c, a next song 921d, whether to display lyrics 921e, and a progress bar 921 f; moreover, the operation interface 921 may also display the model 921g of the intelligent sound, the name 921h of the song currently being played, and the artist 921i of the song; finally, the operation interface 921 may also display the image of the artist of the song or the cover 921j and the lyrics 921k of the album to which the song belongs.

In addition, the operation interface 921 may further include a sound projection control 921m, where the sound projection control 921m is used to adjust an audio data source played by the smart audio 91. For example, in the process that the first electronic device controls the smart sound 91, the smart sound 91 defaults to play with audio data provided by the server, if it is detected that the user triggers the operation on the projection control 921m, the audio data may be sent to the smart sound 91 through the first electronic device, the smart sound 91 may play the audio data provided by the first electronic device, and meanwhile, the first electronic device may also send a control instruction to the smart sound 91 through the operation interface 921, and no longer forwards the control instruction through the server.

It should be noted that, in the process of playing the audio data provided by the first electronic device with the smart audio, the first electronic device may establish a connection with the second electronic device in a near field communication manner and interact with the second electronic device, which is not described herein again.

The first electronic device determines whether the application service needs to be requested from the server or not by searching whether the application service corresponding to the second electronic device is stored in advance or not according to the searching result, and if the application service is stored in advance, the application service can not be requested from the server any more, so that the efficiency and the flexibility of controlling the second electronic device by the first electronic device are improved.

Moreover, the first electronic device can adjust the data source of the second electronic device according to the user triggering operation, so that the second electronic device can be linked according to the data source provided by the server or the first electronic device, and the flexibility of controlling the second electronic device by the first electronic device is improved.

For example, if the second electronic device is an air conditioner, the operation interface may further display a current state of the air conditioner, such as whether the air conditioner is currently operating, adjusting the temperature, the operating mode, and the blowing direction. Referring to fig. 10, fig. 10 illustrates a display interface 102 displayed by a first electronic device, where the display interface 102 may include an operation interface 1021 of an air conditioner, and the operation interface 1021 may include: the air conditioner control system comprises a power supply 1021a, a temperature rise 1021b, a temperature drop 1021c, a work mode 1021d, a blowing direction 1021e and other controls, and the type 1021f of the air conditioner, a target temperature 1021g and a current indoor temperature 1021h can be displayed in an operation interface 1021.

In addition, in the process of establishing connection between the first electronic device and the second electronic device, the first electronic device can be connected with the second electronic device through the Bluetooth module or the Wi-Fi module without depending on the NFC module, so that the flexibility of establishing connection between the first electronic device and the second electronic device is improved.

It should be noted that, in the process of the first electronic device executing step 503, the first electronic device sends a control instruction to the second electronic device through the server in communication with the second electronic device, where the control instruction is used to instruct the second electronic device to execute an operation corresponding to the operation instruction.

Further, after the second electronic device executes the corresponding operation, an execution result indicating that the execution is completed may be fed back to the server, and the server may forward the execution result to the first electronic device, so that the first electronic device may receive a feedback result of the second electronic device to the control instruction from the server, and may update the operation interface according to the feedback result.

For example, referring to fig. 11a and 11b, fig. 11a and 11b show a change situation of an operation interface displayed by a first electronic device according to a song cutting operation triggered by a user, after the first electronic device establishes a connection with an intelligent sound, as shown in fig. 11a, the interface shown in fig. 11a may be displayed in the operation interface of a second electronic device displayed by the first electronic device, a song "P" is currently being played, and lyrics "ABCDEFG" and artist "Q" of the song "O" are displayed, if a control operation in a click form triggered by the user on a next song control is detected, the first electronic device may generate a control instruction for playing a next song according to the control operation, a server may forward the control instruction to the intelligent sound, and the intelligent sound may switch to play the next song according to the control instruction.

Correspondingly, after the intelligent sound equipment switches to play the next song, the intelligent sound equipment may forward the execution result to the server, and the server may forward the execution result to the first electronic device, referring to fig. 11b, the first electronic device may update the operation interface to play the song "R" and update the lyric "HIJKLMN" and the singer "T" of the song "R" according to the execution result, and may also update the progress bar at the same time.

Further, the first electronic device may further control the second electronic device to start playing or stop playing according to a click operation triggered by the user on the play/pause control, and similarly, the first electronic device may control the first electronic device to display lyrics in the operation interface according to a click operation triggered by the user on whether to display the lyrics control; the first electronic equipment can control the playing progress of the second electronic equipment according to the sliding operation triggered by the user on the progress bar control; the first electronic device can adjust the play mode of the second electronic device according to at least one click operation triggered by the user on the play mode control.

It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

Fig. 12 is a block diagram of a cross-device control apparatus provided in the embodiment of the present application, and only a part related to the embodiment of the present application is shown for convenience of description.

Referring to fig. 12, the apparatus includes:

the display module 1201 is configured to, when a distance between the first electronic device and the second electronic device meets a preset range condition, respond to a touch-and-dash operation triggered by a user for the first electronic device or the second electronic device, and display an operation interface in a first area of a display interface of the first electronic device, where the operation interface is an interface corresponding to the second electronic device;

the communication module 1202 is configured to, in response to an operation instruction triggered by the user on the operation interface, control the second electronic device to execute an operation corresponding to the operation instruction.

Optionally, the communication module 1202 is further configured to send a control instruction to the second electronic device through a server in communication with the second electronic device, where the control instruction is used to instruct the second electronic device to execute an operation corresponding to the operation instruction.

Optionally, referring to fig. 13, the apparatus further includes:

a service execution module 1203, configured to determine device description information of the second electronic device;

the service execution module 1203 is further configured to determine the operation interface according to the device description information.

Optionally, the service execution module 1203 is further configured to determine an application service of the second electronic device according to the device description information, where the application service is used to determine an operation interface;

the display module 1201 is further configured to, after determining the operation interface according to the application service, display the operation interface in a first area of a display interface of the first electronic device.

Optionally, the communication module 1202 is further configured to send a request message to the server, where the request message is used to request an application service corresponding to the second electronic device;

the communication module 1202 is further configured to receive an application service from a server.

Optionally, the communication module 1202 is further configured to establish a near field communication connection with the second electronic device in response to a touch-and-dash operation triggered by the user for the first electronic device or the second electronic device.

Optionally, the close-range communication connection between the first electronic device and the second electronic device includes: one or more of a Near Field Communication (NFC) connection, a Bluetooth connection, or a wireless fidelity (Wi-Fi) network connection.

Optionally, the communication module 1202 is further configured to receive a feedback result from the second electronic device for the operation instruction;

the display module 1201 is further configured to update the content displayed on the operation interface according to the feedback result.

Optionally, referring to fig. 14, the apparatus further comprises:

and the user operation module 1204 is configured to detect the control operation triggered on the operation interface.

To sum up, according to the cross-device control apparatus provided in the embodiment of the present application, when the distance between the first electronic device and the second electronic device satisfies the preset range condition, in response to the touch-and-touch operation triggered by the user for the first electronic device or the second electronic device, the operation interface corresponding to the second electronic device is displayed in the first area of the display interface of the first electronic device, in response to the operation instruction triggered by the user in the operation interface, the first electronic device may control the second electronic device to execute the operation corresponding to the operation instruction, compared with the case where the first electronic device implements the control over the second electronic device by running the application corresponding to the second electronic device, the application program corresponding to the second electronic device is not needed, the control interface displayed by the first electronic device can be utilized, based on the operation instruction triggered by the user in the control interface, the control of the second electronic equipment is realized, so that the process that the first electronic equipment controls the second electronic equipment can be reduced, and the efficiency and the flexibility of controlling the second electronic equipment by the first electronic equipment are improved.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described system embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the processes in the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium and can implement the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer readable medium may include at least: any entity or apparatus capable of carrying computer program code to a terminal device, recording medium, computer Memory, Read-Only Memory (ROM), Random-Access Memory (RAM), electrical carrier wave signals, telecommunications signals, and software distribution medium. Such as a usb-disk, a removable hard disk, a magnetic or optical disk, etc. In certain jurisdictions, computer-readable media may not be an electrical carrier signal or a telecommunications signal in accordance with legislative and patent practice.

The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.

Claims

1. A cross-device control method, comprising:

responding to an operation instruction triggered by a user on the operation interface, and controlling the second electronic device to execute an operation corresponding to the operation instruction by the first electronic device, wherein the operation instruction is generated by the first electronic device according to a control operation triggered by the user on the operation interface, and the control operation is a click operation, a sliding operation or a dragging operation triggered by the user on the operation interface.

2. The method according to claim 1, wherein the first electronic device controls the second electronic device to perform an operation corresponding to the operation instruction, and the method includes:

3. The method according to any one of claims 1-2, wherein before displaying the operation interface in the first area of the display interface of the first electronic device, the method further comprises:

4. The method of claim 3, wherein displaying an operation interface in a first area of a display interface of the first electronic device comprises:

5. The method of claim 4, wherein the determining, by the first electronic device, the application service of the second electronic device according to the device description information comprises:

the first electronic device receives the application service from the server.

6. The method of claim 3, wherein prior to the first electronic device determining device description information for the second electronic device, the method further comprises:

7. The method of claim 6, wherein the close-range communication connection between the first electronic device and the second electronic device comprises: one or more of a Near Field Communication (NFC) connection, a Bluetooth connection, or a wireless fidelity (Wi-Fi) network connection.

8. The method according to any one of claims 1 to 7, wherein after the first electronic device controls the second electronic device to execute an operation corresponding to an operation instruction triggered by a user on the operation interface, the method further includes:

9. The method according to any one of claims 1 to 8, wherein a control is displayed in the operation interface of the first electronic device, and information related to linkage between the second electronic device and the first electronic device is also displayed.

10. The method according to any one of claims 1 to 8, wherein the operation interface only includes information of the second electronic device and does not include a control.

11. The method according to any one of claims 1 to 10, wherein the touch-and-bump operation is a touch operation occurring between the first electronic device and the second electronic device, or an operation triggered by a user to approach the second electronic device when a distance between the first electronic device and the second electronic device satisfies a range condition, or an operation triggered by the user to approach the first electronic device when the distance between the first electronic device and the second electronic device satisfies a range condition, or a shake-and-shake operation triggered by the user to the first electronic device or the second electronic device when the distance between the first electronic device and the second electronic device satisfies a range condition.

12. The method according to any one of claims 3 to 11, wherein the device description information of the second electronic device comprises a first field, a second field and a third field, wherein the first field represents a manufacturer of the second electronic device, the second field represents an identifier of an operation interface corresponding to the second electronic device, and the third field represents an identifier for identifying the second electronic device.

13. The method according to any one of claims 3 to 11, wherein the device description information of the second electronic device further includes an address of a server, and the first electronic device requests the server for an application service corresponding to the second electronic device according to the device description information; the application service corresponding to the second electronic device also comprises the address of the server, and the first electronic device controls the second electronic device according to the address in the application service.

14. The method according to any one of claims 1 to 13, wherein the second electronic device is an intelligent sound device, and the first electronic device controls the intelligent sound device to control a play mode, a played song and a play pause of the song through a triggered click operation; the first electronic equipment controls the intelligent sound box to adjust the progress of the played song through triggered sliding operation; the first electronic device adjusts the position of the operation interface displayed in the first electronic device through triggered dragging operation.

15. The method according to any one of claims 1 to 13, wherein the second electronic device is an air conditioner, and the operation interface displays a current state of the air conditioner, wherein the current state of the air conditioner includes: whether the air conditioner works, a power supply, heating, cooling, a working mode or a blowing direction is currently determined, or the type of the air conditioner, a target temperature or a current indoor temperature is displayed.

16. An inter-device control apparatus, comprising:

the communication module is configured to control the second electronic device to execute an operation corresponding to an operation instruction in response to the operation instruction triggered by the user on the operation interface, where the operation instruction is generated by the first electronic device according to a control operation triggered by the user on the operation interface, and the control operation is a click operation, a sliding operation, or a dragging operation triggered by the user on the operation interface.

17. An inter-device control system, comprising: a first electronic device, a second electronic device;

the first electronic device responds to an operation instruction triggered on the operation interface, and sends a control instruction to the second electronic device, wherein the control instruction is used for instructing the second electronic device to execute an operation corresponding to the operation instruction;

and the second electronic equipment executes the operation corresponding to the operation instruction according to the control instruction, wherein the operation instruction is generated by the first electronic equipment according to the control operation triggered by the user on the operation interface, and the control operation is click operation, sliding operation or dragging operation triggered by the user on the operation interface.

18. An electronic device, comprising: a processor for executing a computer program stored in a memory to implement the method of any one of claims 1 to 16.

19. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 16.