WO2022002211A1

WO2022002211A1 - Cross-device control method, apparatus, and system

Info

Publication number: WO2022002211A1
Application number: PCT/CN2021/104067
Authority: WO
Inventors: 牛亮
Original assignee: 华为技术有限公司
Priority date: 2020-07-01
Filing date: 2021-07-01
Publication date: 2022-01-06
Also published as: CN113890773A; CN112260907A

Abstract

The present application is applicable to the technical field of smart home, and provides a cross-device control method, apparatus, and system. The method comprises: when the distance between a first electronic device and a second electronic device satisfies a preset range condition, in response to a touch operation triggered by a user for the first electronic device or the second electronic device, displaying an operation interface on a first area of a display interface of the first electronic device, the operation interface being an interface corresponding to the second electronic device; and in response to an operation instruction triggered by the user at the operation interface, controlling, by the first electronic device, the second electronic device to execute an operation corresponding to the operation instruction. According to the present application, by using a control interface displayed in a first electronic device, a second electronic device can be controlled on the basis of an operation instruction triggered by a user on the control interface, without using an application program corresponding to the second electronic device, so that the processes of controlling the second electronic device by the first electronic device can be reduced, and the efficiency and flexibility of controlling the second electronic device by the first electronic device are improved.

Description

Cross-device control method, device and system

This application claims the priority of the Chinese patent application with the application number 202010621325.7 and the application title "Cross-device control method, device and system" submitted to the State Intellectual Property Office on July 1, 2020, the entire contents of which are incorporated by reference in in this application.

technical field

The present application relates to the field of smart home technology, and in particular, to a cross-device control method, device, and system.

Background technique

With the continuous development of smart homes, electronic devices can touch other electronic devices (for example, smart speakers) in the smart home, so as to quickly establish connections with other electronic devices, so that electronic devices can be linked with other electronic devices, for example, The electronic device can be connected with the smart speaker, and the music of the electronic device can be played through the smart speaker.

In the related art, taking electronic devices and smart speakers as examples, if the sensor of the electronic device detects a touch with the smart speakers, the electronic device can search for and establish a near field communication (NFC) connection with the smart speakers, and then Play the music that the electronic device is currently playing through the smart speaker.

However, on the basis of establishing a connection between the electronic device and other electronic devices, the electronic device runs an application program corresponding to the other electronic device, and the subsequent electronic device can control other electronic devices through the running application program according to the interface shown in Figure 1. equipment, resulting in a more complicated process for electronic equipment to control other electronic equipment.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a cross-device control method, device, and system, which can solve the problem that the electronic device controls the smart home device in a complicated process.

In a first aspect, an embodiment of the present application provides a cross-device control method, including:

When the distance between the first electronic device and the second electronic device satisfies the preset range condition, in response to a touch operation triggered by the user on the first electronic device or the second electronic device, at the first electronic device A first area of a display interface of an electronic device displays an operation interface, and the operation interface is an interface corresponding to the second electronic device;

In response to an operation instruction triggered by the user on the operation interface, the first electronic device controls the second electronic device to perform an operation corresponding to the operation instruction.

In a first possible implementation manner of the first aspect, the first electronic device controls the second electronic device to perform the operation corresponding to the operation instruction, including:

The first electronic device sends a control instruction to the second electronic device through a server in communication with the second electronic device, where the control instruction is used to instruct the second electronic device to perform an operation corresponding to the operation instruction.

Based on any one of the possible implementation manners of the first aspect, in a second possible implementation manner of the first aspect, before the operation interface is displayed in the first area of the display interface of the first electronic device, the The method also includes:

The first electronic device determines device description information of the second electronic device;

The first electronic device determines the operation interface according to the device description information.

Based on the above-mentioned second possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the first electronic device, according to the device description information, displays on the display of the first electronic device The first area of the interface displays the operation interface, including:

The first electronic device determines an application service of the second electronic device according to the device description information, where the application service is used to determine the operation interface;

After the first electronic device determines the operation interface according to the application service, the operation interface is displayed in the first area of the display interface of the first electronic device.

Based on the third possible implementation manner of the first aspect, in a fourth possible implementation manner of the first aspect, the first electronic device determines the application of the second electronic device according to the device description information Services, including:

The first electronic device sends a request message to the server, where the request message is used to request an application service corresponding to the second electronic device;

The first electronic device receives the application service from the server.

Based on the second possible implementation manner of the first aspect, in a fifth possible implementation manner of the first aspect, before the first electronic device determines the device description information of the second electronic device, the method further includes :

In response to a user-triggered tap operation on the first electronic device or the second electronic device, the first electronic device establishes a proximity communication connection with the second electronic device.

Based on the fifth possible implementation manner of the first aspect, in a sixth possible implementation manner of the first aspect, the short-range communication connection between the first electronic device and the second electronic device includes: One or more of a Near Field Communication NFC connection, a Bluetooth connection or a Wi-Fi network connection.

Based on any one of the above possible implementation manners of the first aspect, in a seventh possible implementation manner of the first aspect, in response to an operation instruction triggered by a user on the operation interface, the first electronic device controls After the second electronic device performs the operation corresponding to the operation instruction, the method further includes:

receiving, by the first electronic device, a feedback result for the operation instruction from the second electronic device;

The first electronic device updates the content displayed on the operation interface according to the feedback result.

In a second aspect, an embodiment of the present application provides a cross-device control device, including:

A display module, used for responding to a touch operation triggered by a user on the first electronic device or the second electronic device when the distance between the first electronic device and the second electronic device satisfies a preset range condition , displaying an operation interface in the first area of the display interface of the first electronic device, where the operation interface is an interface corresponding to the second electronic device;

The communication module is configured to control the second electronic device to perform the operation corresponding to the operation instruction in response to the operation instruction triggered by the user on the operation interface.

In a first possible implementation manner of the second aspect, the communication module is further configured to send a control instruction to the second electronic device through a server that communicates with the second electronic device, where the control instruction is used for The second electronic device is instructed to perform the operation corresponding to the operation instruction.

Based on any one of the foregoing possible implementations of the second aspect, in a second possible implementation of the second aspect, the apparatus further includes:

a service execution module, configured to determine the device description information of the second electronic device;

The service execution module is further configured to determine the operation interface according to the device description information.

Based on the second possible implementation manner of the second aspect, in a third possible implementation manner of the second aspect, the service execution module is further configured to determine the second electronic device according to the device description information an application service of the device, where the application service is used to determine the operation interface;

The display module is further configured to display the operation interface in the first area of the display interface of the first electronic device after determining the operation interface according to the application service.

Based on the third possible implementation manner of the second aspect, in a fourth possible implementation manner of the second aspect, the communication module is further configured to send a request message to the server, where the request message is used to request all the application service corresponding to the second electronic device;

The communication module is further configured to receive the application service from the server.

Based on the second possible implementation manner of the second aspect, in a fifth possible implementation manner of the second aspect, the communication module is further configured to The touch operation triggered by the second electronic device establishes a short-range communication connection with the second electronic device.

Based on the fifth possible implementation manner of the second aspect, in a sixth possible implementation manner of the second aspect, the short-range communication connection between the first electronic device and the second electronic device includes: One or more of a Near Field Communication NFC connection, a Bluetooth connection or a Wi-Fi network connection.

Based on any one of the above possible implementation manners of the second aspect, in a seventh possible implementation manner of the second aspect, the communication module is further configured to receive an operation instruction from the second electronic device feedback results;

The display module is further configured to update the content displayed on the operation interface according to the feedback result.

In a third aspect, an embodiment of the present application provides a cross-device control system, including: a first electronic device, a server, and a second electronic device;

When the distance between the first electronic device and the second electronic device satisfies the preset range condition, the first electronic device responds to a touch triggered by the user on the first electronic device or the second electronic device operation, displaying an operation interface in the first area of the display interface of the first electronic device, and the operation interface is an interface corresponding to the second electronic device;

The first electronic device sends a control instruction to the server in response to an operation instruction triggered on the operation interface, where the control instruction is used to instruct the second electronic device to perform an operation corresponding to the operation instruction;

the server forwards the control instruction to the second electronic device;

The second electronic device executes the operation corresponding to the operation instruction according to the control instruction.

In a fourth aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, when the processor executes the computer program The cross-device control method according to any one of the above first aspects is implemented.

In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, any one of the above-mentioned first aspects is implemented. The described cross-device control method.

In a sixth aspect, an embodiment of the present application provides a computer program product that, when the computer program product runs on an electronic device, enables the electronic device to execute the cross-device control method described in any one of the first aspects above.

In a seventh aspect, an embodiment of the present application provides a chip system, the chip system includes a memory and a processor, and the processor executes a computer program stored in the memory to implement any one of the first aspects above The described cross-device control method.

Wherein, the chip system may be a single chip or a chip module composed of multiple chips.

In the cross-device control method provided by the present application, when the distance between the first electronic device and the second electronic device satisfies the preset range condition, in response to a touch triggered by the user on the first electronic device or the second electronic device operation, display the operation interface corresponding to the second electronic device in the first area of the display interface of the first electronic device, and in response to the operation instruction triggered by the user on the operation interface, the first electronic device can control the second electronic device to execute the corresponding operation instruction. Operation, compared with the control of the second electronic device by the first electronic device after running the application program corresponding to the second electronic device, the present application can utilize the displayed information of the first electronic device without the application program corresponding to the second electronic device. The control interface realizes the control of the second electronic device based on the operation instructions triggered by the user on the control interface, thus reducing the flow of the first electronic device controlling the second electronic device and improving the efficiency of the first electronic device controlling the second electronic device and flexibility.

Description of drawings

1 is a schematic interface diagram of an electronic device running an application program corresponding to other electronic devices in the prior art provided by an embodiment of the present application;

2 is a schematic diagram of a system architecture to which a cross-device control method provided by an embodiment of the present application is applicable;

3 is a schematic diagram of a system architecture to which another cross-device control method provided by an embodiment of the present application is applicable;

4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

5 is a schematic flowchart of a cross-device control method provided by an embodiment of the present application;

6 is a schematic diagram of a first electronic device displaying an operation interface provided by an embodiment of the present application;

7 is a schematic flowchart of displaying an operation interface in a first area of a display interface of a first electronic device according to an embodiment of the present application;

8 is a software architecture diagram of a first electronic device provided by an embodiment of the present application;

9 is a schematic diagram of a smart audio and an operation interface provided by an embodiment of the present application;

10 is a schematic diagram of an air conditioner and an operation interface provided by an embodiment of the present application;

11a is a schematic diagram of an operation interface when a song is cut provided by an embodiment of the present application;

11b is a schematic diagram of an operation interface when another song cutting provided by an embodiment of the present application;

12 is a structural block diagram of a cross-device control device provided by an embodiment of the present application;

13 is a structural block diagram of another cross-device control apparatus provided by an embodiment of the present application;

FIG. 14 is a structural block diagram of another cross-device control apparatus provided by an embodiment of the present application.

detailed description

In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are set forth in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

The terms used in the following embodiments are for the purpose of describing particular embodiments only, and are not intended to be limitations of the present application. As used in the specification of this application and the appended claims, the singular expressions "a," "an," "the," "above," "the," and "the" are intended to also Expressions such as "one or more" are included unless the context clearly dictates otherwise. It should also be understood that, in this embodiment of the present application, "one or more" refers to one, two or more; "and/or", which describes the association relationship of associated objects, indicates that there may be three kinds of relationships; for example, A and/or B can mean that A exists alone, A and B exist simultaneously, and B exists independently, wherein A and B can be singular or plural. The character "/" generally indicates that the associated objects are an "or" relationship.

The cross-device control method provided by the embodiments of the present application can be applied to mobile phones, tablet computers, wearable devices, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (personal digital assistants, etc.) PDA) and other electronic devices, the embodiments of the present application do not impose any restrictions on the specific types of the electronic devices.

As an example but not a limitation, when the electronic device is a wearable device, the wearable device may also be a general term for the intelligent design of daily wear and the development of wearable devices by applying wearable technology, such as glasses, gloves, Watches, clothing and shoes, etc. A wearable device is a portable device that is worn directly on the body or integrated into the user's clothing or accessories. Wearable device is not only a hardware device, but also realizes powerful functions through software support, data interaction, and cloud interaction. In a broad sense, wearable smart devices include full-featured, large-scale, complete or partial functions without relying on smart phones, such as smart watches or smart glasses, and only focus on a certain type of application function, which needs to be used in conjunction with other devices such as smart phones. , such as various types of smart bracelets and smart jewelry that monitor physical signs.

Referring to FIG. 2 , FIG. 2 is a schematic diagram of a system architecture applicable to a cross-device control method provided by an embodiment of the present application. The system architecture may include: a first electronic device 10 , a server 20 , and a second electronic device 30 .

The server 20 has connections with the first electronic device 10 and the second electronic device 30 respectively, and both the first electronic device 10 and the second electronic device 30 can perform data interaction with the server 20 . There is a near field communication connection between the first electronic device 10 and the second electronic device 30 . The near field communication connection between the first electronic device and the second electronic device may include one or more of a near field communication (NFC) connection, a Bluetooth connection, or a Wi-Fi network connection.

The first electronic device 10 in the embodiment of the present application may display an operation interface of the second electronic device 30 . Of course, in addition to displaying the operation interface of the second electronic device 30, the first electronic device 10 may also send a control instruction to the second electronic device 30 based on the user's operation on the operation interface. On the one hand, if the above-mentioned system includes the server 20 , the first electronic device 10 can send a control instruction to the second electronic device 30 through the server 20 . On the other hand, if the server 20 is not included in the above system, the control instruction sent by the first electronic device 10 to the second electronic device 30 may not need to be relayed through the server 20 .

Moreover, the server 20 has registration information of the second electronic device and application services corresponding to the second electronic device. Afterwards, the first electronic device 10 may request the application service from the server 20, and display the operation interface of the second electronic device 30 on the first electronic device 10 according to the application service.

2 , referring to FIG. 3 , taking the first electronic device as a mobile phone and the second electronic device as a smart speaker as an example, FIG. 3 is a schematic diagram of a system architecture to which another cross-device control method provided by an embodiment of the present application is applicable. The system architecture may include: a mobile phone 310 , a server 320 and a smart speaker 330 .

The mobile phone 310 may include: a display module, a user operation module, a service execution module and a communication module. The display module is used to display the interface of the mobile phone 310 and the operation interface used to control the smart speaker 330, the user operation module is used to detect the control operation triggered by the user operation interface, and the service execution module is used to control the mobile phone 310 to perform the action of displaying and updating the operation interface , the communication module is used for data interaction with the server 320 and the smart speaker 330 .

Moreover, the smart speaker 330 may include: a user operation module, a service execution module and a communication module. The user operation module is used to detect the operation triggered by the user on the smart speaker 330 , the service execution module is used to execute the corresponding operation according to the operation triggered by the user or the instruction sent by the server 320 , and the communication module is used to carry out the operation with the mobile phone 310 or the server 320 . Data interaction.

It should be noted that the above description is only based on the case where the first electronic device is a mobile phone 310 and the second electronic device is a smart speaker. The second electronic device may also be a TV, a smart lamp, a smart soymilk maker, an air conditioner, or other electronic devices, and the embodiments of the present application do not limit the first electronic device and the second electronic device.

In this embodiment of the present application, the second electronic device may or may not have a display screen, but regardless of whether the second electronic device has a display screen, the user can manage the second electronic device with the help of the display screen of the first electronic device.

FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The electronic device 400 may be a desktop, laptop, tablet, or handheld computer, and may also correspond to computing devices such as cellular telephones, PDAs, dedicated media players, consumer electronic devices, and the like. The electronic device may be the above-mentioned first electronic device, or may be the second electronic device, which is not limited in this application. The electronic device 400 includes:

A processor that controls the receipt and manipulation of input and output data between components of the electronic device's operating system. In this case, the processor is used to determine the application service corresponding to the second electronic device.

The communication module is used to connect the electronic device 400 to the Internet and perform data communication with the server deployed on the Internet. The data interaction between the application service and the server is through the communication module. For example, the communication module is used to send data to the server obtained by the input device. to the user input. In this case, the communication module can be used to request the server for the application service corresponding to the second electronic device and receive the application service sent by the server. The feedback result of the device in response to the operation command.

A memory, which may be connected to the processor, for storing operating system, application program information, etc. used by the electronic device 400 . Memory may include read only memory (ROM), random access memory (RAM), etc. Information may also reside on removable storage media, including SD memory cards, and be loaded or installed on a computer system when needed . In this solution, the memory is used to store device description information and application services of the second electronic device.

The display device is connected with the processor, and is used for receiving the processing result returned by the processor and displaying it. Display devices typically have a graphical user interface (GUI) that provides an easy-to-use user interface between a user of a computer system and an operating system or application running on it.

An input device, connected to the processor, is used to receive user input operations. The input device may be a touch pad or touch screen placed on or before the display device, and may be based on various sensing technologies, including but not limited to capacitive sensing, resistive sensing, surface acoustic wave sensing, pressure sensing, light sensing, and the like. The touchpad or touchscreen may be integrated with the display device or may be a separate component. The input device may be a single-point or multi-point input device. In this solution, the input device is used to receive the user's control operation.

A near-field sensing device, the near-field sensing device can be an NFC module, a BT module or a Wi-Fi module, and the near-field sensing device is used for the first electronic device to establish a short-range communication connection with the second electronic device. For example, when the user performs a touch operation, the near-field sensing device will send a device search signal to find smart home devices near the electronic device 400, and receive response signals fed back by each smart home device, then the electronic device can obtain the device Search for the signal and the response signal, and identify the smart home device that touches the electronic device 400 by analyzing the time between the device's search signal and the response signal, thereby establishing a close proximity between the first electronic device and the second electronic device. Distance communication connection.

FIG. 5 is a schematic flowchart of a cross-device control method provided by an embodiment of the present application. As an example and not a limitation, the method can be applied to the above-mentioned first electronic device. Referring to FIG. 5 , the method includes:

Step 501: When the distance between the first electronic device and the second electronic device satisfies the preset range condition, in response to the touch operation triggered by the user for the first electronic device or the second electronic device, in the first electronic device The first area of the display interface displays the operation interface.

The preset range condition may be that the distance between the first electronic device and the second electronic device is less than or equal to a distance threshold, and the distance threshold may be adjusted according to different modules corresponding to the near-field sensing device of the first electronic device. For example, if the near-field sensing device is an NFC module, the distance threshold can be 1 cm; if the near-field sensing device is a BT module, the distance threshold can be 10 meters; if the near-field sensing device is a Wi-Fi module group, the distance threshold may be set for the number and arrangement of routers in the local area network, and the distance threshold is not limited in this embodiment of the present application.

Moreover, the touch operation may be a touch operation that occurs between the first electronic device and the second electronic device, or it may be that when the distance between the first electronic device and the second electronic device satisfies the range condition, the user The operation triggered by the electronic device to approach the second electronic device, or the operation triggered by the user to the second electronic device to approach the first electronic device, can also be when the distance between the first electronic device and the second electronic device satisfies the range condition, The shaking operation triggered by the user on the first electronic device or the second electronic device, of course, the touching operation can also be sensed by other first electronic devices or second electronic devices and used to establish the relationship between the first electronic device and the second electronic device. The short-range communication connection operation between the two electronic devices does not limit the touch-to-touch operation in this embodiment of the present application.

In addition, the operation interface is an interface corresponding to the second electronic device, and the operation interface may include multiple controls. The first electronic device can detect the control operation triggered by the user on the operation interface, so that the first electronic device can control the second electronic device according to the control operation. The operation interface corresponding to the second electronic device is generated according to the application service corresponding to the second electronic device.

It should be noted that the display interface of the first electronic device may be an interface displayed by the first electronic device to the user, the first area in the display interface may be a preset area, and the position of the first area may also be based on an operation triggered by the user Make adjustments in the display interface.

For example, referring to FIG. 6 , if the second electronic device is a smart speaker, an operation interface 62 corresponding to the smart speaker may be displayed in the first area of the display interface 61 of the first electronic device. The operation interface 62 can be moved in the display interface 61 according to the operation triggered by the user, and the first area of the display interface 61 changes accordingly.

It should be noted that, in practical applications, the display interface of the first electronic device may be displayed through a display screen integrated with the first electronic device, or may be displayed through an external display screen connected to the first electronic device. For example, if the first electronic device is a mobile phone, the display interface of the mobile phone can be displayed on the screen of the mobile phone; if the first electronic device is a computer, the interface of the computer can be displayed on a display connected to the computer host.

In addition, the user may not trigger the control operation on the operation interface displayed by the first electronic device, then the first electronic device may not perform step 502, and only display the operation interface corresponding to the second electronic device to the user, so that the user can follow the operation according to the operation interface. The interface acquires information corresponding to the second electronic device.

Further, the operation interface may only include the information of the second electronic device, but not the controls. For example, the operation interface may only include information such as the name, model, and remaining power of the smart speaker. The content is not limited.

That is, after the first electronic device completes step 501, it does not perform step 502, and only displays the operation interface corresponding to the second electronic device to the user. The second electronic device is controlled according to the operation instruction triggered by the user.

Step 502: In response to the operation instruction triggered by the user on the operation interface, the first electronic device controls the second electronic device to perform the operation corresponding to the operation instruction.

The operation instruction may be generated by the first electronic device according to a control operation triggered by the user on the operation interface, and the control operation may be a click operation, a sliding operation or a dragging operation triggered by the user on the operation interface. Not limited.

After the first electronic device displays the operation interface, when the first electronic device detects a control operation triggered by the user on the operation interface, the first electronic device can generate an operation instruction corresponding to the control operation according to the control operation, and use the operation instruction to generate an operation instruction corresponding to the control operation. The second electronic device is controlled so that the second electronic device can perform corresponding operations. The first electronic device can control the second electronic device without opening an application program corresponding to the second electronic device, which improves the efficiency and flexibility of controlling the second electronic device.

During the process of the first electronic device controlling the second electronic device, the first electronic device may generate and send the control command to the server in response to the operation command triggered on the operation interface, and the server may forward the control command to the second electronic device, and the first electronic device may The second electronic device can perform corresponding operations according to the control instruction, so as to realize the control of the second electronic device by the first electronic device.

For example, still taking the second electronic device as an example of a smart speaker for illustration, the first electronic device can control the smart speaker to control the playback mode, the song played and the playback pause of the song through a triggered click operation; the first electronic device can Through the triggered sliding operation, the smart speaker is controlled to adjust the progress of the song being played; the first electronic device can adjust the displayed position of the operation interface in the first electronic device through the triggered drag operation.

To sum up, in the cross-device control method provided by the embodiments of the present application, when the distance between the first electronic device and the second electronic device satisfies the preset range condition, in response to the user targeting the first electronic device or the second electronic device The touch operation triggered by the electronic device displays the operation interface corresponding to the second electronic device in the first area of the display interface of the first electronic device. In response to the operation instruction triggered by the user on the operation interface, the first electronic device can control the second electronic device. The electronic device executes the operation corresponding to the operation instruction. Compared with the control of the second electronic device by the first electronic device after running the application program corresponding to the second electronic device, the present application does not need to pass the application program corresponding to the second electronic device. Using the control interface displayed by the first electronic device, based on the operation instructions triggered by the user on the control interface, the control of the second electronic device is realized, so the process of controlling the second electronic device by the first electronic device can be reduced, and the first electronic device can be improved. Efficiency and flexibility in controlling the second electronic device.

Moreover, by displaying the operation interface of the second electronic device on the first electronic device, for the second electronic device without a display screen, it is convenient for the user to identify the first electronic device according to the operation interface of the second electronic device displayed on the first electronic device. The content corresponding to the second electronic device (such as the content currently being played by the second electronic device or the temperature adjustment operation being performed by the second electronic device), or it is convenient for the user to execute on the operation interface of the second electronic device displayed on the first electronic device The related operation realizes the control of the second electronic device and improves the convenience of controlling the second electronic device.

Referring to FIG. 7, FIG. 7 is a schematic flowchart of the first electronic device performing step 501. As shown in FIG. 7, step 501 may include: step 501a, step 501b, and step 501c.

Step 501a, in response to a touch operation triggered by the user on the first electronic device or the second electronic device, the first electronic device establishes a short-range communication connection with the second electronic device.

The first electronic device can detect the touch operation triggered by the user on the first electronic device, and if the touch operation triggered by the first electronic device is detected, it can communicate with the second electronic device through the near-field sensing device of the first electronic device. The device establishes a short-range communication connection, so that in a subsequent step, the first electronic device can obtain the device description information of the second electronic device through the short-range communication connection.

Wherein, the near-field sensing device of the first electronic device may establish a short-range communication connection with the second electronic device by means of Wi-Fi, Bluetooth or NFC. Correspondingly, the short-range communication connection between the first electronic device and the second electronic device may be a near-field communication NFC connection, a Bluetooth connection, or a Wi-Fi network connection, which is not limited in this embodiment of the present application.

For example, when the near-field sensing device is a Bluetooth module, the user can trigger a touch operation between the first electronic device and the second electronic device on the first electronic device, then the first electronic device can send a device search signal, and Receive the response signal fed back by each second electronic device, and the distance between each second electronic device and the first electronic device is different, and the time required for the receiving device to search for the signal and send the response signal to the first electronic device is also different, then the first electronic device is different. An electronic device can determine the second electronic device that is closest to the first electronic device according to the moment of receiving each response signal, and the second electronic device that is closest to the first electronic device is the second electronic device that touches the first electronic device. , the first electronic device can establish a near field communication connection with the determined second electronic device.

When the near-field sensing device includes a Wi-Fi module, and includes an NFC module or a Bluetooth module, the user can trigger the touch operation between the first electronic device and the second electronic device on the first electronic device, then the first electronic device An electronic device can first obtain the MAC address of the second electronic device through the NFC module or the Bluetooth module, and then send the MAC address of the second electronic device to the local area network router of the smart home system, so that the router can pull the second electronic device into the local area network. , so as to realize the near field communication connection through Wi-Fi.

It should be noted that when the connection is established through the Bluetooth module or the Wi-Fi module, the first electronic device can first enable the Bluetooth function or the Wi-Fi function according to the operation triggered by the user, so that the enabled function can communicate with the second electronic device. The device establishes a near field communication connection. If the first electronic device does not have the Bluetooth function or the Wi-Fi function turned on, the connection cannot be established through the Bluetooth module or the Wi-Fi module.

Step 501b, the first electronic device determines the device description information of the second electronic device.

The device description information is used to describe the second electronic device, and the device description information may include one or more fields describing the second electronic device.

For example, the device description information of the second electronic device includes a first field, a second field and a third field for illustration, where the first field may represent the identity of the manufacturer of the second electronic device. The first electronic device may determine, according to the identity of the manufacturer, a data processing module (such as an APP Router Service) inside the first electronic device that can process the device description information. The second field may be the identifier of the operation interface corresponding to the second electronic device. The first electronic device may determine the application service corresponding to the second electronic device according to the second field. The third field is used to identify the identity of the second electronic device. For example, the third field may be a physical address (such as an internet protocol (IP) address and/or a medium access control (MAC) address) of the second electronic device, and the first electronic device may field to initialize the application service. Certainly, the device description information may also include other fields describing the second electronic device, which are not limited in this embodiment of the present application.

If the first electronic device and the second electronic device have established a short-range communication connection, it means that the first electronic device can perform data interaction with the second electronic device. The short-range communication connection between the two electronic devices determines the device description information of the second electronic device. That is, the first electronic device can send a request message to the second electronic device, the second electronic device can feed back the device description information to the second electronic device according to the request message, and the first electronic device can receive the device description information, thereby Obtain device description information of the second electronic device.

Specifically, the first electronic device may send a request to the second electronic device for requesting the device description information of the second electronic device from the second electronic device, and the second electronic device may, according to the request, feed back advance information to the first electronic device Stored device description information.

Correspondingly, after sending the request to the second electronic device, the first electronic device can wait for and receive the device description information fed back by the second electronic device. However, if the first electronic device does not receive the device description information sent by the second electronic device within the preset period of time, it means that the first electronic device may not have established a short-range communication connection with the second electronic device, or the second electronic device may not have established a short-range communication connection. If the device does not receive the request sent by the first electronic device, the first electronic device may remind the user that the acquisition of the device description information fails and cannot control the second electronic device.

It should be noted that the first electronic device may acquire the device description information of the second electronic device in different ways according to different near-field sensing devices. For example, when the near-field sensing device of the first electronic device is an NFC module, when the NFC sensing area of the first electronic device is close to the NFC tag of the second electronic device, if the NFC of the first electronic device scans the second electronic device device NFC tag, the information of the NFC tag can be obtained, that is, the device description information of the second electronic device can be obtained.

However, when the near-field sensing device of the first electronic device is a Bluetooth module, the first electronic device can send an information request to the second electronic device by means of Bluetooth communication. The second electronic device may receive the information request, and feed back the device description information of the second electronic device to the first electronic device according to the information request. The first electronic device may receive the device description information sent by the second electronic device.

When the near-field sensing device of the first electronic device is a Wi-Fi module, the first electronic device can send an information request to the router in the local area network through the Wi-Fi wireless network, and forward the information request to the second electronic device through the router . The second electronic device may receive the information request forwarded by the router, feed back the device description information of the second electronic device to the router according to the information request, and also forward the information request to the first electronic device through the router. The first electronic device may receive the device description information of the second electronic device forwarded by the router.

Step 501c, the first electronic device determines and displays the operation interface in the first area of the display interface of the first electronic device according to the device description information.

The first electronic device can determine whether the first electronic device has an application service corresponding to the second electronic device according to the description information, so as to obtain the application service corresponding to the second electronic device from the local storage space or server of the first electronic device according to the confirmation result, The operation interface of the second electronic device is determined and displayed to the user by running the application service corresponding to the second electronic device.

The application service is used to determine the operation interface, that is, used to display the operation interface corresponding to the second electronic device. The application service may be pre-stored in the first electronic device, or may be obtained by the first electronic device requesting the server, and the embodiment of the present application does not limit the manner in which the first electronic device obtains the application service.

Also, the application service may include interface information for displaying the operation interface. In the process of displaying the operation interface, the application service can determine each control included in the operation interface, the position of each control, and the information corresponding to the second electronic device according to the interface information, and then the second electronic device can be generated.

For example, interface information may include one or more interface elements. Taking the second electronic device as an intelligent speaker as an example, the above-mentioned one or more elements may include multiple controls such as play mode, previous song, play/pause, next song, whether to display lyrics, and a progress bar. The first electronic device may obtain an operation interface corresponding to the second electronic device according to the interface information. For the process of how to obtain the operation interface corresponding to the second electronic device according to the interface information, reference may be made to the description in the prior art, which is not limited in this embodiment of the present application.

In addition, the first electronic device may detect a control operation triggered by the user on the operation interface, and control the second electronic device according to the detected control operation. For example, still taking the second electronic device as an example of a smart speaker for illustration, the operation interface of the smart speaker may include multiple controls such as play mode, previous song, play/pause, next song, whether to display lyrics, and a progress bar. , the user can control the smart speaker by clicking on each control in the operation interface.

Optionally, the first electronic device may determine the application service of the second electronic device according to the device description information, and then determine the operation interface according to the application service, and display the operation interface in the first area of the display interface of the first electronic device.

The first electronic device may include a plurality of hardware such as a processor and a memory, and during the operation of the processor, a plurality of functional modules stored in the memory may be executed to determine whether the memory of the first electronic device has a second electronic device corresponding application service.

Wherein, the first electronic device may have an operating system, a data processing module and a message distribution module, and the message distribution module may include at least one distribution module. The data processing module is used to read the device description information, and the distribution module is used to start the application service corresponding to the second electronic device, and send the information for configuring and initializing the application service to the application service.

In addition, each distribution module may correspond to at least one service application. For example, referring to FIG. 8 , the first electronic device is provided with three distribution modules, distribution module 1 may correspond to application service A and application service B, distribution module 2 may correspond to application service C, and distribution module 3 may correspond to application service D. If the application service corresponding to the second electronic device is the application service C, the first electronic device can open and initialize the application service C through the distribution module 2, and then display the operation interface corresponding to the second electronic device through the running application service C.

It should be noted that, in practical applications, the data processing module and the distribution module of the first electronic device may belong to the same software function module, or may belong to different software function modules, which are not limited in this embodiment of the present application. For example, both the data processing module and the distribution module of the first electronic device may belong to the APP Router Service of the first electronic device.

In a possible implementation manner, the operating system of the first electronic device may read a preset field of the device description information, obtain the identifier of the manufacturer of the second electronic device, so as to determine the manufacturer of the second electronic device, and use the The identification of the manufacturer is compared with the identification of the manufacturer of the first electronic device to determine whether the first electronic device and the second electronic device belong to the same manufacturer.

If the second electronic device and the first electronic device belong to the same manufacturer, the device description information can be sent to the preset data processing module; if the second electronic device and the first electronic device belong to different manufacturers, the device description information can be sent to the The data processing module corresponding to the manufacturer of the second electronic device sends the device description information.

For example, the manufacturer of the first electronic device is A, and if the manufacturer of the second electronic device is also A, the first electronic device can send device description information to the pre-stored data processing module; if the manufacturer of the second electronic device is A is B, then the first electronic device can send device description information to the data processing module corresponding to B; if the manufacturer of the second electronic device is C, then the first electronic device can send device description information to the data processing module corresponding to C information.

Afterwards, the data processing module of the first electronic device can read the other fields in the device description information except for the identity of the identification manufacturer one by one, determine the application service corresponding to the second electronic device, and obtain the application service for initialization. configuration information in order to start the application service and display the operation interface through the application service.

Further, in the process of acquiring the application service by the first electronic device, the first electronic device may first find out whether the application service is stored, and if the application service is stored, the first electronic device may enable the application service through the distribution module, and use the The device description information of the second electronic device initializes the application service.

The following will respectively introduce the manner in which the first electronic device obtains the application service of the second electronic device a:

Manner a, the first electronic device has application services of each second electronic device. For example, the first electronic device has device description information of each second electronic device, and application services associated with each device description information. After the first electronic device acquires the device description information of the second electronic device a, the first electronic device may determine the application service of the second electronic device a from the application services of each second electronic device described above. Then, the first electronic device displays the operation interface of the second electronic device a according to the application service of the second electronic device a.

Mode b, the current smart home scene also includes other first electronic devices (such as computers, laptops or tablet computers) that can store application services, then the first electronic device obtains the device description information of the second electronic device a after obtaining the device description information of the second electronic device a. , the application service of the second electronic device a can be requested from other first electronic devices, and the application service can be obtained according to the request.

It should be noted that, if the first electronic device obtains the application service of the second electronic device a through the above method a, the system architecture shown in FIG. 1 may not include a server.

However, if the first electronic device does not have the application service of the second electronic device, the first electronic device may request the server for the application service corresponding to the second electronic device according to the device description information. Optionally, the first electronic device may send a request message to the server, and the first electronic device may also receive an application service from the server, where the request message is used to request an application service corresponding to the second electronic device, and the request message may carry the second Device description information for electronic devices.

For example, if the first electronic device does not have the application service of the second electronic device, the first electronic device may generate a request message according to the device description information, and send the request message to the server. The server may receive the request message, determine the application service corresponding to the second electronic device according to the device description information in the request message, and send the application service corresponding to the second electronic device to the first electronic device. Correspondingly, the first electronic device may receive the application service corresponding to the second electronic device sent by the server, so as to obtain the application service.

It should be noted that the device description information of the second electronic device obtained by the first electronic device may include the address of the server, and the first electronic device may request the server for an application service corresponding to the second electronic device according to the device description information. Moreover, the application service corresponding to the second electronic device may also include the address of the server, then in the subsequent process of the first electronic device controlling the second electronic device, the first electronic device Take control.

After that, the first electronic device can run the application service, generate an operation interface of the second electronic device through the application service in combination with the interface information included in the application service, and display the operation interface in the first area of the display interface of the first electronic device , so that the first electronic device can control the second electronic device through the operation interface.

It should be noted that, in practical applications, the operation interface of the first electronic device can display not only various controls, but also information related to the linkage between the second electronic device and the first electronic device. For example, if the second electronic device is For smart speakers, the operation interface can also display the name, lyrics and artist of the song currently being played by the smart speaker.

Referring to FIG. 9, FIG. 9 shows the display interface 92 displayed by the smart speaker 91 and the first electronic device, wherein the display interface 92 may include an operation interface 921, and the operation interface 921 may include: play mode 921a, upper One song 921b, play/pause 921c, next song 921d, whether to display lyrics 921e, and a progress bar 921f and other controls; moreover, the operation interface 921 can also display the model 921g of the smart speaker, and the name of the currently playing song 921h , and the singer 921i of the song; finally, the operation interface 921 can also display the image of the singer of the song or the cover 921j and lyrics 921k of the album to which the song belongs.

In addition, the operation interface 921 may further include a sound projection control 921m, and the sound projection control 921m is used to adjust the audio data source played by the smart speaker 91 . For example, in the process of controlling the smart speaker 91 by the first electronic device, the smart speaker 91 plays the audio data provided by the server by default. When sending audio data, the smart speaker 91 can play the audio data provided by the first electronic device. At the same time, the first electronic device can also send a control command to the smart speaker 91 through the operation interface 921 instead of forwarding the control command through the server.

It should be noted that, during the above-mentioned smart speaker playing audio data provided by the first electronic device, the first electronic device may establish a connection with the second electronic device and exchange data by means of near field communication, which will not be repeated here.

The first electronic device searches whether the application service corresponding to the second electronic device is pre-stored, and determines whether it needs to request the application service from the server according to the search result. If the application service is pre-stored, it can no longer request the application service from the server. The efficiency and flexibility of the first electronic device to control the second electronic device are improved.

Moreover, the first electronic device can adjust the data source of the second electronic device according to the user's trigger operation, so that the second electronic device can be linked according to the data source provided by the server or the first electronic device, which improves the control of the second electronic device by the first electronic device. Flexibility of electronic devices.

For example, if the second electronic device is an air conditioner, the operation interface can also display the current status of the air conditioner, such as whether it is currently working, adjusting temperature, working mode, and blowing direction. Referring to Fig. 10, Fig. 10 shows a display interface 102 displayed by the first electronic device, wherein the display interface 102 may include an operation interface 1021 of the air conditioner, and the operation interface 1021 may include: a power supply 1021a, a temperature increase 1021b, a temperature decrease 1021c, working mode 1021d and blowing direction 1021e and other controls, and the operation interface 1021 can also display the model 1021f of the air conditioner, the target temperature 1021g and the current indoor temperature 1021h.

In addition, in the process of establishing a connection with the second electronic device, the first electronic device may establish a connection with the second electronic device without relying on the NFC module, but may establish a connection with the second electronic device through a Bluetooth module or a Wi-Fi module Establishing a connection improves the flexibility of establishing a connection between the first electronic device and the second electronic device.

It should be noted that when the first electronic device performs step 502, the first electronic device sends a control instruction to the second electronic device through a server that communicates with the second electronic device, where the control instruction is used to instruct the second electronic device to execute The operation corresponding to the operation command.

Further, after the second electronic device performs the corresponding operation, it can feed back the execution result indicating that the execution is completed to the server, the server can forward the execution result to the first electronic device, and the first electronic device can receive the second electronic device from the server. The feedback result of the electronic device to the control instruction, and the operation interface can be updated according to the feedback result.

For example, referring to Fig. 11a and Fig. 11b, Fig. 11a and Fig. 11b show the change of the operation interface displayed by the first electronic device according to the song-cutting operation triggered by the user. As shown in Fig. 11a, the first electronic device After the connection between the electronic device and the smart speaker is established, the interface shown in Figure 11a can be displayed on the operation interface of the second electronic device displayed by the first electronic device. The song "P" is currently playing, and the lyrics of the song "O" are displayed. ABCDEFG" and singer "Q", if the user's control operation in the form of click triggered by the control of the next song is detected, the first electronic device can generate a control instruction to play the next song according to the control operation, and the server can send it to the intelligent The speaker forwards the control command, and the smart speaker can switch to play the next song according to the control command.

Correspondingly, after switching to play the next song, the smart speaker can forward the execution result to the server, and the server can forward the execution result to the first electronic device. Referring to FIG. 11b, the first electronic device can The operation interface is updated to play the song "R", and update the lyrics "HIJKLMN" and the singer "T" of the song "R", and can also update the progress bar.

Further, the first electronic device can also control the second electronic device to start playing or stop playing according to the click operation triggered by the user on the play/pause control. Similarly, the first electronic device can click on whether to display the lyrics control triggered by the user. operation to control whether the first electronic device displays the lyrics in the operation interface; the first electronic device can control the playback progress of the second electronic device according to the sliding operation triggered by the user on the progress bar control; the first electronic device can At least one click operation triggered by the control adjusts the play mode of the second electronic device.

It should be understood that the size of the sequence numbers of the steps in the above embodiments does not mean the sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

Corresponding to the cross-device control method described in the above embodiment, FIG. 12 is a structural block diagram of a cross-device control apparatus provided by an embodiment of the present application. For the convenience of description, only the control device related to the embodiment of the present application is shown. part.

Referring to Figure 12, the device includes:

The display module 1201 is configured to, when the distance between the first electronic device and the second electronic device satisfies the preset range condition, in response to the touch operation triggered by the user on the first electronic device or the second electronic device, in the first electronic device or the second electronic device. A first area of a display interface of an electronic device displays an operation interface, and the operation interface is an interface corresponding to the second electronic device;

The communication module 1202 is configured to control the second electronic device to perform the operation corresponding to the operation instruction in response to the operation instruction triggered by the user on the operation interface.

Optionally, the communication module 1202 is further configured to send a control instruction to the second electronic device through a server communicating with the second electronic device, where the control instruction is used to instruct the second electronic device to perform an operation corresponding to the operation instruction.

Optionally, referring to Figure 13, the device further includes:

a service execution module 1203, configured to determine the device description information of the second electronic device;

The service execution module 1203 is further configured to determine the operation interface according to the device description information.

Optionally, the service execution module 1203 is further configured to determine the application service of the second electronic device according to the device description information, and the application service is used to determine the operation interface;

The display module 1201 is further configured to display the operation interface in the first area of the display interface of the first electronic device after determining the operation interface according to the application service.

Optionally, the communication module 1202 is further configured to send a request message to the server, where the request message is used to request an application service corresponding to the second electronic device;

The communication module 1202 is further configured to receive application services from the server.

Optionally, the communication module 1202 is further configured to establish a short-range communication connection with the second electronic device in response to a touch operation triggered by the user on the first electronic device or the second electronic device.

Optionally, the short-range communication connection between the first electronic device and the second electronic device includes: one or more of a near-field communication NFC connection, a Bluetooth connection or a Wi-Fi network connection.

Optionally, the communication module 1202 is further configured to receive a feedback result for the operation instruction from the second electronic device;

The display module 1201 is further configured to update the content displayed on the operation interface according to the feedback result.

Optionally, referring to FIG. 14 , the device further includes:

The user operation module 1204 is configured to detect the control operation triggered on the operation interface.

To sum up, the cross-device control device provided by the embodiment of the present application, when the distance between the first electronic device and the second electronic device satisfies the preset range condition, in response to the user targeting the first electronic device or the second electronic device The touch operation triggered by the electronic device displays the operation interface corresponding to the second electronic device in the first area of the display interface of the first electronic device. In response to the operation instruction triggered by the user on the operation interface, the first electronic device can control the second electronic device. The electronic device executes the operation corresponding to the operation instruction. Compared with the control of the second electronic device by the first electronic device after running the application program corresponding to the second electronic device, the present application does not need to pass the application program corresponding to the second electronic device. Using the control interface displayed by the first electronic device, based on the operation instructions triggered by the user on the control interface, the control of the second electronic device is realized, so the process of controlling the second electronic device by the first electronic device can be reduced, and the first electronic device can be improved. Efficiency and flexibility in controlling the second electronic device.

Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. Module completion, that is, dividing the internal structure of the device into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment may be integrated in one processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit, and the above-mentioned integrated units may adopt hardware. It can also be realized in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of the present application. For the specific working processes of the units and modules in the above-mentioned system, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In the foregoing embodiments, the description of each embodiment has its own emphasis. For parts that are not described or described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

In the embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the system embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be Incorporation may either be integrated into another system, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The integrated unit, if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the present application realizes all or part of the processes in the methods of the above embodiments, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When executed by a processor, the steps of each of the above method embodiments can be implemented. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form, and the like. The computer-readable medium may include at least: any entity or device capable of carrying the computer program code to the terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signals, telecommunication signals, and software distribution media. For example, U disk, mobile hard disk, disk or CD, etc. In some jurisdictions, under legislation and patent practice, computer readable media may not be electrical carrier signals and telecommunications signals.

The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the above-mentioned embodiments, those of ordinary skill in the art should understand that: it can still be used for the above-mentioned implementations. The technical solutions described in the examples are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions in the embodiments of the application, and should be included in the within the scope of protection of this application.

Claims

A cross-device control method, comprising:

When the distance between the first electronic device and the second electronic device satisfies the preset range condition, in response to a touch operation triggered by the user on the first electronic device or the second electronic device, at the first electronic device A first area of a display interface of an electronic device displays an operation interface, and the operation interface is an interface corresponding to the second electronic device;

In response to an operation instruction triggered by the user on the operation interface, the first electronic device controls the second electronic device to perform an operation corresponding to the operation instruction.
The method according to claim 1, wherein the first electronic device controls the second electronic device to perform the operation corresponding to the operation instruction, comprising:

The first electronic device sends a control instruction to the second electronic device through a server in communication with the second electronic device, where the control instruction is used to instruct the second electronic device to perform an operation corresponding to the operation instruction.
The method according to any one of claims 1 to 2, wherein before the operation interface is displayed in the first area of the display interface of the first electronic device, the method further comprises:

The first electronic device determines device description information of the second electronic device;

The first electronic device determines the operation interface according to the device description information.
The method according to claim 3, wherein the displaying the operation interface in the first area of the display interface of the first electronic device comprises:

The first electronic device determines an application service of the second electronic device according to the device description information, where the application service is used to determine the operation interface;

After the first electronic device determines the operation interface according to the application service, the operation interface is displayed in the first area of the display interface of the first electronic device.
The method of claim 4, wherein the first electronic device determines the application service of the second electronic device according to the device description information, comprising:

The first electronic device sends a request message to the server, where the request message is used to request an application service corresponding to the second electronic device;

The first electronic device receives the application service from the server.
The method according to claim 3, wherein before the first electronic device determines the device description information of the second electronic device, the method further comprises:

In response to a user-triggered tap operation on the first electronic device or the second electronic device, the first electronic device establishes a proximity communication connection with the second electronic device.
The method according to claim 6, wherein the short-range communication connection between the first electronic device and the second electronic device comprises: a near-field communication (NFC) connection, a Bluetooth connection, or a Wi-Fi connection One or more of the network connections.
The method according to any one of claims 1 to 7, wherein, in response to an operation instruction triggered by a user on the operation interface, the first electronic device controls the second electronic device to perform the operation After the operation corresponding to the instruction, the method further includes:

receiving, by the first electronic device, a feedback result for the operation instruction from the second electronic device;

The first electronic device updates the content displayed on the operation interface according to the feedback result.
A cross-device control device, comprising:

A display module, used for responding to a touch operation triggered by a user on the first electronic device or the second electronic device when the distance between the first electronic device and the second electronic device satisfies a preset range condition , displaying an operation interface in the first area of the display interface of the first electronic device, where the operation interface is an interface corresponding to the second electronic device;

The communication module is configured to control the second electronic device to perform the operation corresponding to the operation instruction in response to the operation instruction triggered by the user on the operation interface.
A cross-device control system, comprising: a first electronic device, a server, and a second electronic device;

When the distance between the first electronic device and the second electronic device satisfies the preset range condition, the first electronic device responds to a touch triggered by the user on the first electronic device or the second electronic device operation, displaying an operation interface in the first area of the display interface of the first electronic device, and the operation interface is an interface corresponding to the second electronic device;

The first electronic device sends a control instruction to the server in response to an operation instruction triggered on the operation interface, where the control instruction is used to instruct the second electronic device to perform an operation corresponding to the operation instruction;

the server forwards the control instruction to the second electronic device;

The second electronic device executes the operation corresponding to the operation instruction according to the control instruction.
An electronic device, characterized by comprising: a processor, where the processor is configured to run a computer program stored in a memory, so as to implement the method according to any one of claims 1 to 9.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and the computer program implements the method according to any one of claims 1 to 9 when the computer program is executed by a processor.