WO2022028494A1

WO2022028494A1 - Multi-device data collaboration method and electronic device

Info

Publication number: WO2022028494A1
Application number: PCT/CN2021/110646
Authority: WO
Inventors: 庾能国; 马红欣; 冯鹏; 胡俊
Original assignee: 华为技术有限公司
Priority date: 2020-08-06
Filing date: 2021-08-04
Publication date: 2022-02-10
Also published as: CN114065706A

Abstract

A multi-device data collaboration method and an electronic device, which are applied to a system comprising a first electronic device and a second electronic device. Said method comprises: in response to a first operation acting on a first document editing application of a second electronic device, the second electronic device displaying a first document editing box of the first document editing application; the second electronic device sending a first notification message to the first electronic device, and the first electronic device displaying a first prompt box, wherein the first prompt box comprises at least one of the following: first prompt information and a first widget; the first prompt information being used for prompting a user whether to start data collaboration with the second electronic device; the first electronic device displaying a data collaboration interface in response to an operation on the first widget; and the first electronic device receiving a user voice input and converting same into a text, sending first text data to the second electronic device in response to a second user operation, and displaying the first text data on the first document editing box.

Description

Method and electronic device for multi-device data collaboration

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority of the Chinese patent application with the application number 202010784936.3 and the application title "A method and electronic device for multi-device data collaboration" filed with the China Patent Office on August 6, 2020, the entire contents of which are incorporated by reference in this application.

technical field

The embodiments of the present application relate to the field of communication technologies, and in particular, to a method and electronic device for data collaboration among multiple devices.

Background technique

Office is the main usage scenario of personal computer (PC), and document creation is one of the main scenarios of office. The main way of creating a current document is that the user sits in front of the computer and uses a keyboard or a stylus to input into a corresponding document editing application, such as word/txt and other software with a long text editing function.

At present, the editing operation method of long text based on personal computer is single, and relies on the user to sit in front of the computer for a long time for input, cannot change the creation scene, and cannot meet the user's needs for the change of the manuscript creation scene.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a multi-device data collaboration method and an electronic device, which are used in a manuscript creation scene, and can meet the scene change requirements of a user in manuscript creation.

In a first aspect, an embodiment of the present application provides a multi-device data collaboration method, which is applied to a second electronic device, and the second electronic device can run a first document editing application. The second electronic device displays the first document editing box of the first document editing application on the second electronic device in response to the first operation on the first document editing application of the second electronic device; the second electronic device displays the first document editing box of the first document editing application on the second electronic device; The electronic device sends a first notification message to the first electronic device, where the first notification message is used to establish data cooperation between the first electronic device and the second electronic device; the second electronic device receives the first electronic device The sent first text data is displayed on the first document edit box.

Through the above method, the second electronic device can send the first notification message to the first electronic device in response to the first operation on the first document editing application of the second electronic device, so that the first electronic device can Establishing data collaboration with the second electronic device, the method is simple and convenient to establish data collaboration, effectively reduces the operational difficulty of establishing data collaboration, and improves the convenience and applicability of users for creating documents in various scenarios. There is no need for the user to open the corresponding data collaboration interface simultaneously on the second electronic device and the first electronic device to actively establish a data collaboration scenario, which improves user experience.

A possible implementation, considering the user's personalized customization of the first document editing application corresponding to the triggering of the data collaboration scenario, and avoiding false triggering of the data collaboration scenario when data collaboration is not used, can configure document editing for the document editing application. The whitelist makes the first document editing application an application in the document editing whitelist configured by the user. Thus, the user's experience of using data collaboration is improved.

A possible implementation manner, the first operation includes at least one of the following: an operation of opening the first document editing application, an operation of clicking a document editing box in the first document editing application, switching the first document editing application. An operation of a document editing application, an operation of switching the document editing box in the first document editing application.

Through the above method, the second electronic device can determine the scene in which the user wants to enter the document editing through the above operation of the user in the first document editing application, thereby triggering the establishment of data collaboration with the first electronic device, which can reduce the user's active triggering of data collaboration The tedious operation brought by the scene, in addition, for users who have not used the data collaboration scene, they can also trigger data collaboration with the first electronic device without perception, which is beneficial for the user to successfully establish the data collaboration scene and improve the user's use of data collaboration. experience.

In a possible implementation manner, before the second electronic device sends the first notification message to the first electronic device, a first search device interface may also be displayed on the second electronic device; the first search device interface is used to at least one electronic device to which the second electronic device establishes a communication connection; the second electronic device, in response to the confirmation operation acting on the first electronic device in the at least one electronic device on the first search device interface, determines to send the The first electronic device that described the first notification message.

Through the above method, considering that the second electronic device may establish a communication connection with at least one electronic device, at this time, the second electronic device may display at least one electronic device to the user by displaying the first checking device interface, so as to respond to the The confirmation operation of the first electronic device in the at least one electronic device on the first search device interface, to determine the first electronic device selected by the user, so that based on the needs of the user, a search between the second electronic device and the first electronic device Establish data collaboration and improve the flexibility and adaptability of data collaboration.

A possible implementation manner is to receive a communication connection request from the first electronic device; the communication connection request is realized by using a near field communication technology; establish a communication connection with the first electronic device, and the second electronic device A first connection message is displayed on the device; the first connection message is used to prompt the user to establish a communication connection between the second electronic device and the first electronic device.

The communication connection between the first electronic device and the second electronic device is realized by using the near field communication technology, which is not limited to the way that the first electronic device and the second electronic device must be in the same local area network to establish the communication connection, thereby reducing the need for communication between different electronic devices. The difficulty of establishing a communication connection improves the compatibility of establishing data collaboration between different electronic devices, and improves the diversity and flexibility of scenarios for realizing data collaboration.

In a possible implementation manner, after the second electronic device sends the first notification message to the first electronic device, it can also receive a first response message sent by the first electronic device, where the first response message is used to confirm the first notification message. The electronic device establishes data cooperation with the second electronic device; thus, the second electronic device can display the first response message on the second electronic device.

Through the above method, the first electronic device can send the first response message to the second electronic device, so that the second electronic device determines that the first electronic device and the second electronic device have established data cooperation. Further, the second electronic device displays the first response message, so that the user can determine that the second electronic device and the first electronic device have successfully established data cooperation, thereby improving user experience.

In a possible implementation manner, the second electronic device includes multiple document editing applications; a second notification message is sent to the first electronic device; the second notification message is used to notify the second electronic device of including the plurality of document editing applications; receiving a switching message sent by the first electronic device; the switching message is used to instruct the second electronic device to switch the focus of the second electronic device from the first document editing application to a second document editing application; switch the focus to the second document editing box of the second document editing application on the second electronic device; receive the third text data sent by the first electronic device, in the first electronic device The third text data is displayed on the second document edit box.

Considering that multiple document editing applications may be opened on the second electronic device, the user needs to perform data collaboration in the document editing boxes in the multiple document editing applications. In the process of data collaboration in the editing box, by sending a switching message to the second electronic device, so that the second electronic device switches the focus to the second document editing box of the second document editing application according to the switching message, so as to realize the The data collaboration scenario in which the third text data is entered in the second document editing box. In order to make the data collaboration function applicable to scenarios of multiple document editing applications, the applicability of data collaboration is improved.

Considering that during the data collaboration process, the second electronic device and/or the first electronic device may interrupt the data collaboration scenario due to other events, in this application, when determining to restore the data collaboration scenario, the second electronic device may The data collaboration is resumed in the document editing application, and the third document editing application is the document editing application corresponding to the interruption of the data collaboration between the first electronic device and the second electronic device; thus, it avoids the user input caused by the interruption of the data collaboration. The second text data is lost, which effectively improves the user experience.

In a possible implementation manner, when the first condition is satisfied, a third document editing application is displayed on the second electronic device; the second electronic device receives the second text data of the first electronic device, and the third The second text data is displayed on the third document editing box of the document editing application; the second text data is text data generated by the first electronic device when the data collaboration is interrupted. The first condition is: in response to a first switching operation on the application, the first switching operation is used to switch the focus of the second electronic device to the third document editing application; or, receiving the first switching operation A restore data cooperation message of an electronic device, where the restore data cooperation message is used to request to restore the data cooperation between the first electronic device and the second electronic device.

Through the above method, the user can perform the first switching operation on the second electronic device, or the user can trigger the recovery data cooperation scene through the recovery data cooperation message sent by the user from the first electronic device to the second electronic device, so that the second The electronic device displays the third document editing application, and receives the second text data sent by the first electronic device. Since the second text data is text data generated by the first electronic device when data collaboration is interrupted, for the user, the The interruption does not affect the data collaboration process, avoids the risk of data loss caused by interruption of data collaboration, and improves the user experience of using data collaboration.

In a possible implementation manner, in response to a second switching operation of the document editing application, a switched interface is displayed on the second electronic device; the second switching operation is used to The focus is switched out of the third document editing application. A second notification message is sent to the first electronic device through the second electronic device; the second notification message is used to notify the second electronic device that the data cooperation between the second electronic device and the first electronic device is interrupted.

Through the above method, it can be determined by the second electronic device that the first electronic device and the second electronic device discontinue data cooperation in response to the second switching operation of the document editing application. Thus, the second electronic device is triggered to send the second notification message to the first electronic device, so that the first electronic device can store the second text data generated when the data cooperation is interrupted, so as to avoid data loss caused by the interrupted data cooperation.

In a possible implementation manner, the second electronic device receives an interruption notification message of the first electronic device, where the interruption notification message is used to notify the second electronic device that the data cooperation with the first electronic device is interrupted.

Through the above method, the second electronic device determines that the first electronic device has interrupted the data collaboration through the interruption notification message, so as to prevent the second electronic device from being unaware of the interruption of the data collaboration, and improve the user experience of the data collaboration process.

A possible implementation manner, before the second electronic device receives the second text data of the first electronic device, may also send a third notification message to the first electronic device; the third notification message is used to notify the first electronic device of An electronic device resumes data cooperation with the second electronic device.

Through the above method, the second electronic device can send a third notification message to the first electronic device when it is determined to restore the data collaboration scene, so as to notify the first electronic device that the data line collaboration scene is restored, thereby improving the efficiency of restoring the data collaboration scene, so that The first electronic device can send the second text data to the second electronic device to reduce delay and improve user experience.

In a possible implementation manner, before the second electronic device receives the second text data of the first electronic device, it may also send a third request message to the first electronic device; the third request message is used to request recovery data cooperation between the first electronic device and the second electronic device; receiving a recovery data cooperation message sent by the first electronic device; the recovery data cooperation message is used to confirm recovery of the first electronic device and the second electronic device Data collaboration for electronic devices.

Through the above method, the second electronic device can send the third request message to the first electronic device, so that the user confirms on the first electronic device whether to resume the data collaboration scenario, and after receiving the resume data collaboration scenario sent by the first electronic device After the message, the second electronic device determines to restore the data collaboration scenario, thereby triggering the display of the third document editing box, so as to receive the second text data sent by the first electronic device, and the user confirms the restoration of data collaboration to improve the recovery of the second electronic device. The accuracy of the data collaboration timing improves the smoothness of the user's use of the second electronic device and the first electronic device.

In a second aspect, the present application provides a method for multi-device data collaboration, which is applied to a first electronic device. The first electronic device receives a first notification message from the second electronic device and displays a first prompt box; the first notification The message is used to request the first electronic device to establish data cooperation with the second electronic device; the first prompt box includes at least one of the following: first prompt information and a first control; in response to acting on the first The first user operation of the control displays a data collaboration interface; collects first voice data, converts the first voice data into first text data, and displays the first text data on the data collaboration interface; responds to the second The user operates to send the first text data to the second electronic device.

The first user operation may be a user's confirmation operation on the first control, and the second user operation may be a user's confirmation operation on the data collaboration interface.

Through the above method, the first electronic device can receive the first notification message of the second electronic device, and prompt the user whether to establish data collaboration through a first prompt box, and in response to the operation of the first control, in the first prompt box The data cooperation interface is displayed on an electronic device, so that the first voice data input by the user is collected, converted into first text data and sent to the second electronic device, so as to realize the data cooperation between the first electronic device and the second electronic device . In this process, the process of establishing data collaboration between the first electronic device and the second electronic device is simple, and the method of sending the first notification message by the second electronic device reduces the operational difficulty of establishing data collaboration and improves the user experience in various scenarios. The ease and applicability of authoring documents.

In a possible implementation manner, the data collaboration interface further includes: editing controls; identifying the first voice data as initial text data, and displaying the initial text data on the data collaboration interface; The third user operation of the editing control determines the editing instruction for the initial text data, and displays the edited initial text data on the data collaboration interface; in response to the confirmation operation acting on the data collaboration interface, all The edited initial text data is used as the first text data.

Through the above method, the recognized initial text data can be edited through the editing control of the data collaboration interface, the operability of the user inputting the text data through voice can be improved, and the format of the initial text data can also be edited through the editing control, Thereby, an editing instruction for the initial text data is generated, displayed as the state of the edited initial text data, the editing ability of the text data is improved, and the operation convenience of data cooperation for inputting text on the second electronic device is improved.

In a possible implementation manner, the first text data includes: initial text data and an editing instruction for the initial text data.

Through the above method, through the editing instruction of the initial text data in the first text data, after receiving the first text data, the second electronic device displays the editing instruction of the initial text data on the second electronic device as editing After the state of the initial text data, improve the applicability of data collaboration.

In a possible implementation manner, the first electronic device may also receive a first confirmation message sent by the second electronic device, where the first confirmation message is used to indicate that the second electronic device has successfully received the first text data; thus, the first electronic device can delete the first text data displayed on the data collaboration interface.

Through the above method, after confirming that the second electronic device has successfully received the first text data, the first electronic device can delete the first text data displayed on the data collaboration interface, which can improve the input voice data and the user experience. The operability of editing the text data displayed on the data collaboration interface can reduce the occupation of the memory and improve the performance for the first electronic device.

In a possible implementation manner, the first electronic device further includes a short-range wireless communication device; before the first electronic device receives the first notification message from the second electronic device, the When the distance of the device meets the first distance threshold, a communication connection request is sent to the second electronic device through near field communication; the first electronic device establishes a communication connection with the second electronic device, and displays a first connection message; the first electronic device A connection message is used to prompt the user to establish a communication connection between the second electronic device and the first electronic device.

Through the above method, through the short-range wireless communication device, when the distance between the short-range wireless communication device of the first electronic device and the short-range wireless communication device of the second electronic device satisfies the first distance threshold, the first electronic device can be activated. Establishing a communication connection with the second electronic device does not limit the fact that the first electronic device and the second electronic device are located in the same local area network, which improves the convenience and application scope of the user's use of data collaboration. The first distance threshold may be set according to the short-range wireless communication device, or may be determined according to other methods, which is not limited herein.

A possible implementation manner, in response to a first user operation acting on the first control, the first electronic device may also send a first response message to the second electronic device; the first response message is used to confirm Establishing a data collaboration between the first electronic device and the second electronic device.

Through the above method, the user confirms the establishment of data cooperation, that is, the operation of the first control sends a first response message to the second electronic device, so that the second electronic device determines that the first electronic device and the second electronic device establish data cooperation.

A possible implementation manner, the second electronic device includes multiple document editing applications; the first electronic device may also receive an application notification message of the second electronic device, and display the multiple document editing applications on the data collaboration interface. controls of a plurality of document editing applications; the application notification message is used to indicate that the second electronic device includes the plurality of document editing applications; in response to a switching operation of the controls acting on the plurality of document editing applications, to the The second electronic device sends a switching message; the switching operation is used to instruct the second electronic device to switch the focus from the first document editing application to the second document editing application; the switching message is used to instruct the second electronic device to switch the The focus of the second electronic device is switched to the second document editing box of the second document editing application; the second voice data is collected, the second voice data is converted into third text data, and the data is displayed on the data collaboration interface. third text data; sending the third text data to the second electronic device in response to a confirmation operation acting on the data collaboration interface.

Considering that multiple document editing applications may be opened on the second electronic device, at this time, the first electronic device can display the controls of multiple document editing applications on the data collaboration interface through the received application notification message, so as to respond to the The operation of the controls of multiple document editing applications enables the user to switch between multiple document editing applications based on the first electronic device, for example, switching from the first document editing application to the second document editing application, and by sending the second electronic device The device sends a switching message to cause the second electronic device to switch the focus to the second document editing box of the second document editing application, thereby implementing a data collaboration scenario of inputting third text data in the second document editing box. The data collaboration function can be applied to scenarios of multiple document editing applications, and the applicability of data collaboration is improved.

In a possible implementation manner, when the second condition is met, the first electronic device caches second text data; the second text data is stored in the text data displayed on the data cooperation interface; the second condition is used to indicate that the data cooperation between the first electronic device and the second electronic device is interrupted; when the third condition is met, the data cooperation interface is displayed, and the The second text data is displayed on the data cooperation interface; the third condition is used to instruct the data cooperation recovery between the first electronic device and the second electronic device; the first electronic device reports to the second electronic device The device sends the second text data.

Through the above method, when the second condition is met, it is determined that the data collaboration scene is interrupted, so that the first electronic device caches the text data displayed on the data collaboration interface, so as to avoid the loss of text input by the user due to the interruption of the data collaboration scene , when the data collaboration is restored, that is, when the third condition is met, the first electronic device sends the second text data to the second electronic device, so as to avoid the loss of the second text data input by the user caused by the interruption of the data collaboration, and cannot be transmitted to the second electronic device. Electronic equipment, effectively improve the user experience.

A possible implementation manner, the second condition is: the first electronic device receives a second notification message sent by the second electronic device, and the second notification message is used to notify the second electronic device and the The data cooperation of the first electronic device is interrupted; or, the first electronic device displays the switched application interface on the first electronic device in response to the switching application operation of the first electronic device; the switching application operation uses in starting the switched application on the first electronic device.

Through the above method, considering the scenario in which the second electronic device triggers the interruption of the data cooperation, the first electronic device may determine that the data cooperation has been interrupted through the second notification message sent to the first electronic device. In addition, it may also be that in the first electronic device, in response to the switching application operation of the first electronic device, it is determined that the data cooperation is interrupted.

A possible implementation manner, after the first electronic device responds to the switching application operation of the first electronic device, it can also send an interruption notification message to the second electronic device; the interruption notification message is used to notify the The data cooperation between the second electronic device and the first electronic device is interrupted.

Considering a scenario in which the first electronic device interrupts the data cooperation, the first electronic device may send an interruption notification message to the second electronic device, so that the second electronic device determines that the data cooperation has been interrupted.

A possible implementation, the third condition is:

A first trigger condition, the first trigger condition includes at least one of the following: in response to detecting a gesture to the first electronic device, it is determined that the gesture satisfies a first gesture condition; the first gesture condition includes: all The first electronic device is moved to a range where the distance from the user is greater than the first threshold and less than the second threshold; the gesture includes: lifting up or moving down; or, the first electronic device is not in a call state ; or, the camera module of the first electronic device is not in an open state; or, a third notification message sent by the second electronic device is received, and the third notification message is used to notify the first electronic device to restore data cooperation with the second electronic device; or, receiving a third request message sent by the second electronic device, where the third request message is used to request the first electronic device to resume communication with the second electronic device data cooperation of the device, the third request message is displayed in the second prompt box on the first electronic device, and in response to the operation on the second prompt box, it is confirmed to restore the first electronic device and the Data collaboration of the second electronic device.

Through the above method, the first electronic device may determine that the first electronic device wants to restore the data collaboration scene when the first trigger condition is satisfied, or the second electronic device may want to restore the data collaboration scene, and send the data to the first electronic device. The third request message may also be that the second electronic device sends a third notification message to the first electronic device after confirming the restoration of data collaboration, thereby adapting to different restoration data collaboration scenarios and improving the availability of data collaboration scenarios.

A possible implementation manner, the first electronic device, in response to the operation on the second prompt box, confirms that the data cooperation between the first electronic device and the second electronic device is restored, and can also send a notification to the second electronic device. The electronic device sends a restore data cooperation message; the restore data cooperation message is used to confirm restoring the data cooperation between the first electronic device and the second electronic device.

Through the above method, the first electronic device can send a resume data collaboration message to the second electronic device to notify the second electronic device to resume data collaboration, avoid false triggering of data collaboration scenarios when data collaboration is not resumed, and improve users' understanding of data collaboration. Use experience.

In a third aspect, the present application provides a method for multi-device data collaboration, which is applied to a system including a first electronic device and a second electronic device, and the second electronic device can run a first document editing application. The second electronic device displays the first document editing box of the first document editing application on the second electronic device in response to the first operation on the first document editing application of the second electronic device; the second electronic device displays the first document editing box of the first document editing application on the second electronic device; The electronic device sends a first notification message to the first electronic device, where the first notification message is used to establish data cooperation between the first electronic device and the second electronic device; the first electronic device receives a message from the second electronic device A first notification message, displaying a first prompt box; the first prompt box includes at least one of the following: first prompt information and a first control; the first prompt information is used to prompt the user whether to turn on the communication with the second electronic device data collaboration of the device; in response to a first user operation acting on the first control, displaying the data collaboration interface; collecting first voice data, converting the first voice data into first text data, and in the The data collaboration interface displays the first text data; in response to a second user operation, the first text data is sent to the second electronic device. The second electronic device receives the first text data sent by the first electronic device, and displays the first text data on the first document editing box. The first user operation may be a user's confirmation operation on the first control, and the second user operation may be a user's confirmation operation on the data collaboration interface.

In a possible implementation manner, the first document editing application is an application in the document editing whitelist configured by the user.

In a possible implementation manner, the data collaboration interface further includes: editing controls; identifying the first voice data as initial text data, and displaying the initial text data on the data collaboration interface; The third user operation of the editing control determines the editing instruction for the initial text data, and displays the edited initial text data on the data collaboration interface; in response to the confirmation operation acting on the data collaboration interface, the The edited initial text data is used as the first text data.

In a possible implementation manner, before the second electronic device sends the first notification message to the first electronic device, it can also display a first search device interface; the first search device interface is used to display the establishment of at least one electronic device that is communicatively connected; in response to a confirmation operation acting on the first electronic device of the at least one electronic device on the first search device interface, determining the first electronic device that sent the first notification message .

A possible implementation manner, the first electronic device further includes a short-range wireless communication device; when the first electronic device determines that the distance from the second electronic device meets a first distance threshold, the communication is sent through near-field communication A connection request is made to the second electronic device; the second electronic device establishes a communication connection with the first electronic device, and a first connection message is displayed on the second electronic device or on the first electronic device; the first electronic device The connection message is used to prompt the user to establish a communication connection between the second electronic device and the first electronic device.

In a possible implementation manner, the first electronic device may also send a first response message to the second electronic device after responding to the first user operation acting on the first control; the first response message uses After confirming that the data cooperation between the first electronic device and the second electronic device is established. After the second electronic device sends the first notification message to the first electronic device, it may also receive a first response message sent by the first electronic device, where the first response message is used to confirm the relationship between the first electronic device and the second electronic device. The electronic device establishes the data collaboration; thus, the second electronic device can display the first response message.

In a possible implementation manner, the second electronic device includes multiple document editing applications; a second notification message is sent to the first electronic device; the second notification message is used to notify the second electronic device of including the multiple document editing applications; the first electronic device may also receive application notification messages of the second electronic device, and display the controls of the multiple document editing applications on the data collaboration interface; the application notification messages use instructing the second electronic device to include the plurality of document editing applications; sending a switching message to the second electronic device in response to a switching operation of the controls acting on the plurality of document editing applications; the switching operation using instructing the second electronic device to switch the focus from the first document editing application to the second document editing application; the second electronic device receives a switching message sent by the first electronic device; the switching message is used to instruct the second electronic device The device switches the focus of the second electronic device from the first document editing application to the second document editing application; switches the focus to the second document editing box of the second document editing application on the second electronic device; The first electronic device collects the second voice data, converts the second voice data into third text data, and displays the third text data on the data cooperation interface; The second electronic device sends the third text data. The second electronic device receives the third text data sent by the first electronic device, and displays the third text data on the second document editing box.

In a possible implementation manner, when the second condition is met, the first electronic device caches second text data; the second text data is stored in the text data displayed on the data cooperation interface; the second condition is used to indicate that the data cooperation between the first electronic device and the second electronic device is interrupted; when the third condition is met, the data cooperation interface is displayed, and the The second text data is displayed on the data cooperation interface; the third condition is used to instruct the data cooperation recovery between the first electronic device and the second electronic device; the first electronic device reports to the second electronic device The device sends the second text data. When the second electronic device determines that the first condition is met, the third document editing application is displayed; the second electronic device receives the second text data of the first electronic device, and displays the second text data on the third document editing box of the third document editing application. The second text data is displayed; the second text data is text data generated by the first electronic device when the data cooperation is interrupted. The first condition is: the second electronic device determines that in response to a first switching operation on the application, the first switching operation is used to switch the focus of the second electronic device to the third document editing application; or , the second electronic device determines to receive a recovery data cooperation message of the first electronic device, where the recovery data coordination message is used to request recovery of the data cooperation between the first electronic device and the second electronic device.

A possible implementation manner, the second condition is: the first electronic device receives a second notification message sent by the second electronic device, and the second notification message is used to notify the second electronic device and the The data cooperation of the first electronic device is interrupted; or, the first electronic device displays the switched application interface in response to the switching application operation acting on the first electronic device; the switching application operation is used to Launch the switched application on the electronic device.

In a possible implementation manner, the second electronic device determines to display the switched interface on the second electronic device in response to the second switching operation of the document editing application; the second switching operation is used to switch the The focus of the second electronic device is switched out of the third document editing application. A second notification message is sent to the first electronic device through the second electronic device; the second notification message is used for notifying the second electronic device that the data cooperation between the second electronic device and the first electronic device is interrupted.

A possible implementation, the third condition is:

A possible implementation manner, the first electronic device sends an interruption notification message to the second electronic device, the second electronic device receives the interruption notification message of the first electronic device, and the interruption notification message is used to notify the second electronic device to communicate with The data cooperation of the first electronic device is interrupted.

In a possible implementation manner, before the second electronic device receives the second text data of the first electronic device, it may also send a third request message to the first electronic device; the third request message is used to request recovery The first electronic device cooperates with the data of the second electronic device; the first electronic device sends a recovery data cooperation message to the second electronic device; the second electronic device receives the recovery data cooperation message sent by the first electronic device; the The restoring data collaboration message is used to confirm restoring the data collaboration between the first electronic device and the second electronic device.

In a fourth aspect, the present application provides an electronic device comprising: a display screen; one or more processors; one or more memories; wherein the one or more memories store one or more computer programs , the one or more computer programs include instructions, and when the instructions are executed by the one or more processors, make the electronic device execute any possible technical solution in the first aspect and the second aspect.

In a fifth aspect, an electronic device is also provided, the electronic device includes modules/units for performing any possible design method of the first aspect or the second aspect; these modules/units can be implemented by hardware, or can be implemented by hardware Execute the corresponding software implementation.

A sixth aspect, an embodiment of the present application provides a chip, the chip is coupled with a memory in an electronic device, and implements any possible technical solution of the first aspect or the second aspect of the embodiment of the present application; ” means that two components are joined directly or indirectly to each other.

In a seventh aspect, an embodiment of the present application provides a system, where the system includes the electronic device of the fourth aspect or the electronic device of the fifth aspect.

In an eighth aspect, a computer program product is provided. The computer program product includes: a computer program (also referred to as code, or instructions), which, when the computer program is executed, causes the computer to execute any one of the first aspect or the second aspect. A method in a possible implementation.

In a ninth aspect, there is provided a computer-readable storage medium, where the computer-readable medium stores a computer program (also referred to as code, or instruction), when it runs on a computer, causing the computer to execute the above-mentioned first aspect or the second A method in any of the possible implementations of an aspect.

In a tenth aspect, there is also provided a graphical user interface on an electronic device, the electronic device having a display screen, one or more memories, and one or more processors configured to execute a memory stored in the device. One or more computer programs in the one or more memories, and the graphical user interface includes the information displayed when the electronic device executes any possible technical solution of the first aspect, the second aspect or the third aspect of the embodiments of the present application GUI.

Description of drawings

1 is a schematic diagram of an application scenario provided by an embodiment of the present application;

FIG. 2 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

3 is a schematic structural diagram of an Android operating system provided by an embodiment of the present application;

FIG. 4a is a schematic flowchart of a method for multi-device data collaboration provided by an embodiment of the present application;

4b to 4g are schematic diagrams of interfaces involved in document editing of the second electronic device provided by the embodiments of the present application;

5a-5c are schematic diagrams of a data cooperation control interface of a second electronic device provided by an embodiment of the present application;

5d is a schematic diagram of a data cooperation control interface of a second electronic device provided by an embodiment of the present application;

6a-6c are schematic diagrams of interfaces of a first electronic device provided by an embodiment of the present application;

7a-7b are schematic diagrams of a data collaboration interface of a second electronic device provided by an embodiment of the present application;

8a-8b are schematic diagrams of a data collaboration interface of a first electronic device provided by an embodiment of the application;

9a is a schematic diagram of a rich text field provided by an embodiment of the present application;

FIG. 9b is a schematic flowchart of text data parsing to a keyboard buffer provided by an embodiment of the present application;

FIG. 10a is a schematic flowchart of a method for multi-device data collaboration provided by an embodiment of the present application;

10b is a schematic diagram of a data cooperation control interface of a first electronic device provided by an embodiment of the present application;

10c is a schematic diagram of a data cooperation control interface of a second electronic device provided by an embodiment of the present application;

11 is a schematic diagram of a gesture of a first electronic device provided by an embodiment of the present application;

FIG. 12a is a schematic flowchart of a method for multi-device data collaboration provided by an embodiment of the present application;

12b is a schematic diagram of a data cooperation control interface of a second electronic device provided by an embodiment of the present application;

FIG. 12c is a schematic diagram of a data cooperation control interface of a first electronic device provided by an embodiment of the present application.

detailed description

With the rapid development of society, mobile terminals such as cell phones are becoming more and more popular. Mobile phones not only have communication functions, but also have powerful processing capabilities, storage capabilities, and camera functions. Therefore, a mobile phone can not only be used as a communication tool, but also a mobile file library of the user. It can be connected with other electronic devices to transmit various personal information, photos, videos and other information of the user. Therefore, based on the mobility and convenience of the mobile terminal, document creation through the mobile terminal, combined with the document editing function of the document editing software on the personal computer, can be applied to various document creation scenarios of the user. Based on this, the present application provides a multi-device data collaboration method.

The embodiments of the present application can be applied to mobile phones, tablet computers, wearable devices (eg, watches, bracelets, helmets, headphones, etc.), in-vehicle devices, augmented reality (AR)/virtual reality (VR) Electronic devices, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), smart home devices (eg, smart TVs, smart speakers, smart cameras, etc.) equipment. It can be understood that, the embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

Referring to FIG. 1 , it is a simplified schematic diagram of a system architecture according to an embodiment of the present application. As shown in FIG. 1 , the system architecture may include: a first electronic device 101 and a second electronic device 102 . The first electronic device 101 and the second electronic device 102 may be connected to the same local area network, or may be connected to different local area networks. The example in which the first electronic device 101 and the second electronic device 102 are connected to the same local area network may specifically be: the first electronic device 101 and the second electronic device 102 establish a wireless connection with the same wireless access point. For example, the first electronic device 101 and the second electronic device 102 are connected to the same wireless fidelity (WI-FI) hotspot. For example, the first electronic device 101 and the second electronic device 102 can also be connected through the Bluetooth protocol. under the same bluetooth beacon. For another example, a communication connection between the first electronic device 101 and the second electronic device 102 can also be triggered by a near field communication (NFC) tag, and encrypted information can be transmitted through a Bluetooth module for identity authentication. After the authentication is successful, data transmission is carried out in a point-to-point (P2P) manner.

The second electronic device 102 also supports the network communication protocol used by the first electronic device 101 to establish a network connection. The second electronic device 102 can be used as a target client for text collaboration, so that collaboration data is input in the first electronic device 101 and text data is output in the second electronic device 102 . In some embodiments, the second electronic device 102 may specifically be a mobile phone, a tablet, or a computer, and the above-mentioned computer may be a desktop computer, or a notebook computer or the like.

The first electronic device 101 , a graphical user interface (hereinafter may be referred to as GUI for short) for the first electronic device 101 , and embodiments for the first electronic device 101 are described below. In some embodiments of the present application, the first electronic device 101 may be a portable electronic device that also includes other functions such as a personal digital assistant and/or a music player function, such as a mobile phone, a tablet computer, a wearable device with a wireless communication function ( such as smart watches). Exemplary embodiments of portable electronic devices include, but are not limited to, carry-on

Or portable electronic devices with other operating systems. The portable electronic device described above may also be other portable electronic devices, such as a laptop computer (Laptop) or the like having a touch-sensitive surface (eg, a touch panel). It should also be understood that, in other embodiments of the present application, the above-mentioned first electronic device 101 may not be a portable electronic device, but a desktop computer having a touch-sensitive surface (eg, a touch panel).

It should be understood that, in the embodiments of the present application, "at least one" refers to one or more, and "a plurality" refers to two or more. "And/or", which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, it can mean that A exists alone, A and B exist at the same time, and B exists alone, where A, B can be singular or plural. The character "/" generally indicates that the associated objects are an "or" relationship. "At least one (item) of the following" or its similar expression refers to any combination of these items, including any combination of single item (item) or plural item (item). For example, at least one (a) of a, b or c may represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c Can be single or multiple.

Referring to FIG. 2 , the electronic device 200 may be the first electronic device 101 or the second electronic device 102 in this embodiment of the present application. In this embodiment of the present application, the first electronic device 101 is taken as the electronic device 200 as an example. The provided electronic device 200 is introduced. Wherein, those skilled in the art can understand that the electronic device 200 shown in FIG. 2 is only an example, and does not constitute a limitation to the electronic device 200, and the electronic device 200 may have more or more than those shown in the figure. Fewer components, two or more components may be combined, or there may be different component configurations. The various components shown in Figure 2 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The electronic device 200 may include a processor 210 , an external memory interface 220 , an internal memory 221 , a USB interface 230 , a charging management module 240 , a power management module 241 , a battery 242 , an antenna 1 , an antenna 2 , a mobile communication module 251 , and a wireless communication module 252 , audio module 270, speaker 270A, receiver 270B, microphone 270C, headphone jack 270D, sensor module 280, buttons 290, motor 291, indicator 292, camera 293, display screen 294, and SIM card interface 295 and so on. The sensor module 280 may include a gyroscope sensor 280A, an acceleration sensor 280B, a proximity light sensor 280G, a fingerprint sensor 280H, and a touch sensor 280K (of course, the electronic device 200 may also include other sensors, such as a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, ambient light sensor, air pressure sensor, bone conduction sensor, etc., not shown in the figure).

The processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or Neural-network Processing Unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors. The controller may be the nerve center and command center of the electronic device 200 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in processor 210 is cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 210 . If the processor 210 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided, and the waiting time of the processor 210 is reduced, thereby improving the efficiency of the system.

The processor 210 may execute the methods provided by the embodiments of the present application, and the processor 210 may include different devices. For example, when the CPU and the GPU are integrated, the CPU and the GPU may cooperate to execute the methods provided by the embodiments of the present application, such as the multi-device data cooperation. In the method, part of the algorithms are executed by the CPU, and the other part of the algorithms are executed by the GPU, so as to obtain faster processing efficiency.

Display screen 294 is used to display images, videos, and the like. Display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light). emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on. In some embodiments, the electronic device 200 may include one or N display screens 294 , where N is a positive integer greater than one. The display screen 294 may be used to display information entered by or provided to the user as well as various graphical user interfaces (GUIs). For example, display 294 may display photos, videos, web pages, or documents, and the like. For another example, the display 294 may display the graphical user interface of the first electronic device 101 as shown in FIG. 1 . The graphical user interface shown in FIG. 1 includes a status bar, a Dock bar, a hideable navigation bar, a time and weather widget (widget), and an application icon, such as a browser icon. The status bar includes operator name (eg China Mobile), mobile network (eg 4G), time and remaining battery. The navigation bar may include a back key icon, a home key icon, and a forward key icon. In addition, it can be understood that, in some embodiments, the status bar may further include a Bluetooth icon, a Wi-Fi icon, an external device icon, and the like. It can also be understood that, in other embodiments, the graphical user interface shown in FIG. 1 may further include a Dock bar, and the Dock bar may include commonly used application icons and the like. After the processor 210 detects a touch event of the user's finger (or stylus, etc.) on an application icon, in response to the touch event, the user interface of the application corresponding to the application icon is opened and displayed on the display 294 The user interface of the application.

In this embodiment of the present application, the display screen 294 may be an integrated flexible display screen, or a spliced display screen composed of two rigid screens and a flexible screen located between the two rigid screens. After the processor 210 executes the method provided by the embodiment of the present application, the processor 210 may control to execute the first document editing application, and in response to the first operation on the first document editing application of the second electronic device, the A first document editing box of the first document editing application is displayed on the second electronic device; a first notification message is sent to the first electronic device, and the first notification message is used to establish the relationship between the first electronic device and the first electronic device. Data collaboration between two electronic devices; receiving first text data sent by the first electronic device, and displaying the first text data on the first document editing box.

Camera 293 (front camera or rear camera, or a camera that can be both a front camera and a rear camera) is used to capture still images or video. Generally, the camera 293 may include a photosensitive element such as a lens group and an image sensor, wherein the lens group includes a plurality of lenses (convex or concave) for collecting the light signal reflected by the object to be photographed, and transmitting the collected light signal to the image sensor . The image sensor generates an original image of the object to be photographed according to the light signal.

Internal memory 221 may be used to store computer executable program code, which includes instructions. The processor 210 executes various functional applications and data processing of the electronic device 200 by executing the instructions stored in the internal memory 221 . The internal memory 221 may include a storage program area and a storage data area. The storage program area may store operating system, code of application programs (such as camera application, WeChat application, etc.), and the like. The storage data area may store data created during the use of the electronic device 200 (eg, images, videos, etc. captured by a camera application).

The internal memory 221 may also store one or more computer programs 1310 corresponding to the multi-device data cooperation algorithm provided in the embodiment of the present application. The one or more computer programs 1 are stored in the aforementioned memory 221 and configured to be executed by the one or more processors 210, the one or more computer programs 1310 comprising instructions which may be used to perform the execution as shown in Fig. 4a , Figure 10a and Figure 12a and other steps in the corresponding embodiments, the computer program 1310 may include running the first document editing application. When the code of the multi-device data cooperation algorithm stored in the internal memory 221 is executed by the processor 210, the processor 210 can control the second electronic device to respond to the first operation on the first document editing application of the second electronic device , displaying the first document editing box of the first document editing application on the second electronic device; the second electronic device sends a first notification message to the first electronic device, and the first notification message is used to create the The first electronic device cooperates with the data of the second electronic device; the second electronic device receives the first text data sent by the first electronic device, and displays the first text data on the first document editing box.

In addition, the internal memory 221 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.

Certainly, the code of the multi-device data cooperation algorithm provided in the embodiment of the present application may also be stored in an external memory. In this case, the processor 210 can run the code of the multi-device data cooperation algorithm stored in the external memory through the external memory interface 220, and the processor 210 can control the second electronic device to run the first document editing application. In response to a first operation on the first document editing application of the second electronic device, displaying a first document editing box of the first document editing application on the second electronic device; sending a first notification message to a first electronic device, where the first notification message is used to establish data cooperation between the first electronic device and the second electronic device; receiving the first text data sent by the first electronic device, in the first electronic device The first text data is displayed on the document edit box.

The function of the sensor module 280 is described below.

The gyro sensor 280A can be used to determine the movement attitude of the electronic device 200 . In some embodiments, the angular velocity of electronic device 200 about three axes (ie, x, y, and z axes) may be determined by gyro sensor 280A. That is, the gyro sensor 280A can be used to detect the current motion state of the electronic device 200, such as shaking or stillness.

When the display screen in the embodiment of the present application is a foldable screen, the gyro sensor 280A can be used to detect a folding or unfolding operation acting on the display screen 294 . The gyroscope sensor 280A may report the detected folding operation or unfolding operation to the processor 210 as an event to determine the folding state or unfolding state of the display screen 294 .

The acceleration sensor 280B can detect the magnitude of the acceleration of the electronic device 200 in various directions (generally three axes). That is, the gyro sensor 280A can be used to detect the current motion state of the electronic device 200, such as shaking or stillness. When the display screen in the embodiment of the present application is a foldable screen, the acceleration sensor 280B can be used to detect a folding or unfolding operation acting on the display screen 294 . The acceleration sensor 280B may report the detected folding operation or unfolding operation to the processor 210 as an event to determine the folding state or unfolding state of the display screen 294 .

Proximity light sensor 280G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diodes may be infrared light emitting diodes. The mobile phone emits infrared light outward through light-emitting diodes. Phones use photodiodes to detect reflected infrared light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the phone. When insufficient reflected light is detected, the phone can determine that there are no objects near the phone. When the display screen in the embodiment of the present application is a foldable screen, the proximity light sensor 280G can be arranged on the first screen of the foldable display screen 294, and the proximity light sensor 280G can detect the first screen according to the optical path difference of the infrared signal. The size of the folding or unfolding angle between the screen and the second screen.

The gyroscope sensor 280A (or the acceleration sensor 280B) may send the detected motion state information (such as angular velocity) to the processor 210 . The processor 210 determines whether the current state is the hand-held state or the tripod state based on the motion state information (for example, when the angular velocity is not 0, it means that the electronic device 200 is in the hand-held state).

The fingerprint sensor 280H is used to collect fingerprints. The electronic device 200 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking pictures with fingerprints, answering incoming calls with fingerprints, and the like.

Touch sensor 280K, also called "touch panel". The touch sensor 280K may be disposed on the display screen 294, and the touch sensor 280K and the display screen 294 form a touch screen, also called a "touch screen". The touch sensor 280K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through display screen 294 . In other embodiments, the touch sensor 280K may also be disposed on the surface of the electronic device 200 , which is different from the location where the display screen 294 is located.

Exemplarily, the display screen 294 of the electronic device 200 displays a main interface, and the main interface includes icons of multiple applications (such as a camera application, a WeChat application, etc.). The user clicks the icon of the camera application in the main interface through the touch sensor 280K, which triggers the processor 210 to start the camera application and turn on the camera 293 . Display screen 294 displays an interface of a camera application, such as a viewfinder interface.

The wireless communication function of the electronic device 200 may be implemented by the antenna 1, the antenna 2, the mobile communication module 251, the wireless communication module 252, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 200 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 251 can provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 200 . The mobile communication module 251 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like. The mobile communication module 251 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 251 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 251 may be provided in the processor 210 . In some embodiments, at least part of the functional modules of the mobile communication module 251 may be provided in the same device as at least part of the modules of the processor 210 . In this embodiment of the present application, the mobile communication module 251 may also be used to exchange information with other terminal devices, that is, to send requests to other terminal devices, or the mobile communication module 251 may be used to receive requests and encapsulate the received requests into a specified format news.

The modem processor may include a modulator and a demodulator. Wherein, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and passed to the application processor. The application processor outputs sound signals through audio devices (not limited to the speaker 270A, the receiver 270B, etc.), or displays images or videos through the display screen 294 . In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modulation and demodulation processor may be independent of the processor 210, and may be provided in the same device as the mobile communication module 251 or other functional modules.

The wireless communication module 252 can provide applications on the electronic device 200 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), NFC, infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 252 may be one or more devices integrating at least one communication processing module. The wireless communication module 252 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 210 . The wireless communication module 252 can also receive the signal to be sent from the processor 210 , perform frequency modulation on the signal, amplify the signal, and then convert it into an electromagnetic wave for radiation through the antenna 2 . In this embodiment of the present application, the wireless communication module 252 is configured to establish a connection with a device, and output a notification message through the device. Alternatively, the wireless communication module 252 can be used to access the access point device and establish a connection with other terminal devices. For example, the second electronic device may establish a communication connection with the first electronic device. Optionally, the wireless communication module 252 can also be used to receive data from other terminal devices.

In addition, the electronic device 200 may implement audio functions through an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, an application processor, and the like. Such as music playback, recording, etc. The electronic device 200 may receive key 290 inputs and generate key signal inputs related to user settings and function control of the electronic device 200 . The electronic device 200 may use the motor 291 to generate vibration alerts (eg, vibration alerts for incoming calls). The indicator 292 in the electronic device 200 can be an indicator light, which can be used to indicate a charging state, a change in power, and can also be used to indicate a message, a missed call, a notification, and the like. The SIM card interface 295 in the electronic device 200 is used to connect the SIM card. The SIM card can be contacted and separated from the electronic device 200 by inserting into the SIM card interface 295 or pulling out from the SIM card interface 295 .

It should be understood that, in practical applications, the electronic device 200 may include more or less components than those shown in FIG. 2 , which are not limited in this embodiment of the present application. The illustrated electronic device 200 is only an example, and the electronic device 200 may have more or fewer components than those shown, two or more components may be combined, or a different configuration of components may be present. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The software system of the terminal device can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiments of the present invention take an Android system with a layered architecture as an example to exemplarily describe the software structure of a terminal device. FIG. 3 is a block diagram of a software structure of a terminal device according to an embodiment of the present invention. Exemplarily, FIG. 3 is a schematic diagram of a software architecture that can run in the above-mentioned first electronic device. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. As shown in Figure 3, the software architecture can be divided into five layers, namely the application layer, the application framework layer, the Android runtime and system library, the hardware abstraction layer and the Linux kernel layer.

The application layer is the top layer of the operating system and includes the native applications of the operating system, such as email client, SMS, calling, calendar, browser, contacts, etc. The APP involved in the embodiments of the present application, referred to as an application for short, is a software program capable of implementing one or more specific functions. Typically, multiple applications can be installed in a terminal device. For example, camera applications, mailbox applications, smart home control applications, etc. The applications mentioned below may be system applications that have been installed when the terminal device is shipped from the factory, or may be third-party applications downloaded from the network or obtained from other terminal devices by the user during the use of the terminal device.

Of course, for developers, developers can write applications and install to this layer. The application framework layer can include window managers, content providers, view systems, telephony managers, resource managers, notification managers, etc. Among them, the window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.

In some embodiments of the present application, the application layer may be used to implement the presentation of a setting interface, and the above setting interface may be used by the user to set the data cooperation function of the first electronic device 101 . For example, the user can enable or disable the data collaboration function in the setting interface, and can also configure the data collaboration function in the setting interface, such as the document type settings available for the data collaboration function, and the user name and password settings for login authentication. Exemplarily, the above-mentioned setting interface may be the content in the status bar or notification bar displayed on the touch screen of the first electronic device 101 , or may be the cooperation control interface displayed on the touch screen of the first electronic device 101 .

In a possible implementation, the application can be developed using the Java language, by calling the application programming interface (API) provided by the application framework layer, and the developer can communicate with the operating system through the application framework. interact with the underlying layers (such as hardware abstraction layer, kernel layer, etc.) to develop their own applications. The application framework is mainly a series of services and management systems of the operating system.

In some embodiments of the present application, the application framework layer includes a document editing discovery service, which is mainly responsible for invoking a service interface that communicates with the hardware abstraction layer, so as to transmit a request for enabling or disabling the data collaboration function to the hardware abstraction layer , is also responsible for the management of document editing discovery service information, such as the management of document types that trigger the document editing discovery service (word\outlook\txt\notepad++\UltraEdit, etc.), the management of user names and passwords for login authentication, etc. Illustratively, the document editing discovery service may include various modules for managing data collaboration functions. For example, document editing discovery services include interface adapters, document discovery settings, document discovery state machines, local controllers, and more. The document editing discovery service may also include configuration files. The configuration file may include a whitelist of applications that can trigger document creation corresponding to the document editing discovery service. For example, the applications in the whitelist may include: document editing applications, such as word, excel, wps, txt, notepad++, UltraEdit, and so on. It can also be a mail application, for example, an email application such as Outlook, an instant messaging application, such as WeChat, DingTalk, Taobao client, etc., or a browser application, such as IE, Firefox, etc. Of course, there may also be other applications where document creation may exist, for example, multimedia applications such as photo editing applications. For example, the user may need to edit the text when creating multimedia files such as photo albums, video files, and voice files. Therefore, the user can add the application to the whitelist, so that the applications in the whitelist are stored in the above configuration file, so that the Enables the document editing discovery service to determine the opening of the document editing scenario when the application in the whitelist is opened.

In some other embodiments, the data collaboration function is implemented as a sub-function of the original document editing function in the first electronic device. For example, the data collaboration function can be implemented as a sub-function of the Huawei Share function of the Huawei mobile phone, At this point, the document editing discovery service can exist in the Huawei Share application in the form of a submodule.

The above interface adapter is used to provide services for the upper-layer setting interface. For example, when the user operates the cooperation switch button of the data collaboration function, the interface adapter can provide corresponding services for the setting interface, so as to change the data collaboration function in the setting interface. The state of the cooperating switch button (eg, switching from an off state to an on state). The above document editing discovery service settings are mainly responsible for saving the document type that triggers the document editing discovery service and/or the username and password for login authentication. The above manuscript finds that the state machine is mainly responsible for monitoring the running state of the underlying collaboration service. The above local controller is mainly responsible for controlling the underlying signals. The above configuration files are mainly used to store collaboration directories, file directories, and user collaboration scope settings. Content providers are used to store and retrieve data and make these data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications. A display interface can consist of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures. The telephony manager is used to provide the communication function of the terminal device. For example, the management of call status (including connecting, hanging up, etc.). The resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on. The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the terminal device vibrates, and the indicator light flashes.

In the embodiment of the present application, the application framework layer may further include a file observer, a WI-FI service, and a notification manager. These three modules are mainly responsible for cooperating with the document editing and discovery service to provide a data collaboration function. For example, the WI-FI service is used to monitor whether the first electronic device is connected to the wireless access point. For another example, the notification manager is configured to transmit the notification message to the upper layer for presentation on the touch screen of the first electronic device.

The Android runtime includes core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system. The core library of the Android system consists of two parts: one part is the function functions that the java language needs to call, and the other part is the core library of the Android system. The application layer and the application framework layer run in virtual machines. Taking java as an example, the virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.

A system library can include multiple functional modules. For example: surface manager, media library, 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc. The Surface Manager manages the display subsystem and provides a fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing. A 2D graphics engine is a drawing engine for 2D drawing.

In some embodiments of the present application, the system library may further include: data collaboration configuration, document editing discovery service password, document editing discovery configuration file, responsible for providing a service interface for communicating with the application framework layer, and also responsible for managing data collaboration Services, manage document discovery configuration files, document editing discovery service passwords, etc. The document discovery configuration file can be used to store the information of the document editing discovery service, for example, the password of the document editing discovery service can be used to store information such as the user name and password of the login authentication.

The Hardware Abstraction Layer (HAL) is the support of the application framework and an important link between the application framework layer and the Linux kernel layer. It can provide services for developers through the application framework layer.

Exemplarily, the functions of the data collaboration service and the document editing discovery service in the embodiments of the present application may be implemented by configuring the first process in the hardware abstraction layer, and the first process may be a subprocess constructed separately in the hardware abstraction layer. The first process may include modules such as an interface, a document editing discovery controller, a data collaboration controller, and a document editing discovery configuration interface. The above interface is a service interface that communicates with the application framework layer. The document editing discovery controller is used to monitor the configuration of the upper-layer document editing discovery service, for example, to control whether authentication is required. The above-mentioned document editing discovery controller is mainly responsible for monitoring whether the input data in the first electronic device needs to be cached or updated. A daemon process may also be included in the hardware abstraction layer, and the daemon process may be used to cache data in the first process, which may be a subprocess constructed separately in the hardware abstraction layer.

The Linux Kernel layer provides the core system services of the operating system, such as security, memory management, process management, network protocol stack and driver model, all based on the Linux kernel. The Linux kernel also acts as an abstraction layer between the hardware and software stacks. This layer has many drivers related to electronic devices, the main drivers are: display driver; Linux-based frame buffer driver; keyboard driver as input device; Flash driver based on memory technology device; camera driver; audio driver; Bluetooth driver ; WI-FI driver, etc. In some embodiments of the present application, the Linux kernel relies on the local file system. The local file system can be accessed through the collaboration service, and the collaboration data in the local file system can be configured through the service interface of the hardware abstraction layer.

The technical solutions involved in the following embodiments can all be implemented in an electronic device having the above-mentioned hardware architecture and software architecture.

For ease of understanding, in this embodiment of the present application, the first electronic device is a mobile phone, the second electronic device is a laptop computer, and the collaboration data in the mobile phone is accessed through the laptop computer as an example, and the text processing method for multiple devices provided in the embodiment of the present application is performed. Specific introduction. As shown in Figure 4a, the following steps are included:

S401. The document editing discovery service of the second electronic device determines that the second electronic device is in a scene of document editing.

In some embodiments of the present application, in response to a first operation on the document editing application of the second electronic device, a first document editing box of the document editing application is displayed on the second electronic device. The first operation may include at least one of the following: an operation of opening a first document editing application, an operation of clicking a document editing box in the first document editing application, an operation of switching the first document editing application, and an operation of switching the first document editing application. The operation of the document editing box in the document editing application.

In a possible manner, the document editing discovery service may determine the document editing application currently opened by the second electronic device by viewing the current process. For example, in response to the operation for opening the word application on the second electronic device, the second electronic device starts the process of the word application, so that the document editing discovery service can determine in the process that the process of the word application has been enabled, and for another example, in response to In the operation for opening the mail application on the second electronic device, the second electronic device starts the process of the mail application, so that the document editing discovery service can determine during the process that the process of the mail application has been enabled. Alternatively, the above application may also be a browser application, an instant messaging application and other applications belonging to a white list, which are not limited herein.

In another possible manner, the second electronic device may be provided with a document editing discovery service, for example, the document editing discovery service may identify that the current focus of the second electronic device is a text editing box. The text editing box may be a text editing box in an application with a text editing function. An application with a text editing function (document editing application) may be a browser, a mail sending and receiving application, a picture editing application, a calling application, a video browsing application, a document editing application, and the like.

The following describes possible ways in which the document editing discovery service of the second electronic device determines that the second electronic device is in a document editing scenario by way of example 1 to way 2.

Mode 1, taking the document editing application as word as an example, in response to the user's operation of opening the word application, the second electronic device opens the word application, and displays a document opening interface on the display screen of the second electronic device, and the document opening interface can display A control for opening a document (eg, as shown in FIG. 4b, open control 4013), and the like. As shown in FIG. 4b, in response to the user's operation of opening the first document, the second electronic device may display an open document interface 4016, wherein the open document interface 4016 may include a plurality of text editing boxes 4017, for example, text editing for entering a file name box, text edit box to enter the document path, search input box. The second electronic device displays the editing interface of the first document in the word application. As shown in FIG. 4c, the editing interface of the first document may include at least one editable text editing box, for example, it may include a main interface 4010 for text editing, a text editing box 4011 for a search bar, and a tool The text edit box in the bar, for example, in the start tab page in the toolbar, the text edit box 4012 of font and font size can be included, and in the page layout tab page in the toolbar, the text edit box corresponding to the paragraph can be included, For another example, as shown in Figure 4d, when word opens the interface of the formula editor, the interface of the formula editor may also include a text editing box 4014 for formula editing, or, as shown in Figure 4e, in the editing interface of word, It can also include an editable text editing box 4015, and the content that can be inserted in the text editing box includes: picture type, ppt type, and other editable picture types, for example, files generated by drawing applications such as viso.

In response to a click operation acting on the editable text edit box, the word application can put the editable text edit box in an editable state (for example, the dotted box represented by 4015 shown in FIG. The mode identifies the editable state, which is not limited here), at this time, the user can edit the inserted content. In response to the closing operation acting on the editable text editing box, the word application may place the editable text editing box in an uneditable state, and at this time, the word application disables the function of editing the inserted content.

The following uses mode 1.1 to mode 1.3 to illustrate possible scenarios for determining the triggering of S403.

In mode 1.1, the document editing discovery service uses the document editing boxes in the application as the document editing boxes of the document editing scene. At this time, the second electronic device may execute S403 after determining the document editing scene.

In response to an operation acting on the text edit boxes, the word application can switch the focus between the text edit boxes. For example, in response to a click operation acting on the main interface, the word application displays the cursor of the first document on the main interface 4010 . At this time, the document editing discovery service can identify the current focus of the second electronic device as the main interface 4010 . In response to the click operation acting on the text edit box 4015 , the word application displays the focus of the first document within the text edit box 4015 . At this time, the document editing discovery service may identify that the current focus of the second electronic device is the text editing box 4015 . In response to the closing operation acting on the text edit box 4015 , the word application displays the focus of the first document in the main interface 4010 . At this time, the document editing discovery service may identify that the current focus of the second electronic device is the text editing box 4010 .

In Manner 1.2, the document editing box in the data collaboration scenario can be triggered by user confirmation in the following S403, thereby establishing a data collaboration scenario through user confirmation, so as to trigger the second electronic device to send the first notification message to the first electronic device.

For example, as shown in (a) of FIG. 4f, the operation to trigger the data collaboration scenario may be the control 4018 on the document editing discovery service interface that triggers the data collaboration scenario, as shown in (b) of FIG. 4f, and also It may be the document editing discovery control 4018 embedded in the document editing application, which is not limited here. In this manner, in response to the user selecting the text editing box (eg, the main interface 4010 ) of the document editing application and the operation of the control triggering the data collaboration scenario, the second electronic device may determine to trigger the data collaboration scenario.

In mode 1.3, the document editing discovery service may determine the document editing box of the scene that triggers the document editing according to the type of the document editing box in the application. For example, in response to the user's operation of selecting a text editing box of a preset type, the second electronic device determines to trigger a data collaboration scenario. For example, a text editing box of a preset type may be a text editing box preset by a user or a system that may be used for data collaboration, and the text editing box may be a text editing box for inputting long text. In combination with the above examples, the text editing box of the preset type may be the main interface 4010, the text editing box 4010, and the like. At this time, the second electronic device may be located on the main interface 4010 according to the display focus of the second electronic device, and may determine to trigger a data collaboration scenario to execute S403.

Mode 2, taking the document editing application as the mail application as an example, in response to the operation of the user opening the mail application, the second electronic device opens the mail application, and displays the mail application interface on the display screen of the second electronic device, as shown in Figure 4g. As shown in (a), the mail application interface may display a control for enabling mail editing (eg, the file control in (a) in FIG. 4g ), and may also include a text editing box 4021 of the search bar and the like. In response to the user's operation of opening the first email, the second electronic device displays an editing interface of the first email in the email application. As shown in (b) of FIG. 4g, the editing interface of the first email may include at least one editable text editing box, for example, may include a text editing main interface 4020, a recipient editing box 4022, a subject editing box 4023, etc., and may also include a text edit box 4024 in the search bar.

The following uses Mode 2.1 to Mode 2.3 as an example to illustrate the possible scenarios for determining the triggering of S403.

Mode 2.1, the document editing discovery service uses the editing boxes in the application, for example, the text editing box 4021, the main interface 4020, the recipient editing box 4022, the subject editing box 4023, the text editing box 4024, etc., as the documents of the document editing scene Edit box. At this time, the second electronic device may execute S403 after determining the document editing scene.

In response to the operation acting on the text editing boxes, the mail application can switch the focus between the text editing boxes. For example, in response to the clicking operation acting on the main interface 4020, the mail application displays the cursor of the first document on the main interface 4020. superior. At this time, the document editing discovery service may identify the current focus of the second electronic device as the main interface 4020 . In response to the operation on the text edit box 4022, the mail application displays the focus of the first document within the text edit box 4022. At this time, the document editing discovery service may identify that the current focus of the second electronic device is the text editing box 4022 .

Mode 2.2, the document editing box in the data collaboration scenario can be triggered by user confirmation in S403, so as to establish a data collaboration scenario through user confirmation to trigger the second electronic device to send the first notification to the first electronic device.

For example, the operation for triggering the data collaboration scenario may be a control on the document editing discovery service interface that triggers the data collaboration scenario, or may be a document editing discovery control embedded in a document editing application, which is not limited herein. In this manner, in response to the user selecting the text editing box 4020 of the document editing application and the operation of the control triggering the data collaboration scenario, the second electronic device may determine to trigger the data collaboration scenario. For details, reference may be made to the implementation manner in manner 1.2, which will not be repeated here.

In mode 2.3, the document editing discovery service may determine the document editing box of the scene that triggers the document editing according to the type of the document editing box in the application. For example, in response to the user's operation of selecting a text editing box of a preset type, the second electronic device determines to trigger a data collaboration scenario. For example, a text editing box of a preset type may be a text editing box preset by a user or a system that may be used for data collaboration, and the text editing box may be a text editing box for inputting long text. In combination with the above examples, the text editing box of the preset type may be the main interface 4020, the text editing box 4024, and so on. At this time, the second electronic device may be located on the main interface 4020 according to the display focus of the second electronic device, and may determine to trigger a data collaboration scenario to execute S403.

In some embodiments of the present application, the document editing discovery service may be implemented as a sub-function of the data collaboration function in the second electronic device. For example, the data collaboration function in a Huawei computer may be implemented as a sub-function of the Huawei Share function of the computer . Referring to Fig. 5a, the user may operate on the data collaboration control interface displayed on the display screen of the computer to enable the document editing discovery service of the second electronic device. For example, the data collaboration control interface 510 may include a switch button 520 for the Huawei Share function, and a switch button for the document editing discovery service. Thus, in response to the operation of the switch button acting on the Huawei Share function, the Huawei Share function is turned on or off. Or, in response to the operation of the switch button acting on the document editing discovery service, the document editing discovery service is turned on or off.

For another example, referring to Fig. 5b, the user may operate on the collaborative control interface displayed on the display screen of the computer, or may operate the prompt box in the notification bar or task bar of the second electronic device. For setting whether to enable the data collaboration function or the document editing discovery service on the second electronic device. As shown in (a) of FIG. 5b, it is a prompt box of the second electronic device when the user does not operate. As shown in (b) of Figure 5b, it is the prompt box of the second electronic device displayed when the user operates the controls of the Huawei Share function. At this time, the controls of the Huawei Share function include the on and off controls of the Huawei Share function . The above operation may also be an operation on a related icon in the notification bar or task bar of the second electronic device, which is not limited herein.

In order to avoid false triggering of the document editing discovery service, the document editing whitelist and document editing control ID can be configured in this service. The document editing whitelist can include: the application type that triggers the document editing discovery service, such as word\outlook\txt\notepad++ \UltraEdit, etc., when the user's input focus is switched to a whitelisted application in these whitelisted applications, the document editing discovery service is triggered to send a notification message to the second electronic device. Exemplarily, the applications in the document editing whitelist may be set for the user. Exemplarily, as shown in FIG. 5a , the data collaboration control interface 501 may further include a document editing whitelist that triggers the document editing discovery service.

Further, as shown in FIG. 5a, the data cooperation control interface 501 may also include a control for the list of the first electronic devices to set the list of the first electronic devices that can be used by the data cooperation function, so as to avoid untrusted first electronic devices. The device may establish a data collaboration connection with the second electronic device to improve the security of the data collaboration function.

S402, the first electronic device establishes a communication connection with the second electronic device.

The first electronic device and the second electronic device can establish a communication connection in various ways, and the first electronic device and the second electronic device can establish a communication connection through Bluetooth, NFC, or WIFI. For example, the second electronic device triggers a communication connection through NFC to discover the first electronic device, thereby receiving a communication connection request from the first electronic device, and then establishing a communication connection with the first electronic device. The mode a1-mode a3 is used as an example for illustration below.

Mode a1, the first electronic device and the second electronic device can establish a wireless connection with the same WI-FI/hotspot, and the second electronic device can find the first electronic device that establishes a communication connection with the second electronic device through a communication connection, Wherein, after the second electronic device establishes a wireless connection with the WI-FI hotspot, it can broadcast a WI-FI frame, and the WI-FI frame can carry the identifier of the WI-FI hotspot that establishes a wireless connection with the second electronic device, so that the first The electronic device learns, according to the received WI-FI frame, whether the second electronic device and the first electronic device have established a wireless connection with the same WI-FI hotspot.

The identifier of the first electronic device discovered by the second electronic device may be displayed in the interface of the data cooperation function of the second electronic device. The identifier of the first electronic device may include a device icon of the first electronic device and/or a discovery name when the first electronic device acts as a collaboration server. Exemplarily, as shown in (a) of FIG. 5c, taking the first electronic device as a mobile phone and the second electronic device as a notebook computer as an example, the user enables the data collaboration function of the notebook computer. In response to the user's click operation, the notebook computer displays a first search device interface, which may be the search device interface 530 of the data collaboration service of the notebook computer, and the search device interface 530 may include a discoverable first electronic device. The identification of the device, specifically, as shown in FIG. 5c , the device search interface includes an icon 540 of a mobile phone and a discovery name 550 when the mobile phone is used as a collaboration server. In this way, it is convenient for the user to distinguish the type of the device of the collaboration server discovered by the second electronic device, for example, whether the device type of the collaboration server is a tablet computer or a mobile phone. In some other embodiments of the present application, the discovered devices may not be distinguished according to the types of the devices of the collaboration server in the first device search interface.

Exemplarily, in some other embodiments, the user may operate the notification bar or the prompt box in the task bar of the second electronic device, and in response to the above operation, the second electronic device opens the above-mentioned first search device interface. In some other embodiments, the user may operate a relevant icon in the notification bar or task bar of the second electronic device, and in response to the above operation, the second electronic device opens the above-mentioned first search device interface. In response to the operation of the data collaboration request acting on the first search device interface, the second electronic device displays a login interface for prompting the user to input a user name and password for login authentication. The above login interface may also be referred to as an authentication interface, which is used to prompt for input of a user name and password for login authentication.

In the case where password-free access is not allowed on the side of the first electronic device, after the user operates the identifier of the first electronic device in the first device search interface shown in FIG. 5c, in response to the above operation, the second electronic device displays The login interface is for the user to enter the user name and password for login authentication. The second electronic device carries the user name and password input by the user in the communication connection request information and sends it to the first electronic device.

Wherein, after the second electronic device receives the user's confirmation input, the second electronic device can carry the user name and password input by the user in the communication connection request information and send it to the first electronic device via the wireless access point.

Exemplarily, in conjunction with (a) in FIG. 5c, after the user clicks on the identifier of the first electronic device in the first search device interface 530 shown in (a) in FIG. For the click operation of the logo, as shown in (b) of FIG. 5 c , the laptop computer displays a login interface 560 , which may include a pop-up window for the user to input the user name and password for login authentication. After the laptop displays the pop-up window, the user can enter the user name and password in the above-mentioned pop-up window, and click the connect button after the input is completed. In response to the click operation acting on the connection button, the notebook computer carries the user name and password input by the user in the communication connection request information and sends it to the mobile phone via the wireless access point.

The first electronic device receives the communication connection request of the second electronic device from the first port, and verifies the validity of the user name and password carried in the communication connection request. The first port is the service port of the LAN cooperation access protocol.

Wherein, after the first electronic device enables the data cooperation function, it can monitor the first port to know in time whether there are other electronic devices that need to establish a communication connection with the device. After the first electronic device receives the communication connection request information forwarded by the second electronic device via the wireless access point from the first port, the first electronic device can verify the legitimacy of the second electronic device based on the communication connection request information, That is, the first electronic device can verify the user name and password input by the user carried in the received communication connection request information. Exemplarily, the above-mentioned validity verification operation may be performed by the application layer, or may be performed by the hardware abstraction layer.

In some other embodiments of the present application, after the legality verification of the second electronic device by the first electronic device is passed, the first electronic device may also display a notification message to notify the user that a device has successfully established a connection with the first electronic device , which can establish a transmission scenario with the cooperation data in the first electronic device. Illustratively, take the hardware abstraction layer performing legality verification as an example. After the hardware abstraction layer passes the legality verification of the second electronic device, the hardware abstraction layer can send a notification message to the application framework layer that the existing electronic device has successfully established a connection with the local machine, and that it can establish data cooperation with the local machine. After the application framework layer receives the notification message, it forwards the notification message to the application layer. After receiving the notification message, the application layer can display the notification message on the notification bar or the status bar displayed on the touch screen of the mobile phone to indicate that an existing electronic device has successfully established a connection with the machine and can establish data cooperation with the machine. For example, the mobile phone may display a notification message in the notification bar displayed on the touch screen of the mobile phone to prompt the user that an existing electronic device has successfully established a connection with the local machine, and it can establish a data collaboration scenario with the local machine.

In some other embodiments of the present application, when the first electronic device side allows password-free access, after the user operates the identifier of the first electronic device in the first query device interface shown in FIG. 5c, the user responds to Acting on the operation of the identification of the first electronic device, the second electronic device may send data cooperation request information to the first electronic device to request enabling of the data cooperation function of the first electronic device.

In manner a2, the second electronic device may find the first electronic device that establishes a communication connection with the second electronic device.

The manner in which the first electronic device establishes a communication connection with the second electronic device may be the various manners mentioned above. In the first possible implementation manner, the second electronic device discovers the first electronic device through a local area network; for example, it may be The first electronic device and the second electronic device are located in the same local area network, so that the second electronic device searches for all the first electronic devices in the local area network where the second electronic device is located. It is also possible that the second electronic device discovers the first electronic device by means of NFC. At this time, the first electronic device and the second electronic device are not limited to be connected to the local area network, and the first electronic device can also be discovered. For example, the first electronic device is not connected to the Internet, and the second electronic device accesses the mobile network through data traffic. At this time, the second electronic device can find the first electronic device by means of NFC.

Exemplarily, the communication connection request may be triggered by the first electronic device, that is, the first electronic device sends a communication connection request to the second electronic device. For example, the user can scan an identifier such as a QR code of the second electronic device through the scanning function of the first electronic device, so that the first electronic device sends a communication connection to the second electronic device according to the acquired identifier of the second electronic device Alternatively, the user may obtain the NFC identifier of the second electronic device through the NFC function of the first electronic device, so as to send a communication connection request to the second electronic device. The second electronic device may send a communication connection response to the first electronic device in response to the operation acting on the found communication connection request of the first electronic device. The first electronic device confirms to establish a communication connection with the first electronic device according to the sending of the communication connection response.

For another example, the communication connection request may also be triggered by the second electronic device. For example, the user may obtain the Bluetooth identifier of the first electronic device through the Bluetooth function of the second electronic device, so as to send a communication connection request to the first electronic device. After receiving the communication connection request, the first electronic device sends a communication connection response to the second electronic device. The second electronic device confirms to establish a communication connection with the first electronic device according to the sending of the communication connection response. In addition, before sending a communication connection response to the second electronic device, the first electronic device may also display a connection request interface on the first electronic device, and in response to an operation acting on the communication connection request interface, confirm to establish communication with the second electronic device connect.

For the process of sending a communication connection request to perform verification on the first electronic device in the manner a2, reference may be made to the manner a1, which will not be repeated here.

Mode a3, the first electronic device and the second electronic device can respectively establish a connection with the WI-FI hotspot, and when the first electronic device and the second electronic device trust each other, determine the first electronic device that can establish a communication connection with the second electronic device. an electronic device.

In a possible implementation manner, the second electronic device establishes a communication connection with the first electronic device by default to avoid disturbing the user.

Among them, there may be multiple scenarios of mutual trust, and the following takes the mode b1 and the mode b2 as an example to illustrate.

Mode b1, the first electronic device and the second electronic device log into the same account. The above account may be an account provided by the operator for the user, such as a glory account, a Huawei account, etc., or may be an application account, such as a social application account, a video application account, and the like. The above account number may also be carried in the WI-FI frame, so that the first electronic device can know whether the second electronic device and the first electronic device have logged into the same account according to the WI-FI frame.

Exemplarily, when the first electronic device establishes a connection with the second electronic device and the same WI-FI hotspot, obtains the second user identifier of the second electronic device, such as the Huawei account logged in by the second electronic device, and determines the second user ID of the second electronic device. Whether the second user identifier of the electronic device is the same as the first user identifier stored in the first electronic device, such as the Huawei account logged in by the first electronic device. If the first electronic device determines that the second user ID is the same as the first user ID, it indicates that the first electronic device and the second electronic device trust each other, and at this time, the first electronic device can automatically establish a communication connection with the second electronic device.

In manner b2, the mutual trust scenario may be the first electronic device and the second electronic device that have established a communication connection in history.

For example, in the second electronic device, the first electronic device that has historically established a communication connection may be stored, and the second electronic device may regard the above-mentioned first electronic device as a trusted first electronic device, at this time, the second electronic device An identification list of the trusted first electronic device may be displayed on the interface of the electronic device, and in response to a selection operation acting on the identification list of the trusted first electronic device, the first electronic device that currently establishes a communication connection with the second electronic device is determined. The electronic device sends a communication connection request to the first electronic device, and receives a communication connection response returned by the first electronic device, so as to complete the establishment of the communication connection between the first electronic device and the second electronic device.

Optionally, a notification message may also be displayed on the display screen of the second electronic device, for example, a first connection message is displayed on the second electronic device; the first connection message is used to prompt the user that the second electronic device is connected to the second electronic device. The first electronic device establishes a communication connection. Similarly, a notification message may also be displayed on the touch screen of the first electronic device for notifying the user that the second electronic device has established a communication connection with the first electronic device. For example, a first connection message is displayed on the first electronic device; the first connection message is used to prompt the user to establish a communication connection between the second electronic device and the first electronic device.

For the process of sending a communication connection request to perform verification on the first electronic device in the manner a3, reference may be made to the manner a1, which will not be repeated here.

Optionally, a first response message may also be displayed on the display screen of the second electronic device, where the first response message is used to confirm that the first electronic device and the second electronic device enable data cooperation. That is, the first response message is used to notify the user that the first electronic device has turned on the data cooperation function, and the first electronic device has established a communication connection with the second electronic device. As shown in Figure 5d, a data collaboration control interface can also be displayed on the notification bar of the second electronic device, and the data collaboration control interface includes prompt information, and the prompt information can be: "Use HUWEI p40 to perform data collaboration with this machine". The data control interface 510 may also include prompt information of the first electronic device for which the connection is established (for example, the discovery name of the first electronic device is HUAWEI p40), and the prompt information may be: "Connected to HUAWEI p40". Thus, the user is notified that the first electronic device has turned on the data cooperation function, and the first electronic device establishes a communication connection with the second electronic device. Similarly, a notification message may also be displayed on the touch screen of the first electronic device to notify the user that the first electronic device has turned on the data cooperation function and that the second electronic device has established a communication connection with the first electronic device. For example, as shown in (a) of FIG. 6b, on the notification bar of the first electronic device, a data collaboration control interface 710 is displayed, and the data collaboration control interface 710 includes prompt information of the data collaboration service, and the prompt information may be: "Working with HUWEI MATEBOOK Data Using Your Mobile Phone". The data control interface 710 may also include prompt information of the second electronic device that establishes the connection (for example, the discovery name of the second electronic device is HUWEI MATEBOOK), and the prompt information may be: "HUAWEI MATEBOOK is connected".

In the scenario where the first electronic device establishes a communication connection with the second electronic device, the second electronic device can discover the first electronic device, so that subsequent users can receive the collaboration data sent by the first electronic device on the second electronic device. ready.

Further, in the process of establishing a communication connection between the first electronic device and the second electronic device, in order to avoid the frequent operation of the data cooperation function by the user, a possible implementation manner, the second electronic device may preset the data cooperation function to be enabled. The trigger condition, for example, when the first electronic device establishes a communication connection with the second electronic device, and the second electronic device starts the application of document editing, the second electronic device automatically enables the data collaboration function.

Correspondingly, the first electronic device may also preset a trigger condition for enabling the data cooperation function. For example, after the first electronic device establishes a communication connection with the second electronic device, the first electronic device automatically enables the data cooperation function. After data collaboration is enabled, a first response message is sent to the second electronic device, where the first response message is used by the second electronic device to confirm that the first electronic device and the second electronic device enable data collaboration. Optionally, the second electronic device can also display the first response message on the display screen, and the first response message can be displayed in the notification bar (for example, as shown in Figure 5d, "HUAWEI p40 is connected"), or it can be displayed by popping the button. The window is displayed, and the specific display method can refer to the display method of the first notification message, which will not be repeated here.

Another possible implementation manner, considering that the communication connection is used to realize the data collaboration function, therefore, the user can set on the data collaboration control interface in the second electronic device: the first electronic device to be searched for has enabled data collaboration functional electronic equipment. Therefore, the second electronic device only establishes a communication connection with the first electronic device with the data cooperation function turned on, so as to improve the security of the communication connection. Exemplarily, when the second electronic device determines that the first electronic device enables the data cooperation function, a communication connection is established with the first electronic device.

Correspondingly, the first electronic device may be preset to enable the data cooperation function.

The following examples illustrate ways A1-A5 for enabling the data collaboration function.

Manner A1, the second electronic device may send a data cooperation request to the first electronic device in response to a data cooperation request operation acting on the found first electronic device. The first electronic device displays a data collaboration control interface in response to the confirmation operation acting on the data collaboration request. In response to the operation acting on the data cooperation control interface, it is confirmed that the data cooperation function is turned on.

In this embodiment of the present application, the data collaboration function of the first electronic device may be implemented as a sub-function of the document editing service function in the first electronic device. For example, the data collaboration function in a Huawei mobile phone may be used as a sub-function of the Huawei Share function of the mobile phone The sub-function is realized. At this time, referring to FIG. 6a, the user operates on the cooperation control interface displayed on the touch screen of the mobile phone to set the data cooperation function of the first electronic device. For example, the data collaboration control interface 610 includes the switch button 620 of the Huawei Share function, the switch button 630 of the data collaboration service, and may also include a document editing whitelist for triggering the data collaboration function by the second electronic device, and a trusted second The second electronic device list corresponding to the electronic device.

Among them, the main function of the switch button 620 of the Huawei Share function is to turn on/off the Huawei Share function. The user can operate the switch button 620 of the Huawei Share function. After receiving the user's operation of the switch button 620 of the Huawei Share function, the mobile phone can call the relevant system service interface to enable/disable the Huawei Share function, and can respond to the user's operation. Operation, switch the state of the switch button 602 of the Huawei Share function (eg, switch from an off state to an on state). The above-mentioned data collaboration control interface 610 may also include a real-time status identifier of the Huawei Share function (not shown in FIG. 6a ). Similarly, the main function of the switch button 630 of the data collaboration service is to enable/disable the data collaboration service. The user can operate the switch button 630 of the data cooperation service. After receiving the operation of the switch button 630 acting on the data cooperation service, the mobile phone can call the relevant system service interface to turn on/off the data cooperation service, and can respond to the user's request. Operation, switch the state of the switch button 630 of the data cooperation service (eg, switch from the off state to the on state). The above-mentioned data cooperation control interface 610 may further include a real-time status identifier of the data cooperation service (not shown in FIG. 6a ).

In a possible embodiment, as shown in (a) of FIG. 6b, the user operates the collaboration control 720 (input) of the data collaboration function on the first prompt box 710 in the notification bar displayed on the touch screen of the mobile phone. , which is used to enable the data cooperation function of the first electronic device. The above notification bar may be an interface displayed by the user on the touch screen of the mobile phone, for example, displayed after performing a sliding operation on the home screen of the mobile phone.

Exemplarily, with reference to FIG. 3 and FIG. 5a, when the user wants to realize the collaborative creation of text between the first electronic device and the second electronic device, the user may, in the collaborative control interface 501 displayed on the touch screen of the first electronic device, The cooperation switch button 502 of the data cooperation function is touch-operated. At this time, the application layer of the operating system running in the mobile phone can detect the operation of enabling the data cooperation function. The application layer converts the detected operation into a request for enabling the data cooperation function, and then transfers it to the application framework layer of the operating system running in the mobile phone. After receiving the request, the application framework layer calls the service interface that communicates with the hardware abstraction layer of the operating system running in the mobile phone, so as to transmit the request for enabling the data cooperation function to the hardware abstraction layer. After receiving the request for enabling the data collaboration function, the hardware abstraction layer enables the data collaboration function of the mobile phone. For example, the hardware abstraction layer can start two daemons to turn on the data cooperation function of the mobile phone. The first daemon process can provide functions such as data collaboration services and user authority verification, which can enable document editing and discovery services, and the second daemon process can enable the laptop to receive local text data files of the Linux kernel layer of the operating system in the mobile phone.

In some other embodiments of the present application, the cooperation switch button of the above-mentioned data cooperation function may be a physical button, and the button may be set on a surface of the first electronic device; when the user's finger presses or toggles the physical button ( That is, the above-mentioned first input), the first electronic device enables the data cooperation function, and when the user's finger presses or toggles the physical button again, the first electronic device can disable the data cooperation function.

Manner A2, the second electronic device establishes a communication connection with the first electronic device by default, and the first electronic device automatically enables the data cooperation function to avoid disturbing the user.

For example, before establishing a communication connection with the second electronic device, the first electronic device may enable the data cooperation function in response to the user setting on the data cooperation control interface to enable the data cooperation function by default.

Manner A3, the first electronic device may also be the first electronic device when certain conditions are met (for example, S404, the first electronic device receives a data collaboration request from the second electronic device, the first electronic device satisfies a preset gesture, etc.) The device automatically enables the data cooperation function of the first electronic device.

Mode A4, the first electronic device and the second electronic device can respectively establish a connection with the WI-FI hotspot, and when the first electronic device and the second electronic device trust each other, determine the first electronic device that can establish a communication connection with the second electronic device. An electronic device, the first electronic device can automatically enable the data cooperation function.

For example, after the first electronic device can set a trusted second electronic device in the data cooperation control interface to establish a communication connection, the first electronic device enables the data cooperation function.

Mode A5, the interface of the second electronic device can display the identification list of the trusted first electronic device, and in response to the selection operation acting on the identification list of the trusted first electronic device, it is determined that the current connection with the second electronic device is established. The first electronic device connected in communication, and the second electronic device sends a data cooperation request to the first electronic device. In response to the confirmation operation acting on the data cooperation request, the first electronic device confirms that the data cooperation function is enabled, and establishes a communication connection with the second electronic device.

In this embodiment of the present application, after the data collaboration function is enabled, the touch screen of the first electronic device may further display a collaboration state identifier, where the collaboration state identifier is used to indicate that the data collaboration function has been enabled. Exemplarily, after the hardware abstraction layer enables the data collaboration function, a notification message that the data collaboration function has been enabled may be sent to the application framework layer. After the application framework layer receives the notification message, it forwards the notification message to the application layer. After receiving the notification message, the application layer can display a collaboration status indicator on the touch screen of the mobile phone for indicating that the data collaboration function has been turned on. For example, as shown in FIG. 6c, the mobile phone may display a collaboration icon 740 in the status bar 730 displayed on the touch screen of the mobile phone to prompt the user that the data collaboration function of the mobile phone has been turned on. The first electronic device can monitor the real-time status of the data collaboration service in the setting database by means of a registered observer. With the change of the status of the data collaboration service, the real-time status identifier of the data collaboration service can be correspondingly marked in the control interface 601. Update, you can also update the real-time status identifier of the data collaboration service in the notification bar, which is not limited here.

In combination with the above embodiments, the data cooperation control interface 610 may further include a switch button visible to the second electronic device. Exemplarily, only when the switch button 630 of the data cooperation service and the switch button visible to the second electronic device establishing the communication connection are turned on at the same time, the first electronic device can receive the data cooperation request from the second electronic device.

Optionally, the data collaboration control interface 610 may further include a pop-up box (not shown in FIG. 6a ) for switching the visible range, where the pop-up box is used for the user to switch the visible range of the data collaboration. The user can operate the setting interface or the notification option of the notification bar to trigger the display of the above-mentioned pop-up box on the touch screen of the mobile phone. When the status of the data collaboration service changes, if the above-mentioned pop-up box is displayed, the above-mentioned pop-up box disappears. In some embodiments, when the user selects the visible range to be visible to "all devices", when the mobile phone is connected to an open wireless access point or allows password-free access to other electronic devices, the mobile phone may display a prompt pop-up window to remind It is risky for users to open the data collaboration service. In addition, when the user enables the data collaboration service, the mobile phone can also verify the user's permissions, such as whether to allow the data collaboration service to be enabled and/or whether to obtain a Huawei account.

In some other embodiments of the present application, the user can also identify, in the collaboration control interface, the discovery name of the first electronic device as the collaboration server, the scope of collaboration data that the collaboration client can access, and the username and password for login authentication, etc. Make settings.

Exemplarily, as shown in FIG. 3 and FIGS. 5a-5d, taking the user wanting to set the user name and password for login authentication as an example, the data collaboration control interface 510 also includes a computer access verification option. The user can operate the computer access verification option in the data collaboration control interface 510 . At this point, the application layer can detect the above operation. After the application layer converts the above operation into a request to set the user name and password for login authentication, it is passed to the application framework layer. After the application framework layer receives the request, it provides the application layer with the function of setting the user name and password for login authentication. At this time, the application layer can display the user name and password setting window on the touch screen of the mobile phone according to the functions provided by the application framework layer in response to the above operation. The user can enter the corresponding user name and password in the user name and password setting window, and click the OK button after the input is completed. The application layer transmits the user name and password entered by the user to the application framework layer according to the click action on the OK button. After the application framework layer receives the username and password, it calls the service interface that communicates with the hardware abstraction layer to pass the received username and password to the hardware abstraction layer. After receiving the user name and password, the hardware abstraction layer stores the received user name and password in the document editing discovery service password, so as to realize the setting of the user name and password for login authentication. In other embodiments of the present application, the user name and password for login authentication are not only stored in the document editing and discovery service password of the hardware abstraction layer, but also a copy of the user name and password may be stored in the application framework layer. When users enter the validity of the username and password on the computer, they can query the valid username and password from the copy saved in the application layer, which reduces the interaction between layers. In some other embodiments of the present application, the user may also not set the user name and password for login authentication. In this way, the user name and password for login authentication will adopt the default configuration. In other embodiments of the present application, for the setting of the user name and password for login authentication, if the user deletes the default user name and password for login authentication, and does not set a new user name and password for login authentication, the second electronic device is accessing When the first electronic device is used, there is no need to enter a user name and password, and it can be accessed automatically. In addition, in some embodiments of the present application, the first electronic device may further provide the user with an interface for selecting whether the access of the second electronic device requires authentication, so as to decide whether to enable the password-free access function.

Exemplarily, taking the user wanting to set the discovery name when the mobile phone is used as the collaboration server as an example, as shown in FIG. ) to operate. At this point, the application layer can detect the above operation. After the application layer converts the above operation into a request to set the discovery name, it is passed to the application framework layer. After the application framework layer receives the request, it provides the application layer with the function of setting the discovery name. At this time, the application layer can display the setting window of the discovery name on the touch screen of the mobile phone in response to the above operation according to the function provided by the application framework layer. The user can input the corresponding name in the setting window of the discovery name, and click the OK button after the input is completed. The application layer transmits the name entered by the user to the application framework layer based on the click action on the OK button. The application framework layer receives the name and invokes the service interface that communicates with the hardware abstraction layer to pass the received name to the hardware abstraction layer. After the hardware abstraction layer receives the name, it stores the received name in the data collaboration configuration file to realize the setting of the discovery name. In some embodiments, before the user clicks the OK button, the mobile phone can also perform legality detection on the discovery name input by the user, and the user can operate the OK button only when the discovery name input by the user is detected to be valid. If it is detected that the discovery name input by the user is invalid, a prompt box may be displayed to prompt the user that the discovery name is invalid. In other embodiments of the present application, in addition to saving the discovery name in the data collaboration configuration file of the hardware abstraction layer, a copy of the discovery name may also be saved in the application framework layer, so that when the discovery name needs to be queried subsequently, Can be queried from replicas held in the application layer, reducing interactions between layers. In some other embodiments of the present application, the user may also not set the discovery name, in this way, the discovery name will adopt the default configuration. For example, as shown in (a) of Figure 5c, the default discovery name when the mobile phone is used as the collaboration server is: Huawei mobile phone 1. If the user does not modify the discovery name, the name of the collaboration server searched by the laptop is Huawei laptop.

In this embodiment of the present application, when the user sets the data collaboration function for the first time, the first electronic device may display a series of guide interfaces to guide the user to set the data collaboration function, and the first electronic device may also save The user's setting preferences, so that the collaboration function can be set according to the user's setting preferences next time.

It should be noted that S401 and S402 are not limited in order. In the specific implementation process, S401 and S402 may be executed at the same time, or S402 may be executed first, and S401 may be executed later, or, S401 may be executed first, and S402 may be executed later. This is not limited. The above step of enabling the data collaboration function may be performed simultaneously with establishing a network connection, or may be performed after S404, and may be specifically set according to the scene. The specific implementation performed after S404 is described in detail below.

S403. In response to the first operation acting on the document editing application, the second electronic device sends a first notification message to the first electronic device.

As shown in FIG. 7a, the second electronic device may determine that the second electronic device is in the document editing scene according to the display focus of the second electronic device in the document editing box 720 in the document editing application 710, or may determine that the second electronic device is in the document editing scene according to the display focus of the second electronic device. The display focus is on the document editing application 710, and it is determined that the second electronic device is in the document editing scene.

In a possible implementation manner, the second electronic device may send the first notification message to the first electronic device when it is determined that the second electronic device is in a document editing scene.

In another possible implementation manner, the second electronic device may send the first notification message to the first electronic device when it is determined that the second electronic device has triggered the data collaboration scenario. Wherein, the second electronic device may determine to trigger the data collaboration scenario in response to the operation acting on the document editing application. Combining Manner 1 and Manner 2, in response to the user selecting the text editing box of the document editing application and the operation of triggering the data collaboration scenario, the second electronic device determines to trigger the data collaboration scenario. It may also be that the second electronic device determines to trigger the data collaboration scenario in response to the user's operation of selecting a text editing box of a preset type. Thus, the second electronic device can send the first notification message to the first electronic device to establish a data collaboration scenario.

The first notification message sent by the second electronic device may further include the identification of the document editing software that is the focus of the second electronic device, so as to notify the user whether the user needs to use the first electronic device to edit text in the document editing software that is the focus of the second electronic device. collaborative input.

In some possible implementations, the document editing application may include only one window (interface). In other possible implementations, the document editing application may include multiple windows (interfaces), for example, in the case of multiple application windows, floating windows, and the like. Considering that a scenario where multiple application interfaces are displayed simultaneously may occur on the second electronic device, the second electronic device includes multiple editing interfaces. As shown in FIG. 7b, the applications currently opened by the second electronic device include a document editing application and an application 1, wherein the document editing application opens two interfaces, including an interface 710 of document 1 and an interface 712 of document 2. The interface 710 includes an edit box 720 for document editing, and the interface 712 includes an edit box 722 for document editing. Application 1 opens an interface 711 . Application 1 includes an edit box 721 for document editing. The second electronic device may determine that the second electronic device is in a document editing scene when the user's focus is switched to a document editing application (the interface of the document 1 shown in FIG. 7b ). It may also be determined that the second electronic device is in the document editing scene when the user starts the document editing application (as shown in FIG. 7b on the interface of document 1 or the interface of document 2). Thus, the second electronic device may send notification messages of the plurality of document editing applications to the first electronic device; the notification messages may be used to notify the second electronic device of multiple document editing boxes of the plurality of document editing applications ; Thereby, after receiving the notification message, the first electronic device displays multiple editing preview interfaces of the multiple document editing boxes on the data collaboration interface (for example, as shown in (b) in FIG. 8 a ) The editing preview interface in the third control, or, as shown in (c) in FIG. 8a, the editing preview interface displayed corresponding to the fourth control); in response to the switching operation acting on the plurality of editing preview interfaces, the the second electronic device sends a switching message; the switching operation is used to indicate the switched second document edit box; after the second electronic device receives the switching message sent by the first electronic device, The focus switches to the second document edit box. Therefore, the second electronic device can receive the third text data sent by the first electronic device, and display the third text data on the second document editing box.

S404. The data cooperation service of the first electronic device receives the first notification message, and displays the first prompt box on the first electronic device.

The first prompt box may be displayed in the notification bar, for example, as shown in (a) of FIG. 6b, the first prompt box 710 is displayed in the notification bar. Alternatively, the first prompt box may also be displayed on the main interface of the first electronic device. For example, as shown in (b) of FIG. 6b, the first prompt box 730 is displayed on the main interface of the first electronic device. The first prompt box may include first prompt information to display the first notification message. As shown in (a) and (b) of FIG. 6b, take the identifier of the second electronic device as HUWEI MATEBOOK as an example. The prompt information can be: "Use your mobile phone for data collaboration with HUWEI MATEBOOK".

In a possible implementation manner, in response to an operation acting on the first prompt box, such as a sliding operation, a selection operation, etc., the first control is displayed on the first prompt box.

As shown in (a) of FIG. 6b, the first control 711 included in the first prompt box 710 may be a confirmation control for prompting the user to click the first control to enter the data collaboration display interface. The first prompt box 710 may further include an ignore control 712 for the user to close the first prompt box 710 . As shown in (b) of FIG. 6b, the first control 731 included in the first prompt box 730 may be a confirmation control for prompting the user to click the first control to enter the data collaboration display interface. The first prompt box 730 may further include an ignore control 732 for the user to close the first prompt box 730 .

Further, the first control may also be a cooperation switch of the data cooperation function. This switch can be used to enable or disable the data collaboration function. For example, as shown in FIG. 6a, the first prompt box may be a collaboration control interface popped up by the first electronic device, and the collaboration switch button of the data collaboration function may be included in the collaboration control interface. For example, in some embodiments, the first operation It may be the user's operation on the collaboration switch button 630 of the data collaboration function in the data collaboration control interface 610 displayed on the touch screen of the mobile phone. In response to the operation of the cooperation switch button 630 acting on the data cooperation function, the state of the cooperation switch button 630 of the data cooperation function will change, for example, from an off state to an on state. When the collaboration switch button of the data collaboration function is in an on state, the first electronic device confirms to enter the data collaboration scene.

When the user performs an operation to enable the data collaboration function on the first control, the first electronic device displays a data collaboration interface. When the user operates the first control to turn off the data cooperation function, the first electronic device displays a notification message that the data cooperation function is turned off. The display mode of the notification message can refer to the display mode of the first prompt box, which is not repeated here. The user's operation on the cooperation switch of the data cooperation function of the first electronic device may include operations such as clicking, sliding, double-clicking, multi-gesture operation, or voice control, which is not limited herein.

S405. In response to the first user operation acting on the first control, pop up a data collaboration interface.

The first user operation may be a confirmation operation. At this time, in response to the confirmation operation acting on the first control, the first electronic device may confirm that the data collaboration function is enabled. The second electronic device sends a first response message, where the first response message is used to confirm that the data cooperation function of the first electronic device and the second electronic device is enabled. Therefore, after the second electronic device receives the first response message, the data cooperation service can be displayed on the notification bar to confirm that the first electronic device and the second electronic device establish data cooperation.

In response to the confirmation operation acting on the first control, the first electronic device pops up a data collaboration interface on the display screen. In a possible implementation manner, the data collaboration interface may be displayed on the first electronic device in the form of a first display frame.

As shown in (a) of FIG. 8a , the first display box 810 may include at least one of the following: second prompt information, and a second control 820 .

Wherein, the second prompt information may be used to prompt that the data collaboration scenario is opened, and please perform voice input.

The second control 820 may include a collaboration operation button of the data collaboration function. The operation button is used to enable or disable the user's voice collection, text entry, text operation and other functions.

Further, considering that the second electronic device may open multiple document editing application interfaces, the first display frame 810 may further include a third control. As shown in (b) of FIG. 8a, the third control 830 may display a third control. The editing preview interface of multiple document editing boxes of the second electronic device, that is, the small icons (including document 1, document 2 and application 1) of the interface of multiple document editing applications opened by the second electronic device, for the user to select the collaborative creation The interface of the document editing application corresponding to the document. For example, in response to the operation of the icon acting on the document 1, the second electronic device switches to the document editing application of the document 1 to perform data collaboration with the first electronic device. In response to the operation of the icon acting on the document 2, the second electronic device switches to the document editing application of the document 2 to perform data collaboration with the first electronic device. In response to the operation acting on the icon of the application 1, the second electronic device switches to the document editing box of the application 1 to perform data collaboration with the first electronic device. Certainly, the switching process may be that when the first electronic device determines the small icon selected by the user, it sends the corresponding interface identifier to the second electronic device, thereby realizing real-time switching. Another possible way is that after the first electronic device determines the text to be sent, when sending the text to be sent to the second electronic device, the interface identifier is sent to the second electronic device at the same time, so that the second electronic device is in the After receiving the text to be sent and the interface identifier, the focus is switched to the interface, and the text to be sent is displayed on the interface.

Considering that in the interface where the second electronic device may open multiple document editing applications, each document editing application may have at least one editable document editing box, the multiple document editing applications of the second electronic device may be received by receiving the multiple document editing applications. In the notification message, the first electronic device determines a plurality of document editing applications of the second electronic device. Thus, multiple editing preview interfaces of the multiple document editing applications are displayed on the data collaboration interface. The notification message may also be used to notify the first electronic device of multiple document editing boxes of the second electronic device, so that the first electronic device determines multiple document editing boxes of multiple document editing applications of the second electronic device. Thus, multiple editing preview interfaces of the multiple document editing boxes are displayed on the data collaboration interface.

In response to the switching operation acting on the plurality of editing preview interfaces, a switching message is sent to the second electronic device; the switching operation is used to indicate the switched second document editing frame; the switching message is used to indicate the The second electronic device switches the focus of the second electronic device to the second document editing frame. For example, the current focus of the second electronic device is on the first document editing box of the first document editing application, after the second electronic device receives the switching message, the second electronic device can change the focus from the first document editing application to the first document editing box. A document editing frame is switched to the second document editing frame of the second document editing application. At this time, if the first electronic device collects the second voice data, converts the second voice data into third text data, and displays the third text data on the data cooperation interface; The second electronic device sends the third text data. Correspondingly, the second electronic device receives the third text data sent by the first electronic device, and can display the third text data on the second document editing box.

In a possible embodiment, multiple editing preview interfaces may be displayed in the first display frame, for example, the first display frame may further include a fourth control, as shown in (c) of FIG. 8a, the fourth control 840 It may be a button of the next focus interface (eg, edit box), and in response to the operation acting on the fourth control 840, the focus in the second electronic device may be moved to the next editable edit box. Further, the fourth control 840 may further include an editing preview interface of the focus interface in the second electronic device, so as to ensure that the focus interface currently selected by the user is the focus interface required by the user.

S406. In response to the first operation acting on the first display frame, receive the first voice data of the user, and display the first text data on the data collaboration interface.

The user's operation on the cooperation operation button of the data cooperation function of the first electronic device may include operations such as clicking, sliding, double-clicking, multi-gesture operation, or voice control, which is not limited herein.

The user can perform voice input based on the second control 820 in the first display box.

As shown in (a)-(c) in Fig. 8a, the way of voice input can be the way of long pressing the second control. When the user presses the second control, the voice signal starts to be received; when the user releases the second control When the control is activated, it stops receiving voice signals, thus completing a voice input. Alternatively, the second control may be clicked to trigger the activation of the voice input function, and the current state of voice input is displayed in the first display box. In response to the user's operation of clicking the second control again, the reception of the voice signal is stopped, thereby completing a voice input.

The second control 820 may call a speech recognition application to recognize the input speech. In this embodiment of the present application, the speech recognition application called by the second control may be the default speech recognition application of the first electronic device, or it may be the user's voice recognition application. Identify third-party applications set in the settings interface, which is not limited here.

The first voice data is recognized as initial text data, and the initial text data is displayed on the data collaboration interface. In a possible manner, as shown in (a) of FIG. 8 b , the first display frame may further include a preview interface 850 . The preview interface 850 is used to display the converted original text data.

There are many ways to display, for example, one possible way is that the received voice data can be recognized and converted into text while the voice is input, and the converted text can be displayed in the preview interface in the first display box. to display. In another possible manner, after completing a voice input, the input voice data is recognized, and the recognized text is displayed on the preview interface. Further, error correction can also be performed on the recognized text, and the error correction process can be displayed on the preview interface at the same time.

S407. In response to the confirmation operation acting on the first display frame, send the first text data to the second electronic device.

The confirmation operation acting on the first display box may be confirming that the text in the preview interface is text data to be sent.

Exemplarily, as shown in (b) of FIG. 8b, the first display box 810 may further include an edit control 860, which may be a confirmation button, for the user to confirm that the text in the preview interface is the text to be sent.

Before the user confirms the text to be sent, the user can also edit the text in the preview interface. In this case, the data collaboration interface can include an editing control, and the editing control is used to edit the text in the preview interface. Therefore, the first electronic device determines an editing instruction for the initial text data in response to the third user operation acting on the editing control, and displays the edited initial text data on the data collaboration interface; the first electronic device In response to a second user operation of the user, the edited initial text data is used as the first text data. There are many editing methods, the following is an example of methods c1-c3.

In manner c1, the preview interface 850 may be an editable interface, and a cursor may be displayed in the editable interface, and the cursor is used to display the position of the currently inserted text. In response to the user clicking the cursor on the editable interface, for example, moving the cursor, selecting at least one text, etc., the position of the cursor or the selected at least one text is displayed in the preview interface 850 . In response to an operation acting on the voice confirmation control, voice data input by the user is received, the voice input by the user is recognized, and displayed text is inserted or updated at the cursor position, or at the position of at least one selected text.

Mode c2, the text in the preview interface 850 can be selected by the user, and in response to the selection operation acting on the text, an editing control is displayed, and the editing control can include: delete, insert, line feed, backspace, copy, paste and other editing sub-controls . The text is edited in response to a click on the edit control. For example, wrap the input text, add punctuation marks, modify the text content, etc.

In manner c3, the preview interface 850 may be an editable interface, and in response to the user's operation of clicking on the editable interface, a keyboard input box is displayed. In response to the operation acting on the keyboard input box, the text input by the user is received and displayed on the preview interface, so as to realize the editing of the text.

The text data sent by the first electronic device to the second electronic device may also be rich text data. For example, the first text data sent by the first electronic device may include: initial text data and an editing instruction for the initial text data. In a possible implementation manner, the rich text data includes: fields for rich text editing operations. The protocol satisfied by the text data may be a preset protocol. For example, as shown in FIG. 9a, the protocol field may include the protocol number Cmd identifier, the fields corresponding to the protocol requester and the responder, and the text data field. For example, when the Cmd identifier is 0x01, it may indicate that the protocol request sends a first notification message to the responder to establish a data collaboration scenario. When the Cmd identifier is 0x02, it may indicate that the protocol request sends a second notification message to the responder to notify the interruption of the data collaboration scenario. When the Cmd identifier is 0x03, it can indicate that the protocol request sends text data to the responder to notify the responder to receive text data. When the Cmd identifier is 0x04, it can indicate that the protocol request sends text data to the responder to notify the responder to receive text data, where the text data may be data including text and data of rich text editing instructions. The fields corresponding to the protocol requester and the responder may occupy 4 bits. For example, 0x01 is used to indicate that the second electronic device sends a text input request to the first electronic device, and 0x81 is used to indicate that the first electronic device sends a text input request to the second electronic device. The device sends a text input response. 0x02 is used to indicate that the first electronic device sends a text input request to the second electronic device, and 0x82 is used to indicate that the second electronic device sends a text input response to the first electronic device.

S408. The second electronic device receives the first text data, and displays the first text data in the first document editing box of the first document editing application.

After receiving the first text data through the application layer, the second electronic device parses the text data field in the first text data, sends the text data field to the kernel layer, and the core layer stores the text data field in the keyboard buffer, so as to pass the The keyboard buffer is displayed on the first document editing box of the first document editing application.

Modes C1-C3 are exemplified below to illustrate how the application layer transmits text data fields and other fields of text data to the core layer and stores them in the keyboard buffer. As shown in Figure 9b.

In mode C1, the text data field and other fields of the text data parsed from the protocol are converted into UNICODE keyboard codes at the application layer, and the converted UNICODE keyboard codes are sent to the keyboard buffer of the kernel layer.

In mode C2, a keyboard driver is added to the application layer, and the UNICODE keyboard code is generated by parsing the text data field and other fields of the text data through the keyboard driver. Send the UNICODE keyboard code generated by the keyboard driver to the keyboard buffer through the interface between the keyboard driver and the keyboard buffer. This method can improve the success rate of parsing text data fields and other fields of text data.

Mode C3, adding an input method interface of a third-party application in the application layer, and transmitting the first text data to the keyboard driver corresponding to the corresponding third-party application through the input method interface, thereby parsing the text through the keyboard driver corresponding to the third-party application For data fields and other fields of text data, generate UNICODE keyboard codes and input them into the keyboard buffer. It should be noted that, in this manner, the second electronic device needs to load a third-party application, so as to store text data in the keyboard buffer through the keyboard driving of the third-party application.

Optionally, the first electronic device determines that the second electronic device successfully receives the first text data, deletes the first text data, and deletes the first text data on the display interface of the first display frame.

In some embodiments of the present application, the first electronic device may determine that the second electronic device successfully receives the first text data by receiving the first confirmation message sent by the second electronic device. The first confirmation message is used to indicate that the second electronic device has successfully received the first text data.

In some other embodiments of the present application, after it is determined that the data cooperation scenario between the second electronic device and the first electronic device ends, the data cooperation function of the first electronic device may be turned off. A possible implementation manner may be that the user actively disables the data collaboration function of the first electronic device. At this time, in response to the closing operation acting on the data collaboration interface, the application layer can detect the closing operation acting on the data collaboration interface. After the application layer converts the above operation into a request to close the data collaboration function, it is passed to the application framework layer. After the application framework layer receives the request, it calls the service interface that communicates with the hardware abstraction layer to pass the request to close the data cooperation function to the hardware abstraction layer. After receiving the request to close the data cooperation function, the hardware abstraction layer closes the data cooperation function of the mobile phone.

In another possible implementation manner, the first electronic device can also dynamically monitor the communication connection state between the first electronic device and the second electronic device, or the connection state between the first electronic device and the wireless access point, if the first electronic device When the device detects that the connection with the second electronic device is disconnected, or the connection with the wireless access point is disconnected, the first electronic device can automatically turn off the data cooperation function to save power consumption of the first electronic device. In addition, the first electronic device may also display a notification message on the touch screen of the first electronic device to prompt the user that the device is disconnected from the second electronic device or disconnected from the wireless access point. The data collaboration function of the machine has been automatically turned off.

In the process of cooperatively processing text, the second electronic device needs to jump to other applications to process other things, thus causing interruption of the data cooperation scene. In this embodiment of the present application, as shown in FIG. 10a, the method for data collaboration among multiple devices may further include the following steps:

S501. The second electronic device displays a switched interface on the second electronic device in response to a second switching operation of the application; the second switching operation is used to switch the focus of the second electronic device to a third document In addition to the editing application; the third document editing application is a third document editing application corresponding to when the first electronic device and the second electronic device discontinue data cooperation. Thus, the data collaboration service of the second electronic device determines that the second electronic device exits the data collaboration scenario.

In a possible implementation manner, the second switching operation of the application may be that the user jumps to another application, causing the focus of the second electronic device to be switched to the display interface of the other application. The display interface of other applications here may be the interface of the application newly opened by the user, or may be the user switching the focus of the second electronic device to the interface of other opened applications, which is not limited herein.

Another possible implementation manner, the second switching operation of the application may be displaying a notification message on the second electronic device, or receiving a pop-up window of other applications (for example, instant messaging applications, video communication applications, etc.), causing the second electronic device The focus of the electronic device is shifted to the display interface of other applications.

S502. The second electronic device sends a second notification message to the first electronic device.

The second notification message is used to notify the first electronic device that the focus of the second electronic device has been switched, so as to notify that the data cooperation between the second electronic device and the first electronic device is interrupted.

Further, the data collaboration service of the second electronic device can store the third document editing box of the interrupted document editing application (third document editing application), so that when the data collaboration scene is restored, the second electronic device can store the third document according to the stored third document. Edit the third document editing box of the application, directly display the third document editing box of the third document editing application on the second electronic device, or move the focus of the second electronic device to the third document editing application of the third document editing application On the box, improve the response speed of recovery data collaboration scenarios.

S503. The first electronic device receives the second notification message, and displays a second prompt box on the first electronic device.

The second prompt box is used to prompt the user that the focus of the second electronic device has been switched.

As shown in (a) of FIG. 10b, the second prompt box 1010 may include third prompt information, and the third prompt information may be: "The scenario of HUAWEI MATEBOOK data collaboration has been interrupted". Further, the second prompt box 1010 may further include a control 1020 for stopping input, so that in response to the operation of the control 1020 for stopping input, the first electronic device closes the data collaboration interface.

S504. Save the second text data that has not been sent on the preview interface.

In a possible implementation manner, the second text data can be directly stored in the buffer area in the data collaboration service, or the second text data can also be established according to the document editing application of the second electronic device selected by the user, corresponding to the application. file, so that the second text data is cached in the corresponding file.

In some embodiments of the present application, the above files may be updated dynamically. For example, the application framework layer may monitor the text data in the preview interface in the mobile phone, and notify the hardware abstraction when the text data in the preview interface is monitored to change. layer so that the hardware abstraction layer can update the corresponding files.

Further, the first electronic device may close the preview interface.

Therefore, when the second electronic device satisfies the first condition, the third document editing box of the third document editing application is displayed on the second electronic device; the first condition is used to indicate the first electronic device and the second electronic device The data cooperative recovery of the device; the first condition may include various, for example, triggering the data cooperative recovery between the first electronic device and the second electronic device through the second electronic device, or triggering the first electronic device and the second electronic device through the first electronic device. The data cooperative recovery of the two electronic devices is described below by taking S505a and S505c as examples.

S505a. In response to a first switching operation of the application by the second electronic device, the first switching operation is used to switch the focus of the second electronic device back to the third document editing application, where the third document editing application is the A document editing application corresponding to when the first electronic device and the second electronic device discontinue data collaboration. Therefore, the data cooperation service of the second electronic device determines the recovery data cooperation scenario of the second electronic device, and thus sends a third request message to the first electronic device, where the third request message is used to request to restore the first electronic device and the Data collaboration of the second electronic device.

S506a, the first electronic device receives the third request message sent by the second electronic device, and displays a third prompt box on the first electronic device.

The third prompt box is used to prompt the user that the focus of the second electronic device has been restored to the third document editing box of the third document editing application. The third prompt box may be displayed on the notification bar, or may be displayed on the main interface, which is not limited herein.

Taking the display of the third prompt box in the notification bar as an example, as shown in (b) in Figure 10b, the third prompt box 1011 may include prompt information, and the prompt information may be: "whether to use a mobile phone to cooperate with HUAWEI MATEBOOK data". Further, the third prompt box 1011 may further include a control 1021 for restoring input, so that in response to the operation of the control acting on restoring input, the first electronic device displays a data collaboration interface and sends a restoring data collaboration message to the second electronic device , the restoring data cooperation message is used to confirm that the first electronic device and the second electronic device restore data cooperation. Here, the data collaboration interface may be the data collaboration interface shown in FIGS. 8a-8b. It is not repeated here.

In the solutions S505a-S506a, the data collaboration scene between the first electronic device and the second electronic device is restored only after confirmation by the first electronic device, so as to prevent the user from interrupting other events that may be performed on the first electronic device and improve the user experience.

S505b. In response to the first switching operation of the second electronic device on the application, the first switching operation is used to switch the focus of the second electronic device back to the document editing application, so that the data collaboration of the second electronic device The service determines a data collaboration scenario for the second electronic device to resume, and thus sends a third notification message to the first electronic device, where the third notification message is used to confirm that the data collaboration between the first electronic device and the second electronic device is resumed. Correspondingly, the first electronic device receives the third notification message sent by the second electronic device, and displays a third prompt box on the first electronic device. At this time, the third prompt box may include prompt information, and the prompt information may be: "Resume the use of mobile phone and HUAWEI MATEBOOK data collaboration".

In the solution of S505b, the first electronic device does not need to confirm, and directly restores the data collaboration scene between the first electronic device and the second electronic device, so as to avoid excessive confirmation by the user and improve user experience.

S505c: When the first electronic device determines that the first trigger condition is met, the data cooperation service of the second electronic device determines the first electronic device to restore the data cooperation scenario, thereby sending a restore data cooperation message to the second electronic device.

Wherein, the first trigger condition is used to trigger the data cooperation service of the first electronic device. A possible implementation manner of the first trigger condition is illustrated below with the manners d1-d2 as an example.

Manner d1, in response to a recovery operation of the first electronic device on the data collaboration service, the recovery operation may be a gesture acting on the first electronic device, and the gesture acting on the first electronic device may include: lifting up, or moving down . The first electronic device may determine that the user is in an upward lift gesture or a downward movement gesture through a gyroscope, an accelerometer, a gravitational accelerometer and other devices. Further, in order to improve the accuracy with which the first electronic device triggers the restoration of the data collaboration scenario, the first electronic device may further determine that the first electronic device is in the data collaboration scenario when the gesture satisfies the first gesture condition.

As shown in FIG. 11 , in a possible implementation manner, the first gesture condition may include: the first electronic device moves to a range where the distance from the user is greater than a first threshold and less than a second threshold. For example, as shown in FIG. 11 , when the first electronic device moves from the initial position to the first position, the corresponding first distance is within the first threshold range. The first electronic device moves from the initial position to the second position, and the corresponding first distance is within a range greater than the second threshold. The first electronic device moves from the initial position to the third position, and the corresponding first distance is within a range greater than or equal to the first threshold and less than or equal to the second threshold. Wherein, the first threshold may be the distance range between the first electronic device to answer the call and the user. The second threshold may be the distance range within which the user uses the front camera of the terminal device.

In manner d2, the first trigger condition may further include: the first electronic device is not in a call state, or the camera module of the first electronic device is not in an on state, and the like.

When the first electronic device determines that the first trigger condition is satisfied, it sends a recovery data cooperation message to the second electronic device, so that the second electronic device switches the focus to the interrupted first electronic device after receiving the recovery data coordination message from the first electronic device. The third document editing box of the three document editing application. The third document editing application is a document editing application corresponding to when the first electronic device and the second electronic device discontinue data collaboration.

Further, after receiving the data recovery cooperation message from the first electronic device, the second electronic device may display a fourth prompt box on the second electronic device. The fourth prompt box is used to prompt the user to restore the data cooperation message sent by the first electronic device to the second electronic device, so that the user can determine whether to restore the data cooperation.

As shown in (a) of FIG. 10c, the fourth prompt box 1030 may include prompt information, and the prompt information may be: "whether to resume using HUAWEI p40 for data collaboration". Further, the fourth prompt box 1030 may further include a control 1031 for restoring input, so that in response to the operation of the control acting on restoring input, a response for restoring collaboration is sent to the first electronic device to restore the scenario of data collaboration.

S506c, the first electronic device receives the third notification message from the second electronic device, and displays a third prompt box on the first electronic device.

The third notification message is used to notify the first electronic device to resume data cooperation with the second electronic device. The third prompt box is used to prompt the user that the focus of the second electronic device has been restored to the interface of the document editing application. The third prompt box may be displayed on the notification bar, or may be displayed on the main interface, which is not limited herein. For the display manner of the third prompt box, reference may be made to the third prompt box 1011 in FIG. 10b, which will not be repeated here.

It should be noted that S506c may be an optional step, for example, the first electronic device and the second electronic device may negotiate in advance, and the first electronic device triggers the recovery of the data collaboration scenario, without the confirmation of the second electronic device, that is, the first electronic device When confirming that the first trigger condition is satisfied, the electronic device confirms to restore the data cooperation scenario of the first electronic device and the second electronic device. When confirming that the first trigger condition is satisfied, the first electronic device displays a third prompt box on the first electronic device.

S507. In response to the operation acting on the third prompt box, the first electronic device displays a data collaboration interface.

Among them, the data collaboration interface can display the text data that was not sent last time.

Further, in response to the operation acting on the third prompt box, the first electronic device may also display a preview interface.

S508. In response to the second user operation, send second text data to the second electronic device.

The second user operation may be a confirmation operation acting on the data collaboration interface, and the second text data is unsent text data on the preview interface saved by the first electronic device.

In S508, the first electronic device may also send a confirmation message (eg, a third notification message) for resuming the data collaboration to the second electronic device.

S509, the second electronic device displays the second text data in the third document editing box.

Wherein, the second electronic device may display the second text data on the third document editing box of the third document editing application, and optionally, the second electronic device may display the fifth prompt box on the display screen. As shown in (b) of FIG. 10c, the fifth prompt box 1040 may include prompt information, and the prompt information may be: "The use of HUAWEI p40 for data collaboration has been resumed".

Further, the user may continue to input voice on the data collaboration interface to continue the data collaboration scenario. For this step, reference may be made to S406-S409, which will not be repeated here.

The first electronic device may be interrupted by other applications in the process of cooperatively processing text. For example, the first electronic device needs to answer a call or switch the way to access the network. For another example, the user needs to switch to other applications to search for data, etc., it is also possible that the network of the first electronic device is interrupted, and the process of reconnection is performed, thereby causing interruption of the data collaboration scenario. In this embodiment of the present application, as shown in FIG. 12a, the method for data collaboration among multiple devices may further include the following steps:

S601. In response to the switching application operation of the first electronic device, the data cooperation service of the first electronic device determines that the first electronic device exits the document creation scene, that is, the data cooperation between the second electronic device and the first electronic device is interrupted .

In a possible implementation manner, the application switching operation may be that the user jumps to another application, causing the display interface of the first electronic device to display the display interface of the other application. The display interface of other applications here may be an application newly opened by the user, or may be the user switching the display interface of the first electronic device to another opened application interface, which is not limited herein.

Another possible implementation manner, the application switching operation may be displaying a notification message on the first electronic device, or receiving a pop-up window of other applications (eg, instant messaging applications, video communication applications, etc.), causing the second electronic device to display an interface Displays the display interface of other applications.

S602. The first electronic device sends an interruption notification message to the second electronic device.

The interruption notification message is used to notify the first electronic device that the data cooperation scene has been interrupted.

Correspondingly, the first electronic device can close the preview interface.

In a possible implementation manner, the first electronic device may save the unsent second text data on the preview interface. The manner in which the first electronic device saves the unsent second text data on the preview interface may refer to S502, which will not be repeated here.

In another possible implementation manner, before the first electronic device is interrupted, the user has confirmed that the second text data is the data to be sent. At this time, the first electronic device can send the second text data to the second electronic device to The second electronic device is caused to display the second text data in the corresponding document editing application.

S603. The second electronic device receives the interruption notification message, and displays a third prompt box on the second electronic device.

The third prompt box may be used to display the second prompt interface. The second prompt interface is used to prompt the user that the data collaboration scene of the first electronic device has been interrupted.

For example, as shown in (a) of FIG. 12b, the second prompt interface 1210 may include prompt information, and the prompt information may be: "The scenario of HUAWEI P40 data collaboration has been interrupted". Further, the second prompt interface 1210 may further include a control 1211 for stopping data collaboration, so that, in response to the operation of the control 1211 for stopping data collaboration, the second electronic device may stop the data collaboration service, and may store the corresponding data collaboration The interface of the document editing application. For example, the data collaboration service of the second electronic device may store the interface of the interrupted data collaboration application (third document editing application), so that when the data collaboration scenario is restored, the second electronic device may store the interface of the interrupted data collaboration application according to the stored interface. The interface of the interrupted data cooperation application is directly displayed on the second electronic device, or the focus of the second electronic device is moved to the interface of the interrupted data cooperation application, so as to improve the response speed of restoring the data cooperation scene.

When the first electronic device determines that a third condition is met, the data collaboration interface is displayed on the first electronic device, and the second text data is displayed on the data collaboration interface; the third condition is used for Instructing the first electronic device and the second electronic device to collaboratively restore data.

The third condition may include multiple ways, which may be triggered by the first electronic device or by the second electronic device. The following uses S604a-S604c as examples to illustrate the possible scenarios of the third condition.

S604a. When the first electronic device satisfies the first trigger condition, it is determined to enable the data cooperation service of the first electronic device.

Manner D1, in response to the restore operation of the application by the first electronic device, the data cooperation service of the first electronic device determines a data cooperation scenario of the first electronic device restoring data, so that the first electronic device sends a restoring data cooperation message to the second electronic device.

In one possible implementation, the recovery operation may be a gesture acting on the first electronic device, determining that the gesture satisfies the first gesture condition, and sending a third request message to the second electronic device. In another possible implementation, the first electronic The device sends a resume data collaboration message to the second electronic device in response to the opening operation acting on the data collaboration interface. Therefore, after receiving the data recovery message from the first electronic device, the second electronic device switches the focus to the third document editing box of the interrupted third document editing application. For details, reference may be made to the manner d1, which is not repeated here.

In manner D2, the first trigger condition may also be that the first electronic device determines that it is not in a call state; or, the camera module of the first electronic device is not in an on state. For details, reference may be made to the manner d2, which will not be repeated here.

S605a. The second electronic device receives a data recovery cooperation message sent by the first electronic device, where the recovery data cooperation message is used to request recovery of the data cooperation between the first electronic device and the second electronic device; display on the second electronic device The third prompt interface.

The third prompt interface is used to prompt the user that the data collaboration interface of the first electronic device has been restored. The third prompt interface may be displayed in the notification bar, or may be displayed in the third document editing box of the third document editing application, which is not limited herein.

For example, as shown in (b) of FIG. 12b, the third prompt interface 1220 may include prompt information, and the prompt information may be: "Resume the scenario of HUAWEI P40 data collaboration". Further, as shown in FIG. 12c , the third prompt interface 1220 may further include a control 1221 for resuming data collaboration, so that, in response to the operation of the control 1221 for resuming data collaboration, the second electronic device may enable the data collaboration service, and A third document editing box of the document editing application corresponding to the stored data collaboration before the interruption is displayed.

In some embodiments, the second electronic device may send a third notification message to the first electronic device in response to the operation of the control for resuming the data collaboration, the third notification message is used to confirm that the first electronic device and the all data cooperation of the second electronic device. In other embodiments, the second electronic device may also confirm that the data cooperation between the first electronic device and the second electronic device has been restored after receiving the restore data cooperation message, without sending the first electronic device the first Three notification messages, the specific implementation process can be determined as needed, which is not limited here.

S604b. In response to the first switching operation of the second electronic device, the data cooperation service of the second electronic device determines that the second electronic device restores the data cooperation scenario, thereby sending a third notification message to the first electronic device, the third notification message using After confirming that the first electronic device resumes data cooperation with the second electronic device.

S604c, in response to the first switching operation of the second electronic device, the data cooperation service of the second electronic device determines that the second electronic device restores the data cooperation scenario, thereby sending a third request message to the first electronic device, and the third request message uses requesting the first electronic device to resume data cooperation with the second electronic device.

For the specific data cooperation service of the second electronic device to determine the data cooperation scenario of the second electronic device restoring data cooperation, reference may be made to S505a, which will not be repeated here.

S605c: The first electronic device receives a data recovery cooperation message from the second electronic device, where the recovery data cooperation message is used to notify the first electronic device to resume data cooperation with the second electronic device, and display it on the first electronic device The fourth prompt interface.

The fourth prompt interface is used to prompt the user that the focus of the second electronic device has been restored to the third document editing box of the document editing application. The fourth prompt interface may be displayed on the notification bar or on the main interface, which is not limited herein.

For example, as shown in (a) of FIG. 12c, the fourth prompt interface 1230 may include fourth prompt information, and the fourth prompt information may be: "Resume the HUAWEI P40 data collaboration scene". Further, the fourth prompt interface 1230 may further include a control 1231 for confirming restoration, so that, in response to the operation of the control 1221 for confirming restoration, the second electronic device may start the data cooperation service and send the restoration cooperation to the first electronic device response.

S606. In response to the operation of the fifth prompt interface acting on the first electronic device, the first electronic device displays a preview interface.

For example, as shown in (b) of FIG. 12c , the fifth prompt interface 1240 may include fifth prompt information, and the fifth prompt information may be: "Resume the scenario of HUAWEI P40 data collaboration". Further, the fifth prompt interface 1240 may further include a control 1241 for resuming the input, so that in response to the operation of the control 1241 for confirming the restoration, the second electronic device may enable the data collaboration service and display the data collaboration before the interruption of the data collaboration interface. The data collaboration interface may include a preview interface before data collaboration is interrupted.

The preview interface may display text data that was not sent last time. For the display manner of the preview interface, reference may be made to the display manners of (a) and (b) in FIG. 8b , which will not be repeated here.

S607. In response to the second user operation, send third text data to the second electronic device.

The second user operation may be a confirmation operation acting on the data collaboration interface, and the third text data may be unsent text data on the preview interface saved by the first electronic device, or may be newly confirmed by the first electronic device to be sent text data.

S608, the second electronic device displays the third text data.

Wherein, the second electronic device may display the third text data on the document editing box of the interrupted data collaboration application, and the specific method may refer to S509, which will not be repeated here. Optionally, the user may also continue to input voice on the data collaboration interface to continue the data collaboration scenario. For this step, reference may be made to S406-S409, which will not be repeated here.

In the above-mentioned embodiments of the present application, the methods provided by the embodiments of the present application are introduced from the perspective of an electronic device as an execution subject. In order to realize each function in the method provided by the above-mentioned embodiments of the present application, the terminal device may include a hardware structure and/or a software module, and implement the above-mentioned functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above functions is performed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

As used in the above embodiments, depending on the context, the terms "when" or "after" can be interpreted to mean "if" or "after" or "in response to determining..." or "in response to detecting …”. Similarly, depending on the context, the phrases "in determining..." or "if detecting (the stated condition or event)" can be interpreted to mean "if determining..." or "in response to determining..." or "on detecting (the stated condition or event)" or "in response to the detection of (the stated condition or event)". Additionally, in the above-described embodiments, relational terms such as first and second are used to distinguish one entity from another, without limiting any actual relationship and order between these entities.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server or data center Transmission to another website site, computer, server, or data center is by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), and the like.

It should be noted that a part of this patent application file contains content protected by copyright. Except for making copies of the patent files of the Patent Office or the contents of the recorded patent files, the copyright owner reserves the right to copyright.

Claims

A method for multi-device data collaboration, applied to a second electronic device, comprising:

In response to a first operation acting on the first document editing application, displaying a first document editing box of the first document editing application;

sending a first notification message to the first electronic device, where the first notification message is used to establish data cooperation between the first electronic device and the second electronic device;

The first text data sent by the first electronic device is received, and the first text data is displayed on the first document editing box.
The method according to claim 1, wherein the first document editing application is an application in a document editing whitelist configured in the second electronic device.
The method according to claim 1, wherein the first operation comprises at least one of the following items:

The operation of opening the first document editing application; the operation of clicking the document editing box in the first document editing application; the operation of switching the first document editing application; or, the switching of the first document editing application The operation of the document edit box.
The method according to claim 1, wherein before the sending the first notification message to the first electronic device, the method further comprises:

displaying a first search device interface, where the first search device interface is used to display an electronic device that establishes a communication connection with the second electronic device;

In response to a second operation of selecting the first electronic device of the electronic devices, it is determined to send the first notification message to the first electronic device.
The method according to claim 1, wherein the method further comprises:

receiving a communication connection request sent by the first electronic device, wherein the communication connection request is sent by near field communication;

establishing a communication connection with the first electronic device;

A first connection message is displayed, where the first connection message is used to prompt the user to establish a communication connection between the second electronic device and the first electronic device.
The method according to any one of claims 1-5, wherein after the sending the first notification message to the first electronic device, the method further comprises:

receiving a first response message sent by the first electronic device, where the first response message is used to confirm that the first electronic device and the second electronic device establish data cooperation;

The first response message is displayed.
The method according to any one of claims 1-6, wherein the second electronic device includes multiple document editing applications, and the multiple document editing applications at least include the first document editing application and the first document editing application. Two document editing applications, the method further includes:

sending a second notification message to the first electronic device, where the second notification message is used to instruct the second electronic device to run the plurality of document editing applications,

receiving a switching message sent by the first electronic device, where the switching message is used to instruct the second electronic device to switch the focus from the first document editing application to the second document editing application;

switching the focus to a second document editing box of the second document editing application;

receiving third text data sent by the first electronic device, and displaying the third text data on the second document editing box.
The method according to claim 1, wherein the method further comprises:

When the first condition is satisfied, a third document editing application is displayed on the second electronic device, and the third document editing application is the document editing corresponding to the interruption of data collaboration between the first electronic device and the second electronic device application;

receiving second text data sent by the first electronic device, and displaying the second text data on a third document editing box of the third document editing application;

Wherein, the second text data is text data generated by the first electronic device when the data collaboration is interrupted;

Wherein, the first condition includes at least one of the following items: in response to a first switching operation, the first switching operation switches the focus of the second electronic device to the third document editing application;

Or, receive a resumption data cooperation message sent by the first electronic device, where the resumption data cooperation message is used to request resumption of data cooperation between the first electronic device and the second electronic device.
The method according to claim 8, wherein the method further comprises:

Displaying a switched interface in response to a second switching operation acting on the third document editing application, the second switching operation being used to switch the focus of the second electronic device out of the third document editing application ;

Sending a third notification message to the first electronic device, where the third notification message is used to notify the second electronic device that the data cooperation between the second electronic device and the first electronic device is interrupted.
The method according to claim 8, wherein the interruption of data cooperation between the first electronic device and the second electronic device comprises:

An interruption notification message of the first electronic device is received, where the interruption notification message is used to notify the interruption of data cooperation between the second electronic device and the first electronic device.
The method according to any one of claims 8-10, wherein before the receiving the second text data sent by the first electronic device, the method further comprises:

Sending a fourth notification message to the first electronic device, where the fourth notification message is used to notify the first electronic device to resume data cooperation with the second electronic device.
The method according to any one of claims 8-10, wherein before the receiving the second text data sent by the first electronic device, the method further comprises:

sending a recovery request message to the first electronic device, where the recovery request message is used to request recovery of data cooperation between the first electronic device and the second electronic device;

A restore data cooperation message sent by the first electronic device is received, where the restore data cooperation message is used to confirm restoring the data cooperation between the first electronic device and the second electronic device.
A method for multi-device data collaboration, applied to a first electronic device, characterized in that it includes:

Receive a first notification message sent by the second electronic device, and display a first prompt box, where the first notification message is used to request the first electronic device to establish data cooperation with the second electronic device, and the first prompt box including the first control;

displaying a data collaboration interface in response to a first user operation acting on the first control;

collecting first voice data, converting the first voice data into first text data, and displaying the first text data on the data collaboration interface;

In response to a second user operation, the first text data is sent to the second electronic device.
The method according to claim 13, wherein the data collaboration interface further comprises an editing control, and the converting the first voice data into the first text data comprises:

converting the first voice data into initial text data, and displaying the initial text data on the data collaboration interface;

In response to a third user operation acting on the editing control, executing an editing instruction on the initial text data, and displaying the edited text data on the data collaboration interface;

In response to a confirmation operation acting on the data collaboration interface, the edited text data is replaced with the first text data.
The method of claim 14, wherein the first text data includes initial text data and editing instructions for the initial text data.
The method according to any one of claims 13-15, wherein the method further comprises:

receiving a first confirmation message sent by the second electronic device, where the first confirmation message is used to indicate that the second electronic device has successfully received the first text data;

The first text data displayed on the data collaboration interface is deleted.
The method according to any one of claims 13-16, wherein before the receiving the first notification message sent by the second electronic device, the method further comprises:

When the distance with the second electronic device meets the first distance threshold, send a communication connection request to the second electronic device through near field communication;

A communication connection is established with the first electronic device, and a first connection message is displayed, where the first connection message is used to prompt the second electronic device to establish a communication connection with the first electronic device.
The method according to any one of claims 13-17, wherein the responding to the first user operation acting on the first control further comprises:

Sending a first response message to the second electronic device, where the first response message is used to confirm that data cooperation between the first electronic device and the second electronic device is enabled.
The method according to any one of claims 13-18, wherein the second electronic device includes multiple document editing applications, and the multiple document editing applications include at least a first document editing application and a second document Editing the application, the method further includes:

receiving an application notification message sent by the second electronic device, and displaying the controls of the plurality of document editing applications on the data collaboration interface; the application notification message is used to indicate that the second electronic device includes the plurality of document editing applications document editing applications;

sending a switching message to the second electronic device in response to a switching operation acting on the controls of the plurality of document editing applications, wherein the switching operation refers to the second electronic device to change focus from editing the first document The application is switched to the second document editing application, and the switching message is used to instruct the second electronic device to switch the focus of the second electronic device to the second document editing box of the second document editing application;

collecting second voice data, converting the second voice data into third text data, and displaying the third text data on the data collaboration interface;

In response to the second user operation, the third text data is sent to the second electronic device.
The method according to any one of claims 13-19, wherein the method further comprises:

When the second condition is satisfied, second text data is cached, and the second text data is text data displayed on the data cooperation interface when the first electronic device and the second electronic device interrupt data cooperation, and the second text data is displayed on the data cooperation interface. The second condition is used to indicate that the data cooperation between the first electronic device and the second electronic device is interrupted;

When a third condition is met, the data collaboration interface is displayed, and the second text data is displayed on the data collaboration interface, where the third condition is used to indicate the first electronic device and the second electronic device collaborative data recovery;

Sending the second text data to the second electronic device.
The method of claim 20, wherein the second condition comprises at least one of the following:

receiving a second notification message sent by the second electronic device, where the second notification message is used to notify that the data cooperation between the second electronic device and the first electronic device is interrupted;

Or, in response to an application switching operation of the first electronic device, a switched application interface is displayed on the first electronic device, and the switching application operation is used to start the switched application on the first electronic device .
The method according to claim 21, wherein the switching application operation in response to the first electronic device further comprises:

Sending an interruption notification message to the second electronic device, where the interruption notification message is used to notify the second electronic device that the data cooperation with the first electronic device is interrupted.
The method of claim 20, wherein the third condition comprises at least one of the following:

Detecting a gesture to the first electronic device, and determining that the gesture satisfies a first gesture condition, the first gesture condition means that the first electronic device moves to a distance from the user greater than a first threshold and less than a second threshold. Within the range, the gesture includes: lift up, or move down;

The first electronic device is not in a call state; or, the camera module of the first electronic device is not in an on state; a third notification message sent by the second electronic device is received, and the third notification message is used for Notifying the first electronic device to resume data cooperation with the second electronic device;

Or, receiving a third request message sent by the second electronic device, where the third request message is used to request the first electronic device to resume data cooperation with the second electronic device, and the first electronic device The third request message is displayed in a second prompt box on the device, and in response to the operation on the second prompt box, it is confirmed to restore the data cooperation between the first electronic device and the second electronic device.
The method according to claim 23, wherein after confirming that the data cooperation between the first electronic device and the second electronic device is restored in response to the operation on the second prompt box, the method further comprises:

Sending a restore data cooperation message to the second electronic device, where the restore data cooperation message is used to confirm restoring the data cooperation between the first electronic device and the second electronic device.
An electronic device, characterized in that the electronic device includes a memory and one or more processors; wherein the memory is used to store computer program code, and the computer program code includes computer instructions; when the computer instructions are When executed by the processor, the electronic device is caused to execute the method according to any one of claims 1 to 12.
An electronic device, characterized in that the electronic device includes a memory and one or more processors; wherein the memory is used to store computer program code, and the computer program code includes computer instructions; when the computer instructions are When executed by the processor, the electronic device is caused to execute the method according to any one of claims 13 to 24.
A computer-readable storage medium, characterized in that the computer-readable storage medium includes program instructions, which, when the program instructions are executed on a terminal device, cause the terminal device to execute any one of claims 1 to 12 the method described.
A computer-readable storage medium, characterized in that the computer-readable storage medium includes program instructions, which, when the program instructions are executed on a terminal device, cause the terminal device to execute any one of claims 13 to 24 the method described.