CN114780192A

CN114780192A - Remote assistance method, remote assistance device and electronic equipment

Info

Publication number: CN114780192A
Application number: CN202210431777.8A
Authority: CN
Inventors: 吴禹辰
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2022-04-22
Filing date: 2022-04-22
Publication date: 2022-07-22

Abstract

The application discloses a remote assistance method, a remote assistance device and electronic equipment, and belongs to the technical field of communication. The remote assistance method is applied to first electronic equipment and comprises the following steps: receiving a first input of a user; in response to the first input, displaying a first interface in a first area of the display screen, displaying a second interface in a second area of the display screen, and sending a remote assistance request to the second electronic device; receiving a first message sent by second electronic equipment under the condition that the first electronic equipment establishes remote assistance connection with the second electronic equipment; and updating the display content of the second interface based on the first message.

Description

Remote assistance method, remote assistance device and electronic equipment

Technical Field

The application belongs to the technical field of communication, and particularly relates to a remote assistance method, a remote assistance device and electronic equipment.

Background

When assisting a local user to solve a problem, a remote user usually connects a device of the local user by using a network remote assistance technology to realize remote control of the local device.

Disclosure of Invention

An object of the embodiments of the present application is to provide a remote assistance method, a remote assistance apparatus, and an electronic device, which can solve the problem of poor security when a remote user remotely controls a local device.

In a first aspect, an embodiment of the present application provides a remote assistance method, which is applied to a first electronic device, and includes:

receiving a first input of a user;

in response to the first input, displaying a second interface in a second area of the display screen and sending a remote assistance request to a second electronic device; the first interface is used for the user to operate, the display content of the second interface is determined based on the display content of the first interface, and the remote assistance request is used for requesting to establish remote assistance connection between the first electronic device and the second electronic device;

under the condition that the first electronic device establishes remote assistance connection with the second electronic device, receiving a first message sent by the second electronic device, wherein the first message is determined based on display content of a third interface in the second electronic device, and the display content of the third interface has an association relation with the display content of the second interface;

updating display content of the second interface based on the first message.

In a second aspect, an embodiment of the present application provides another remote assistance method, which is applied to a second electronic device, and the method includes:

receiving a remote assistance request sent by first electronic equipment;

displaying a third interface under the condition of establishing remote assistance connection with the first electronic equipment, wherein the display content of the third interface has an incidence relation with the display content of a second interface in the first electronic equipment;

receiving a sixth input of the user;

in response to the sixth input, updating the display content of the third interface, and sending a first message to the first electronic device, wherein the first message is determined based on the updated display content of the third interface, and the first message is used for indicating that the display content of the second interface is updated.

In a third aspect, an embodiment of the present application provides a remote assistance apparatus, applied to a first electronic device, where the apparatus includes:

the first receiving module is used for receiving a first input of a user;

the first processing module is used for responding to the first input, displaying a first interface in a first area of a display screen, displaying a second interface in a second area of the display screen, and sending a remote assistance request to second electronic equipment; the first interface is used for the user to operate, the display content of the second interface is determined based on the display content of the first interface, and the remote assistance request is used for requesting to establish remote assistance connection between the first electronic device and the second electronic device;

the second processing module is configured to receive a first message sent by the second electronic device when the first electronic device establishes a remote assistance connection with the second electronic device, where the first message is determined based on display content of a third interface in the second electronic device, and the display content of the third interface has an association relationship with the display content of the second interface; updating display content of the second interface based on the first message.

In a fourth aspect, an embodiment of the present application provides a remote assistance apparatus, applied to a second electronic device, where the apparatus includes:

the second receiving module is used for receiving a remote assistance request sent by the first electronic equipment;

the first display module is used for displaying a third interface under the condition that remote assistance connection is established with the first electronic equipment, and the display content of the third interface has an incidence relation with the display content of a second interface in the first electronic equipment;

the third receiving module is used for receiving a sixth input of the user;

and the third processing module is used for responding to the sixth input, updating the display content of the third interface and sending a first message to the first electronic device, wherein the first message is determined based on the updated display content of the third interface, and the first message is used for indicating that the display content of the second interface is updated.

In a fifth aspect, embodiments of the present application provide an electronic device, which includes a processor and a memory, where the memory stores a program or instructions executable on the processor, and the program or instructions, when executed by the processor, implement the steps of the method according to the first aspect or the second aspect.

In a sixth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first or second aspect.

In a seventh aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect or the second aspect.

In an eighth aspect, the present application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the method according to the first or second aspect.

In the embodiment of the application, the remote assistance connection is established between the first electronic device and the second electronic device, the first electronic device sends the content to be processed in the second interface to the second electronic device, the content is displayed on the third interface of the second electronic device, when the second electronic device sends the first message to the first electronic device, the updated second interface can be obtained on the first electronic device, and then the user is guided to perform corresponding operation on the first interface according to the updated display content on the second interface, so that when a remote user at the second electronic device remotely assists a local user, only the content uploaded by the local user can be checked and edited, the right for controlling the first electronic device cannot be directly obtained, the safety of the first electronic device is improved, and the risk that the privacy of the local user is exposed is reduced.

Drawings

Fig. 1 is a schematic flowchart of a remote assistance method according to an embodiment of the present application;

fig. 2 is a second flowchart of a remote assistance method according to an embodiment of the present application;

fig. 3 is an interaction diagram of a remote assistance method provided in an embodiment of the present application;

FIG. 4 is a schematic diagram of an interface for remote assistance provided by an embodiment of the present application;

FIG. 5 is a second schematic diagram of an interface for remote assistance according to an embodiment of the present application;

fig. 6 is a third schematic view of an interface for remote assistance provided in an embodiment of the present application;

FIG. 7 is a fourth schematic view of an interface for remote assistance provided by an embodiment of the present application;

fig. 8 is a schematic structural diagram of a remote assistance device according to an embodiment of the present application;

fig. 9 is a second schematic structural diagram of a remote assistance device according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

FIG. 11 is a hardware schematic diagram of an electronic device provided in an embodiment of the present application;

fig. 12 is a second hardware schematic diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below clearly with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application are capable of operation in sequences other than those illustrated or described herein, and that the terms "first," "second," etc. are generally used in a generic sense and do not limit the number of terms, e.g., a first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/", and generally means that the former and latter related objects are in an "or" relationship.

The remote assistance method, the remote assistance apparatus, the electronic device, and the readable storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

The remote assistance method may be applied to the terminal, and may be specifically executed by hardware or software in the terminal.

The terminal includes, but is not limited to, a mobile phone or other portable communication device such as a tablet computer having a touch sensitive surface (e.g., a touch screen display and/or a touch pad). It should also be understood that in some embodiments, the terminal may not be a portable communication device, but rather a desktop computer having a touch-sensitive surface (e.g., a touch screen display and/or a touchpad).

In the following various embodiments, a terminal including a display and a touch-sensitive surface is described. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, mouse, and joystick.

In the remote assistance method provided in the embodiment of the present application, an execution subject of the remote assistance method may be an electronic device or a functional module or a functional entity capable of implementing the remote assistance method in the electronic device, the electronic device mentioned in the embodiment of the present application includes, but is not limited to, a mobile phone, a tablet computer, a wearable device, and the like, and the remote assistance method provided in the embodiment of the present application is described below with the electronic device as the execution subject.

As shown in fig. 1, the remote assistance method, applied to a first electronic device, includes: step 110, step 120 and step 130.

Step 110, receiving a first input of a user.

In this step, the first input is used to trigger the first electronic device to turn on the remote assistance function.

The first input may be at least one of the following modes:

first, the first input may be a touch input, including but not limited to a click input, a slide input, a press input, and the like.

In this embodiment, the receiving of the first input by the user may be receiving a touch operation of the user on the display screen.

In order to reduce the misoperation rate of the user, the active area of the display screen can be limited in a specific area, such as a blank area of the display screen.

In this embodiment, after the user clicks the remote connection control on the display screen of the first electronic device, the remote assistance function of the first electronic device is started.

Second, the input may be physical key input.

In this embodiment, the body of the terminal is provided with an entity key for starting remote connection, and receives a first input of a user, which may be an operation of receiving the user pressing the corresponding entity key; the input may also be a combined operation of pressing multiple physical cases simultaneously.

Third, the input may be a voice input.

In this embodiment, after the display area of the first electronic device is opened, the remote assistance function of the first electronic device may be turned on after the received voice is "turn on remote connection".

Of course, in other embodiments, the input may be in other forms, including but not limited to character input, and the like, which may be determined according to actual needs, and this embodiment does not limit this.

In some embodiments, the first input may be a single input or may be a combination input in the form of multiple inputs.

Step 120, responding to the first input, displaying a first interface in a first area of the display screen, displaying a second interface in a second area of the display screen, and sending a remote assistance request to the second electronic device; the first interface is used for operation of a user, display content of the second interface is determined based on the display content of the first interface, and the remote assistance request is used for requesting establishment of remote assistance connection between the first electronic device and the second electronic device.

In the step, the display screen can be a straight screen, and two independent display areas, namely a first area and a second area, exist on the straight screen; the display screen can also be a folding screen, and the display areas of the two screens of the folding screen are respectively a first area and a second area; other display screens having at least two display areas are also possible.

In this step, the first interface is an operation interface of the user, and on the operation interface, the local user can edit the display content of the interface alone, or can edit the display content through an assistance instruction sent by other remote connection devices, so as to complete a related assistance task.

In this step, the display content on the second interface may be "filtered" (e.g., graffiti, mosaiced, or occluded) based on the display content of the first interface, in order to prevent the remote user at the second electronic device from viewing the entire display content of the first interface; of course, the display content of the second interface may also be all the display content of the first interface, and the display content of the first interface may be selectively displayed on the second interface according to the actual needs of the user.

In some embodiments, the display content of the second interface may also be identical to the display content of the first interface, and when there is an area related to the privacy of the local user in the display content of the second interface, the area of the second interface may also be masked or blackened, and when the first electronic device transmits the display content of the second interface to the second electronic device and displays the display content on the third interface of the second electronic device, the masked or blackened area is not included on the third interface seen by the remote user at the second electronic device.

It should be noted that the display content on the first interface may be a video or a picture; the display content of the second interface is determined by the first interface, and the display content on the second interface can be videos or pictures.

In this step, after the first interface and the second interface are displayed on the first electronic device, the first electronic device sends a remote assistance request to the second electronic device, where the request may be an ip address of the first electronic device, an account ID of the first electronic device, or information for identifying the identity of the electronic device by other users, and after receiving the assistance request, the second electronic device establishes a remote connection with the first electronic device after confirming the identity information.

It should be noted that, the manner of establishing the remote assisted connection between the first electronic device and the second electronic device may be to perform connection by using a remote connection function of the electronic device itself, for example, when the remotely connected device is a computer, the remote connection may be performed by using a connection service of two computers; the first electronic device and the second electronic device may establish a remote assistance connection by using a third-party tool, for example, a remote connection tool is installed on the electronic device to be connected, and the connection between the two electronic devices is implemented through the connection of the connection tool.

In this embodiment, when the first input is a combined input of a plurality of input forms, the first input may include a first sub input and a second sub input; the first sub-input and the second sub-input may be touch input, physical keys and their combination input, voice input, or other types of input, and the specific reference is made to the form of the first input, which is not described in detail in this embodiment.

The first sub-input and the second sub-input are taken as touch inputs for example to explain.

In this embodiment, a first sub-input of the user is received, and the display screen of the first electronic device turns on the remote function in response to the first sub-input.

In the embodiment shown in fig. 4, a remote function is activated through a specific touch operation on a display screen of the first electronic device, for example, when an "S" letter is drawn on the screen or when the screen is tapped multiple times in succession, a remote connection service of the first electronic device is activated, and at this time, the first interface 410 is displayed in the first area and the second interface 420 is displayed in the second area.

After the first interface and the second interface are displayed on the display screen of the first electronic device, a second sub-input of the user is received, the display screen responds to the second sub-input, a user list is displayed, and after the target user is determined, a remote assistance request is sent to the target user.

In this embodiment, the user list on the display screen is clicked, and after the user is selected as the "second electronic device", a remote assistance request is sent to the second electronic device.

Of course, the first input may also be a mixed combination of inputs of multiple forms, for example, a touch input is combined with a physical key input, where the touch input and the physical key input are in the form of the first input, which is not described in detail in this embodiment.

In some embodiments, after receiving the remote connection request sent by the first electronic device, the second electronic device may receive the connection request after confirming the identity information of the other party, so as to implement remote connection between the two electronic devices, which is convenient for the second electronic device to receive the related information sent by the first electronic device, and send feedback information to the first electronic device.

In some embodiments, in the case of establishing the remote assistance connection with the first electronic device, a third interface is displayed, and display content of the third interface has an association relationship with display content of the second interface in the first electronic device.

It should be noted that the third interface refers to an interface that can be seen by a remote user at the second electronic device, and the first interface and the second interface are pictures that can be seen by a local user at the first electronic device; the display content on the third interface can be videos or pictures; the display content of the third interface has an association relationship with the display content of the second interface in the first electronic device, which means that part of the display content of the third interface may be the same as the display content of the second interface, for example, the third interface and the second interface both include a video or a picture to be edited, but the display content of the third interface is different from the display content of the second interface, for example, the remote user also has an input control on the third interface for adding instruction information on the display content of the third interface, but the display content of the second interface only includes the video or the picture to be edited and the instruction information, and does not include the input control; in addition, after the user blocks or blackens part of the display content of the second interface, at this time, a blocked or blackened area is not displayed on the third interface of the second electronic device that establishes the remote assistance connection with the first electronic device.

In this embodiment, after the first interface and the second interface are displayed on the display screen and the second electronic device establishes the remote assistance connection with the first electronic device, the first electronic device may also send the display content of the second interface to the second electronic device by receiving an input of a local user after confirming the display content of the second interface to be sent, and display the display content on the third interface of the second electronic device, where the input may be a touch input, an entity key and its combination input, a voice input, or other types of inputs, and specifically refer to the form of the first input, which is not described in detail in this embodiment.

In this embodiment, after the first interface and the second interface are obtained and the second electronic device establishes the remote assistance connection with the first electronic device, and after the upload control on the display screen of the first electronic device is clicked, the first electronic device sends the display content of the second interface to the second electronic device, and displays the display content on the third interface of the second electronic device.

Certainly, in other embodiments, after the first interface and the second interface are obtained and the second electronic device establishes the remote assistance connection with the first electronic device, the third interface of the second electronic device may also be automatically updated according to the display content of the second interface.

In some embodiments, a sixth input is received from the user.

In this step, a sixth input is used to add target information on the third interface;

the sixth input may be touch input, physical keys and their combination input, voice input, and other types of input, which is specifically referred to the above first input form and is not described in detail in this embodiment.

In this embodiment, the target information refers to information set on the third interface by the remote user at the second electronic device, and the information may be text, voice or legend, or may be a combination of text, voice and legend; the target information comprises an operation instruction, and the first interface updates the display content according to the operation instruction.

In this embodiment, a text with a content of "click to solve the right side of the image by a finger, slide left" is added on the third interface of the second electronic device, and then the added text is the target information.

In some embodiments, the voice information may be further added near the "save" control on the third interface as "save by click" as target information, so as to remind a user at the first electronic device that a corresponding save operation may be performed on the current task interface after receiving the information of the third interface.

In some embodiments, the sixth input may be a single input or a combination of inputs.

In some embodiments, in response to the sixth input, the display content of the third interface is updated, and a first message is sent to the first electronic device, the first message being determined based on the updated display content of the third interface, and the first message indicating that the display content of the second interface is updated.

In this embodiment, the third interface of the second electronic device responds to the sixth input, and displays the addition target information on the third interface, wherein the target information can be characters, voice or graffiti, and can also be a combination of the characters, the voice and the graffiti.

It should be noted that the first message may be part of display content of the third interface, where the display content includes a video or a picture to be edited, and also includes information such as newly added text, voice, or graffiti.

It should be noted that the first message may be directly sent to the first electronic device by the second electronic device, or may be sent to the server by the second electronic device first, and then forwarded to the first electronic device by the server.

In some embodiments, when the sixth input is a combined input in a plurality of input forms, the sixth input is taken as a touch input for example to be described.

In the embodiment shown in fig. 5, three controls "add graffiti", "add voice", and "add text" 511 are provided on the third interface 510 of the second electronic device, and after the "add text" control 511 is clicked, a text input box pops up, characters "click the right side of the image with finger and slide left" are input in the input box, and an arrow pointing to the right side of the image is drawn on the third interface, at this time, the updated third interface includes the display content of the original third interface and the added characters and arrows.

In this embodiment, after the third interface of the second electronic device is updated, the upload control on the third interface is clicked to send the first message to the first electronic device, and after the first message is received, the received second message is displayed on the second interface of the first electronic device, where the second message includes the text and the arrow added to the third interface.

Of course, the sixth input may also be a mixed combination of inputs of multiple forms, for example, a touch input is combined with a physical key input, where the touch input and the physical key input are in the form of the first input described above, and this embodiment is not described again.

Step 130, receiving a first message sent by a second electronic device under the condition that the first electronic device establishes a remote assistance connection with the second electronic device, wherein the first message is determined based on display content of a third interface in the second electronic device, and the display content of the third interface has an association relation with the display content of the second interface;

and updating the display content of the second interface based on the first message.

In this step, the manner of establishing the remote assistance connection between the first electronic device and the second electronic device may be to connect by using a remote connection function of the electronic device itself, or may be to connect remotely by using a third-party application, as described in the manner of the remote connection in step 130, which is not described in detail in this embodiment.

In this step, the first message may be part of the display content of the updated third interface, where the display content includes a video or a picture to be edited, and also includes information such as newly added text, voice, or graffiti.

In this step, the display content of the third interface and the display content of the second interface have an association relationship, which means that part of the display content of the third interface of the second electronic device may be the same as the display content of the second interface of the first electronic device, for example, both the third interface and the second interface include a video or a picture to be edited; the third interface is also different from the second interface in display content, for example, the remote user also has an input control on the third interface for adding instruction information to the content displayed on the third interface, but the display content on the second interface only includes a video or picture to be edited and instruction information, and does not include the input control.

In the embodiment shown in fig. 6, when the first electronic device establishes the remote assistance connection with the second electronic device, after receiving the first message sent by the second electronic device, the first electronic device synchronously displays characters of "clicking the right side of the image with a finger, sliding left" and an arrow pointing to the right side of the image on the second interface 420 of the first electronic device, and at this time, corresponding operations are executed on the first interface 410 of the first electronic device according to the prompts of the characters and the arrow.

According to the remote assistance method provided by the embodiment of the application, the first electronic device establishes the remote assistance connection with the second electronic device, the first electronic device sends the display content to be processed in the second interface to the second electronic device, displaying on a third interface of the second electronic device, when the second electronic device sends the first message to the first electronic device, the first electronic device can obtain the updated second interface, and then guide the user to perform corresponding operation on the first interface according to the display content on the updated second interface, such that when a remote user at a second electronic device remotely assists a local user at a first electronic device, the display content uploaded by the local user can only be checked and edited, the permission for controlling the first electronic equipment cannot be directly acquired, the safety of the first electronic equipment is improved, and the risk that the privacy of the local user is exposed is reduced.

In some embodiments, after updating the display content of the second interface based on the first message, step 130, the method further comprises: receiving a second input of the user; updating the display content of the first interface in response to the second input; and sending a second message to the second electronic device, wherein the second message is determined based on the updated display content of the first interface, and the second message is used for instructing the second electronic device to update the display content of the third interface.

It can be understood that, when a remote assistance task needs to be completed in multiple steps, the third interface of the second electronic device needs to be updated multiple times, and different target information is added, the second electronic device sends the updated display content to be edited and the target information on the third interface to the first electronic device, displays the display content on the second interface of the first electronic device, performs corresponding operation on the display content on the first interface of the first electronic device according to the updated target information on the second interface, and obtains the updated first interface on the first electronic device until the remote assistance task is completed.

The target information refers to information set on the third interface by a remote user at the second electronic device, and the information may be characters, voice or legends, or may be a combination of characters, voice and legends; the target information comprises an operation instruction, and a first interface of the first electronic device updates display content according to the operation instruction.

It should be noted that the second message is determined by the display content of the first interface of the first electronic device, and the second message may be completely the same as the display content of the first interface or different from the display content of the first interface, for example, the first electronic device performs processing such as shielding or blacking a partial area in the display content of the first interface to be transmitted, and then transmits the processed content to the second electronic device, and displays the processed content on the third interface of the second electronic device.

In this embodiment, a second input of the user is received, and the first interface of the first electronic device responds to the second input, and displays the updated first interface, where the second input may be a touch input, an entity key and a combination input thereof, a voice input, and other types of inputs, and the details of the first input are specifically referred to, and are not repeated in this embodiment.

In this embodiment, when a character of "clicking the right side of the image with a finger, sliding left" and an operation instruction of an arrow pointing to the right side of the image appear on the second interface 420 of the first electronic device, at this time, the right side of the image pointed by the arrow is clicked on the first interface 410 of the first electronic device, and the first electronic device slides left, and after the operation is completed, the first interface 410 is updated in the first electronic device.

In some embodiments, after the first electronic device obtains the updated first interface 410, the display content of the first interface 410 may be filtered (for example, scrawling, mosaicing, or blocking), and the filtered display content is sent to the second electronic device and displayed on the third interface 510 of the second electronic device, where the third interface 510 does not include the filtered content.

According to the remote assistance method provided by the embodiment of the application, the second message is determined by receiving the second input of the user to the first interface of the first electronic equipment, and is displayed on the third interface of the second electronic equipment after being sent to the second electronic equipment, so that the remote user can conveniently check and edit the content uploaded by the local user.

In some embodiments, before receiving the first message sent by the second electronic device, step 130, the method further comprises: receiving a third input of the user; in response to a third input, determining target content, the target content comprising partial display content of the second interface; wherein the first message is generated based on the target content.

It can be understood that, when a user performs an operation related to personal privacy and the like on a first interface of a first electronic device, it is not desirable that the operation content (such as a login personal account) is uploaded to a second electronic device and is viewed by a remote user, before the first electronic device sends content to be uploaded to the second electronic device, the content related to the user privacy in the content to be uploaded may be filtered to obtain target content, and the target content is sent from the first electronic device to the second electronic device to be displayed on a third interface of the second electronic device.

It should be noted that the target content includes content that a local user, such as a video or a picture to be processed, wants to see and process by a remote user, and does not include privacy information, such as an account and a password of the user; the first message is generated based on the target content, namely after the target content uploaded by the local user through the first electronic device is displayed on the third interface of the second electronic device, the remote user edits the target content on the third interface, and then the first message is determined according to the edited instruction information.

In this embodiment, a third input of the user is received, the second interface of the first electronic device responds to the third input, and the target content is displayed on the second interface, where the third input may be a touch input, an entity key and a combination input thereof, a voice input, and other types of inputs, and specific reference is made to the form of the first input, which is not described in detail in this embodiment.

In this embodiment, when the display content of the first interface is displayed on the second interface, the privacy area (for example, a password input interface) of the second interface is pressed for a long time to shield or filter the privacy area, at this time, the display content of the second interface may be used as the target content, and the first electronic device sends the target content to the second electronic device and displays the target content on the third interface of the second electronic device.

In some embodiments, the first electronic device may also select to mask the private content in the picture or video within a preset time range to obtain the target content, so that a local user at the first device performs an operation related to the private information; the preset time range can be between 10s and 100s, and can also be set in a user-defined mode according to user requirements.

Take the target content as the video as an example.

In this embodiment, a local user logs in a personal account on a first interface of a first electronic device, after 30 seconds, the first interface displays a video including content corresponding to the 30s, when the video is displayed on a second interface of the first electronic device, the video including the content corresponding to the 30s may be deleted on the second interface to obtain a new video, the video is used as target content, and when a remote assistance connection is established between the first electronic device and a second electronic device, the first electronic device sends the target content to the second electronic device and displays the target content on a third interface of the second electronic device, and a remote user may determine a first message that needs to be sent to the first electronic device according to the target content.

According to the remote assistance method provided by the embodiment of the application, the display content of the second interface is filtered, only the target content which a local user wants a remote user to see is reserved, and the safety of the local user when the local user uses the first electronic equipment to receive remote assistance is improved.

In some embodiments, after updating the display content of the second interface based on the first message, step 130, the method further comprises: receiving a fourth input from the user; and responding to the fourth input, and saving a target multimedia file, wherein the target multimedia file comprises the display content of the second interface after the first electronic equipment establishes the remote assistance connection with the second electronic equipment.

In this embodiment, the target multimedia file refers to a display content on a second interface of the first electronic device after the first electronic device and the second electronic device establish the remote assistance connection, where the display content includes a picture or a video, and further includes instruction information such as a voice, a scribble, or a text added to the picture or the video; in the process of executing the task to be assisted, the target multimedia file can be the display content on all the second interfaces or the content displayed on part of the second interfaces.

In this embodiment, a fourth input of the user is received, the second interface of the first electronic device responds to the fourth input, and the content displayed on the second interface is saved, where the fourth input may be a touch input, an entity key and a combination thereof, a voice input, or another type of input, and the specific reference is made to the form of the first input, which is not described in this embodiment again.

In this embodiment, the target multimedia file may be saved each time the first electronic device receives the first message and updates the display content of the second interface, or may be saved after the task to be assisted is completed.

In this embodiment, after the task to be assisted is completed, the "all save" control on the second interface of the first electronic device is clicked, and the current display content and the history display content in the second interface are all saved in the first electronic device.

According to the remote assistance method provided by the embodiment of the application, the multimedia file of the second interface of the first electronic equipment is saved, so that a local user can independently solve the similar task according to the saved multimedia file.

In some embodiments, the second interface after updating the display content includes a play control; after the display content of the second interface is updated based on the first message, the method further comprises the following steps: receiving a fifth input of the user to the play control; in response to a fifth input, playing the voice information, the first message including the voice information.

In this embodiment, the play control includes content of the target information added on the third interface of the second electronic device, the play control including the target message is added on the third interface, the second electronic device sends the content to be processed including the play control to the first electronic device and displays the content on the second interface of the first electronic device, and by clicking the play control displayed on the second interface, the relevant operation can be executed at the corresponding position of the first interface according to the played content.

In this embodiment, a fifth input of the user is received, and the play control on the second interface responds to the fifth input to play the instruction information, where the fifth input may be a touch input, an entity key and a combination input thereof, a voice input, and other types of inputs, and specific reference is made to the form of the first input, which is not described in detail in this embodiment.

In the embodiment shown in fig. 7, when a piece of voice with content "ok after saving is clicked" is added to the third interface of the second electronic device, the voice is dragged to a position near the saving control, so that the first message is determined by the display content of the third interface, at this time, the first message is sent to the first electronic device, after the first message is received by the first electronic device, the voice with content "ok after saving clicked" is synchronously displayed at the corresponding position of the saving control on the second interface 420 of the first electronic device, and after the voice is played, the corresponding operation is executed on the first interface 410 according to the voice content.

According to the remote assistance method provided by the embodiment of the application, after the playing control containing the operation instruction is added to the third interface of the second electronic equipment and is sent to the first electronic equipment, the local user can obtain all operation information by clicking the playing control on the second interface, and the operation experience between the remote user and the local user is improved.

In the remote assistance method provided by the embodiment of the application, the execution main body can be a remote assistance device. In the embodiment of the present application, a remote assistance method executed by a remote assistance apparatus is taken as an example to describe the remote assistance apparatus provided in the embodiment of the present application.

The embodiment of the application also provides a remote assistance device.

As shown in fig. 8, the remote assistance apparatus includes: a first receiving module 810, a first processing module 820, and a second processing module 830.

A first receiving module 810 for receiving a first input of a user;

a first processing module 820, configured to, in response to a first input, display a first interface in a first area of a display screen, display a second interface in a second area of the display screen, and send a remote assistance request to a second electronic device; the remote assistance method comprises the steps that a first interface is used for being operated by a user, the display content of a second interface is determined based on the display content of the first interface, and a remote assistance request is used for requesting to establish remote assistance connection between first electronic equipment and second electronic equipment;

the second processing module 830 is configured to receive a first message sent by the second electronic device when the first electronic device establishes the remote assistance connection with the second electronic device, where the first message is determined based on display content of a third interface in the second electronic device, and the display content of the third interface has an association relationship with the display content of the second interface; and updating the display content of the second interface based on the first message.

According to the remote assistance device provided by the embodiment of the application, the first electronic equipment establishes the remote assistance connection with the second electronic equipment, the first electronic equipment sends the content to be processed in the second interface to the second electronic equipment, displaying on a third interface of the second electronic device, when the second electronic device sends the first message to the first electronic device, the first electronic device can obtain the updated second interface, and then guide the user to perform corresponding operation on the first interface according to the display content on the updated second interface, such that when a remote user at a second electronic device remotely assists a local user at a first electronic device, the display content uploaded by the local user can only be checked and edited, and the right for controlling the first electronic device cannot be directly acquired, so that the safety of the first electronic device is improved, and the risk of exposing the privacy of the local user is reduced.

In some embodiments, the apparatus further comprises:

the third receiving module is used for receiving a second input of the user after the display content of the second interface is updated based on the first message;

the second display module is used for responding to the second input and updating the display content of the first interface;

and the first sending module is used for sending a second message to the second electronic device, the second message is determined based on the updated display content of the first interface, and the second message is used for indicating the second electronic device to update the third interface.

According to the remote assistance device provided by the embodiment of the application, the second message is determined by receiving the second input of the user to the first interface of the first electronic equipment, and is displayed on the third interface of the second electronic equipment after being sent to the second electronic equipment, so that the remote user can conveniently check and edit the content uploaded by the local user.

In some embodiments, the apparatus further comprises:

the fourth receiving module is used for receiving a third input of the user before receiving the first message sent by the second electronic equipment;

the fourth processing module is used for responding to the third input and determining target content, and the target content comprises part of display content of the second interface;

wherein the first message is generated based on the target content.

According to the remote assistance device provided by the embodiment of the application, the display content of the second interface is filtered, only the target content which a local user wants a remote user to see is reserved, and the safety of the local user when the local user uses the first electronic equipment to receive remote assistance is improved.

In some embodiments, the apparatus further comprises:

the fifth receiving module is used for receiving a fourth input of the user after the display content of the second interface is updated based on the first message;

and the fifth processing module is used for responding to the fourth input and storing the target multimedia file, wherein the target multimedia file comprises display content which is displayed on the second interface after the first electronic equipment and the second electronic equipment establish the remote assistance connection.

According to the remote assistance device provided by the embodiment of the application, the multimedia file of the second interface of the first electronic equipment is saved, so that a local user can independently solve the similar task according to the saved multimedia file.

In some embodiments, the second interface after updating the display content includes a play control therein, and the apparatus further includes:

the sixth receiving module is configured to receive a fifth input of the user to the play control after the display content of the second interface is updated based on the first message;

and the sixth processing module is used for responding to the fifth input and playing the voice information, and the first message comprises the voice information.

According to the remote assistance device provided by the embodiment of the application, the playing control containing the operation instruction is added to the third interface of the second electronic equipment and is sent to the second interface, so that a local user can obtain all operation information by clicking the control, and the operation experience between the remote user and the local user is improved.

The embodiment of the application provides another remote assistance method.

It should be noted that, for the remote assistance method, the remote assistance method is applied to the second electronic device, and the execution subject of the remote assistance method is the second electronic device, including but not limited to a mobile terminal, such as a mobile phone, a tablet computer, a watch, and the like; or a control device of the second electronic device; or a server communicatively connected to a second electronic device, etc.

As shown in fig. 2, the remote assistance method, applied to a second electronic device, includes: step 210, step 220, step 230 and step 240.

Step 210, receiving a remote assistance request sent by a first electronic device.

In this step, the display screen of the first electronic device may be a straight screen, a folded screen, or another display screen with at least two display areas.

It should be noted that, after the first interface and the second interface are displayed on the first electronic device, the first electronic device sends a remote assistance request to the second electronic device, where the request may be an ip address of the first electronic device, an account ID of the first electronic device, or information for identifying the identity of the electronic device by other users, and after the second electronic device receives the assistance request, the second electronic device establishes a remote connection with the first electronic device after confirming the identity information.

In the embodiment shown in fig. 3, after receiving the remote assistance request, the second electronic device establishes a remote connection with the first electronic device, where the remote connection may be performed by using a remote connection function of the electronic device itself, or may be performed by using a third-party device.

In this embodiment, by receiving a remote connection request sent by a first electronic device, a remote connection between a second electronic device and the first electronic device is established, which is convenient for the second electronic device to receive related information sent by the first electronic device and send feedback information to the first electronic device.

Step 220, displaying a third interface under the condition that the remote assistance connection is established with the first electronic device, wherein the display content of the third interface has an association relation with the display content of the second interface in the first electronic device.

It should be noted that, the third interface refers to a picture that can be seen by a remote user at the second electronic device, and the first interface and the second interface are pictures that can be seen by a local user at the first electronic device, and the content on the third interface may be a video or a picture; the display content of the third interface is associated according to the display content of the second interface in the first electronic device, which means that part of the display content of the third interface may be the same as the display content of the second interface, for example, the third interface and the second interface both include a video or a picture to be edited, but the display content of the third interface is different from the display content of the second interface, for example, a remote user also has an input control on the third interface for adding instruction information to the content displayed on the third interface, but the display content on the second interface only includes the video or the picture to be edited and the instruction information, and does not include the input control; in addition, after the user blocks or blackens part of the display content of the second interface, at this time, a blocked or blackened area is not displayed on the display content of the third interface in the second electronic device that establishes the remote assistance connection with the first electronic device.

In this embodiment, after the first interface and the second interface are acquired and the second electronic device establishes the remote assistance connection with the first electronic device and then clicks the upload control on the display screen of the first electronic device, the first electronic device sends the display content of the second interface to the second electronic device and displays the display content on the third interface of the second electronic device.

Of course, in other embodiments, after the first interface and the second interface are obtained and the second electronic device establishes the remote assistance connection with the first electronic device, the third interface of the second electronic device may also be automatically updated according to the display content of the second interface.

And step 230, receiving a sixth input of the user.

In this step, a sixth input is used to add target information on the third interface.

In this embodiment, a text with a content of "click to solve the right side of the image by a finger and slide left" is added on the third interface of the second electronic device, and then the added text is the target information.

Step 240, in response to the sixth input, updating the display content of the third interface, and sending a first message to the first electronic device, where the first message is determined based on the updated display content of the third interface, and the first message is used to indicate that the display content of the second interface is updated.

In this embodiment, in response to the sixth input, the third interface of the second electronic device displays, on the third interface, the third interface to which the target information is added, where the target information may be text, voice, or graffiti, or may be a combination of text, voice, and graffiti.

It should be noted that the first message may be part of display content of the updated third interface, where the display content includes a video or a picture to be edited, and also includes information such as newly added text, voice, or graffiti.

In this embodiment, when the sixth input is a combined input of a plurality of input forms, the sixth input is taken as a touch input as an example, and the description is given.

In the embodiment shown in fig. 5, three controls 511 of "add graffiti", "add voice", and "add text" are provided on the third interface 510 of the second electronic device, and after the control 511 of "add text" is clicked, a text input box pops up, and a text of "click right side of image and left slide with finger" is input in the input box, and an arrow pointing to the right side of image is drawn on the third interface, at this time, the updated third interface includes the original third interface content and the added text and arrow.

In this embodiment, after the third interface of the second electronic device is updated, the synchronization control on the third interface is clicked to send the first message requesting the synchronous display to the first electronic device, and after the first electronic device receives the first message, the updated second interface is displayed in the second area of the first electronic device, where the interface includes the text and the arrow added to the third interface.

According to the remote assistance method provided by the embodiment of the application, the remote assistance connection is established between the first electronic device and the second electronic device, the second electronic device acquires the second message sent by the first electronic device, displays the second message on the third interface of the second electronic device, and obtains the first message after the target information is added on the third interface by the remote user, the second electronic device sends the first message to the first electronic device, and displays the first message on the second interface of the first electronic device, so that the local user can perform subsequent operation on the first interface of the first electronic device according to the display content of the second interface, and online teaching among remote users is realized.

In some embodiments, updating the display content of the third interface comprises: and adding at least one of characters, images and playing controls on the third interface.

In this embodiment, the remote user may view or edit the display content of the third interface of the second electronic device, where the editing may be adding characters, images, or setting a play control on the third interface, where the play control is used to enter voice information, and when the display content of the second interface is updated based on the display content of the third interface, the local user may click the voice control on the second interface of the first electronic device and play the voice information entered by the remote user, so as to obtain an operation instruction to perform a related operation on the display content of the first interface.

In this embodiment, a voice playing control preset on a third interface of the second electronic device is clicked, and a first message is obtained after the voice information is "click-to-save ready", and after the second electronic device sends the first message to the first electronic device, the local user operates the display content of the first interface of the first electronic device according to the first message.

According to the remote assistance method provided by the embodiment of the application, by setting various types of target information, the assistance modes of remote users are increased, and the experience of local users in solving assistance tasks is improved.

In some embodiments, after sending the first message to the first electronic device, the method further includes: receiving a second message sent by the first electronic equipment; and updating the display content of the third interface based on the second message.

In this embodiment, the first message may be part of display content on a third interface of the second electronic device, where the display content includes a video or a picture to be edited, and also includes information such as newly added text, voice, or doodle; the second message is determined according to the display content of the first interface of the first electronic device, and the second message may be identical to the display content of the first interface or different from the display content of the first interface, for example, a part of the area in the display content of the first interface to be transmitted is shielded or blackened, and the processed content is transmitted to the second electronic device and displayed on the third interface of the second electronic device.

In this embodiment, the first message may be directly sent to the first electronic device by the second electronic device, or may be sent to the server by the second electronic device first, and then forwarded to the first electronic device by the server.

In this embodiment, after the second electronic device sends the first message to the first electronic device, the updated second interface is obtained at the first electronic device, where the second interface includes the operation instruction in the first message, and according to the operation instruction, the display content of the first interface of the first electronic device may be operated in a related manner, and the updated content is displayed at the first interface.

In some embodiments, after the display content of the first interface of the first electronic device is updated, the display content of the first interface still needs to be sent to the second electronic device, and is updated and displayed on the third interface of the second electronic device, and after the remote user views the updated third interface, the remote user may continue to add a related operation instruction on the third interface, so as to help the local user complete a corresponding operation according to the operation instruction.

According to the remote assistance method provided by the embodiment of the application, the first electronic equipment sends the second message to the second electronic equipment for multiple times and the second electronic equipment sends the first message to the first electronic equipment for multiple times, so that the remote user and the local user can execute multiple assistance tasks, and the experience of the local user in receiving remote assistance is improved.

The embodiment of the application also provides a remote assistance device.

As shown in fig. 9, the remote assistance apparatus includes: a fifth receiving module 910, a second display module 920, a sixth receiving module 930, and a fifth processing module 940.

A second receiving module 910, configured to receive a remote assistance request sent by a first electronic device;

the first display module 920 is configured to display a third interface under the condition that the remote assistance connection is established with the first electronic device, where display content of the third interface has an association relationship with display content of a second interface in the first electronic device;

a third receiving module 930, configured to receive a sixth input from the user;

and a third processing module 940, configured to update the display content of the third interface in response to the sixth input, and send a first message to the first electronic device, where the first message is determined based on the updated display content of the third interface, and the first message is used to indicate that the display content of the second interface is updated.

According to the remote assistance device provided by the embodiment of the application, the remote assistance connection is established between the first electronic device and the second electronic device, the second electronic device acquires the second message sent by the first electronic device, displays the second message on the third interface of the second electronic device, so as to acquire the third interface which has the same content as the second interface on the second electronic device, when the remote user adds the target information on the third interface, the first message is acquired, the second electronic device sends the first message to the first electronic device, and the first message is displayed on the second interface of the first electronic device, so that the local user can perform subsequent operation on the first interface of the first electronic device according to the display content of the second interface, and online teaching among remote users is realized.

According to the remote assistance device provided by the embodiment of the application, by setting various types of target information, the assistance modes of remote users are increased, and the experience of local users in solving assistance tasks is promoted.

In some embodiments, the apparatus further comprises:

a seventh receiving module, configured to receive a second message sent by the first electronic device after sending the first message to the first electronic device;

and the seventh processing module is used for updating the display content of the third interface based on the second message.

According to the remote assistance device provided by the embodiment of the application, the first electronic equipment sends the second message to the second electronic equipment for multiple times and the second electronic equipment sends the first message to the first electronic equipment for multiple times, so that the remote user and the local user can execute multiple assistance tasks, and the experience of the local user in receiving remote assistance is improved.

The remote assistance device in the embodiment of the present application may be an electronic device, or may be a component in the electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or may be a device other than a terminal. The electronic Device may be, for example, a Mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic Device, a Mobile Internet Device (MID), an Augmented Reality (AR)/Virtual Reality (VR) Device, a robot, a wearable Device, an ultra-Mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and may also be a Network Attached Storage (Network Attached Storage, Network Attached computer (PC), a NAS (television, TV), a teller machine (teller machine), a self-service machine, and the like, and the embodiments of the present application are not limited in particular.

The remote assistance apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which is not specifically limited in the embodiment of the present application.

The remote assistance device provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to fig. 7, and is not described here again to avoid repetition.

Optionally, as shown in fig. 10, an electronic device 1000 is further provided in the embodiment of the present application, and includes a processor 1001, a memory 1002, and a program or an instruction that is stored in the memory 1002 and is executable on the processor 1001, where when the program or the instruction is executed by the processor 1001, the program or the instruction implements each process of the above-described remote assistance method embodiment, and can achieve the same technical effect, and in order to avoid repetition, the description is omitted here.

It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.

Fig. 11 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 1100 includes, but is not limited to: radio frequency unit 1101, network module 1102, audio output unit 1103, input unit 1104, sensor 1105, display unit 1106, user input unit 1107, interface unit 1108, memory 1109, processor 1110, and the like.

Those skilled in the art will appreciate that the electronic device 1100 may further include a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 1110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. The electronic device structure shown in fig. 11 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.

A user input unit 1107, configured to receive a first input from a user;

a processor 1110, configured to control the display unit 1106 to display a first interface in a first area of a display screen, display a second interface in a second area of the display screen, and send a remote assistance request to a second electronic device in response to a first input; the first interface is used for being operated by a user, the display content of the second interface is determined based on the display content of the first interface, and the remote assistance request is used for requesting to establish remote assistance connection between the first electronic device and the second electronic device.

The processor 1110 is further configured to receive a first message sent by the second electronic device when the first electronic device establishes a remote assistance connection with the second electronic device, where the first message is determined based on display content of a third interface in the second electronic device, and the display content of the third interface has an association relationship with the display content of the second interface;

According to the remote assistance device provided by the embodiment of the application, the first electronic equipment establishes the remote assistance connection with the second electronic equipment, the first electronic equipment sends the content to be processed in the second interface to the second electronic equipment, displaying on a third interface of the second electronic device, when the second electronic device sends the first message to the second interface, the first electronic device can obtain the updated second interface, and then guide the user to perform corresponding operation on the first interface according to the display content on the updated second interface, therefore, when the remote user at the second electronic device remotely assists the local user, the remote user can only check and edit the content uploaded by the local user, and cannot directly acquire the authority for controlling the first electronic device, so that the safety of the first electronic device is improved, and the risk of exposing the privacy of the local user is reduced.

Optionally, the user input unit 1107 is further configured to receive a second input from the user after updating the display content of the second interface based on the first message;

the display unit 1106 is further used for responding to the second input and updating the display content of the first interface;

the processor 1110 is further configured to send a second message to the second electronic device, where the second message is determined based on the updated display content of the first interface, and the second message is used to instruct the second electronic device to update the third interface.

According to the electronic equipment provided by the embodiment of the application, the second message is determined by receiving the second input of the user to the first interface of the first electronic equipment, and is displayed on the third interface of the second electronic equipment after being sent to the second electronic equipment, so that the remote user can conveniently check and edit the content uploaded by the local user.

Optionally, the user input unit 1107 is further configured to receive a third input from the user before receiving the first message sent by the second electronic device;

a processor 1110 further for determining target content in response to a third input, the target content including a portion of the display content of the second interface;

wherein the first message is generated based on the target content.

According to the electronic equipment provided by the embodiment of the application, the display content of the second interface is filtered, only the target content which the local user wants to see by the remote user is reserved, and the safety of the local user when the local user uses the first electronic equipment to receive remote assistance is improved.

Optionally, the user input unit 1107 is further configured to receive a fourth input from the user after updating the display content of the second interface based on the first message;

the memory 1109 is further configured to save, in response to the fourth input, a target multimedia file, where the target multimedia file includes display content that is displayed on the second interface after the first electronic device establishes the remote assistance connection with the second electronic device.

According to the electronic equipment provided by the embodiment of the application, the multimedia file of the second interface of the first electronic equipment is saved, so that a local user can independently solve the similar task according to the saved multimedia file.

Optionally, the second interface after updating the display content includes a play control, and the user input unit 1107 is further configured to receive a fifth input to the play control from the user after updating the display content of the second interface based on the first message;

an audio output unit 1103 for playing the voice information in response to the fifth input, the first message including the voice information.

According to the electronic equipment provided by the embodiment of the application, after the playing control containing the operation instruction is added on the third interface of the second electronic equipment and is sent to the first electronic equipment, all operation information can be obtained by clicking the control on the second interface by a local user, and the operation experience between a remote user and the local user is improved.

It should be understood that, in the embodiment of the present application, the input Unit 1104 may include a Graphics Processing Unit (GPU) 11041 and a microphone 11042, and the Graphics processor 11041 processes image data of still pictures or video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1106 may include a display panel 11061, and the display panel 11061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1107 includes at least one of a touch panel 11071 and other input devices 11072. The touch panel 11071 is also referred to as a touch screen. The touch panel 11071 may include two portions of a touch detection device and a touch controller. Other input devices 11072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

The memory 1109 may be used to store software programs as well as various data. The memory 1109 may mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area may store an operating system, application programs or instructions required for at least one function (such as a sound playing function, an image playing function, etc.), and the like. Further, the memory 1109 may include volatile memory or nonvolatile memory, or the memory 1109 may include both volatile and nonvolatile memory. The non-volatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. The volatile Memory may be a Random Access Memory (RAM), a Static Random Access Memory (Static RAM, SRAM), a Dynamic Random Access Memory (Dynamic RAM, DRAM), a Synchronous Dynamic Random Access Memory (Synchronous DRAM, SDRAM), a Double Data Rate Synchronous Dynamic Random Access Memory (Double Data Rate SDRAM, ddr SDRAM), an Enhanced Synchronous SDRAM (ESDRAM), a Synchronous Link DRAM (SLDRAM), and a Direct Memory bus RAM (DRRAM). The memory 1109 in the embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.

Processor 1110 may include one or more processing units; optionally, the processor 1110 integrates an application processor, which primarily handles operations involving the operating system, user interface, and applications, etc., and a modem processor, which primarily handles wireless communication signals, such as a baseband processor. It will be appreciated that the modem processor described above may not be integrated into processor 1110.

Fig. 12 is a schematic hardware structure diagram of another electronic device for implementing the embodiment of the present application.

The electronic device 1200 includes, but is not limited to: radio unit 1201, network module 1202, audio output unit 1203, input unit 1204, sensor 1205, display unit 1206, user input unit 1207, interface unit 1208, memory 1209, and processor 1210.

Those skilled in the art will appreciate that the electronic device 1200 may further comprise a power supply (e.g., a battery) for supplying power to the various components, and the power supply may be logically connected to the processor 1210 via a power management system, so as to implement functions of managing charging, discharging, and power consumption via the power management system. The electronic device structure shown in fig. 12 does not constitute a limitation to the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.

The processor 1210 is configured to receive a remote assistance request sent by a first electronic device;

a display unit 1206, configured to display a third interface when a remote assistance connection is established with the first electronic device, where display content of the third interface has an association relationship with display content of a second interface in the first electronic device;

a user input unit 1207 for receiving a sixth input by the user;

the processor 1210 is configured to update the third interface in response to the sixth input, and send a first message for synchronizing the third interface with the second interface to the first electronic device.

Optionally, updating the display content of the third interface includes: and adding at least one of characters, images and playing controls on the third interface.

According to the electronic equipment provided by the embodiment of the application, various types of target information are set, so that the teaching mode of a remote user is increased, and the experience of a local user in solving an assistance task is promoted.

Optionally, the processor 1210 is further configured to, after sending the first message to the first electronic device, receive a second message sent by the first electronic device;

the processor 1210 is further configured to update the display content of the third interface based on the second message.

According to the electronic equipment provided by the embodiment of the application, the first electronic equipment sends the second message to the second electronic equipment for multiple times and the second electronic equipment sends the first message to the first electronic equipment for multiple times, so that the remote user and the local user can execute multiple assistance tasks, and the experience of the local user in receiving remote assistance is improved.

It should be understood that, in the embodiment of the present application, the input Unit 1204 may include a Graphics Processing Unit (GPU) 12041 and a microphone 12042, and the Graphics Processing Unit 12041 processes image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1207 includes at least one of a touch panel 12071 and other input devices 12072. A touch panel 12071, also referred to as a touch screen. The touch panel 12071 may include two parts of a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

The memory 1209 may be used to store software programs as well as various data. The memory 1209 may mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area may store an operating system, application programs or instructions (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, the memory 1209 may include volatile memory or nonvolatile memory, or the memory 1209 may include both volatile and nonvolatile memory. The non-volatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. The volatile Memory may be a Random Access Memory (RAM), a Static Random Access Memory (Static RAM, SRAM), a Dynamic Random Access Memory (Dynamic RAM, DRAM), a Synchronous Dynamic Random Access Memory (Synchronous DRAM, SDRAM), a Double Data Rate Synchronous Dynamic Random Access Memory (Double Data Rate SDRAM, ddr SDRAM), an Enhanced Synchronous SDRAM (ESDRAM), a Synchronous Link DRAM (SLDRAM), and a Direct bus RAM (DRRAM). The memory 1209 in the embodiments of the subject application include, but are not limited to, these and any other suitable types of memory.

Processor 1210 may include one or more processing units; optionally, the processor 1210 integrates an application processor, which primarily handles operations related to the operating system, user interface, applications, etc., and a modem processor, which primarily handles wireless communication signals, such as a baseband processor. It is to be appreciated that the modem processor described above may not be integrated into processor 1210.

The embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored, and when the program or the instruction is executed by a processor, the program or the instruction implements the processes of the remote assistance method embodiment, and can achieve the same technical effects, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read only memory ROM, a random access memory RAM, a magnetic or optical disk, and the like.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above remote assistance method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element identified by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the description of the foregoing embodiments, it is clear to those skilled in the art that the method of the foregoing embodiments may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but in many cases, the former is a better implementation. Based on such understanding, the technical solutions of the present application or portions thereof that contribute to the prior art may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the present embodiments are not limited to those precise embodiments, which are intended to be illustrative rather than restrictive, and that various changes and modifications may be effected therein by one skilled in the art without departing from the scope of the appended claims.

Claims

1. A remote assistance method is applied to a first electronic device and comprises the following steps:

receiving a first input of a user;

in response to the first input, displaying a first interface in a first area of a display screen, displaying a second interface in a second area of the display screen, and sending a remote assistance request to a second electronic device; the first interface is used for the user to operate, the display content of the second interface is determined based on the display content of the first interface, and the remote assistance request is used for requesting to establish remote assistance connection between the first electronic device and the second electronic device;

under the condition that the first electronic device establishes a remote assistance connection with the second electronic device, receiving a first message sent by the second electronic device, wherein the first message is determined based on display content of a third interface in the second electronic device, and the display content of the third interface has an association relation with the display content of the second interface;

updating display content of the second interface based on the first message.

2. The remote assistance method according to claim 1, wherein after the updating of the display content of the second interface based on the first message, the method further comprises:

receiving a second input of the user;

updating display content of the first interface in response to the second input;

sending a second message to the second electronic device, wherein the second message is determined based on the updated display content of the first interface, and the second message is used for instructing the second electronic device to update the display content of the third interface.

3. The remote assistance method according to claim 1, wherein before the receiving the first message sent by the second electronic device, the method further comprises:

receiving a third input of the user;

in response to the third input, determining target content, the target content comprising partially displayed content of the second interface;

wherein the first message is generated based on the target content.

4. The remote assistance method according to claim 1, wherein after the updating of the display content of the second interface based on the first message, the method further comprises:

receiving a fourth input of the user;

and responding to the fourth input, and saving a target multimedia file, wherein the target multimedia file comprises the display content of the second interface after the first electronic equipment and the second electronic equipment establish the remote assistance connection.

5. The remote assistance method according to claim 1, wherein a play control is included in the second interface after the display content is updated;

after the updating the display content of the second interface based on the first message, the method further includes:

receiving a fifth input of the user to the play control;

in response to the fifth input, playing voice information, the first message including the voice information.

6. A remote assistance method applied to a second electronic device is characterized by comprising the following steps:

receiving a remote assistance request sent by first electronic equipment;

receiving a sixth input of the user;

7. The remote assistance method according to claim 6, wherein the updating of the display content of the third interface includes: and adding at least one of characters, images and playing controls on the third interface.

8. The remote assistance method according to claim 6, further comprising, after sending the first message to the first electronic device:

receiving a second message sent by the first electronic equipment;

updating the display content of the third interface based on the second message.

9. A remote assistance device applied to a first electronic device, comprising:

the first receiving module is used for receiving a first input of a user;

the second processing module is configured to receive a first message sent by the second electronic device when the first electronic device establishes a remote assistance connection with the second electronic device, where the first message is determined based on display content of a third interface in the second electronic device, and the display content of the third interface has an association relationship with the display content of the second interface;

updating display content of the second interface based on the first message.

10. A remote assistance device applied to a second electronic device, comprising:

the third receiving module is used for receiving a sixth input of the user;

11. An electronic device comprising a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions when executed by the processor implementing the steps of the remote assistance method of any one of claims 1 to 8.