CN114780192B

CN114780192B - Remote assistance method, remote assistance device and electronic equipment

Info

Publication number: CN114780192B
Application number: CN202210431777.8A
Authority: CN
Inventors: 吴禹辰
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2022-04-22
Filing date: 2022-04-22
Publication date: 2024-05-24
Anticipated expiration: 2042-04-22
Also published as: CN114780192A

Abstract

The application discloses a remote assistance method, a remote assistance device and electronic equipment, and belongs to the technical field of communication. The remote assistance method is applied to the first electronic equipment and comprises the following steps: receiving a first input of a user; responding to the first input, displaying a first interface in a first area of the display screen, displaying a second interface in a second area of the display screen, and sending a remote assistance request to the second electronic device; receiving a first message sent by second electronic equipment under the condition that the first electronic equipment and the second electronic equipment establish remote assistance connection; the display content of the second interface is updated based on the first message.

Description

Remote assistance method, remote assistance device and electronic equipment

Technical Field

The application belongs to the technical field of communication, and particularly relates to a remote assistance method, a remote assistance device and electronic equipment.

Background

When a remote user assists a local user in solving a problem, a network remote assistance technology is generally adopted to connect equipment of the local user, so that remote control of the local equipment is realized.

Disclosure of Invention

The embodiment of the application aims to provide a remote assistance method, a remote assistance device and electronic equipment, which can solve the problem of poor safety of a remote user when remotely controlling local equipment.

In a first aspect, an embodiment of the present application provides a remote assistance method, applied to a first electronic device, where the method includes:

receiving a first input of a user;

Responding to the first input, displaying a second interface in a second area of the display screen, and sending a remote assistance request to second electronic equipment; the first interface is used for being operated by the user, the display content of the second interface is determined based on the display content of the first interface, and the remote assistance request is used for requesting to establish the remote assistance connection between the first electronic device and the second electronic device;

Receiving a first message sent by the second electronic device under the condition that the first electronic device and the second electronic device are in remote assistance connection, wherein the first message is determined based on the display content of a third interface in the second electronic device, and the display content of the third interface has an association relationship with the display content of the second interface;

And updating the display content of the second interface based on the first message.

In a second aspect, an embodiment of the present application provides another remote assistance method applied to a second electronic device, where the method includes:

Receiving a remote assistance request sent by first electronic equipment;

Displaying a third interface under the condition of establishing remote assistance connection with the first electronic equipment, wherein the display content of the third interface has an association relationship with the display content of a second interface in the first electronic equipment;

receiving a sixth input from the user;

And in response to the sixth input, updating the display content of the third interface, and sending a first message to the first electronic device, wherein the first message is determined based on the updated display content of the third interface, and the first message is used for indicating to update the display content of the second interface.

In a third aspect, an embodiment of the present application provides a remote assistance device, applied to a first electronic device, where the device includes:

The first receiving module is used for receiving a first input of a user;

The first processing module is used for responding to the first input, displaying a first interface in a first area of a display screen, displaying a second interface in a second area of the display screen and sending a remote assistance request to second electronic equipment; the first interface is used for being operated by the user, the display content of the second interface is determined based on the display content of the first interface, and the remote assistance request is used for requesting to establish the remote assistance connection between the first electronic device and the second electronic device;

the second processing module is used for receiving a first message sent by the second electronic device under the condition that the first electronic device and the second electronic device establish remote assistance connection, wherein the first message is determined based on the display content of a third interface in the second electronic device, and the display content of the third interface has an association relationship with the display content of the second interface; and updating the display content of the second interface based on the first message.

In a fourth aspect, an embodiment of the present application provides a remote assistance device, applied to a second electronic device, where the device includes:

The second receiving module is used for receiving a remote assistance request sent by the first electronic equipment;

the first display module is used for displaying a third interface under the condition of establishing remote assistance connection with the first electronic equipment, and the display content of the third interface has an association relation with the display content of a second interface in the first electronic equipment;

the third receiving module is used for receiving a sixth input of a user;

And the third processing module is used for responding to the sixth input, updating the display content of the third interface and sending a first message to the first electronic equipment, wherein the first message is determined based on the updated display content of the third interface, and the first message is used for indicating to update the display content of the second interface.

In a fifth aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the method according to the first or second aspect.

In a sixth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor implement the steps of the method according to the first or second aspect.

In a seventh aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the first aspect or the second aspect.

In an eighth aspect, embodiments of the present application provide a computer program product stored in a storage medium, the program product being executable by at least one processor to implement the method according to the first or second aspect.

In the embodiment of the application, remote assistance connection is established between the first electronic equipment and the second electronic equipment, the first electronic equipment sends the content to be processed in the second interface to the second electronic equipment, the content is displayed on the third interface of the second electronic equipment, when the second electronic equipment sends the first message to the first electronic equipment, the updated second interface can be obtained on the first electronic equipment, and then the user is guided to perform corresponding operation on the first interface according to the updated display content on the second interface, so that when the remote user at the second electronic equipment remotely assists the local user, the remote user at the second electronic equipment can only view and edit the content uploaded by the local user, the authority for controlling the first electronic equipment cannot be directly obtained, the safety of the first electronic equipment is improved, and the risk that the privacy of the local user is exposed is reduced.

Drawings

FIG. 1 is a schematic flow chart of a remote assistance method according to an embodiment of the present application;

FIG. 2 is a second flowchart of a remote assistance method according to the embodiment of the present application;

FIG. 3 is an interactive schematic diagram of a remote assistance method provided by an embodiment of the present application;

FIG. 4 is a schematic illustration of an interface for remote assistance provided by an embodiment of the present application;

FIG. 5 is a second schematic diagram of an interface for remote assistance provided by an embodiment of the present application;

FIG. 6 is a third illustrative view of an interface for remote assistance provided by an embodiment of the present application;

FIG. 7 is a fourth illustrative diagram of an interface for remote assistance provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of a remote assistance device according to an embodiment of the present application;

FIG. 9 is a second schematic diagram of a remote assistance device according to the embodiment of the present application;

Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

FIG. 11 is a schematic diagram of hardware of an electronic device according to an embodiment of the present application;

Fig. 12 is a second hardware schematic of the electronic device according to the embodiment of the application.

Detailed Description

The technical solutions of the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which are obtained by a person skilled in the art based on the embodiments of the present application, fall within the scope of protection of the present application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type, and are not limited to the number of objects, such as the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

The remote assistance method, the remote assistance device, the electronic device and the readable storage medium provided by the embodiment of the application are described in detail below through specific embodiments and application scenarios thereof with reference to the accompanying drawings.

The remote assistance method can be applied to the terminal, and can be specifically executed by hardware or software in the terminal.

The terminal includes, but is not limited to, a mobile phone or other portable communication device such as a tablet computer having a touch sensitive surface (e.g., a touch screen display and/or a touch pad). It should also be appreciated that in some embodiments, the terminal may not be a portable communication device, but rather a desktop computer having a touch-sensitive surface (e.g., a touch screen display and/or a touch pad).

In the following various embodiments, a terminal including a display and a touch sensitive surface is described. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, mouse, and joystick.

The execution subject of the remote assistance method provided by the embodiment of the application may be an electronic device or a functional module or a functional entity in the electronic device capable of implementing the remote assistance method, and the electronic device in the embodiment of the application includes, but is not limited to, a mobile phone, a tablet computer, a wearable device, and the like.

As shown in fig. 1, the remote assistance method is applied to a first electronic device, and includes: step 110, step 120 and step 130.

Step 110, a first input of a user is received.

In this step, a first input is used to trigger the first electronic device to turn on a remote assistance function.

Wherein the first input may be at least one of:

First, the first input may be a touch input including, but not limited to, a click input, a slide input, a press input, and the like.

In this embodiment, the receiving of the first input by the user may be receiving a touch operation by the user on the display screen.

In order to reduce the user's rate of misoperation, the active area of the display screen may be limited to a specific area, such as a blank area of the display screen.

In this embodiment, after clicking the remote connection control on the display screen of the first electronic device, the user opens the remote assistance function of the first electronic device.

Secondly, the input may be a physical key input.

In this embodiment, the body of the terminal is provided with an entity key for opening remote connection, and the operation of receiving the first input of the user and pressing the corresponding entity key by the user may be performed; the input may also be a combined operation of pressing multiple physical cases simultaneously.

Third, the input may be a voice input.

In this embodiment, after the display area of the first electronic device is opened, the remote assistance function of the first electronic device may be turned on after the voice is received as "turn on remote connection".

Of course, in other embodiments, the input may take other forms, including but not limited to character input, etc., which may be specifically determined according to actual needs, and the present embodiment is not limited thereto.

In some embodiments, the first input may be a single input or a combined input in the form of multiple inputs.

Step 120, in response to the first input, displaying a first interface in a first area of the display screen, displaying a second interface in a second area of the display screen, and sending a remote assistance request to the second electronic device; the first interface is used for being operated by a user, the display content of the second interface is determined based on the display content of the first interface, and the remote assistance request is used for requesting to establish the remote assistance connection between the first electronic device and the second electronic device.

In this step, the display screen may be a straight screen, and there are two independent display areas on the straight screen, which are a first area and a second area respectively; the display screen can also be a folding screen, and the display areas of the two screens of the folding screen are a first area and a second area respectively; other display screens having at least two display areas are also possible.

In this step, the first interface is an operation interface of the user, on which the local user can independently edit the display content of the interface, or can edit the display content through the assistance instruction sent by other remote connection devices, so as to complete the related assistance task.

In this step, the display content on the second interface may be obtained after "filtering" (such as graffiti, mosaicing, or shielding) based on the display content of the first interface, so as not to allow the remote user at the second electronic device to view the entire display content of the first interface; of course, the display content of the second interface may be all the display content of the first interface, and the display content of the first interface may be selectively displayed on the second interface according to the actual requirement of the user.

In some embodiments, the display content of the second interface may also be identical to the display content of the first interface, and when there is an area related to the privacy of the local user, the area of the second interface may also be masked or blackened, and when the first electronic device sends the display content of the second interface to the second electronic device and displays the display content on the third interface of the second electronic device, the third interface seen by the remote user at the second electronic device does not include the above-mentioned masked or blackened area.

It should be noted that, the display content on the first interface may be video or a picture; the display content of the second interface is determined by the first interface, and the display content on the second interface can be video or pictures.

In the step, after the first interface and the second interface are displayed on the first electronic device, the first electronic device sends a remote assistance request to the second electronic device, wherein the request can be an ip address of the first electronic device, an account ID of the first electronic device, or information of other users for identifying the identity of the electronic device, and the second electronic device establishes remote connection with the first electronic device after confirming the identity information after receiving the assistance request.

It should be noted that, the way of establishing the remote assistance connection between the first electronic device and the second electronic device may be to connect by using a remote connection function of the electronic device, for example, when the remote connection device is a computer, the remote connection may be performed by using connection services of two computers; the first electronic device and the second electronic device may be connected in a remote manner by using a third party tool, for example, a remote connection tool is installed on an electronic device to be connected, and connection between the two electronic devices is achieved through connection of the connection tool.

In this embodiment, when the first input is a combined input in the form of a plurality of inputs, the first input may include a first sub-input and a second sub-input; the first sub-input and the second sub-input may be touch input, physical key and combination input thereof, voice input and other types of input, and the embodiment will not be repeated with reference to the form of the first input.

Taking the first sub-input and the second sub-input as touch inputs as examples, explanation will be made.

In this embodiment, a first sub-input is received from a user, and a display screen of the first electronic device is responsive to the first sub-input to turn on a remote function.

In the embodiment shown in fig. 4, a remote function is turned on a display screen of the first electronic device through a specific touch operation, for example, when an "S" letter is drawn on the screen or when the screen is tapped a plurality of times in succession, a remote connection service of the first electronic device is turned on, at this time, a first interface 410 is displayed in a first area, and a second interface 420 is displayed in a second area.

After the first interface and the second interface are displayed on the display screen of the first electronic device, receiving a second sub-input of the user, displaying a user list by the display screen in response to the second sub-input, and after the target user is determined, sending a remote assistance request to the target user.

In this embodiment, after clicking on the list of users on the display screen and selecting the user as the "second electronic device", a remote assistance request is sent to the second electronic device.

Of course, the first input may also be a hybrid combination of multiple types of inputs, such as a touch input combined with a physical key input, where the touch input and the physical key input are in the form of the first input, and the embodiment is not repeated.

In some embodiments, after receiving the remote connection request sent by the first electronic device, the second electronic device may receive the connection request after confirming the identity information of the other party, so as to implement remote connection of the two electronic devices, so that the second electronic device receives the related information sent by the first electronic device, and sends feedback information to the first electronic device.

In some embodiments, a third interface is displayed with the remote assistance connection established with the first electronic device, and display content of the third interface has an association relationship with display content of a second interface in the first electronic device.

It should be noted that, the third interface refers to an interface that can be seen by a remote user at the second electronic device, and the first interface and the second interface are pictures that can be seen by a local user at the first electronic device; the display content on the third interface can be video or pictures; the display content of the third interface and the display content of the second interface in the first electronic device have an association relationship, which means that part of the display content of the third interface may be the same as the display content of the second interface, for example, the third interface and the second interface both include a video or a picture to be edited, but the display content of the third interface is different from the display content of the second interface, for example, the remote user also has an input control on the third interface for adding instruction information to the display content of the third interface, but the display content of the second interface only includes the video or the picture to be edited and the instruction information, and does not include the input control; in addition, after the user blocks or blackens part of the display content of the second interface, at the moment, the blocked or blacked area is not displayed on the third interface of the second electronic device which is in remote assistance connection with the first electronic device.

In this embodiment, after the first interface and the second interface are displayed on the display screen and the second electronic device establishes a remote assistance connection with the first electronic device, the first electronic device may also send the display content of the second interface to the second electronic device by receiving an input of a local user after confirming the display content of the second interface to be sent, and display the display content of the second interface on a third interface of the second electronic device, where the input may be a touch input, an entity key and a combination input thereof, a voice input, and other types of inputs, and detailed description is omitted with reference to the form of the first input.

In this embodiment, after the first interface and the second interface are obtained and the second electronic device establishes a remote assistance connection with the first electronic device, after clicking an upload control on a display screen of the first electronic device, the first electronic device sends display content of the second interface to the second electronic device, and displays the display content on a third interface of the second electronic device.

Of course, in other embodiments, after the first interface and the second interface are acquired and the second electronic device establishes a remote assistance connection with the first electronic device, the third interface of the second electronic device may also be automatically updated according to the display content of the second interface.

In some embodiments, a sixth input is received from the user.

In this step, a sixth input is used to add the target information on the third interface;

the sixth input may be a touch input, a physical key, a combination input thereof, a voice input, and other types of inputs, and the embodiment will not be described again with reference to the form of the first input.

In this embodiment, the target information refers to information set by the remote user at the second electronic device on the third interface, where the information may be text, voice or a legend, and may also be a combination of text, voice and legend; the target information comprises an operation instruction, and the first interface updates display content according to the operation instruction.

In this embodiment, a text with a content of "hand-held resolution image right side, left-hand slide" is added on the third interface of the second electronic device, and the added text is the target information.

In some embodiments, voice information can be added near a "save" control on the third interface as "click save" as target information, so as to remind the user at the first electronic device that a corresponding save operation can be performed on the current task interface after receiving the information of the third interface.

In some embodiments, the sixth input may be a single input or a combined input in the form of multiple inputs.

In some embodiments, in response to the sixth input, updating the display content of the third interface and sending a first message to the first electronic device, the first message determined based on the updated display content of the third interface and the first message indicating to update the display content of the second interface.

In this embodiment, the third interface of the second electronic device is responsive to the sixth input to display on the third interface additional target information, which may be text, speech, or graffiti, or a combination of text, speech, and graffiti.

It should be noted that, the first message may be a part of display content of the third interface, where the display content includes a video or a picture to be edited, and further includes information such as a newly added text, a voice, or a graffiti.

It should be noted that, the first message may be directly sent to the first electronic device by the second electronic device, or may be sent to the server by the second electronic device first, and then forwarded to the first electronic device by the server.

In some embodiments, when the sixth input is a combined input of a plurality of input forms, the sixth input is taken as a touch input for example.

In the embodiment shown in fig. 5, three controls 511 of "adding graffiti", "adding voice", and "adding text" are provided on the third interface 510 of the second electronic device, after clicking the control 511 of "adding text", a text input box is popped up, a text of "finger clicking right side of the image and left sliding" is input in the input box, and an arrow pointing to the right side of the image is drawn on the third interface, where the updated third interface includes the display content of the original third interface and the added text and arrow.

In this embodiment, after the third interface of the second electronic device is updated, clicking the upload control on the third interface to send a first message to the first electronic device, and after receiving the first message, displaying a received second message on the second interface of the first electronic device, where the second message includes characters and arrows added on the third interface.

Of course, the sixth input may also be a hybrid combination of multiple types of inputs, such as a touch input combined with a physical key input, where the touch input and the physical key input are in the form of the first input, which is not described in detail in this embodiment.

130, Under the condition that the first electronic device and the second electronic device establish remote assistance connection, receiving a first message sent by the second electronic device, wherein the first message is determined based on the display content of a third interface in the second electronic device, and the display content of the third interface has an association relationship with the display content of the second interface;

the display content of the second interface is updated based on the first message.

In this step, the first electronic device and the second electronic device may be connected by using a remote connection function of the electronic device, or may be remote connection implemented by using a third party application, which is not described in detail in the foregoing remote connection manner of step 130.

In this step, the first message may be updated part of the display content of the third interface, where the display content includes a video or a picture to be edited, and further includes information such as a newly added text, a voice, or a graffiti.

In this step, the display content of the third interface and the display content of the second interface have an association relationship, which means that a portion of the display content of the third interface of the second electronic device may be the same as the display content of the second interface of the first electronic device, for example, the third interface and the second interface both include a video or a picture to be edited; the third interface is different from the second interface in display content, for example, the remote user further has an input control on the third interface for adding instruction information to the content displayed on the third interface, but the display content on the second interface only includes the video or picture to be edited and the instruction information, and does not include the input control.

In the embodiment shown in fig. 6, in the case where the first electronic device establishes a remote assistance connection with the second electronic device, after the first electronic device receives the first message sent by the second electronic device, the first electronic device synchronously displays a text of "finger click on the right side of the image, left slide" and an arrow pointing to the right side of the image on the second interface 420 of the first electronic device, and at this time, according to the prompt of the text and the arrow, a corresponding operation is performed on the first interface 410 of the first electronic device.

According to the remote assistance method provided by the embodiment of the application, the remote assistance connection is established between the first electronic equipment and the second electronic equipment, the first electronic equipment sends the display content to be processed in the second interface to the second electronic equipment, the display content is displayed on the third interface of the second electronic equipment, when the second electronic equipment sends the first message to the first electronic equipment, the first electronic equipment can obtain the updated second interface, and then the user is guided to perform corresponding operation on the first interface according to the updated display content on the second interface, so that the remote user at the second electronic equipment can only check and edit the display content uploaded by the local user when remotely assisting the local user at the first electronic equipment, the authority of controlling the first electronic equipment cannot be directly obtained, the safety of the first electronic equipment is improved, and the risk of exposing the local user is reduced.

In some embodiments, after updating the display content of the second interface based on the first message, the method further comprises: receiving a second input from the user; updating the display content of the first interface in response to the second input; and sending a second message to the second electronic device, wherein the second message is determined based on the updated display content of the first interface, and the second message is used for indicating the second electronic device to update the display content of the third interface.

It can be understood that when a remote assistance task needs to be completed in multiple steps, the third interface of the second electronic device needs to be updated multiple times, different target information is added, after the second electronic device sends the display content to be edited and the target information on the updated third interface to the first electronic device, the display is performed on the second interface of the first electronic device, then corresponding operation is performed on the display content of the first interface of the first electronic device according to the target information on the updated second interface, and the updated first interface is obtained on the first electronic device until the remote assistance task is completed.

The target information refers to information set by a remote user at the second electronic device on a third interface, wherein the information can be words, voices or legends, and can also be a combination form of the words, voices and the legends; the target information comprises an operation instruction, and the first interface of the first electronic equipment updates display content according to the operation instruction.

It should be noted that, the second message is determined by the display content of the first interface of the first electronic device, and the second message may be completely the same as the display content of the first interface or may be different from the display content of the first interface, for example, the first electronic device performs processing such as shielding or blackening on a partial area in the display content of the first interface to be sent, and then sends the processed content to the second electronic device, and displays the processed content on the third interface of the second electronic device.

In this embodiment, a second input of the user is received, and the first interface of the first electronic device responds to the second input, and displays the updated first interface, where the second input may be a touch input, a physical key and a combination input thereof, a voice input, or other types of input, and the embodiment will not be repeated with reference to the form of the first input.

In this embodiment, when the "finger clicks on the right side of the image, the text of the left slide" and an operation instruction of an arrow pointing to the right side of the image appear on the second interface 420 of the first electronic device, at this time, the right side of the image pointed to by the arrow is clicked on the first interface 410 of the first electronic device, and slides to the left, and after the above operation is completed, the updated first interface 410 is obtained on the first electronic device.

In some embodiments, after the first electronic device obtains the updated first interface 410, the display content of the first interface 410 may be filtered (such as graffiti, mosaicing, or shielding), and the filtered display content is sent to the second electronic device, and displayed on the third interface 510 of the second electronic device, where the third interface 510 does not include the filtered content.

According to the remote assistance method provided by the embodiment of the application, the second message is determined by receiving the second input of the user to the first interface of the first electronic device, and after the second message is sent to the second electronic device, the second message is displayed on the third interface of the second electronic device, so that the remote user can conveniently check and edit the content uploaded by the local user.

In some embodiments, step 130, before receiving the first message sent by the second electronic device, the method further comprises: receiving a third input from the user; determining target content in response to the third input, the target content including a portion of the display content of the second interface; wherein the first message is generated based on the target content.

It can be appreciated that when the user performs an operation related to personal privacy on the first interface of the first electronic device, the operation content (such as a login personal account) is not expected to be uploaded to the second electronic device and is viewed by the remote user, and before the first electronic device sends the content to be uploaded to the second electronic device, the content related to user privacy in the content to be uploaded can be filtered to obtain the target content, and the target content is sent to the second electronic device by the first electronic device to be displayed on the third interface of the second electronic device.

It should be noted that, the target content includes the content that the local user such as the video or the picture to be processed wants the remote user to see and process, but does not include the privacy information such as the account, the password, etc. of the user; the first message is generated based on the target content, namely after the target content uploaded by the local user through the first electronic device is displayed on a third interface of the second electronic device, the remote user edits the target content on the third interface, and then the first message is determined according to the edited instruction information.

In this embodiment, a third input of the user is received, and the second interface of the first electronic device responds to the third input, and the target content is displayed on the second interface, where the third input may be a touch input, a physical key and a combination input thereof, a voice input and other types of inputs, and the detailed description of the embodiment is omitted herein with reference to the form of the first input.

In this embodiment, when the display content of the first interface is displayed on the second interface, the privacy area (such as the password input interface) of the second interface is pressed for a long time, and the privacy area is masked or filtered, and at this time, the display content of the second interface may be used as the target content, and the first electronic device sends the target content to the second electronic device and displays the target content on the third interface of the second electronic device.

In some embodiments, the first electronic device may also choose to mask the private content in the picture or video within a preset time range to obtain the target content, so that a local user at the first device performs an operation related to the private information; the preset time range can be between 10s and 100s, and can be set in a self-defined mode according to user requirements.

Taking the target content as video as an example.

In this embodiment, a local user performs an operation of logging in a personal account on a first interface of a first electronic device, after 30s, the first interface displays a video containing content corresponding to 30s, when the video is displayed on a second interface of the first electronic device, the content corresponding to 30s in the video may be deleted on the second interface to obtain a new video, and the video is used as a target content, where the first electronic device and the second electronic device establish a remote assistance connection, the first electronic device sends the target content to the second electronic device, and the target content is displayed on a third interface of the second electronic device, and the remote user may determine a first message to be sent to the first electronic device according to the target content.

According to the remote assistance method provided by the embodiment of the application, the display content of the second interface is filtered, so that only the target content which the local user hopes the remote user to see is reserved, and the safety of the local user when the first electronic equipment is used for receiving remote assistance is improved.

In some embodiments, after updating the display content of the second interface based on the first message, the method further comprises: receiving a fourth input from the user; and responding to the fourth input, and storing a target multimedia file, wherein the target multimedia file comprises display content of the second interface after the first electronic device and the second electronic device establish remote assistance connection.

In this embodiment, the target multimedia file refers to display content on the second interface of the first electronic device after the first electronic device and the second electronic device establish remote assistance connection, where the display content includes a picture or a video, and further includes instruction information such as voice, graffiti, or text added to the picture or the video; in the process of executing the task to be assisted, the target multimedia file may be the display content on all the second interfaces, or may be the content displayed on part of the second interfaces.

In this embodiment, a fourth input of the user is received, and the second interface of the first electronic device responds to the fourth input and stores the content displayed on the second interface, where the fourth input may be a touch input, a physical key and a combination input thereof, a voice input and other types of inputs, and the embodiment will not be repeated with reference to the form of the first input.

In this embodiment, the target multimedia file may be saved each time the first electronic device receives the first message and updates the display content of the second interface, or may be saved after the task to be assisted is completed.

In this embodiment, after the task to be assisted is completed, the "all save" control on the second interface of the first electronic device is clicked, and the current display content and the historical display content in the second interface are all saved in the first electronic device.

According to the remote assistance method provided by the embodiment of the application, the multimedia file of the second interface of the first electronic equipment is saved, so that the local user can independently solve the similar tasks according to the saved multimedia file.

In some embodiments, the second interface after updating the display content includes a play control; after updating the display content of the second interface based on the first message, the method further comprises: receiving a fifth input of a user to the play control; in response to the fifth input, the voice information is played, the first message including the voice information.

In this embodiment, the playing control includes content of the target information added on the third interface of the second electronic device, the playing control including the target information is added on the third interface, the second electronic device sends the content to be processed including the playing control to the first electronic device, the content is displayed on the second interface of the first electronic device, and by clicking the playing control displayed on the second interface, related operations can be executed at corresponding positions of the first interface according to the played content.

In this embodiment, a fifth input of the user is received, and the play control on the second interface responds to the fifth input to play the instruction information, where the fifth input may be a touch input, a physical key and a combination input thereof, a voice input and other types of inputs, and the embodiment will not be repeated with reference to the form of the first input.

In the embodiment shown in fig. 7, when a section of voice with the content of "after clicking and saving" is added to the third interface of the second electronic device, the voice is dragged to a position near the saving control, so that the display content of the third interface determines the first message, at this time, the first message is sent to the first electronic device, after the first message is received by the first electronic device, the content is synchronously displayed on the corresponding position of the saving control on the second interface 420 of the first electronic device as the voice with the content of "after clicking and saving", and after playing the voice, the corresponding operation is performed on the first interface 410 according to the voice content.

According to the remote assistance method provided by the embodiment of the application, after the play control containing the operation instruction is added on the third interface of the second electronic device and is sent to the first electronic device, the local user can acquire all operation information by clicking the play control on the second interface, and the operation experience between the remote user and the local user is improved.

According to the remote assistance method provided by the embodiment of the application, the execution subject can be a remote assistance device. In the embodiment of the present application, a method for executing remote assistance by a remote assistance device is taken as an example, and the remote assistance device provided by the embodiment of the present application is described.

The embodiment of the application also provides a remote assistance device.

As shown in fig. 8, the remote assistance apparatus includes: a first receiving module 810, a first processing module 820, and a second processing module 830.

A first receiving module 810 for receiving a first input of a user;

a first processing module 820 configured to display a first interface in a first area of the display screen, display a second interface in a second area of the display screen, and send a remote assistance request to the second electronic device in response to the first input; the first interface is used for being operated by a user, the display content of the second interface is determined based on the display content of the first interface, and the remote assistance request is used for requesting to establish remote assistance connection between the first electronic device and the second electronic device;

The second processing module 830 is configured to receive, when the first electronic device and the second electronic device establish a remote assistance connection, a first message sent by the second electronic device, where the first message is determined based on a display content of a third interface in the second electronic device, and the display content of the third interface has an association relationship with the display content of the second interface; the display content of the second interface is updated based on the first message.

According to the remote assistance device provided by the embodiment of the application, the remote assistance connection is established between the first electronic equipment and the second electronic equipment, the first electronic equipment sends the content to be processed in the second interface to the second electronic equipment, the content is displayed on the third interface of the second electronic equipment, when the second electronic equipment sends the first message to the first electronic equipment, the first electronic equipment can obtain the updated second interface, and then the user is guided to perform corresponding operation on the first interface according to the updated display content on the second interface, so that the remote user at the second electronic equipment can only check and edit the display content uploaded by the local user when remotely assisting the local user at the first electronic equipment, the authority of controlling the first electronic equipment cannot be directly obtained, the safety of the first electronic equipment is improved, and the risk that the local privacy user is exposed is reduced.

In some embodiments, the apparatus further comprises:

the third receiving module is used for receiving a second input of the user after updating the display content of the second interface based on the first message;

The second display module is used for responding to the second input and updating the display content of the first interface;

The first sending module is used for sending a second message to the second electronic device, the second message is determined based on the updated display content of the first interface, and the second message is used for indicating the second electronic device to update the third interface.

According to the remote assistance device provided by the embodiment of the application, the second message is determined by receiving the second input of the user to the first interface of the first electronic equipment, and after the second message is sent to the second electronic equipment, the second message is displayed on the third interface of the second electronic equipment, so that the remote user can conveniently view and edit the content uploaded by the local user.

In some embodiments, the apparatus further comprises:

A fourth receiving module, configured to receive a third input of the user before receiving the first message sent by the second electronic device;

The fourth processing module is used for responding to the third input and determining target content, wherein the target content comprises part of display content of the second interface;

wherein the first message is generated based on the target content.

According to the remote assistance device provided by the embodiment of the application, the display content of the second interface is filtered, so that only the target content which the local user hopes the remote user to see is reserved, and the safety of the local user when the first electronic equipment is used for receiving remote assistance is improved.

In some embodiments, the apparatus further comprises:

A fifth receiving module, configured to receive a fourth input of the user after updating the display content of the second interface based on the first message;

And the fifth processing module is used for responding to the fourth input and storing a target multimedia file, wherein the target multimedia file comprises display contents displayed on the second interface after the first electronic equipment and the second electronic equipment are in remote assistance connection.

According to the remote assistance device provided by the embodiment of the application, the multimedia file of the second interface of the first electronic equipment is saved, so that the local user can independently solve the similar tasks according to the saved multimedia file.

In some embodiments, the second interface after updating the display content includes a play control, and the apparatus further includes:

The sixth receiving module is used for receiving a fifth input of the playing control by the user after updating the display content of the second interface based on the first message;

And the sixth processing module is used for responding to the fifth input and playing the voice information, wherein the first message comprises the voice information.

According to the remote assistance device provided by the embodiment of the application, the playing control containing the operation instruction is added on the third interface of the second electronic equipment and is sent to the second interface, so that the local user can acquire all operation information by clicking the control, and the operation experience between the remote user and the local user is improved.

The embodiment of the application provides another remote assistance method.

It should be noted that, the remote assistance method is applied to the second electronic device, and the execution subject of the remote assistance method is the second electronic device, including but not limited to a mobile terminal, such as a mobile phone, a tablet computer, a watch, and the like; or a control device of the second electronic device; or a server communicatively coupled to the second electronic device, etc.

As shown in fig. 2, the remote assistance method is applied to a second electronic device, and includes: step 210, step 220, step 230 and step 240.

Step 210, a remote assistance request sent by a first electronic device is received.

In this step, the display screen of the first electronic device may be a straight screen, a folded screen, or another display screen having at least two display areas.

It should be noted that, after the first interface and the second interface are displayed on the first electronic device, the first electronic device sends a remote assistance request to the second electronic device, where the request may be an ip address of the first electronic device, or an account ID of the first electronic device, or information that other users identify the identity of the electronic device, and after the second electronic device receives the assistance request, the second electronic device confirms the identity information and then establishes a remote connection with the first electronic device.

In the embodiment shown in fig. 3, the second electronic device establishes a remote connection with the first electronic device after receiving the remote assistance request, where the remote connection may be implemented by using a remote connection function of the electronic device itself or by using a remote connection implemented by a third party device.

In this embodiment, by receiving the remote connection request sent by the first electronic device, remote connection between the second electronic device and the first electronic device is established, so that the second electronic device receives the related information sent by the first electronic device and sends feedback information to the first electronic device.

And 220, displaying a third interface under the condition of establishing remote assistance connection with the first electronic equipment, wherein the display content of the third interface has an association relationship with the display content of the second interface in the first electronic equipment.

It should be noted that, the third interface refers to a picture that can be seen by a remote user at the second electronic device, and the first interface and the second interface are pictures that can be seen by a local user at the first electronic device, where the content on the third interface may be video or pictures; the display content of the third interface has an association relationship according to the display content of the second interface in the first electronic device, which means that part of the display content of the third interface may be the same as the display content of the second interface, for example, the third interface and the second interface both include a video or a picture to be edited, but the display content of the third interface is different from the display content of the second interface, for example, the remote user also has an input control on the third interface for adding instruction information to the content displayed on the third interface, but the display content of the second interface only includes the video or the picture to be edited and the instruction information, and does not include the input control; in addition, after the user blocks or blackens part of the display content of the second interface, at the moment, the blocked or blacked area is not displayed on the display content of the third interface in the second electronic device which is in remote assistance connection with the first electronic device.

In this embodiment, after the first interface and the second interface are acquired and the second electronic device establishes a remote assistance connection with the first electronic device and then clicks the upload control on the display screen of the first electronic device, the first electronic device sends the display content of the second interface to the second electronic device and displays the display content on the third interface of the second electronic device.

Step 230, receiving a sixth input from the user.

In this step, the sixth input is used to add the target information on the third interface.

Step 240, in response to the sixth input, updating the display content of the third interface, and sending a first message to the first electronic device, where the first message is determined based on the updated display content of the third interface, and the first message is used to indicate to update the display content of the second interface.

In this embodiment, the third interface of the second electronic device is responsive to the sixth input to display a third interface with the target information added, where the target information may be text, voice, or graffiti, or a combination of text, voice, and graffiti.

It should be noted that, the first message may be part of the updated display content of the third interface, where the display content includes a video or a picture to be edited, and further includes information such as a newly added text, a voice, or a graffiti.

In this embodiment, when the sixth input is a combined input of a plurality of input forms, the sixth input is taken as an example of a touch input.

In the embodiment shown in fig. 5, three controls 511 of "adding graffiti", "adding voice", and "adding text" are provided on the third interface 510 of the second electronic device, after clicking the control 511 of "adding text", a text input box is popped up, a text of "finger clicking right side of the image and left sliding" is input in the input box, and an arrow pointing to the right side of the image is drawn on the third interface, where the updated third interface includes the original third interface content and the added text and arrow.

In this embodiment, after the third interface of the second electronic device is updated, clicking the synchronization control on the third interface to send a first message requesting synchronous display to the first electronic device, and after the first electronic device receives the first message, displaying the updated second interface in the second area of the first electronic device, where the interface includes the text and the arrow added on the third interface.

According to the remote assistance method provided by the embodiment of the application, the remote assistance connection is established through the first electronic equipment and the second electronic equipment, after the second electronic equipment acquires the second message sent by the first electronic equipment, the second message is displayed on the third interface of the second electronic equipment, when the remote user adds the target information on the third interface to obtain the first message, the second electronic equipment sends the first message to the first electronic equipment and displays the first message on the second interface of the first electronic equipment, so that the local user can perform subsequent operation on the first interface of the first electronic equipment according to the display content of the second interface, and online teaching among the remote users is realized.

In some embodiments, updating the display content of the third interface includes: and adding at least one of characters, images and playing controls on the third interface.

In this embodiment, the remote user may view or edit the display content of the third interface of the second electronic device, where the editing may be by adding text, an image, or setting a play control on the third interface, where the play control is used to enter voice information, and when the display content of the second interface is updated based on the display content of the third interface, the local user may click the voice control on the second interface of the first electronic device and play the voice information entered by the remote user, so as to obtain an operation instruction to perform a related operation on the display content of the first interface.

In this embodiment, clicking a preset voice playing control on a third interface of the second electronic device, inputting voice information to obtain a first message after clicking and storing the voice information, and after the second electronic device sends the first message to the first electronic device, operating the display content of the first interface of the first electronic device according to the first message by a local user.

According to the remote assistance method provided by the embodiment of the application, by setting the target information of various types, the assistance mode of the remote user is increased, and the experience of the local user in solving the assistance task is improved.

In some embodiments, after sending the first message to the first electronic device, further comprising: receiving a second message sent by the first electronic equipment; and updating the display content of the third interface based on the second message.

In this embodiment, the first message may be a part of display content on the third interface of the second electronic device, where the display content includes a video or a picture to be edited, and further includes information such as a newly added text, a voice, or a graffiti; the second message is determined according to the display content of the first interface of the first electronic device, and the second message may be identical to the display content of the first interface or may be different from the display content of the first interface, for example, a partial area in the display content of the first interface to be sent is subjected to processing such as shielding or blackening, and then the processed content is sent to the second electronic device and displayed on a third interface of the second electronic device.

In this embodiment, the first message may be sent by the second electronic device directly to the first electronic device, or may be sent by the second electronic device to the server first, and then forwarded by the server to the first electronic device.

In this embodiment, after the second electronic device sends the first message to the first electronic device, the updated second interface is obtained on the first electronic device, where the second interface includes an operation instruction in the first message, and according to the instruction, the display content of the first interface of the first electronic device may be subjected to a related operation, and the updated content is displayed on the first interface.

In some embodiments, after the display content of the first interface of the first electronic device is updated, the display content of the first interface still needs to be sent to the second electronic device, and update display is performed on the third interface of the second electronic device, and after the remote user views the updated third interface, a relevant operation instruction can be continuously added on the third interface, so as to help the local user complete a corresponding operation according to the operation instruction.

According to the remote assistance method provided by the embodiment of the application, the first electronic equipment sends the second message to the second electronic equipment for a plurality of times and the second electronic equipment sends the first message to the first electronic equipment for a plurality of times, so that the remote user and the local user can execute a plurality of times of assistance tasks, and the experience sense when the local user accepts remote assistance is improved.

The embodiment of the application also provides a remote assistance device.

As shown in fig. 9, the remote assistance apparatus includes: a fifth receiving module 910, a second display module 920, a sixth receiving module 930, and a fifth processing module 940.

A second receiving module 910, configured to receive a remote assistance request sent by the first electronic device;

the first display module 920 is configured to display a third interface when a remote assistance connection is established with the first electronic device, where display content of the third interface has an association relationship with display content of a second interface in the first electronic device;

A third receiving module 930 configured to receive a sixth input from the user;

the third processing module 940 is configured to update the display content of the third interface in response to the sixth input, and send a first message to the first electronic device, where the first message is determined based on the updated display content of the third interface, and the first message is used to indicate to update the display content of the second interface.

According to the remote assistance device provided by the embodiment of the application, the remote assistance connection is established through the first electronic equipment and the second electronic equipment, after the second electronic equipment acquires the second message sent by the first electronic equipment, the second message is displayed on the third interface of the second electronic equipment so as to acquire the third interface with the same content as that displayed on the second interface on the second electronic equipment, when the remote user adds the target information on the third interface, the first message is obtained, the second electronic equipment sends the first message to the first electronic equipment and displays the first message on the second interface of the first electronic equipment, so that the local user can perform subsequent operation on the first interface of the first electronic equipment according to the display content of the second interface, and online teaching among the remote users is realized.

According to the remote assistance device provided by the embodiment of the application, by setting the target information of various types, the assistance mode of a remote user is increased, and the experience of a local user in solving assistance tasks is improved.

In some embodiments, the apparatus preferably comprises:

a seventh receiving module, configured to receive, after sending the first message to the first electronic device, a second message sent by the first electronic device;

and a seventh processing module, configured to update the display content of the third interface based on the second message.

According to the remote assistance device provided by the embodiment of the application, the first electronic equipment sends the second message to the second electronic equipment for a plurality of times and the second electronic equipment sends the first message to the first electronic equipment for a plurality of times, so that the remote user and the local user can execute a plurality of times of assistance tasks, and the experience sense when the local user accepts remote assistance is improved.

The remote assistance device in the embodiment of the application can be an electronic device, or can be a component in the electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or may be other devices than a terminal. For example, the electronic device may be a Mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a Mobile internet appliance (Mobile INTERNET DEVICE, MID), an augmented reality (augmented reality, AR)/Virtual Reality (VR) device, a robot, a wearable device, an ultra-Mobile personal computer (UMPC), a netbook or a personal digital assistant (personal DIGITAL ASSISTANT, PDA), or the like, and may also be a network attached memory (Network Attached Storage, NAS), a personal computer (personal computer, PC), a Television (TV), a teller machine, a self-service machine, or the like, which is not limited in the embodiments of the present application.

The remote assistance device in the embodiment of the application may be a device with an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, and the embodiment of the present application is not limited specifically.

The remote assistance device provided in the embodiment of the present application can implement each process implemented by the embodiments of the methods of fig. 1 to 7, and in order to avoid repetition, a description is omitted here.

Optionally, as shown in fig. 10, the embodiment of the present application further provides an electronic device 1000, including a processor 1001, a memory 1002, and a program or an instruction stored in the memory 1002 and capable of being executed on the processor 1001, where the program or the instruction implements each process of the foregoing remote assistance method embodiment when executed by the processor 1001, and the same technical effects are achieved, and for avoiding repetition, a description is omitted herein.

The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device.

Fig. 11 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 1100 includes, but is not limited to: radio frequency unit 1101, network module 1102, audio output unit 1103, input unit 1104, sensor 1105, display unit 1106, user input unit 1107, interface unit 1108, memory 1109, and processor 1110.

Those skilled in the art will appreciate that the electronic device 1100 may further include a power source (e.g., a battery) for powering the various components, which may be logically connected to the processor 1110 by a power management system, such as to perform functions such as managing charging, discharging, and power consumption by the power management system. The electronic device structure shown in fig. 11 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than illustrated, or may combine some components, or may be arranged in different components, which are not described in detail herein.

Wherein the user input unit 1107 is configured to receive a first input of a user;

a processor 1110 for controlling the display unit 1106 to display a first interface in a first region of the display screen, a second interface in a second region of the display screen, and to send a remote assistance request to the second electronic device in response to the first input; the first interface is used for being operated by a user, the display content of the second interface is determined based on the display content of the first interface, and the remote assistance request is used for requesting to establish the remote assistance connection between the first electronic device and the second electronic device.

The processor 1110 is further configured to receive, when the first electronic device and the second electronic device establish a remote assistance connection, a first message sent by the second electronic device, where the first message is determined based on a display content of a third interface in the second electronic device, and the display content of the third interface has an association relationship with the display content of the second interface;

According to the remote assistance device provided by the embodiment of the application, the remote assistance connection is established between the first electronic equipment and the second electronic equipment, the first electronic equipment sends the content to be processed in the second interface to the second electronic equipment, the content is displayed on the third interface of the second electronic equipment, when the second electronic equipment sends the first message to the second interface, the first electronic equipment can obtain the updated second interface, and then the user is guided to perform corresponding operation on the first interface according to the updated display content on the second interface, so that when the remote user at the second electronic equipment remotely assists the local user, the remote user can only view and edit the content uploaded by the local user, the permission of controlling the first electronic equipment cannot be directly obtained, the safety of the first electronic equipment is improved, and the risk that the local privacy user is exposed is reduced.

Optionally, the user input unit 1107 is further configured to receive a second input of the user after updating the display content of the second interface based on the first message;

a display unit 1106, further configured to update display content of the first interface in response to the second input;

The processor 1110 is further configured to send a second message to the second electronic device, where the second message is determined based on the updated display content of the first interface, and the second message is used to instruct the second electronic device to update the third interface.

According to the electronic equipment provided by the embodiment of the application, the second message is determined by receiving the second input of the user to the first interface of the first electronic equipment, and after the second message is sent to the second electronic equipment, the second message is displayed on the third interface of the second electronic equipment, so that the remote user can conveniently check and edit the content uploaded by the local user.

Optionally, the user input unit 1107 is further configured to receive a third input of the user before receiving the first message sent by the second electronic device;

Processor 1110 is further configured to determine, in response to the third input, target content, the target content including a portion of the display content of the second interface;

wherein the first message is generated based on the target content.

According to the electronic equipment provided by the embodiment of the application, the display content of the second interface is filtered, so that only the target content which the local user hopes the remote user to see is reserved, and the safety of the local user when the first electronic equipment is used for receiving remote assistance is improved.

Optionally, the user input unit 1107 is further configured to receive a fourth input of the user after updating the display content of the second interface based on the first message;

the memory 1109 is further configured to store, in response to the fourth input, a target multimedia file including display content displayed on the second interface after the first electronic device establishes a remote assistance connection with the second electronic device.

According to the electronic equipment provided by the embodiment of the application, the multimedia file of the second interface of the first electronic equipment is saved, so that the local user can independently solve the similar tasks according to the saved multimedia file.

Optionally, the second interface after updating the display content includes a play control, and the user input unit 1107 is further configured to receive a fifth input of the play control from the user after updating the display content of the second interface based on the first message;

An audio output unit 1103 for playing the voice information in response to the fifth input, the first message comprising the voice information.

According to the electronic device provided by the embodiment of the application, after the play control containing the operation instruction is added on the third interface of the second electronic device and is sent to the first electronic device, the local user can acquire all operation information by clicking the control on the second interface, and the operation experience between the remote user and the local user is improved.

It should be appreciated that in embodiments of the present application, the input unit 1104 may include a graphics processor (Graphics Processing Unit, GPU) 11041 and a microphone 11042, the graphics processor 11041 processing image data of still pictures or video obtained by an image capture device (e.g., a camera) in a video capture mode or an image capture mode. The display unit 1106 may include a display panel 11061, and the display panel 11061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1107 includes at least one of a touch panel 11071 and other input devices 11072. The touch panel 11071 is also referred to as a touch screen. The touch panel 11071 may include two parts, a touch detection device and a touch controller. Other input devices 11072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein.

The memory 1109 may be used to store software programs as well as various data. The memory 1109 may mainly include a first memory area storing programs or instructions and a second memory area storing data, wherein the first memory area may store an operating system, application programs or instructions (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, the memory 1109 may include volatile memory or nonvolatile memory, or the memory 1109 may include both volatile and nonvolatile memory. The nonvolatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable EPROM (EEPROM), or a flash Memory. The volatile memory may be random access memory (Random Access Memory, RAM), static random access memory (STATIC RAM, SRAM), dynamic random access memory (DYNAMIC RAM, DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate Synchronous dynamic random access memory (Double DATA RATE SDRAM, DDRSDRAM), enhanced Synchronous dynamic random access memory (ENHANCED SDRAM, ESDRAM), synchronous link dynamic random access memory (SYNCH LINK DRAM, SLDRAM), and Direct random access memory (DRRAM). Memory 1109 in embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.

Processor 1110 may include one or more processing units; optionally, processor 1110 integrates an application processor that primarily processes operations involving an operating system, user interface, application programs, and the like, and a modem processor that primarily processes wireless communication signals, such as a baseband processor. It will be appreciated that the modem processor described above may not be integrated into the processor 1110.

Fig. 12 is a schematic hardware structure of another electronic device implementing an embodiment of the present application.

The electronic device 1200 includes, but is not limited to: a radio frequency unit 1201, a network module 1202, an audio output unit 1203, an input unit 1204, a sensor 1205, a display unit 1206, a user input unit 1207, an interface unit 1208, a memory 1209, and a processor 1210.

Those skilled in the art will appreciate that the electronic device 1200 may also include a power source (e.g., a battery) for powering the various components, which may be logically connected to the processor 1210 by a power management system, such as to perform functions such as managing charging, discharging, and power consumption by the power management system. The electronic device structure shown in fig. 12 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than illustrated, or may combine certain components, or may be arranged in different components, which are not described in detail herein.

The processor 1210 is configured to receive a remote assistance request sent by the first electronic device;

A display unit 1206, configured to display a third interface when a remote assistance connection is established with the first electronic device, where display content of the third interface has an association relationship with display content of a second interface in the first electronic device;

a user input unit 1207 for receiving a sixth input of the user;

processor 1210 is configured to update the third interface in response to the sixth input and send a first message to the first electronic device for synchronizing the third interface with the second interface.

Optionally, updating the display content of the third interface includes: and adding at least one of characters, images and playing controls on the third interface.

According to the electronic equipment provided by the embodiment of the application, through setting the target information of various types, the teaching mode of a remote user is increased, and the experience of a local user in solving the assisting task is improved.

Optionally, the processor 1210 is further configured to receive a second message sent by the first electronic device after sending the first message to the first electronic device;

Processor 1210 is further configured to update the display content of the third interface based on the second message.

According to the electronic equipment provided by the embodiment of the application, the first electronic equipment sends the second message to the second electronic equipment for a plurality of times and the second electronic equipment sends the first message to the first electronic equipment for a plurality of times, so that the remote user and the local user can execute a plurality of times of assistance tasks, and the experience sense when the local user accepts remote assistance is improved.

It should be appreciated that in embodiments of the present application, the input unit 1204 may include a graphics processor (Graphics Processing Unit, GPU) 12041 and a microphone 12042, the graphics processor 12041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1207 includes at least one of a touch panel 12071 and other input devices 12072. The touch panel 12071 is also called a touch screen. The touch panel 12071 may include two parts, a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein.

Memory 1209 may be used to store software programs as well as various data. The memory 1209 may mainly include a first memory area storing programs or instructions and a second memory area storing data, wherein the first memory area may store an operating system, application programs or instructions (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, the memory 1209 may include volatile memory or nonvolatile memory, or the memory 1209 may include both volatile and nonvolatile memory. The nonvolatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable EPROM (EEPROM), or a flash Memory. The volatile memory may be random access memory (Random Access Memory, RAM), static random access memory (STATIC RAM, SRAM), dynamic random access memory (DYNAMIC RAM, DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate Synchronous dynamic random access memory (Double DATA RATE SDRAM, DDRSDRAM), enhanced Synchronous dynamic random access memory (ENHANCED SDRAM, ESDRAM), synchronous link dynamic random access memory (SYNCH LINK DRAM, SLDRAM), and Direct random access memory (DRRAM). Memory 1209 in embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.

Processor 1210 may include one or more processing units; optionally, processor 1210 integrates an application processor that primarily processes operations involving an operating system, user interface, application programs, and the like, and a modem processor that primarily processes wireless communication signals, such as a baseband processor. It will be appreciated that the modem processor described above may not be integrated into processor 1210.

The embodiment of the application also provides a readable storage medium, on which a program or an instruction is stored, which when executed by a processor, implements each process of the above remote assistance method embodiment, and can achieve the same technical effects, and in order to avoid repetition, a detailed description is omitted here.

Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes computer readable storage medium such as computer readable memory ROM, random access memory RAM, magnetic or optical disk, etc.

The embodiment of the application further provides a chip, which comprises a processor and a communication interface, wherein the communication interface is coupled with the processor, and the processor is used for running programs or instructions to realize the processes of the remote assistance method embodiment, and the same technical effects can be achieved, so that repetition is avoided, and the description is omitted here.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are to be protected by the present application.

Claims

1. A remote assistance method applied to a first electronic device, comprising:

receiving a first input of a user;

Responding to the first input, displaying a first interface in a first area of a display screen, displaying a second interface in a second area of the display screen, and sending a remote assistance request to second electronic equipment; the first interface is used for being operated by the user, the display content of the second interface is determined based on the display content of the first interface, and the remote assistance request is used for requesting to establish the remote assistance connection between the first electronic device and the second electronic device;

Updating display content of the second interface based on the first message; the second interface includes at least part of the display content of the third interface and the display content that is blocked or blacked out, and the display content of the third interface does not include the display content that is blocked or blacked out.

2. The method of remote assistance according to claim 1, wherein after updating the display content of the second interface based on the first message, the method further comprises:

Receiving a second input from the user;

updating display content of the first interface in response to the second input;

And sending a second message to the second electronic device, wherein the second message is determined based on the updated display content of the first interface, and the second message is used for indicating the second electronic device to update the display content of the third interface.

3. The method of remote assistance according to claim 1, wherein prior to said receiving the first message sent by the second electronic device, the method further comprises:

Receiving a third input from the user;

determining target content in response to the third input, the target content including a portion of the display content of the second interface;

wherein the first message is generated based on the target content.

4. The method of remote assistance according to claim 1, wherein after updating the display content of the second interface based on the first message, the method further comprises:

Receiving a fourth input from the user;

and responding to the fourth input, and storing a target multimedia file, wherein the target multimedia file comprises display content of the second interface after the first electronic device and the second electronic device establish remote assistance connection.

5. The method of claim 1, wherein the second interface after updating the display content includes a play control;

after updating the display content of the second interface based on the first message, the method further comprises:

Receiving a fifth input of a user to the play control;

in response to the fifth input, playing voice information, the first message including the voice information.

6. A remote assistance method applied to a second electronic device, comprising:

Receiving a remote assistance request sent by first electronic equipment;

receiving a sixth input from the user;

In response to the sixth input, updating display content of the third interface, and sending a first message to the first electronic device, wherein the first message is determined based on the updated display content of the third interface, and the first message is used for indicating to update the display content of the second interface; the second interface comprises at least part of display content and shielded or blacked display content of the third interface, and the display content of the third interface does not comprise the shielded or blacked display content;

The display content of the second interface is determined based on the display content of a first interface of the first electronic device, the first interface is located in a first area of a display screen of the first electronic device, the second interface is located in a second area of the display screen of the first electronic device, and the first interface is used for a user to operate.

7. The method of claim 6, wherein updating the display content of the third interface comprises: and adding at least one of characters, images and playing controls on the third interface.

8. The method of remote assistance according to claim 6, further comprising, after sending the first message to the first electronic device:

Receiving a second message sent by the first electronic equipment;

And updating the display content of the third interface based on the second message.

9. A remote assistance apparatus for use with a first electronic device, comprising:

The first receiving module is used for receiving a first input of a user;

The second processing module is used for receiving a first message sent by the second electronic device under the condition that the first electronic device and the second electronic device establish remote assistance connection, wherein the first message is determined based on the display content of a third interface in the second electronic device, and the display content of the third interface has an association relationship with the display content of the second interface;

10. A remote assistance apparatus for use with a second electronic device, comprising:

the third receiving module is used for receiving a sixth input of a user;

A third processing module, configured to update display content of the third interface in response to the sixth input, and send a first message to the first electronic device, where the first message is determined based on the updated display content of the third interface, and the first message is used to indicate updating of the display content of the second interface; the second interface comprises at least part of display content and shielded or blacked display content of the third interface, and the display content of the third interface does not comprise the shielded or blacked display content;

11. An electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the remote assistance method according to any one of claims 1-8.