WO2022088991A1 - 一种远程协助方法、电子设备、系统及存储介质 - Google Patents

一种远程协助方法、电子设备、系统及存储介质 Download PDF

Info

Publication number
WO2022088991A1
WO2022088991A1 PCT/CN2021/116514 CN2021116514W WO2022088991A1 WO 2022088991 A1 WO2022088991 A1 WO 2022088991A1 CN 2021116514 W CN2021116514 W CN 2021116514W WO 2022088991 A1 WO2022088991 A1 WO 2022088991A1
Authority
WO
WIPO (PCT)
Prior art keywords
application
remote assistance
control
interface
manipulation
Prior art date
Application number
PCT/CN2021/116514
Other languages
English (en)
French (fr)
Inventor
杨智辉
黄丽薇
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP21884722.6A priority Critical patent/EP4216060A4/en
Publication of WO2022088991A1 publication Critical patent/WO2022088991A1/zh
Priority to US18/307,242 priority patent/US20230262110A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G06F9/453—Help systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469—User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons

Definitions

  • the embodiments of the present application relate to the field of remote assistance, and in particular, to a remote assistance method, electronic device, system, and storage medium.
  • the old man’s mobile phone and the child’s mobile phone establish a remote assistance connection; the old man’s mobile phone records the screen and sends the recorded screen data to the child’s mobile phone; the child operates on the child’s mobile phone based on the screen data received, and sends the position coordinates of the operation Give the mobile phone to the elderly; the mobile phone of the elderly generates corresponding control instructions based on the received position coordinates, so as to realize the control of these electronic devices.
  • this remote assistance method requires very high network quality, which leads to the problem of poor interface display effect during remote assistance; moreover, this remote assistance method based on screen sharing is still through the supporting application in the mobile phone of the elderly The software controls these electronic devices, resulting in the need to download a large number of supporting application software in the mobile phone of the elderly, and the storage space is occupied too much.
  • Embodiments of the present application provide a remote assistance method, an electronic device, a system, and a storage medium, which solve the problems that the existing remote assistance method has high requirements on network quality and poor display effect during remote assistance, and the assisted electronic device The problem of too much storage space being used up.
  • an embodiment of the present application provides a remote assistance method, which is applied to a system including a first device, a second device, and a third device, where the first device is a preset assisted device, and the second device is a controlled device , the third device is an assisting device of the first device; the method includes: after the first device obtains the first information, starting a first remote assistance application in the first device, wherein the first information includes a control device for controlling the second device.
  • the control command received by the control interface enables the third device to remotely control the second device.
  • the first device can be used as an assisted device used by a user who needs to be assisted.
  • the assisted user can trigger the assisted device to acquire the controlled device through short-distance communication.
  • the assisted user can notify the assisting user on the side of the third device as the assisting device to remotely control the second device as the controlled device without further operations on the assisted device, which simplifies the assisted user.
  • the assisted device since the assisted device sends a remote assistance request carrying the application identifier of the control application of the controlled device to the assisting device, there is no high requirement for network quality;
  • the control of the device is done on the assisting device, so the assisted device may not have a control application corresponding to each controlled device installed, so the storage space of the assisted device used by the assisted user will not be occupied too much.
  • the method further includes: the second remote assistance application of the third device displays a first interface, where the first interface includes a first control, and the first control is used to instruct the third device to search Electronic device; the third device detects the first operation input by the user, and the first operation acts on the first control; in response to the first operation, the second remote assistance application of the third device displays a second interface, and the second interface displays a search
  • the identification of the found electronic device, the searched identification of the electronic device includes the identification of the first device; the third device detects the second operation input by the user, and the second operation acts on the identification of the first device; in response to the second operation , the third device sends a first request to the first device through the second remote assistance application, the first request carries the account information of the third device, and the first request is used to instruct the first device to set the third device as the first device's account information assisting the device; in response to receiving the first request, the first device sets the third device as an assisting device of the first device; the
  • the method further includes: the first device sends second information to the third device, and the second information carries the second information.
  • the account information of the first device, or the second information carries the assistance relationship between the account information of the first device and the account information of the third device; in response to receiving the second information, the third device sets the first device as the recipient of the third device.
  • assisting device the third device stores the assisting relationship between the first device and the third device.
  • the assistance relationship between the first device and the third device may be set in advance.
  • the first device is provided with an NFC module
  • the first information is NFC tag information of the second device
  • the first remote assistance application includes: after the first device obtains the NFC tag information of the second device through the NFC module, starting the first remote assistance application in the first device.
  • the first device obtains the NFC tag information of the second device through the NFC module, and this way of obtaining the first information does not require the user to perform operations on the first device and the second device. For users, it is simple and convenient.
  • the third device in response to receiving the remote assistance request, starts a second remote assistance application in the third device, including: in response to receiving the remote assistance request, the third device displays a third Interface, the third interface includes a second control and a third control, the second control is used to approve the remote assistance request, and the third control is used to reject the remote assistance request; the third operation input by the user is detected, and the third operation acts on the third control.
  • Two controls in response to the third operation, the third device launches a second remote assistance application in the third device.
  • a third interface including the second control and the third control may be provided, so that the assisting user can use the third interface when it is inconvenient to assist the assisted user.
  • Three controls deny the current remote assistance request.
  • the third operation may be the user's touch operation on the third interface, or may be the user's voice. Provide a variety of trigger operations to enhance the user experience from the perspective of assisting users.
  • displaying the control interface of the second application in the second remote assistance application includes: displaying an entry icon of the second application in the second remote assistance application; The entry command received by the entry icon of the second remote assistance application displays the control interface of the second application.
  • the system further includes a first cloud platform, and the first device sends a remote assistance request to the third device through the first remote assistance application, including: the first device through the first remote assistance application Send a first remote assistance request to the first cloud platform, where the first remote assistance request carries the application identifier of the second application, and the first remote assistance request is used to instruct the first cloud platform to send the second remote assistance request to the third device; response After receiving the first remote assistance request, the first cloud platform sends a second remote assistance request to the third device, and the second remote assistance request carries the application identifier of the second application.
  • the assisted user seeks help from the third device assisting the user through the first device
  • usually the first device and the third device are located in different spaces, even if the first device and the third device are far away, Therefore, it is inconvenient for the first device and the third device to communicate by means of short-distance communication. Therefore, a communication connection between the first device and the third device can be established through the first cloud platform.
  • the first remote assistance request and the second remote assistance request may be the same or different.
  • Both requests carry the application identifier of the second application, however, other information or encapsulation formats carried in the first remote assistance request and the second remote assistance request may be different.
  • the first remote assistance request and the second remote assistance request are the same as an example to illustrate the transmission process of the remote assistance request, which does not mean that the first remote assistance request and the second remote assistance request are the same. .
  • the system further includes a first cloud platform, and in response to the manipulation instruction received on the first manipulation interface of the second application, the third device remotely controls the second device, including: In response to the first manipulation instruction received on the manipulation interface of the second application, the third device sends the first manipulation instruction to the first cloud platform through the second remote assistance application, where the first manipulation instruction is used to instruct the second device to execute and manipulate the instruction Corresponding operations; in response to receiving the first manipulation instruction, the first cloud platform sends a second manipulation instruction to the first device, and the second manipulation instruction is used to instruct the second device to perform an operation corresponding to the manipulation instruction; in response to receiving the second manipulation instruction instruction, the first device sends a third manipulation instruction to the second device, and the third manipulation instruction is used to instruct the second device to perform an operation corresponding to the manipulation instruction.
  • the transmission path of the manipulation instruction from the third device to the second device is: the third device, the first cloud platform, the first device, and the second device. Since the transmission protocols between different devices may be different, the following three situations may exist between the first manipulation command, the second manipulation command, and the third manipulation command: all are the same, some are the same, and all are different. However, the first manipulation instruction, the second manipulation instruction and the third manipulation instruction are all used to instruct the second device to perform an operation corresponding to the manipulation instruction.
  • the transmission process of the manipulation command is described by taking the first manipulation command, the second manipulation command and the third manipulation command being completely identical as an example. However, it does not mean that the first manipulation command, the second manipulation command and the third manipulation command are completely identical.
  • the first information further includes a device identifier of the second device; before the first device sends the third manipulation instruction to the second device, the method further includes: the first device is based on the first device The device identifier of the second device establishes a connection with the first device.
  • a connection needs to be established between the first device and the second device in advance.
  • system further includes a first cloud platform
  • the third device remotely controls the second device, including:
  • the third device In response to the manipulation instruction received on the manipulation interface of the second application, the third device sends a fourth manipulation instruction to the first cloud platform through the second remote assistance application, and the fourth manipulation instruction is used to instruct the second device to execute the manipulation instruction corresponding to the manipulation instruction. operation; in response to receiving the fourth manipulation instruction, the first cloud platform sends a fifth manipulation instruction to the second device, and the fifth manipulation instruction is used to instruct the second device to perform an operation corresponding to the manipulation instruction;
  • the third device In response to the manipulation instruction received on the first manipulation interface of the second application, the third device sends a sixth manipulation instruction to the first cloud platform through the second remote assistance application, and the sixth manipulation instruction is used to instruct the second device to execute and manipulate the instruction Corresponding operation; in response to receiving the sixth manipulation instruction, the first cloud platform sends the seventh manipulation instruction to the second cloud platform, and the seventh manipulation instruction is used to instruct the second device to perform the operation corresponding to the manipulation instruction, and the seventh manipulation instruction is used for Instructing the second cloud platform to send an eighth manipulation instruction to the second device, where the eighth manipulation instruction is used to instruct the second device to perform an operation corresponding to the manipulation instruction.
  • the first to eighth manipulation instructions may also exist in the following situations: completely identical, partially identical, and completely different.
  • the transmission process of the manipulation command is described by taking the first manipulation command to the eighth manipulation command being the same as an example, which does not mean that the first manipulation command to the eighth manipulation command are the same.
  • control interface of the second application displayed by the second remote assistance application of the third device is denoted as the first control interface
  • control interface of the first application displayed by the first remote assistance application of the first device is denoted as the first control interface. It is the second control interface.
  • the functions of the first control interface and the second control interface are the same. Since the operating systems of the first device and the third device may be different, there may be some differences in the layout and/or displayed content of the first control interface and the second control interface. . In the specific implementation manner, although the control interface is taken as an example, it does not mean that the first control interface and the second control interface are necessarily the same.
  • the method further includes: the first remote assistance application in the first device displays the information of the second application.
  • the second control interface is
  • the second control interface of the second application may also be displayed, so that the assisted user can also display the second control of the second application on the first device.
  • the interface inputs manipulation instructions, which provides a more flexible way of controlling the second device.
  • the method further includes: the control interface of the first remote assistance application in the first device includes a fourth control, where the fourth control is used to initiate help to the third device; In response to the fourth operation, the first device sends a remote assistance request to the third device through the first remote assistance application, and the fourth operation acts on the fourth control.
  • a fourth control is set in the control interface of the first remote assistance application of the assisted device to initiate help to the third device, which improves the flexibility of the remote assistance method provided in the embodiment of the present application in implementation sex.
  • the method before the first device sends a remote assistance request to the third device through the first remote assistance application, the method further includes: the first device acquires third information, the third information including an application identifier of the fourth application used to control the fourth device and an identifier used to represent that the fourth device supports remote control; the first device displays a manipulation interface of the fourth application through the first remote assistance application; the first device uses the first remote assistance application
  • the remote assistance application sends a remote assistance request to the third device, specifically: the first device sends a remote assistance request to the third device through the first remote assistance application, and the remote assistance request carries the application identifier of the second application and the information of the fourth application. App ID.
  • the assisted user can control the first device to approach multiple controlled devices to obtain information (for example, the first information, one or more third information) of the multiple controlled devices, and then initiate help. It enables a single help process to control multiple controlled devices, and provides a variety of remote assistance methods.
  • the method further includes: the first device acquires fourth information, where the fourth information includes using The application identifier of the fifth application used to control the fifth device and the identifier used to characterize that the fifth device supports remote control; the first device displays the control interface of the fifth application through the first remote assistance application; the first device sends a message to the third device The application identifier of the fifth application.
  • the user can control the first device to approach at least one controlled device to obtain information of the at least one controlled device (for example, at least one fourth device information), in this case, the assisted user does not need to initiate help again.
  • the at least one controlled device for example, at least one fourth device information
  • the second remote assistance application of the third device receives the application identifiers of the control applications of at least two controlled devices, and the at least two controlled devices include the second device and the fourth device.
  • the method further includes: in response to the received first switching instruction, displaying the second remote assistance application of the third device in the second remote assistance application.
  • the first manipulation interface of the application is switched to the manipulation interface of the fourth application.
  • the at least two controlled devices include the second device
  • the control applications of at least two controlled devices include the second application
  • the control applications of at least two controlled devices include the fourth application
  • the control applications of at least two controlled devices include the fourth application
  • the at least two controlled devices include the fourth application.
  • the control applications of at least two controlled devices include a fifth application
  • the method further includes:
  • the third device displays the first control interface through the second remote assistance application, wherein the first control interface is any one of the control interfaces of the control applications of the at least two controlled devices;
  • the first control interface displayed in the second remote assistance application of the third device is switched to the second control interface, wherein the second control interface is the interface of at least two controlled devices. Controls any one of the control interfaces of the application except the first control interface.
  • the third device when the third device receives the application identifiers of the control applications of at least two controlled devices, it can display the control interfaces of the control applications of the multiple controlled devices in a switching display manner.
  • the method further includes: the first device acquires the first information by approaching or touching the second device.
  • the method for the first device to obtain the first information by approaching or touching the second device may be an NFC method, a Bluetooth proximity discovery method, or a Wi-Fi Aware proximity discovery method.
  • the method before the first device sends a remote assistance request to the third device through the first remote assistance application, the method further includes: the first device searches for assistance of the first device by using the stored assistance relationship A device, the assisting device of the first device includes a third device.
  • the assistance relationship between the first device and the third device has been pre-stored in the first device, and the assistance relationship between the first device and the third device determines that the first device is the target of the third device.
  • the assisting device, and the third device is the assisting device of the first device. Therefore, the first device may search for a pre-stored assisting device of the first device.
  • the method further includes: when there are at least two assisting devices of the first device, the third device is the one with the highest priority among the assisting devices of the first device.
  • a first device can be set with multiple assistance devices.
  • the mobile phones of multiple children of the elderly can all be set as assistance devices of the elderly mobile phone, and the multiple assistance devices can also be prioritized , you can ask the assisting device with the highest priority for help each time, and if the assisting device with the highest priority is unsuccessful, you can ask the assisting device with the second highest priority for help.
  • the user experience when the remote assistance method provided by the embodiments of the present application is implemented is enhanced.
  • an embodiment of the present application provides a remote assistance method, which is applied to a first device.
  • the method includes: after the first device acquires the first information, starting a first remote assistance application in the first device, wherein, The first information includes an application identifier of a second application used to control the second device and an identifier used to indicate that the second device supports remote control, the first device is a preset assisted device, and the second device is a controlled device; A device sends a remote assistance request to a third device through the first remote assistance application, wherein the third device is an assistance device of the first device, the remote assistance request carries the application identifier of the second application, and the remote assistance request is used to indicate the first device.
  • the third device starts the second remote assistance application, and performs remote control on the second device based on the second remote assistance application and the second application.
  • the first device in response to receiving the first request, sets the third device as an assisting device of the first device, where the first request is sent by the third device to the first device , the first request carries the account information of the third device; the first device stores the assistance relationship between the first device and the third device, and the assistance relationship between the first device and the third device includes: the account information of the first device and the third device.
  • the corresponding relationship of the information; the second information is used to instruct the third device to set the first device as an assisted device of the third device.
  • the first device is provided with an NFC module
  • the first information is NFC tag information of the second device
  • the first device responds to the The identifier of the second device supporting remote control determines that the second device supports remote control
  • starting the first remote assistance application in the first device includes: after the first device obtains the NFC tag information of the second device through the NFC module, starting the first device The first remote assistance application in the device.
  • sending the remote assistance request by the first device to the third device through the first remote assistance application includes: the first device sending the first remote assistance request to the first cloud platform through the first remote assistance application Assistance request, the first remote assistance request carries the application identifier of the second application, the first remote assistance request is used to instruct the first cloud platform to send a second remote assistance request to the third device, and the second remote assistance request carries the second application application ID.
  • the method further includes: the first remote assistance application in the first device displays the information of the second application. control interface.
  • the method further includes: the control interface of the first remote assistance application in the first device includes a fourth control, where the fourth control is used to initiate help to the third device; A fourth operation input by the user is detected, and the fourth operation acts on the fourth control; in response to the fourth operation, the first device sends a remote assistance request to the third device through the first remote assistance application.
  • the control interface of the first remote assistance application in the first device includes a fourth control, where the fourth control is used to initiate help to the third device; A fourth operation input by the user is detected, and the fourth operation acts on the fourth control; in response to the fourth operation, the first device sends a remote assistance request to the third device through the first remote assistance application.
  • the method before the first device sends a remote assistance request to the third device through the first remote assistance application, the method further includes: the first device obtains third information, the third information including an application identifier of the fourth application used to control the fourth device and an identifier used to represent that the fourth device supports remote control; the first device displays a manipulation interface of the fourth application through the first remote assistance application; the first device uses the first remote assistance application
  • the remote assistance application sends a remote assistance request to the third device, specifically: the first device sends a remote assistance request to the third device through the first remote assistance application, and the remote assistance request carries the application identifier of the second application and the information of the fourth application. App ID.
  • the method further includes: the first device obtains fourth information, and the first device obtains the fourth information through the first remote assistance application.
  • a remote assistance application displays a control interface of the fifth application, wherein the fourth information includes an application identifier of the fifth application used to control the fifth device and an identifier used to indicate that the fifth device supports remote control;
  • the remote assistance application displays the control interface of the fifth application; the first device sends the application identifier of the fifth application to the third device.
  • the first device acquires application identifiers of control applications of at least two controlled devices, and the at least two controlled devices include the second device and the fourth device in the first device.
  • the method further includes: in response to the received second switching instruction, switching the control interface of the second application currently displayed in the first remote assistance application of the first device It is the control interface of the fourth application.
  • the method further includes: the first device acquires the first information by approaching or touching the second device.
  • the method before the first device sends a remote assistance request to the third device through the first remote assistance application, the method further includes: the first device searches for assistance of the first device through the stored assistance relationship A device, the assisting device of the first device includes a third device.
  • the method further includes: when there are at least two assisting devices of the first device, the third device is the one with the highest priority among the assisting devices of the first device.
  • an embodiment of the present application provides a remote assistance method, which is applied to a third device.
  • the method includes: in response to receiving a remote assistance request, the third device starts a second remote assistance application in the third device, wherein the remote assistance The assistance request is sent by the first device to the third device through the first remote assistance application, and the remote assistance request carries the application identifier of the second application used to control the second device; the second remote assistance application in the third device displays There is a manipulation interface of the second application; in response to the manipulation instruction received at the manipulation interface of the second application, the third device remotely controls the second device.
  • the method further includes: the second remote assistance application of the third device displays a first interface, where the first interface includes a first control, and the first control is used to instruct the third device to search Electronic device; the third device detects the first operation, and the first operation acts on the first control; in response to the first operation, the second remote assistance application of the third device displays a second interface, and the second interface displays the searched electronic device.
  • the identification of the device, the searched identification of the electronic device includes the identification of the first device; the third device detects the second operation, and the second operation acts on the identification of the first device; in response to the second operation, the third device passes the first device.
  • the second remote assistance application sends a first request to the first device, where the first request carries account information of the third device, and the first request is used to instruct the first device to set the third device as an assistance device of the first device.
  • the third device in response to receiving the remote assistance request, starts a second remote assistance application in the third device, including: in response to receiving the remote assistance request, the third device displays the third Interface, the third interface includes a second control and a third control, the second control is used to approve the remote assistance request, and the third control is used to reject the remote assistance request; the third operation input by the user is detected, and the third operation acts on the third control.
  • Two controls in response to the third operation, the third device launches a second remote assistance application in the third device.
  • control interface displaying the second application in the second remote assistance application in the third device includes: displaying the second application in the second remote assistance application in the third device The entry icon of the second application; in response to the entry instruction received through the entry icon of the second application, the second remote assistance application displays a manipulation interface of the second application.
  • the third device in response to the manipulation instruction received on the manipulation interface of the second application, remotely controls the second device, including:
  • the third device In response to the manipulation instruction received on the manipulation interface of the second application, the third device sends the first manipulation instruction to the first cloud platform through the second remote assistance application, and the first manipulation instruction is used to instruct the first cloud platform to send the first manipulation instruction to the first device
  • the second manipulation command, the second manipulation command is used to instruct the first device to send the third manipulation command to the second device, and the first manipulation command, the second manipulation command and the third manipulation command are all used to instruct the second device to execute and manipulate the command corresponding operation;
  • the third device in response to the manipulation command received on the manipulation interface of the second application, the third device sends a fourth manipulation command to the first cloud platform through the second remote assistance application, and the fourth manipulation command is used to instruct the first cloud platform to send the second manipulation command to the second cloud platform.
  • the device sends a fifth manipulation instruction, and both the fourth manipulation instruction and the fifth manipulation instruction are used to instruct the second device to perform an operation corresponding to the manipulation instruction;
  • the third device in response to the manipulation command received on the manipulation interface of the second application, the third device sends a sixth manipulation command to the first cloud platform through the second remote assistance application, and the sixth manipulation command is used to instruct the first cloud platform to send the second manipulation command to the second cloud platform.
  • the cloud platform sends the seventh manipulation command, and the seventh manipulation command is used to instruct the second cloud platform to send the eighth manipulation command to the second device, wherein the sixth manipulation command, the seventh manipulation command and the eighth manipulation command are all used to instruct the first manipulation command
  • the second device executes the operation corresponding to the manipulation instruction.
  • the remote assistance request further carries an application identifier of a fourth application used to control the fourth device, where the fourth device is a controlled device, and the method further includes: a third The device displays the manipulation interface of the second application or the manipulation interface of the fourth application in the second remote assistance application.
  • the method further includes: receiving an application identifier of a fifth application used to control the fifth device, and the third device The device displays the control interface of the fifth application in the second remote assistance application.
  • the second remote assistance application of the third device receives application identifiers of control applications of at least two controlled devices, and the at least two controlled devices include the second device and the fourth device.
  • application after the third device displays the first control interface of the second application through the second remote assistance application, the method further includes: in response to the received first switching instruction, displaying the first control interface currently displayed in the second remote assistance application of the third device The control interface of the second application is switched to the control interface of the fourth application.
  • an electronic device comprising:
  • the first remote assistance application launching unit is configured to launch the first remote assistance application after acquiring the first information, wherein the first information includes an application identifier of the second application used to control the second device and an application identifier used to characterize the second application.
  • the device supports the identification of remote control, the first device is the preset assisted device, and the second device is the controlled device;
  • a remote assistance unit configured to send a remote assistance request to a third device through the first remote assistance application, wherein the third device is an assistance device of the first device, the remote assistance request carries the application identifier of the second application, and the remote assistance request is used to instruct the third device to start the second remote assistance application.
  • an electronic device comprising:
  • the second remote assistance application starting unit is configured to start the second remote assistance application in the third device in response to receiving the remote assistance request, wherein the remote assistance request is sent by the first device to the third device through the first remote assistance application , the remote assistance request carries the application identifier of the second application used to control the second device, and the second device is the controlled device; the second remote assistance application displays the control interface of the second application;
  • the remote control unit is used for the third device to remotely control the second device in response to the manipulation instruction received on the manipulation interface of the second application.
  • an electronic device including a processor, where the processor is configured to run a computer program stored in a memory to implement the method of any one of the second aspect of the present application.
  • an electronic device including a processor, where the processor is configured to run a computer program stored in a memory to implement the method of any one of the third aspect of the present application.
  • a remote assistance system including the electronic device provided in the sixth aspect and the electronic device provided in the seventh aspect.
  • a chip system comprising a processor, the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement any method of the second aspect of the present application and/or any one of the third aspect item method.
  • a tenth aspect provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by one or more processors, implements any one of the methods and/or third aspects of the second aspect of the present application A method of any of the aspects.
  • an embodiment of the present application provides a computer program product, which, when the computer program product runs on a device, enables the device to perform any method of the second aspect of the present application and/or any one of the third aspect of the present application. method.
  • FIG. 1 is a schematic diagram of an application scenario of a remote assistance method provided by an embodiment of the present application
  • FIG. 2 is a schematic diagram of a hardware structure of an electronic device for performing a remote assistance method provided by an embodiment of the present application
  • FIG. 3 is a schematic flowchart of a remote assistance method provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of an application scenario of a remote assistance method provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a process of binding two electronic devices shown in step 1 of the embodiment shown in FIG. 4;
  • FIG. 6 is a schematic diagram of a process for establishing a remote assistance session between an assisted device and an assisting device, as shown in step 3 of the embodiment shown in FIG. 4;
  • FIG. 7 is a schematic diagram of the display interface of the assisted device and the assisting device in the embodiment shown in FIG. 4;
  • FIG. 8 is a technical architecture diagram of a remote assistance method provided by an embodiment of the present application.
  • FIG. 9 is a schematic sequence diagram of a remote assistance method based on a technical architecture diagram provided by the embodiment shown in FIG. 8;
  • FIG. 10 is a technical architecture diagram of another remote assistance method provided by an embodiment of the present application.
  • FIG. 11 is a schematic sequence diagram of a remote assistance method based on a technical architecture diagram provided by the embodiment shown in FIG. 10;
  • FIG. 12 is a schematic diagram of an application scenario of a remote assistance method provided by an embodiment of the present application.
  • FIG. 13 is a schematic diagram of an application scenario of a remote assistance method provided by an embodiment of the present application.
  • FIG. 14 is a schematic diagram of an application scenario of a remote assistance method provided by an embodiment of the present application.
  • 15 is a schematic diagram of a process of displaying a manipulation interface of a control application on a first device according to an embodiment of the present application
  • 16 is a schematic flowchart of a remote assistance method with a first device as an execution subject provided by an embodiment of the present application;
  • FIG. 17 is a schematic flowchart of a remote assistance method using a third device as an execution subject provided by an embodiment of the present application.
  • FIG. 18 is a schematic block diagram of a functional architecture unitization of a first device for executing a remote assistance method provided by an embodiment of the present application;
  • FIG. 19 is a schematic block diagram of a functional architecture unitization of a third device for executing a remote assistance method according to an embodiment of the present application.
  • one or more refers to one, two or more; "and/or”, which describes the association relationship of associated objects, indicates that there may be three kinds of relationships; for example, A and/or B can mean that A exists alone, A and B exist simultaneously, and B exists independently, wherein A and B can be singular or plural.
  • the character “/” generally indicates that the associated objects are an "or" relationship.
  • references in this specification to "one embodiment” or “some embodiments” and the like mean that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the present application.
  • appearances of the phrases “in one embodiment,” “in some embodiments,” “in other embodiments,” “in other embodiments,” etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean “one or more but not all embodiments” unless specifically emphasized otherwise.
  • the terms “including”, “including”, “having” and their variants mean “including but not limited to” unless specifically emphasized otherwise.
  • the remote assistance method provided by the embodiment of the present application may be applied to the application scenario shown in FIG. 1 .
  • an electronic device such as a smart speaker can be used as a controlled device, and an NFC (Near Field Communication) module is set on the controlled device.
  • the mobile phone 1 can be used as an assisted device for the assisted user, and the mobile phone 1 is provided with an NFC module.
  • the smart speaker and the mobile phone 1 are located in the same space.
  • the smart speaker and the mobile phone 1 are located in the home of the assisted user corresponding to the mobile phone 1 .
  • the mobile phone 2 and the mobile phone 1 are located in different spaces.
  • the mobile phone 2 is located in the home or company of the assisting user corresponding to the mobile phone 2 .
  • the mobile phone 2 is used as an assisting device for assisting the user.
  • the assisting user is an elderly person, the assisting user may be a child of the elderly.
  • the mobile phone 1 used by the assisted user can get close to the smart speaker, and the mobile phone 1 receives the NFC tag information of the smart speaker.
  • the NFC tag information includes the application identifier of the control application of the smart speaker and the smart speaker.
  • the speaker supports the identification of remote control.
  • the mobile phone 1 sends a remote assistance request carrying the application identification of the control application of the smart speaker to the mobile phone 2, and the mobile phone 2 realizes the remote control of the smart speaker based on the control application corresponding to the received application identification.
  • the remote assistance method provided by the embodiments of the present application can be applied to a system composed of multiple electronic devices.
  • the electronic devices in the system are not limited to the mobile phone 1 and mobile phone 2 described in the above application scenarios, but can also be other electronic devices, such as tablet computers, wearable devices, notebook computers, ultra-mobile personal computers (ultra-mobile personal computers) , UMPC), netbooks, personal digital assistants (personal digital assistant, PDA) and other electronic devices.
  • the embodiment of the present application does not limit the specific type of the electronic device.
  • FIG. 2 shows a schematic structural diagram of an electronic device.
  • the electronic device 200 may include a processor 210, an internal memory 221, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, a headphone jack 270D, a sensor module 280, An indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295, etc.
  • the sensor module 280 may include a pressure sensor 280A, a magnetic sensor 280D, a distance sensor 280F, a touch sensor 280K, and the like.
  • the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 200 .
  • the electronic device 200 may include more or less components than shown, or combine some components, or separate some components, or arrange different components.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • the processor 210 is configured to execute the remote assistance method in this embodiment of the present application, for example, the following steps 301 to 304 and so on.
  • the controller may be the nerve center and command center of the electronic device 200 .
  • the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 210 for storing instructions and data.
  • the memory in processor 210 is cache memory.
  • the memory may hold instructions or data that have just been used or recycled by the processor 210 . If the processor 210 needs to use the instruction or data again, it can be called directly from memory. Repeated access is avoided, the waiting time of the processor 210 is reduced, and the efficiency of the system is improved.
  • the processor 210 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • the I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL).
  • the processor 210 may contain multiple sets of I2C buses.
  • the processor 210 can be respectively coupled to the touch sensor 280K, the charger, the flash, the camera 293 and the like through different I2C bus interfaces.
  • the processor 210 can couple the touch sensor 280K through the I2C interface, so that the processor 210 communicates with the touch sensor 280K through the I2C bus interface, so as to realize the touch function of the electronic device 200.
  • the user is assisted by touching the third device
  • the control interface of the control application displayed on the display screen generates control instructions.
  • the I2S interface can be used for audio communication.
  • the processor 210 may contain multiple sets of I2S buses.
  • the processor 210 may be coupled with the audio module 270 through an I2S bus to implement communication between the processor 210 and the audio module 270 .
  • the audio module 270 can transmit audio signals to the wireless communication module 260 through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.
  • the assisted user listens to audio information in a video or audio session of the assisted user through a headset.
  • the PCM interface can also be used for audio communications, sampling, quantizing and encoding analog signals.
  • the audio module 270 and the wireless communication module 260 may be coupled through a PCM bus interface.
  • the audio module 270 can also transmit audio signals to the wireless communication module 260 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • a UART interface is typically used to connect the processor 210 with the wireless communication module 260 .
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 200 .
  • the electronic device 200 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the wireless communication function of the electronic device 200 may be implemented by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 200 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 250 may provide a wireless communication solution including 2G/3G/4G/5G, etc. applied on the electronic device 200 .
  • the mobile communication module 250 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and the like.
  • the mobile communication module 250 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 250 can also amplify the signal modulated by the modulation and demodulation processor, and then convert it into electromagnetic waves for radiation through the antenna 1 .
  • At least part of the functional modules of the mobile communication module 250 may be provided in the processor 210 . In some embodiments, at least part of the functional modules of the mobile communication module 250 may be provided in the same device as at least part of the modules of the processor 210 .
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low frequency baseband signal is processed by the baseband processor and passed to the application processor.
  • the application processor outputs sound signals through audio devices (not limited to the speaker 270A, the receiver 270B, etc.), or displays images or videos through the display screen 294 .
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent of the processor 210, and may be provided in the same device as the mobile communication module 250 or other functional modules.
  • the wireless communication module 260 can provide applications on the electronic device 200 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation Satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • BT wireless fidelity
  • GNSS global navigation Satellite system
  • frequency modulation frequency modulation, FM
  • NFC near field communication technology
  • IR infrared technology
  • the wireless communication module 260 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 260 receives electromagnetic waves via the antenna 2 , modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 210 .
  • the wireless communication module 260 can also receive the signal to be sent from the processor 210 , perform frequency modulation on the signal, amplify the signal, and then convert it into an electromagnetic wave for radiation through the antenna 2 .
  • the assisted device can transmit control instructions to the controlled device through its Bluetooth or Wi-Fi module.
  • the antenna 1 of the electronic device 200 is coupled with the mobile communication module 250, and the antenna 2 is coupled with the wireless communication module 260, so that the electronic device 200 can communicate with the network and other devices through wireless communication technology.
  • Wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband code division Multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM , and/or IR technology, etc.
  • GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi-zenith) satellite system, QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the electronic device 200 implements a display function through a GPU, a display screen 294, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 294 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.
  • Display screen 294 is used to display images, videos, and the like.
  • Display screen 294 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • LED diode AMOLED
  • flexible light-emitting diode flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.
  • the electronic device 200 may include one or N display screens 294 , where N is a positive integer greater than one.
  • a video session between the assisted device and the assisting device can be implemented through an ISP, a camera 293, a video codec, a GPU, a display screen 294, an application processor, and the like.
  • the ISP is used to process the data fed back by the camera 293 .
  • the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin tone.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 293 .
  • Camera 293 is used to capture still images or video.
  • the object is projected through the lens to generate an optical image onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the electronic device 200 may include 1 or N cameras 293 , where N is a positive integer greater than 1.
  • a digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 200 may support one or more video codecs.
  • the electronic device 200 can play or record videos in various encoding formats, such as: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.
  • MPEG moving picture experts group
  • Internal memory 221 may be used to store computer executable program code, which includes instructions.
  • the processor 210 executes various functional applications and data processing of the electronic device 200 by executing the instructions stored in the internal memory 221 .
  • the internal memory 221 may include a storage program area and a storage data area.
  • the storage program area may store an operating system and an application program required for at least one function (such as a control application of a controlled device, etc.).
  • the storage data area may store data created during the use of the electronic device 200 .
  • the internal memory 221 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • non-volatile memory such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the electronic device 200 may implement audio functions through an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, and an application processor. For example, an audio session between the assisted device and the assisting device, etc.
  • the audio module 270 is used for converting digital audio signals into analog audio signal outputs, and also for converting analog audio inputs into digital audio signals. Audio module 270 may also be used to encode and decode audio signals. In some embodiments, the audio module 270 may be provided in the processor 210 , or some functional modules of the audio module 270 may be provided in the processor 210 .
  • Speaker 270A also referred to as a "speaker" is used to convert audio electrical signals into sound signals.
  • the electronic device 200 can listen to music through the speaker 270A, or listen to a hands-free call.
  • the receiver 270B also referred to as an "earpiece" is used to convert audio electrical signals into sound signals.
  • the voice can be answered by placing the receiver 270B close to the human ear.
  • the microphone 270C also called “microphone” or “microphone” is used to convert sound signals into electrical signals.
  • the user can make a sound by approaching the microphone 270C through the human mouth, and input the sound signal into the microphone 270C.
  • the electronic device 200 may be provided with at least one microphone 270C. In other embodiments, the electronic device 200 may be provided with two microphones 270C, which may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 200 may further be provided with three, four or more microphones 270C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.
  • the headphone jack 270D is used to connect wired headphones.
  • the earphone interface 270D can be a USB interface 230, or can be a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the pressure sensor 280A is used to sense pressure signals, and can convert the pressure signals into electrical signals.
  • the pressure sensor 280A may be provided on the display screen 294 .
  • the capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to pressure sensor 280A, the capacitance between the electrodes changes.
  • the electronic device 200 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 294, the electronic device 200 detects the intensity of the touch operation according to the pressure sensor 280A.
  • the electronic device 200 may also calculate the touched position according to the detection signal of the pressure sensor 280A.
  • the electronic device 200 can measure the distance through infrared or laser.
  • the assisted device can receive the NFC tag information by means of Bluetooth ranging, and the distance sensor 280F is used to measure the distance during the Bluetooth ranging.
  • Touch sensor 280K also called “touch panel”.
  • the touch sensor 280K may be disposed on the display screen 294, and the touch sensor 280K and the display screen 294 form a touch screen, also called a "touch screen”.
  • the touch sensor 280K is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to touch operations may be provided through display screen 294 .
  • the touch sensor 280K may also be disposed on the surface of the electronic device 200 , which is different from the location where the display screen 294 is located.
  • the SIM card interface 295 is used to connect a SIM card.
  • the SIM card can be contacted and separated from the electronic device 200 by inserting into the SIM card interface 295 or pulling out from the SIM card interface 295 .
  • the electronic device 200 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • the SIM card interface 295 can support Nano SIM card, Micro SIM card, SIM card and so on.
  • the same SIM card interface 295 can insert multiple cards at the same time. Multiple cards can be of the same type or different.
  • the SIM card interface 295 can also be compatible with different types of SIM cards.
  • the SIM card interface 295 is also compatible with external memory cards.
  • the electronic device 200 interacts with the network through the SIM card to realize functions such as call and data communication.
  • the electronic device 200 employs an eSIM, ie: an embedded SIM card.
  • the eSIM card can be embedded in the electronic device 200 and cannot be separated from the electronic device 200 .
  • the embodiment of the present application does not specifically limit the specific structure of the execution body of a remote assistance method, as long as the program that records the code of the remote assistance method of the embodiment of the present application can be executed to obtain a remote assistance method according to the embodiment of the present application.
  • a remote assistance method can be used to communicate.
  • the execution body of the remote assistance method provided by the embodiments of the present application may be a functional module in an electronic device that can call a program and execute the program, or a communication device, such as a chip, applied in the electronic device.
  • the assisted device (mobile phone 1) in the application scenario corresponding to FIG. 1 may be recorded as the first device
  • the assisting device (mobile phone 2) may be recorded as the third device
  • the controlled device in the application scenario corresponding to FIG. 1 The (smart speaker) can be denoted as the second device
  • the control application of the controlled device in the corresponding application scenario of FIG. 1 can be denoted as the second application.
  • the remote assistance system provided by the embodiment of the present application includes: a first device and a third device, A second device may also be included.
  • FIG. 3 is a schematic flowchart of a remote assistance method provided by an embodiment of the present application. As shown in the figure, the method includes:
  • Step 301 After acquiring the first information, the first device starts a first remote assistance application in the first device, where the first device is a preset assisted device, and the first information includes the information used to control the second device.
  • the first device may obtain the first information through a short-distance communication way.
  • a short-distance communication way As an example, you can use Wi-Fi Aware wireless sensing, Bluetooth ranging, or NFC.
  • the first information may also include a device identification of the second device.
  • the device identifier of the second device is used to determine the second device to be remotely controlled based on the device identifier when the third device remotely controls the second device in the subsequent step 304 .
  • the first information may be NFC tag information of the second device.
  • the NFC tag information includes at least three fields, the first field is: the application identification of the second application, the second field is: the device identification of the second device, and the third field is: the identification of whether the second device supports remote control .
  • the first device needs to be set as the assisted device in advance, which can be understood as: the electronic device preset as the assisted device is the first device.
  • Setting the third device as the assisting device of the first device in advance can be understood as: the electronic device preliminarily set as the assisting device of the first device is the third device.
  • the first device obtains the first information, and if the identifier in the first information indicating whether the second device supports remote control is "the second device supports remote control", then The first device launches the first remote assistance application in the first device.
  • the identifier in the first information that indicates whether the second device supports remote control is "the second device does not support remote control”
  • the first device will start the second application corresponding to the application identifier in the first information, and the second application is used to control second device.
  • the first device obtains the first information, even if the identifier in the first information indicating whether the second device supports remote control is "the second device supports remote control", The first device will not start the first remote assistance application, but will start the second application corresponding to the application identifier in the first information, that is, the second application used to control the second device.
  • Step 302 the first device sends a remote assistance request to a third device through the first remote assistance application, where the remote assistance request carries an application identifier of the second application, and the third device is an assistance device of the first device.
  • the remote assistance request may include the following content: a remote assistance request command, an application identifier of the second application, and a device identifier of the second device corresponding to the application identifier of the second application.
  • the NFC tag information received by the first device may contain more content than the information carried in the remote assistance request.
  • the first field and the second field in the NFC tag information can be carried in the remote assistance request.
  • the third field need not be carried in the remote assistance request.
  • Step 303 after receiving the remote assistance request, the third device starts a second remote assistance application in the third device, and displays a control interface of the second application in the second remote assistance application.
  • the third device may display an interface in which there is an option to approve or reject the remote assistance request, and assist the user to agree to the remote assistance request through the interface displayed by the third device.
  • the remote assistance request is made, it means that a remote assistance session is established between the first device and the third device.
  • the third device After the interface of the third device receives the information of agreeing to the remote assistance request, the third device starts the second remote assistance application in the third device, and the second remote assistance application of the third device can display the The control interface of the second application corresponding to the application identifier carried in the remote assistance request.
  • the third device needs to acquire the second application corresponding to the application identifier in the remote assistance request, and the specific acquisition method may be downloading from a preset server, or may be acquired from the storage space of the third device.
  • the second remote assistance application of the third device may display a manipulation interface of the second application to remotely control the second device.
  • a certain application identifier may be an application identifier of a control application of a microwave oven.
  • the control applications downloaded by different assisting devices based on the application ID may belong to different version of.
  • the versions of the control application downloaded by the assisted device and the assisting device may also be different.
  • the second application in this embodiment of the present application includes control applications for controlling various versions of the second device.
  • the electronic device when the electronic device is set as the assisted device, the electronic device is the first device, and the remote assistance application in the electronic device is the first remote assistance application.
  • the electronic device When the electronic device is set as the assisted device In the case of a device, the electronic device is the third device, and the remote assistance application in the electronic device is the second remote assistance application.
  • the remote assistance application when the remote assistance application is installed, it is in the role of the assisted device, obtains the NFC tag information containing the application identification of the control application, and starts the pre-installed remote assistance application, which is only the remote assistance application. Named the first remote assistance application.
  • the remote assistance application on the assisting device may be named as the second remote assistance application.
  • the assisting device since assisting the user needs to set the assisted device of the assisting device in the remote assistance application of the assisting device, the assisting device needs to pre-install the remote assistance application or add a remote assistance application applet to facilitate the assistance of the user in assisting the device.
  • the assisted device is set up after launching the Remote Assistance application (or opening the Remote Assistance application applet) on the device.
  • the remote assistance application may not be pre-installed or the remote assistance application applet may be added.
  • the electronic device 1 After the electronic device 1 agrees to the setting request (request to set the electronic device 1 to be an assisted device of other electronic devices), the electronic device 1 acquires the role of the assisted device.
  • the electronic device 1 After the electronic device 1 agrees to the setting request, the electronic device 1 downloads the remote assistance application from the application store (or the first cloud platform) based on the setting request (or autonomously by the user); Afterwards, the electronic device 1 requests (or autonomously by the user) to add the applet of the remote assistance application based on the setting.
  • the electronic device when the electronic device is in the role of assisting the device or has no role set in advance, and obtains the NFC tag information containing the application identifier of the control application and the identifier indicating that the controlled device supports remote control, the NFC is activated.
  • the application in the tag information identifies the corresponding control application.
  • Step 304 in response to the manipulation instruction received on the manipulation interface of the second application, the third device remotely controls the second device.
  • the second remote assistance application in the third device can acquire and display the control interface of the second application corresponding to the application identifier, and the assist user can display the control interface of the second application through the second remote assistance application A manipulation instruction is received, and the second device corresponding to the second application is remotely controlled through the manipulation instruction.
  • the first device can be used as an assisted device used by a user who needs to be assisted.
  • the assisted user can trigger the assisted device to acquire the controlled device through short-distance communication.
  • the assisted user can notify the assisting user on the side of the third device as the assisting device to remotely control the second device as the controlled device without further operations on the assisted device, which simplifies the assisted user.
  • the assisted device sends to the assisting device a remote assistance request that carries the application identifier of the control application of the controlled device (for example, when the controlled device is the second device, the control application is the second application), Therefore, there will be no high requirements for network quality; finally, since the control of the controlled device is completed on the assisting device, the assisted device does not need to install the control application corresponding to each controlled device. Therefore, It will not take up too much storage space of the assisted device used by the assisted user.
  • the first device sending a remote assistance request to the third device through the first remote assistance application includes:
  • the first device sends a remote assistance request to the first cloud platform through the first remote assistance application to instruct the first cloud platform to send a remote assistance request to the third device, where the remote assistance request carries the application identifier of the second application.
  • the first device and the third device may communicate through the first cloud platform.
  • the first cloud platform stores the binding relationship between the first device and the third device.
  • the first cloud platform is a server that provides support for remote assistance applications. For the binding relationship between the first device and the third device, reference may be made to the description in the subsequent embodiments.
  • remotely controlling the second device in response to the manipulation instruction received by the manipulation interface of the second application, remotely controlling the second device includes:
  • the third device In response to the manipulation instruction received by the manipulation interface of the second application, the third device sends the manipulation instruction to the first device through the second remote assistance application;
  • the first device sends the received manipulation instruction to the second device;
  • the third device in response to the manipulation instruction received by the manipulation interface of the second application, sends the manipulation instruction to the first cloud platform through the second remote assistance application to instruct the first cloud platform to send the manipulation instruction to the second device;
  • the third device in response to the manipulation instruction received by the manipulation interface of the second application, the third device sends a manipulation instruction to the first cloud platform through the second remote assistance application, so as to instruct the first cloud platform to send the second device to the second device through the second cloud platform Send control commands.
  • the manipulation instruction between the third device and the second device may be forwarded through the first device; may also be forwarded through the first cloud platform; may also be forwarded through multiple cloud platforms, for example, through the first cloud platform It is forwarded to the second cloud platform, and then forwarded to the second device through the second cloud platform, where the manipulation instruction is used to instruct the second device to execute a response corresponding to the manipulation instruction.
  • the first cloud platform is a server corresponding to a remote assistance application
  • the second cloud platform is a server corresponding to a control application. This is because the developer of the remote assistance application and the developer of the control application may be different developers, and the developer of the control application may not want the cloud platform of other developers to directly control the controlled device of the developer of the control application. In the way of cloud platform docking, the developer corresponding to the controlled device can master the control right of its own controlled device.
  • the remote assistance method provided by the embodiment shown in FIG. 3 can be applied to a remote assistance system including a first device and a third device.
  • FIG. 4 is a schematic diagram of an application scenario of the above embodiment .
  • the remote assistance method provided by the embodiment of the present application when the remote assistance method provided by the embodiment of the present application is implemented, two electronic devices need to be bound in advance, and the assisted device and the assisting device of the assisted device are preset during binding. , or the assisting device and the assisting device of the assisting device are preset.
  • the electronic device set as the assisted device is the first device (eg, the elderly's mobile phone) described in the above embodiments, and the electronic device set as the assisting device is the third device (eg, the children's mobile phone) described in the above embodiments.
  • the binding may be the first device and the third device, or may be the first account associated with the first device and the second account associated with the third device.
  • the old man can himself or ask his family to help him register the first account on the first cloud platform, and the children can register the second account on the first cloud platform.
  • the association relationship between the first device and the first account may be: the SIM card number in the first device has a corresponding relationship with the first account; the device identifier of the first device has a corresponding relationship with the first account; or, in the first device
  • the account used to log in to the remote assistance application is the first account.
  • For the association relationship between the third device and the second account reference is made to the association relationship between the first device and the first account, which will not be repeated here.
  • the process of binding two electronic devices in advance can be referred to as shown in FIG. 5 , and assisting users (eg, children of the elderly) can search for remote users on device A (eg, children’s mobile phones) through the negative screen in device A
  • the method of assisting the application or clicking the remote assistance application on the desktop of device A opens the remote assistance application.
  • the display interface shown in (a) in Figure 5 (which can be marked as the first One interface), since the purpose of binding at this time is to set device A to assist the user or to set other electronic devices as assisted devices of device A.
  • Device A is associated with the second account. If device A or the second account associated with device A has added some assisted devices, the display interface can display the assisted devices that have been added.
  • FIG. 5 There is a switch button for the remote assistance application in the interface shown in ), after the user enables the remote assistance function, the display interface shown in (a) in FIG. 5 displays a list of added assisted devices, for example, (a) in FIG. 5 ) has been added to Nick's tablet and Mom's P30 displayed in the list of assisted devices.
  • the electronic device displayed in the list of added assisted devices is the assisted device that has been added by device A.
  • device A can display the searched other electronic devices in the form of a list (the trusted device shown in (b) in FIG. 5 ), the display interface shown in (b) in FIG. 5 (can be denoted as the second interface), where the searched trusted device is displayed in the display interface,
  • the trusted devices include: Dad's Mate 30, Maruko's mobile phone, Piggy's mobile phone, and beauty's mobile phone.
  • an optional button is set corresponding to the device name of each searched trusted device in the display interface, and the user is assisted to select the assisted device to be added by clicking the optional button.
  • an assisting user can add one or more assisted devices at a time.
  • buttons in the display interface shown in (b) of FIG. 5 , which assists the user to set the selected one or more trusted devices as the selected trusted devices of Device A through the “Confirm” button. assistance equipment.
  • the operation of the user clicking on the logo of "Dad's Mate 30" can be recorded as the second operation, that is, there is no “Confirm” button, and the operation of the user clicking on the logo of "Dad's Mate 30" triggers the sending of a device addition request, and also The operation of the user clicking the logo of "Dad's Mate 30" and the operation of clicking the "Confirm” virtual button may be recorded as the second operation.
  • device A also needs to send a device addition request (which can be recorded as the first request) to each selected trusted device, for example, assist the user to click on the
  • the "Confirm" button in the display interface shown below sends a device addition request to the selected trusted device, and the add request carries the second account of device A.
  • the selected trusted device device B, for example, Dad's Mate 30
  • the “add” virtual button may be recorded as the second control
  • the "reject” virtual button may be understood as the third control
  • the user's operation of clicking the second control may be the third operation.
  • device B is an assisted device of device A
  • device A is an assisting device of device B. It can also be understood that the device B is the first device, and the device A is the third device.
  • the binding relationship between device A and device B may be embodied by the binding relationship between the second account associated with device A and the first account associated with device B. After device B agrees to be added, device B stores the binding relationship between device A and device B. At the same time, device B can also feed back response information to device A. For example, the response information (which can be recorded as second information) can carry the binding relationship between device A and device B, so that device A stores the relationship between device A and device B. binding relationship between. The response information can also carry the first account of device B, so that device A can generate and store the binding relationship between device A and device B.
  • the response information (which can be recorded as second information) can carry the binding relationship between device A and device B, so that device A stores the relationship between device A and device B. binding relationship between.
  • the response information can also carry the first account of device B, so that device A can generate and store the binding relationship between device A and device B.
  • device B can also send the binding relationship between device A and device B to the first cloud platform through the first account
  • device A can also send device A and device B to the first cloud platform through the second account
  • the binding relationship of B makes the first cloud platform store the binding relationship between device A and device B.
  • device A in addition to the one-to-one correspondence between device A and device B, device A can also set multiple devices B as assisted devices of device A, that is, one assisting device can assist multiple assisted devices; Similarly, multiple devices A can also set the same device B as an assisted device, that is, one assisted device can ask for help from multiple assisting devices.
  • the application scenario shown in FIG. 5 is an application scenario in which device B is added to device A as an assisted device of device A.
  • device B may also be added to device A as an assisting device of device A.
  • the interface for adding assisting devices can also display a list of assisting devices that have been added, and there may also be a virtual button of “Add assisting device”.
  • the device addition request means that device A requests to add device B as an assisting device of device A.
  • the binding relationship between device A and device B in this application scenario is opposite to the roles of the assisting device and the assisted device in the binding relationship between device A and device B in the scenario shown in FIG. 5 .
  • For the process of adding an assisting device to an electronic device reference may be made to the process of adding an assisted device to an electronic device, which will not be described in detail.
  • the assisted user on the side of the assisted device can bring the assisted device (for example, the mobile phone of the elderly) close to the controlled device (for example, a microwave oven) that supports remote control through the “touch” scene.
  • the controlled device can also be smart speakers, self-service ticket machines and other electronic devices.
  • These controlled devices are provided with an NFC module, and the assisted device is also provided with an NFC module.
  • the assisted device can obtain the NFC tag information of the controlled device.
  • the first device is close to the microwave oven, and the NFC tag information of the microwave oven is obtained.
  • the NFC tag information of the microwave oven includes: the first field, the application identifier of the control application of the microwave oven; the second field, the device identifier of the microwave oven; the third field, whether the microwave oven supports remote control 's identification.
  • the controlled devices in this application scenario all support remote control by default.
  • the first device obtains the NFC tag information of the smart speaker.
  • the NFC tag information of the smart speaker includes: the first field, the The application identifier of the control application; the second field, the device identifier of the smart speaker; the third field, the identifier of whether the smart speaker supports remote control.
  • the assisted device when the remote control application of the assisted device is not started, after the assisted device gets close to the first controlled device and obtains the NFC tag information of the first controlled device, if the NFC tag information in the first NFC tag information
  • the third field is the identifier that supports remote control, and the assisted device starts the remote assistance application. After the remote assistance application of the assisted device is started, the assisted device gets close to the second controlled device to obtain the NFC of the second controlled device. After the tag information, the operation of starting the remote assistance application in the assisted device is no longer performed.
  • the assisted user can obtain the NFC tag information of multiple controlled devices through the "touch" scene, thereby obtaining the application identifiers of the control applications of multiple controlled devices, and the assisted user After acquiring the application identifiers of the control applications of one or more controlled devices, the device can acquire the control application corresponding to each application identifier, and then acquire the entry of each control application.
  • the remote assistance application of the assisted device adds the entry of each control application into the container management module of the remote assistance application of the assisted device, and the remote assistance application can The entry of the control application in the container management module is displayed, and the icon of each control application can be used as the entry of each control application. That is, the remote assistance application of the assisted device can display the icon of the microwave oven application and the icon of the smart speaker application (the step of touching the smart speaker by the assisted device is not shown in FIG. 4 ). The assisted user can click on the icon to enter and display the control interface of the control application corresponding to the icon.
  • the remote assistance application of the assisted device may not display the entry of the control application in the form of an icon, but the remote assistance application directly starts the control application of the controlled device, and displays the control interface of the started control application. , as shown in Figure 6 for details.
  • the assisted user brings the assisted device close to at least two controlled devices through the "touch" scene, such as the microwave oven and the smart speaker in the illustration, and the assisted device uses the remote assistance application Display the control interface of the microwave oven and the control interface of the smart speaker, such as shown in (b) in Figure 6.
  • the assisted user can also switch gestures (for example, Sliding gesture) switch to display the control interface of different control applications, as shown in (b) and (c) in FIG. 6 , through the sliding gesture, the control interface displayed by the remote assistance application of the assisted device can be displayed by the intelligent The control interface of the control application of the speaker is switched to the control interface of the control application of the microwave oven.
  • gestures for example, Sliding gesture
  • the assisted device may initiate a remote assistance request to the assisting device.
  • the remote assistance application can also display the “Initiate Help” button (which can be denoted as the fourth control) for initiating a remote assistance request, and the assisted user clicks the virtual button. "Initiate help” (which can be recorded as the fourth operation), the assisted device sends a remote assistance request carrying the application identifier of the microwave control application and the application identifier of the smart speaker control application to the assisting device.
  • the assisted device sends a remote assistance request carrying the application identifier of the microwave control application and the application identifier of the smart speaker control application to the assisting device. Referring to (d) in FIG.
  • the display interface of the assisting device includes an agree or reject button, and the assisting user can click the agree button in the current display interface of the assisting device, so that a remote assistance session is established between the assisted device and the assisting device.
  • the assisting user can click the reject button in the current display interface to reject the remote assistance request.
  • the assisted device may select one of the multiple assisting devices as the receiving device for the current remote assistance request. If the receiving device of the current remote assistance request rejects the current remote assistance request, the assisted device can continue to select other assisting devices as the receiving device of the remote assistance request, until the receiving device of a certain remote assistance request agrees to the remote assistance request or all of assistance devices declined remote assistance requests.
  • priorities can also be preset among the multiple assisting devices, that is, the multiple assisting devices are sorted according to their priorities, and the one with the highest priority is preferentially selected as the current remote assistance.
  • the receiving device of the request after the receiving device with the highest priority rejects the current remote assistance request, continues to send the remote assistance request to the assisting device with the second highest priority, until the receiving device of a certain remote assistance request agrees to the remote assistance request or All assistance devices rejected remote assistance requests.
  • the video session or audio session between the assisted device and the assisting device can be used to confirm the identity between the assisted user and the assisting user.
  • the assisting user can also guide the assisted user how to use the video session or audio session. Control the controlled device.
  • the assistance device starts the remote assistance application in the assistance device.
  • the remote assistance request received by the assisting device includes the application identifier of the control application of the controlled device.
  • the remote assistance application in the assisting device can obtain the control application corresponding to the application identifier, and the remote assistance application of the assisting device can display the icons of each control application.
  • the remote assistance application of the assistance device can display the control interface of the control application corresponding to the icon.
  • the remote assistance application of the assisting device can also directly display the manipulation interface of the control application, for example, the manipulation interface of the microwave oven control application displayed by the assisting device as shown in (b) of FIG. 7 .
  • the assisting user can also switch gestures in the assisting device to instruct the remote assistance application of the assisting device to change the currently displayed
  • the control interface of the control application of the microwave oven is switched to the control interface of the control application of other controlled devices.
  • the assisting user can operate in the control interface displayed by the remote assistance application of the assisting device to generate control instructions. For details, please refer to (b) in FIG. 7 . In the control interface, touch the button "milk”, and then touch the button "start” to generate a control instruction indicating "the microwave oven runs according to the milk program".
  • the control interface shown in (a) in FIG. 7 is the second control interface displayed by the remote assistance application of the assisted device, and the control interface shown in (b) in FIG. 7 is the first control interface displayed by the remote assistance application of the assisting device , as shown in (a) in FIG. 7 and (b) in FIG. 7 , both the assisted device and the remote assistance application of the assisting device can display the picture of the video session.
  • the picture A displayed in the assisted device is The picture of assisting the user
  • the picture B displayed in the assisting device is the picture of the assisted user
  • the picture of assisting the user may be the picture captured by the camera of the assisting device used by the assisting user
  • the picture of the assisted user may be the picture of the assisted user The image captured by the camera of the assisted device used by the user.
  • the “disconnect” button can be displayed in the remote assistance applications of both the assisted device and the assisting device, and the assisted user clicks the “disconnect” button in the assisted device.
  • the current remote assistance session can be disconnected, and the video session (or audio session) will also be interrupted.
  • both the assisted device and the assisting device can close their respective remote assistance
  • the application clears the entry icons or control interfaces of each control application in the container management module of the remote assistance application.
  • the assisting device can close the remote assistance application, and at the same time, clear the assisting device.
  • the entry icon or control interface of each control application in the container management module of the remote assistance application may not be closed, and the entry icon and control interface in the container management module of the remote assistance application in the assisted device may not be cleaned up.
  • the assisted user can continue to use the "Initiate Help" button to ask Other assistance devices initiate a remote assistance request.
  • the assisted user can exit the remote assistance application modified in the assisted device, and at the same time clear the container management of the remote assistance application of the assisted device.
  • the entry icon or manipulation interface of each control application in the module is the same.
  • the assisted device will Both the remote assistance application and the assistance device can close their respective remote assistance applications, and at the same time, clear the entry icons or control interfaces of each control application in the container management module of the remote assistance application.
  • the assisting device sends the manipulation instruction to the assisted device.
  • the assisted device forwards the manipulation instruction to the microwave oven.
  • the assisting device may also forward the manipulation instruction to the microwave oven through the cloud platform.
  • the assisting device can send the manipulation instruction to the first cloud platform, and forward the manipulation instruction to the microwave oven through the first cloud platform.
  • send the manipulation instruction to the first cloud platform the first cloud platform then sends the manipulation instruction to the second cloud platform, and the second cloud platform sends the manipulation instruction to the microwave oven.
  • the first cloud platform may be a server corresponding to the remote assistance application
  • the second cloud platform may be a server of the controlled device.
  • the assisting device may also send the device identifier of the controlled device corresponding to the manipulation command along with the manipulation command in the process of sending the manipulation command to the assisted device or the PTZ.
  • the microwave oven After receiving the manipulation instruction, the microwave oven performs corresponding operations according to the manipulation instruction.
  • the embodiment of the present application describes an application scenario of the remote assistance method provided by the embodiment of the present application with reference to FIG. 4 and in conjunction with FIG. 5 to FIG. 7 .
  • other application scenarios may also exist.
  • the contents described in FIGS. 4 to 7 do not impose any limitations on the embodiments of the present application.
  • FIG. 8 is a technical architecture diagram of a remote assistance method provided by the embodiment of the present application
  • FIG. 8 shows the sequence diagram of the remote assistance method of the technical architecture diagram.
  • step A in FIG. 9 the assisted device and the assisting device are bound.
  • the binding process may be implemented by a remote assistance application in the assisted device and a remote assistance application in the assisting device. If the binding process is performed through the first account associated with the assisted device and the second account associated with the assisting device, the binding process may be implemented through the first cloud platform corresponding to the first account and the second account.
  • both the assisted device and the assisting device have remote assistance applications at the upper layer of the system.
  • an account management module exists in the assisted device, the assisting device and the first cloud platform, and the binding relationship between the assisted device and the assisting device can be stored in the account management module and assisting device in the remote assistance application of the assisted device. The account management module in the remote assistance application and the account management module of the first cloud platform.
  • the NFC module of the assisted device acquires the NFC tag information of the controlled device, the NFC tag information includes the application identification of the control application of the controlled device, the device identification of the controlled device and whether the controlled device supports remote Control ID.
  • the controlled device is provided with an NFC module.
  • the assisted device is also provided with an NFC module. The user will approach the assisted device to the assisting device, and the device discovery module in the assisted device finds that the NFC module is installed. (the dotted line between the NFC module and the device discovery module in Figure 8), and after the assisted device discovers the controlled device with the NFC module, the NFC module in the assisted device (not shown in Figure 8) The NFC tag information of the controlled device can be obtained.
  • the short-range communication method supported by the device discovery module shown in FIG. 8 only shows the proximity discovery that supports NFC. In practical applications, it can also support the proximity discovery of wifi Aware and the proximity discovery of Bluetooth. For example, taking Bluetooth proximity discovery as an example, the device discovery module in the assisted device can discover the controlled device provided with the Bluetooth module. After the device discovery module in the assisted device discovers the controlled device equipped with the Bluetooth module, the Bluetooth module of the assisted device can obtain the application identification of the control application of the controlled device, the device identification of the controlled device and the controlled device through Bluetooth transmission. Indicates whether the control device supports remote control.
  • Step C in Figure 9 the NFC module in the assisted device sends a call instruction carrying the NFC tag information to the application management module, the call instruction is an instruction to call the interface in the application management module, and the interface has the function of starting the remote assistance application .
  • the calling instruction carries the NFC tag information.
  • the system layer of the assisted device has an application management module, and the application management module can start the application program located in the upper layer of the system.
  • step D in FIG. 9 the application management module in the assisted device starts the remote assistance application.
  • the remote assistance application can be started in the form of a start instruction, and the start instruction can carry the application identifier and the device identifier in the NFC tag information.
  • the application management module in the assisted device receives the NFC tag information, the identification of whether the controlled device supports remote control in the NFC tag information indicates "Yes", and the current electronic device is set as the assisted device's
  • the application management module in the assisted device sends a startup instruction to the remote assistance application.
  • the startup instruction no longer carries the identifier of whether the controlled device supports remote control, and the startup instruction can carry the application identifier and the device identifier.
  • step E in FIG. 9 the remote assistance application on the upper layer of the assisted device system is started.
  • the remote assistance application of the assisted device obtains the application ID and the device ID.
  • the remote assistance application at the upper layer of the assisted device system establishes a connection with the controlled device according to the device identification.
  • the remote assistance application on the upper layer of the assisted device system is provided with a control management module, and the control management module establishes a connection relationship with the Kit (the relevant control interface in the Kit is opened for use by the upper-layer application), and the Kit can be integrated in the upper-layer application software. , for example, in remote assistance applications.
  • the Kit establishes a connection relationship with the transmission management module of the system layer.
  • connection management module in the layer and the connection management module in the controlled device are jointly responsible for establishing a connection between the Bluetooth of the controlled device and the Bluetooth of the assisted device.
  • a transmission channel is formed between the transmission management module of the assisted device - the Bluetooth of the assisted device - the Bluetooth of the controlled device - the connection management module of the controlled device, The transmission channel is used for subsequent transmission of manipulation instructions.
  • the connection management module of the controlled device is responsible for transmitting the received manipulation instructions to the control management module through an integrated interface (for example, the interface provided in the software tool development kit), so as to realize the control of the controlled device.
  • the transmission path of the manipulation command from the control management module of the assisted device to the control management module of the controlled device is: the control management module of the assisted device-Kit module-transmission management module-Bluetooth or Wi-Fi-Bluetooth of the controlled device or Wi-Fi-the connection management module of the controlled device-the control management module of the controlled device.
  • step F in FIG. 8 and FIG. 9 a connection is established between the assisted device and the assisting device, and the connection provides a transmission channel for subsequent manipulation commands.
  • step G in FIG. 9 the remote assistance application in the assisted device adds the entry or manipulation interface of the control application corresponding to the application identifier to the container management module of the remote assistance application.
  • a container management module is provided in the remote assistance application.
  • the container management module is used for accommodating or controlling the entry or manipulation interface of the application.
  • the display interface of the remote assistance application of the assisted device displays the entry or control interface of the control application in the container management module.
  • the remote assistance application calls the method provided by the system layer to start the control application of the controlled device, for example, the start ability() function is called, and the application identifier of the control application of the controlled device and the device of the controlled device are passed in at the same time. logo.
  • the system layer can verify whether the control application of the controlled device is allowed to be started by the remote assistance application through the "identification of whether the controlled device supports remote control" in the NFC tag information received by the application management module.
  • the remote assistance application is started, the control application of the controlled device is started, and the entry or control interface of the control application is added to the container management module of the remote assistance application.
  • the remote assistance application can display the entry or control interface in the container management module.
  • step G can be canceled.
  • step H in FIG. 9 the remote assistance application of the assisted device searches for the bound assistance device from the account management module.
  • the binding relationship between the assisted device and the assisted device has been pre-stored in the account management module of the assisted device.
  • the session management module in the remote assistance application of the assisted device can initiate a remote assistance session, for example, a remote assistance request can be generated, and the generated remote assistance request carries the application identifier of the control application.
  • step J in FIG. 9 the remote assistance application of the assisted device sends a remote assistance request to the first cloud platform.
  • step K in FIG. 9 the first cloud platform sends a remote assistance request to the assistance device.
  • step L in FIG. 9 after the application management module in the assistance device receives the remote assistance request, the application management module starts the remote assistance application.
  • an application management module exists in the system layer of the assistance device, and a remote assistance application exists in the upper layer of the system layer.
  • step M in FIG. 9 the remote assistance application in the assistance device is started.
  • step N in FIG. 9 the account management module in the remote assistance application of the assisting device verifies the information of the assisted device.
  • the account management module of the assisting device also pre-stores the binding relationship between the assisted device and the assisting device, and the account management module can determine whether the initiator currently receiving the remote assistance request is the assisted device that has a binding relationship with the device.
  • Step O in Figure 9 the user agrees to the remote assistance session.
  • the account management module determines that the originator of the currently received remote assistance request is an assisted device that has a binding relationship with this device
  • the remote assistance application of the assisting device can display an interface with "Agree” or “Rejection” in the interface. button, the user can click "Agree” to indicate that the user agrees to the remote assistance session.
  • step P in FIG. 9 a remote assistance session is established between the remote assistance application of the assisting device and the remote assistance application of the assisted device.
  • the session management module in the remote assistance application of the assisted device the session management module in the first cloud platform—the session management module of the remote assistance application of the assisting device, between the three
  • a remote assistance session is established between the remote assistance application assisting the device and the remote assistance application assisting the device.
  • a video session or an audio session may also be established between the assisted device and the assisting device.
  • the remote assistance session between the assisting device and the assisted device can exist in the form of a session.
  • the assisted device sends a remote assistance request to the assisting device
  • the assisting device creates a session
  • the assisting device assigns an ID to the session
  • the The ID is sent to the assisted device.
  • the assisted device sends other information to the assisting device, it can carry the ID in other information.
  • the assisting device receives the information carrying the ID, it can The information carrying this ID is associated with previously received information with the same ID, thereby maintaining the session between the assisting device and the assisted device.
  • the description of the above session ignores the forwarding process of the first cloud platform.
  • the assisted device sends a remote assistance request to the assisting device, and the remote assistance request carries the application identification and device identification of the control application of the microwave oven.
  • the assisting device can return the session ID to the assisted device.
  • the assisted device sends the application identifier of the control application of the smart speaker to the assisting device, and carries the session ID at the same time.
  • the assisting device determines that the application ID of the control application of the smart speaker and the application ID of the control application of the microwave oven come from the same remote assistance session with the same assisted device.
  • step Q in FIG. 9 the remote assistance application of the assisting device adds the entry or control interface of the control application corresponding to the application identifier to the container management module.
  • a container management module also exists in the remote assistance application of the assisting device, and the container management module may have the same function as the container management module in the assisted device, which will not be repeated here.
  • step R in FIG. 9 the user operates in the control interface of the control application, thereby generating a control instruction.
  • the remote assistance application of the assistance device can display the control interface of the control application in the container management module, and the user operates in the control interface to generate control instructions for the controlled device.
  • step S in FIG. 9 the remote assistance application of the assistance device invokes the control management module.
  • the remote assistance application in the assistance device is provided with a control management module, and the control management module can send a manipulation instruction to the control management module of the first cloud platform.
  • step T in FIG. 9 the control management module in the remote assistance application of the assistance device sends a manipulation instruction to the first cloud platform.
  • step U in FIG. 9 the first cloud platform sends a manipulation instruction to the assisted device.
  • control management module in the remote assistance application of the assisting device sends a manipulation instruction to the control management module of the first cloud platform, and the control management module of the first cloud platform then sends the control in the remote assistance application of the assisted device to the control management module.
  • the management module sends the manipulation instruction.
  • step V in FIG. 9 the control management module in the remote assistance application of the assisted device calls the interface provided by Kit, referring to the description in step F, the interface provided by Kit can provide transmission control instructions between the assisted device and the assisting device channel.
  • the assisted device sends a manipulation instruction to the connection management module of the controlled device through a pre-established channel between the assisted device and the assisting device.
  • the controlled device There is a connection management module, which can include a software development kit (Software Development Kit, SDK).
  • SDK integrates the interface for communication between the control management module of the controlled device and the underlying Bluetooth module, or the controlled The interface for communication between the control management module of the device and the Wi-Fi module, thereby providing a communication channel between the control management module of the controlled device and the Bluetooth module or a communication channel between the control management module of the controlled device and the Wi-Fi module.
  • step F in FIG. 8 and FIG. 9 represents the process of establishing a channel for transmitting manipulation instructions between the assisted device and the controlled device.
  • Step W in FIG. 8 and FIG. 9 represents the process of sending a manipulation command through the channel established in step F in FIG. 8 and FIG. 9 .
  • step X in FIG. 9 the connection management module in the controlled device provides an SDK interface to send a manipulation command to the control management module, and the control management module is used to control the corresponding software and hardware to respond based on the manipulation command.
  • the transmission process of the manipulation instruction from the assisted device to the controlled device is: the control management module—Kit—in the remote assistance application of the assisted device is The transmission management module in the system layer of the assisting device—the Bluetooth or Wi-Fi module of the assisted device—the Bluetooth or Wi-Fi of the controlled device—the connection management module of the controlled device—the control management module of the controlled device—the controlled The software and hardware corresponding to the device.
  • FIG. 10 is a technical architecture diagram of a remote assistance method provided by an embodiment of the present application
  • FIG. 11 is a technical architecture diagram based on the technical architecture diagram shown in FIG. 10 provided by an embodiment of the present application. Sequence diagram of the remote assistance method.
  • FIG. 10 in combination with the embodiment corresponding to FIG. 11 transmits a control instruction to the controlled device.
  • assisting device first cloud platform—controlled device
  • the instruction sent by the assisting device to the first cloud platform is denoted as the fourth manipulation instruction
  • the instruction sent by the first cloud platform to the controlled device is denoted as the fourth control instruction.
  • the transmission process of the control instruction to the controlled device in the embodiment corresponding to FIG. 8 in conjunction with FIG. 9 is: assisting device—first cloud platform—assisted device—controlled device (in this embodiment, the assisting device sends the first cloud platform to the first cloud platform.
  • the sent instruction is denoted as the first manipulation instruction
  • the manipulation instruction sent by the first cloud platform to the assisted device is denoted as the second manipulation instruction
  • the instruction sent by the assisted device to the controlled device is denoted as the third manipulation instruction).
  • Step F the manipulation instruction is forwarded to the controlled device through the first cloud platform, or the first cloud platform and the second cloud platform. If it is through the first cloud platform, the control instruction is sent to the connection management module of the controlled device, and the connection management module sends the control instruction to the control management module in the application layer of the controlled device.
  • the second cloud platform can send the control command to the control management module of the application layer of the controlled device.
  • the second cloud platform is a cloud platform corresponding to the manufacturer of the controlled device.
  • connection management module in the controlled device, and the connection management module may include a software tool development kit (Software Development Kit, SDK), and the control management module of the controlled device and the first cloud platform are integrated in the SDK. An interface for communication between them, thereby providing a channel between the control management module of the controlled device and the control management module of the first cloud platform to transmit manipulation instructions.
  • SDK Software Development Kit
  • the remote assistance method provided by the embodiments of the present application may also have other application scenarios.
  • the application scenario shown in FIG. 12 is that the assisted user only needs to assist the user to control the microwave oven remotely.
  • the application scenario shown in Figure 13 is that the assisted user needs to assist the user to remotely control the microwave oven and the smart speaker.
  • the application scenario shown in FIG. 14 is based on the application scenario shown in FIG. 13 , and it is also necessary to assist the user to control the self-service ticket machine remotely.
  • the controlled devices in the application scenarios in FIGS. 12 to 14 all support remote control by default.
  • the assisted user in the scenario where the assisted user only needs to assist the user to help control the microwave oven to heat milk, as shown in (a) of Figure 12, the assisted user "touches" the microwave oven through the assisted device, and the assisted device Obtain the NFC tag information of the microwave oven.
  • the assisted device starts the remote assistance application, and the remote assistance application obtains the control interface (control interface of the microwave oven) of the control application corresponding to the application identifier.
  • the remote assistance application displays the control interface of the control application of the microwave oven.
  • the user can initiate help to the assisting device through the "Initiate Help" button in the remote assistance application of the assisted device, and the assisted device sends a remote assistance request to the assisting device, where the remote assistance request carries the application identifier of the control application of the microwave oven.
  • the assisting device displays the interface shown in (c) in Establish a remote assistance session between assistance devices. Assist the user to realize the remote control of the microwave oven on the side of the assistance device through the control application (the control application of the microwave oven) corresponding to the application identifier in the remote assistance request.
  • the microwave oven is the first controlled device that is "touched" by the assisted device.
  • the assisted device needs to start the remote assistance application in the assisted device.
  • the assisted device sends the application identifier of the control application of the first controlled device to the assisting device, the application identifier is sent together with the remote assistance request.
  • the assisted user needs to assist the user to help control the microwave oven to heat milk, and also needs to assist the user to help connect the smart speaker to the wireless network.
  • the assisted user "touches" the microwave oven with the assisted device, and the assisted device acquires the NFC tag information of the microwave oven.
  • the assisted device Start the Remote Assistance application. At this time, the assisted user can not initiate help through the remote assistance application, but continue to follow (c) in Figure 13.
  • the assisted user "touches" the smart speaker with the assisted device, and the assisted device obtains the NFC tag information of the smart speaker.
  • the assisted device Since the remote assistance application in the assisted device is already activated at this time, the assisted device no longer responds to "start the remote assistance application" to the acquired NFC tag information of the smart speaker, but instead responds as shown in Figure 13 As shown in (d), the control interface of the control application of the smart speaker can be displayed through the activated remote assistance application. In the same way, after the remote assistance application is started and before the assisted user initiates help through the remote assistance application, the assisted device will no longer "start remote assistance" on the NFC tag information of any controlled device obtained through "touch". application”, but the control interface of the control application corresponding to the application ID obtained by the current “touch” can be displayed through the remote assistance application that has been started.
  • the assisted user can initiate help through the “Initiate Help” button in the interface shown in (d) of FIG. 13 .
  • the remote assistance request sent by the assisted device to the assisting device carries: the application identifier of the control application of the microwave oven And the application ID of the control application of the smart speaker.
  • the assisting device receives the remote assistance request, as shown in (e) of FIG. 13 , the assisting user agrees to the remote assistance request on the assisting device side, and establishes a remote assistance session between the assisted device and the assisting device.
  • Assist the user to realize the remote control of the smart speaker through the control application of the smart speaker corresponding to the application identifier in the remote assistance request on the side of the assistance device.
  • the microwave oven is the first controlled device that is "touched” by the assisted device.
  • the assisted device needs to start the remote assistance application in the assisted device.
  • the smart speaker is the second controlled device that is "touched” by the assisted device.
  • the assisted device does not need to start the remote assistance application in the assisted device.
  • the 3rd, 4th, . . When the assisted device side initiates help, the sent remote assistance request carries the application identifiers of the control applications of the first to i th controlled devices.
  • the assisted device after the assisted device "touches" the controlled device, if the NFC tag information of the controlled device is obtained, it can first determine whether the assisted device has started the remote assistance application;
  • the remote assistance application is not activated, it means that the currently obtained NFC tag information is the NFC tag information of the first controlled device, and the remote assistance application can be activated;
  • the remote assistance application If the remote assistance application has been started, it means that the currently obtained NFC tag information is the NFC tag information of the 2nd, 3rd, ... i-th controlled device, and you can wait to initiate help.
  • FIG. 14 on the basis of the application scenario shown in Figure 13 (in actual application, it can also be the application scenario shown in Figure 12), after assisting the user to agree to the remote assistance request on the assisting device side, as shown in Figure 14 ( As shown in f), a remote assistance session is established between the assisted device and the assisting device, and the "Initiate Help" button is no longer displayed in the display interface of the remote assistance application of the assisted device.
  • 14 (a) to FIG. 14 (e) can refer to the descriptions of FIG. 13 (a) to FIG. 13 (e), which will not be repeated.
  • the assisted user can also “touch” the assisted device from the self-service ticket machine to obtain the self-service ticket machine again NFC tag information. Since the remote assistance application in the assisted device has been started, and a remote assistance session has been established between the assisted device and the assisting device through the remote assistance request, the assisted device no longer responds with "starting the remote assistance application", As shown in (h) of FIG.
  • the “Initiate Help” button is no longer displayed in the interface of the remote assistance application of the assisted device, and the assisted device can use the acquired application identifier of the control application of the self-service ticket machine It is sent to the assisting device without being carried in the remote assistance request like the application identifier of the control application of the second, ..., i-th controlled device.
  • the assistance device no longer displays an interface for approving or rejecting the remote assistance request, but displays a control interface of the control application of the self-service ticketing machine through the activated remote assistance application.
  • the assisted user needs to assist the user in providing remote assistance to microwave ovens, smart speakers and self-service ticket machines.
  • the remote assistance application in the assistance device can receive the application identifier of the control application of the microwave oven, the application identifier of the control application of the smart speaker, and the application identifier of the control application of the self-service ticket machine. Therefore, the remote assistance application of the assistance device can display the control interface of the microwave oven control application, the control application of the smart speaker, and the control application of the self-service ticket machine, and the assistance device can also switch to display the control of each control application. interface.
  • the microwave oven is the first controlled device that is "touched” by the assisted device.
  • the assisted device needs to start the remote assistance application in the assisted device.
  • the smart speaker is the second controlled device that is "touched” by the assisted device.
  • the assisted device does not need to start the remote assistance application in the assisted device.
  • the 3rd, 4th, . . When the assisted device side initiates help, the sent remote assistance request carries the application identifiers of the control applications of the first to i th controlled devices. For each controlled device (i+1th, i+2th, .
  • the assisted device no longer executes the response of "starting the remote assistance application", and no longer sends the "remote assistance request".
  • What the assisted device needs to execute is the application that will “touch” the control application of each controlled device (i+1, i+2, ..., i+j controlled device) The identification is sent to the assisting device.
  • the 2nd, 3rd, 4th, ..., the NFC tag information of the i-th controlled device in the above example can be recorded as the third information; i+1th, i+2th, ... ..., the NFC tag information of the i+j th controlled device can be recorded as the fourth information.
  • the assisted device After the assisted device starts the remote assistance application, the assisted device "touches" the controlled device. If the NFC tag information of the controlled device is obtained, it can be determined whether the assisted device and the assisting device have been established. remote assistance sessions;
  • the remote assistance session is not established, it means that the currently obtained application ID is the MFC label information of the 2nd, 3rd, ..., i-th controlled device, and you can wait to initiate help;
  • the currently acquired application identifier is the NFC tag information of the i+1th, i+2th, ..., i+jth controlled device, then the currently acquired NFC tag information to the assisting device.
  • i is a positive integer greater than or equal to 2
  • j is a positive integer greater than or equal to 1.
  • the process for the remote assistance application of the assisted device to display the control interface of the control application of the controlled device includes:
  • the assisted device displays the icon of the control application of the controlled device through the remote assistance application
  • the assisted device In response to the first start instruction received through the icon, the assisted device starts the control application of the controlled device through the remote assistance application, and displays the activated control interface of the control application of the controlled device.
  • the assisted device can request the assisting device to perform remote assistance, so it is set: when the assisted device "touches" the controlled device that supports remote control, the assisted device starts the remote assistance in the assisted device. application to send a remote assistance request to the assistance device through the remote assistance application.
  • the entry of the control application of the controlled device may be displayed in the remote assistance application of the assisted device.
  • the remote assistance application of the assisted device can display the icon of the control application of the controlled device, for example, the icon of the control application of the microwave oven and the icon of the control application of the smart speaker shown in (a) of FIG.
  • the assisted user can enter the manipulation interface of the control application by touching the displayed icon.
  • the user touches the icon of the control application of the microwave oven displayed in the remote assistance application of the assisted device, and as shown in (b) of FIG. 15 , the remote assistance application of the assisted device displays the microwave oven The control interface of the control application.
  • the user touches the icon of the control application of the smart speaker displayed in the remote assistance application of the assisted device.
  • the remote assistance application of the assisted device displays The control interface of the control application of the smart speaker.
  • (a) of FIG. 15 the user touches the icon of the control application of the smart speaker displayed in the remote assistance application of the assisted device.
  • the user touches the icon of the control application of the self-service ticketing machine displayed in the remote assistance application of the assisted device.
  • the remote assistance of the assisted device The application displays the control interface of the control application of the self-service ticket machine.
  • the control interface of the controlled device can also be directly displayed in the first remote assistance application of the first device.
  • FIG. 15 takes the assisted device as an example to describe the process of displaying the control interface of the control application of the controlled device.
  • the process of assisting the device to display the control interface of the control application of the controlled device can refer to the corresponding description in FIG. 15 , and will not be repeated here.
  • control interface of the started control application of the controlled device can also be directly displayed.
  • the following focuses on describing the remote assistance method provided by the embodiments of the present application, using the first device and the third device as execution subjects respectively.
  • FIG. 16 is a schematic flowchart of a remote assistance method provided by an embodiment of the present application, applied to a first device, and the method includes:
  • Step 1601 after acquiring the first information, the first device starts the first remote assistance application in the first device, where the first information includes an application identifier used to control the second application of the second device and an application identifier used to characterize the first remote assistance application.
  • the second device supports the identification of remote control, the first device is the preset assisted device, and the second device is the controlled device.
  • Step 1602 the first device sends a remote assistance request to a third device through the first remote assistance application, wherein the third device is an assistance device of the first device, the remote assistance request carries the application identifier of the second application, and the remote assistance request It is used to instruct the third device to start the second remote assistance application, and perform remote control on the second device based on the second remote assistance application and the second application.
  • the third device is an assistance device of the first device
  • the remote assistance request carries the application identifier of the second application
  • the remote assistance request It is used to instruct the third device to start the second remote assistance application, and perform remote control on the second device based on the second remote assistance application and the second application.
  • the method further includes:
  • the first device sets the third device as an assisting device of the first device, wherein the first request is sent by the third device, and the first request carries the account information of the third device;
  • the first device stores the assistance relationship between the first device and the third device, and the assistance relationship between the first device and the third device includes: a correspondence between account information of the first device and account information of the third device;
  • the first equipment sends the second information to the third equipment, and the second information carries the account information of the first equipment, or the second information carries the corresponding relationship between the account information of the first equipment and the account information of the third equipment;
  • the second information is used to instruct the third device to set the first device as an assisted device of the third device.
  • the first device is provided with an NFC module, and the first information is NFC tag information of the second device;
  • the first device After acquiring the first information, the first device starts the first remote assistance application in the first device, including:
  • the first device After acquiring the NFC tag information of the second device through the NFC module, the first device starts the first remote assistance application in the first device in response to determining that the second device supports remote control according to the identifier used to indicate that the second device supports remote control .
  • the first device sending a remote assistance request to the third device through the first remote assistance application includes:
  • the first device sends a first remote assistance request to the first cloud platform through the first remote assistance application, the first remote assistance request carries the application identifier of the second application, and the first remote assistance request is used to instruct the first cloud platform to send the third
  • the device sends a second remote assistance request, where the second remote assistance request carries an application identifier of the second application.
  • the method further includes:
  • the first remote assistance application in the first device displays a manipulation interface of the second application.
  • the method further includes:
  • the control interface of the first remote assistance application in the first device includes a fourth control, and the fourth control is used to initiate help to the third device;
  • a fourth operation input by the user is detected, and the fourth operation acts on the fourth control
  • the first device In response to the fourth operation, the first device sends a remote assistance request to the third device through the first remote assistance application.
  • the method before the first device sends a remote assistance request to the third device through the first remote assistance application, the method further includes:
  • the first device acquires third information, where the third information includes an application identifier of a fourth application used to control the fourth device and an identifier used to characterize that the fourth device supports remote control;
  • the first device displays the control interface of the fourth application through the first remote assistance application
  • the first device sends a remote assistance request to the third device through the first remote assistance application, specifically:
  • the first device sends a remote assistance request to the third device through the first remote assistance application, where the remote assistance request carries the application identifier of the second application and the application identifier of the fourth application.
  • the method further includes:
  • the first device acquires fourth information, where the fourth information includes an application identifier of a fifth application used to control the fifth device and an identifier used to characterize that the fifth device supports remote control;
  • the first device displays the control interface of the fifth application through the first remote assistance application
  • the first device sends the application identifier of the fifth application to the third device.
  • the first device acquires application identifiers of control applications of at least two controlled devices, and the at least two controlled devices include the second device and the fourth device.
  • the first remote assistance application in the first device After displaying the second manipulation interface of the second application, the method further includes:
  • control interface of the second application currently displayed in the first remote assistance application of the first device is switched to the control interface of the fourth application.
  • the method further includes:
  • the first device acquires the first information by approaching or touching the second device.
  • the method before the first device sends a remote assistance request to the third device through the first remote assistance application, the method further includes:
  • the first device searches the assisting device of the first device through the stored assisting relationship, and the assisting device of the first device includes the third device.
  • the method further includes:
  • the third device is the one with the highest priority among the assisting devices of the first device.
  • the manner in which the first remote assistance application in the first device displays the manipulation interfaces of the fourth application and the fifth application may refer to the manner of displaying the manipulation interface of the second application, which will not be repeated here.
  • the manner in which the remote assistance application of the first device switches and displays different control interfaces reference may be made to the manner in which the remote assistance application of the third device switches and displays different control interfaces in the foregoing embodiment.
  • FIG. 17 is a schematic flowchart of a remote assistance method provided by an embodiment of the present application, applied to a third device, and the method includes:
  • Step 1701 in response to receiving the remote assistance request, the third device starts a second remote assistance application in the third device, wherein the remote assistance request carries the application identifier of the second application used to control the second device, and the second device is In the controlled device, a control interface of the second application is displayed in the second remote assistance application.
  • Step 1702 in response to the manipulation instruction received on the manipulation interface of the second application, the third device remotely controls the second device.
  • the second remote assistance application of the third device displays a first interface, the first interface includes a first control, and the first control is used to instruct the third device to search for the electronic device;
  • the third device detects the first operation, and the first operation acts on the first control
  • the second remote assistance application of the third device displays a second interface, and the second interface displays the identifier of the searched electronic device, and the identifier of the searched electronic device includes the identifier of the first device;
  • the third device detects the second operation, and the second operation acts on the identification of the first device
  • the third device In response to the second operation, the third device sends a first request to the first device through the second remote assistance application, where the first request carries account information of the third device, and the first request is used to instruct the first device to set the third device Assisting device for the first device.
  • the third device in response to receiving the remote assistance request, starts a second remote assistance application in the third device, including:
  • the third device In response to receiving the remote assistance request, the third device displays a third interface, the third interface includes a second control and a third control, the second control is used to approve the remote assistance request, and the third control is used to reject the remote assistance request;
  • a third operation input by the user is detected, and the third operation acts on the second control
  • the third device launches a second remote assistance application in the third device.
  • the control interface in which the second application is displayed includes:
  • An entry icon of the second application is displayed in the second remote assistance application in the third device;
  • the second remote assistance application In response to the entry instruction received through the entry icon of the second application, the second remote assistance application displays a manipulation interface of the second application.
  • the third device in response to the manipulation instruction received on the manipulation interface of the second application, remotely controls the second device, including:
  • the third device In response to the manipulation instruction received on the manipulation interface of the second application, the third device sends the first manipulation instruction to the first cloud platform through the second remote assistance application, and the first manipulation instruction is used to instruct the first cloud platform to send the first manipulation instruction to the first device
  • the second manipulation command, the second manipulation command is used to instruct the first device to send the third manipulation command to the second device, and the first manipulation command, the second manipulation command and the third manipulation command are all used to instruct the second device to execute and manipulate the command corresponding operation;
  • the third device in response to the manipulation command received on the manipulation interface of the second application, the third device sends a fourth manipulation command to the first cloud platform through the second remote assistance application, and the fourth manipulation command is used to instruct the first cloud platform to send the second manipulation command to the second cloud platform.
  • the device sends a fifth manipulation instruction, and both the fourth manipulation instruction and the fifth manipulation instruction are used to instruct the second device to perform an operation corresponding to the manipulation instruction;
  • the third device in response to the manipulation command received on the manipulation interface of the second application, the third device sends a sixth manipulation command to the first cloud platform through the second remote assistance application, and the sixth manipulation command is used to instruct the first cloud platform to send the second manipulation command to the second cloud platform.
  • the cloud platform sends the seventh manipulation command, and the seventh manipulation command is used to instruct the second cloud platform to send the eighth manipulation command to the second device, wherein the sixth manipulation command, the seventh manipulation command and the eighth manipulation command are all used to instruct the first manipulation command
  • the second device executes the operation corresponding to the manipulation instruction.
  • the remote assistance request also carries an application identifier of a fourth application used to control a fourth device, where the fourth device is a controlled device, and the method further includes:
  • the third device displays the manipulation interface of the second application or the manipulation interface of the fourth application in the second remote assistance application.
  • the method further includes:
  • the application identifier of the fifth application for controlling the fifth device is received, and the third device displays a manipulation interface of the fifth application in the second remote assistance application.
  • the second remote assistance application of the third device receives application identifiers of control applications of at least two controlled devices, the at least two controlled devices include the second device and the fourth application, and the third device After displaying the first control interface of the second application through the second remote assistance application, the method further includes:
  • control interface of the second application currently displayed in the second remote assistance application of the third device is switched to the control interface of the fourth application.
  • the first device may be divided into functional units according to the foregoing method examples.
  • each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one unit.
  • the above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units. It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and other division methods may be used in actual implementation. The following is an example of dividing each functional unit corresponding to each function to illustrate:
  • the first device 1800 includes:
  • the first processing unit 1801 is configured to start a first remote assistance application after acquiring the first information, where the first information includes an application identifier of the second application used to control the second device and an application identifier used to indicate that the second device supports The identifier of the remote control, the first device is the preset assisted device, and the second device is the controlled device;
  • the remote assistance unit 1802 is configured to send a remote assistance request to a third device through the first remote assistance application, wherein the third device is an assistance device of the first device, and the remote assistance request carries the application identifier of the second application, and the remote assistance The request is used to instruct the third device to start the second remote assistance application, and to remotely control the second device based on the second remote assistance application and the second application.
  • the first processing unit 1801 is further configured to:
  • the third device as an assisting device of the first device in response to the first request, wherein the first request is sent by the third device, and the first request carries account information of the third device;
  • the assistance relationship between the first device and the third device is stored, and the assistance relationship between the first device and the third device includes: the corresponding relationship between the account information of the first device and the account information of the third device;
  • the third device sets the first device as an assisted device of the third device.
  • the first device is provided with an NFC module, and the first information is NFC tag information of the second device;
  • the first processing unit 1801 is further configured to: after acquiring the NFC tag information of the second device through the NFC module, start the first device in response to determining that the second device supports remote control according to the identifier used to indicate that the second device supports remote control The first remote assistance application in .
  • the first processing unit 1801 is further configured to: before sending a remote assistance request to the third device through the first remote assistance application, search for the assistance device of the first device, where the assistance device of the first device includes the third device. equipment.
  • the third device when there are at least two assisting devices of the first device, the third device is the one with the highest priority among the assisting devices.
  • the remote assistance unit 1802 is further configured to:
  • the first remote assistance request is sent to the first cloud platform through the first remote assistance application, the first remote assistance request carries the application identifier of the second application, and the first remote assistance request is used to instruct the first cloud platform to send the first remote assistance request to the third device.
  • Two remote assistance requests where the second remote assistance request carries the application identifier of the second application.
  • the first processing unit 1801 is configured to control the first remote assistance application to display a control interface of the second application.
  • control interface of the first remote assistance application in the first device includes a fourth control, and the fourth control is used to initiate help to the third device;
  • the first processing unit 1801 detects the fourth operation input by the user, and the fourth operation acts on the fourth control
  • the remote assistance unit 1802 is also used to:
  • the first device In response to the fourth operation, the first device sends a remote assistance request to the third device through the first remote assistance application.
  • the first processing unit 1801 is further configured to:
  • third information is obtained, where the third information includes an application identifier of the fourth application used to control the fourth device and an application identifier used to indicate that the fourth device supports remote control 's identification;
  • the remote assistance request sent to the third device by the first remote assistance application carries the application identifier of the second application and the application identifier of the fourth application.
  • the first processing unit 1801 is further configured to:
  • the fourth information includes an application identifier of a fifth application used to control the fifth device and an identifier used to characterize that the fifth device supports remote control;
  • the remote assistance unit 1802 is further configured to: send the application identifier of the fifth application to the third device.
  • the first processing unit 1801 is further configured to:
  • the first device acquires the application identifiers of the control applications of at least two controlled devices, and the at least two controlled devices include the second device and the fourth device.
  • the first remote assistance application in the first device displays the second manipulation of the second application After the interface, in response to the received second switching instruction, the control interface of the second application currently displayed in the first remote assistance application is controlled to switch to the control interface of the fourth application.
  • the first processing unit 1801 is further configured to:
  • the first information is acquired by approaching or touching the second device on the first device.
  • the third device may be divided into functional units according to the foregoing method examples.
  • each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one unit.
  • the above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units. It should be noted that the division of units in the embodiments of the present application is schematic, and is only a logical function division, and other division methods may be used in actual implementation. The following is an example of dividing each functional unit corresponding to each function to illustrate:
  • the third device 1900 includes:
  • the second processing unit 1901 is configured to start a second remote assistance application in the third device in response to receiving the remote assistance request, wherein the remote assistance request carries an application identifier of the second application used to control the second device, and the second remote assistance application
  • the device is a controlled device; the second remote assistance application displays a control interface of the second application;
  • the remote control unit 1902 is used for the third device to remotely control the second device in response to the manipulation instruction received on the manipulation interface of the second application.
  • the second processing unit 1901 is further configured to:
  • the first operation is detected, and the first operation acts on the first control
  • the second remote assistance application is controlled to display a second interface, and the second interface is displayed with an identification of the searched electronic device, and the searched identification of the electronic device includes the identification of the first device;
  • a second operation is detected, and the second operation acts on the identification of the first device
  • a first request is sent to the first device through the second remote assistance application, where the first request carries account information of the third device, and the first request is used to instruct the first device to set the third device as the first device Equipment assistance equipment.
  • the second processing unit 1901 is further configured to:
  • the third interface includes a second control and a third control, the second control is used to approve the remote assistance request, and the third control is used to reject the remote assistance request;
  • a third operation input by the user is detected, and the third operation acts on the second control
  • a second remote assistance application in the third device is launched.
  • the second processing unit 1901 is further configured to:
  • the second remote assistance application is controlled to display a manipulation interface of the second application.
  • the remote control unit 1902 is also used for:
  • the first manipulation command is sent to the first cloud platform through the second remote assistance application, wherein the first device is the assisted device of the third device, and the first manipulation command uses
  • the second manipulation instruction is used to instruct the first device to send a third manipulation instruction to the second device
  • the first manipulation instruction, the second manipulation instruction and the third manipulation instruction Both are used to instruct the second device to perform the operation corresponding to the manipulation instruction;
  • the sixth manipulation command is used to instruct the first cloud platform to send to the second cloud platform
  • the seventh manipulation instruction, the seventh manipulation instruction is used to instruct the second cloud platform to send the eighth manipulation instruction to the second device, wherein the sixth manipulation instruction, the seventh manipulation instruction and the eighth manipulation instruction are all used to instruct the second device to execute The operation corresponding to the manipulation command.
  • the remote assistance request further carries an application identifier of a fourth application used to control a fourth device, where the fourth device is a controlled device;
  • the second processing unit 1901 is also used for:
  • the manipulation interface of the second application or the manipulation interface of the fourth application is displayed in the second remote assistance application.
  • the second processing unit 1901 is further configured to:
  • An application identifier of a fifth application used to control the fifth device is received, and a manipulation interface of the fifth application is displayed in the second remote assistance application.
  • the second remote assistance application of the third device receives the application identifiers of the control applications of at least two controlled devices, where the at least two controlled devices include the second device and the fourth application, and the second process Unit 1901 is also used to:
  • the control interface of the second application currently displayed in the second remote assistance application of the third device is switched It is the control interface of the fourth application.
  • each functional unit in the embodiment may be integrated in one unit, or each unit may exist physically alone, or two or more units may be integrated in one unit, and the above-mentioned integrated units may be implemented in the form of hardware, It can also be implemented in the form of software functional units.
  • the specific names of the functional units are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of the present application.
  • Embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the foregoing method embodiments can be implemented.
  • the embodiments of the present application further provide a computer program product, which enables the first device to implement the steps in the foregoing method embodiments when the computer program product runs on the first device.
  • the integrated unit if implemented as a software functional unit and sold or used as a stand-alone product, may be stored in a computer-readable storage medium.
  • the present application realizes all or part of the processes in the methods of the above-mentioned embodiments, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can be stored in a computer-readable storage medium.
  • the steps of the foregoing method embodiments may be implemented.
  • the computer program includes computer program code
  • the computer program code may be in the form of source code, object code, executable file or some intermediate forms, and the like.
  • the computer-readable medium may include at least: any entity or device capable of carrying the computer program code to the first device, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), electrical carrier signals, telecommunications signals, and software distribution media.
  • ROM read-only memory
  • RAM random access memory
  • electrical carrier signals telecommunications signals
  • software distribution media For example, U disk, mobile hard disk, disk or CD, etc.
  • computer readable media may not be electrical carrier signals and telecommunications signals.
  • An embodiment of the present application further provides a chip system, the chip system includes a processor, the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement the steps of any method embodiment of the present application.
  • the chip system may be a single chip, or a chip module composed of multiple chips.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephone Function (AREA)
  • Selective Calling Equipment (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本申请实施例提供一种远程协助方法、电子设备、系统及存储介质，涉及远程协助技术领域，可以解决远程协助对网络质量要求高、显示效果差，以及被协助设备的存储空间被占用过多的问题。该方法包括: 作为被协助设备的第一设备获取到第一信息，启动第一设备中的第一远程协助应用，第一信息包括用于控制第二设备的第二应用的应用标识和用于表征第二设备支持远程控制的标识; 第一设备通过第一远程协助应用向作为协助设备的第三设备发送远程协助请求，远程协助请求中携带第二应用的应用标识; 第三设备接收到远程协助请求，启动第二远程协助应用，第二远程协助应用中显示第二应用的操控界面; 在操控界面接收操控指令，以对第二设备进行远程控制。

Description

一种远程协助方法、电子设备、系统及存储介质
本申请要求于2020年10月27日提交国家知识产权局、申请号为202011167175.3、申请名称为“一种远程协助方法、电子设备、系统及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及远程协助领域，尤其涉及一种远程协助方法、电子设备、系统及存储介质。
背景技术
随着物联网的发展，家居环境中增加了越来越多的电子设备。这些电子设备，既可以由用户直接操控，也可以由用户通过其他电子设备(例如手机)上配套的应用软件(Application，APP)间接操控。然而，对于一些老人而言，无论是直接操控这些电子设备，还是通过其他电子设备上配套的应用软件间接操控这些电子设备，均具有一定的难度。
目前，存在一些远程协助的方法帮助老人使用这些电子设备。例如，老人手机和子女手机建立远程协助连接；老人手机进行屏幕录制，并将录制的屏幕数据发送给子女手机；子女在子女手机上基于接收到的屏幕数据进行操作，并将操作的位置坐标发送给老人手机；老人手机基于接收到的位置坐标产生相应的控制指令，从而实现对这些电子设备的操控。然而，这种远程协助的方法对网络质量的要求非常高，导致远程协助时界面显示效果较差的问题；而且，这种基于屏幕共享的远程协助的方法，依然是通过老人手机中的配套应用软件对这些电子设备进行操控，导致老人手机中需要下载大量的配套应用软件，存储空间被占用过多。
发明内容
本申请实施例提供一种远程协助方法、电子设备、系统及存储介质，解决现有的远程协助方法对网络质量的要求较高、远程协助时显示效果较差的问题，以及被协助的电子设备存储空间被占用过多的问题。
为达到上述目的，本申请采用如下技术方案：
第一方面，本申请实施例提供一种远程协助方法，应用于包括第一设备、第二设备和第三设备的系统，第一设备为预设的被协助设备，第二设备为被控设备，第三设备为第一设备的协助设备；该方法包括：第一设备在获取到第一信息后，启动第一设备中的第一远程协助应用，其中，第一信息包括用于控制第二设备的第二应用的应用标识和用于表征第二设备支持远程控制的标识；第一设备通过第一远程协助应用向第三设备发送远程协助请求，其中，远程协助请求中携带有第二应用的应用标识；响应于接收远程协助请求，第三设备启动第三设备中的第二远程协助应用，第二远程协助应用中显示有第二应用的第一操控界面；响应于在第二应用的操控界面接收的操控指令，第三设备对第二设备进行远程控制。
本申请实施例中，第一设备可以作为需要被协助的用户使用的被协助设备，被协助用户在使用被协助设备的过程中，可以通过短距离的通信方式触发被协助设备获取到被控设备的第一信息，后续被协助用户无需在被协助设备上做进一步操作，就能够通知作为协助设备的第三设备侧的协助用户对作为被控设备的第二设备进行远程控制，简化了被协助用户的操作；而且，由于被协助设备向协助设备发送的是携带被控设备的控制应用的应用标识的远程协助请求，因此，不会对网络质量有过高的要求；最后，由于对被控设备的控制是在协助设备上完成的，因此被协助设备上可以不安装每个被控设备对应的控制应用，因此，不会过多占用被协助用户使用的被协助设备的存储空间。
在第一方面的一种可能的实现方式中，该方法还包括：第三设备的第二远程协助应用显示第一界面，第一界面包括第一控件，第一控件用于指示第三设备搜索电子设备；第三设备检测到用户输入的第一操作，第一操作作用于第一控件；响应于第一操作，第三设备的第二远程协助应用显示第二界面，第二界面显示有搜索到的电子设备的标识，搜索到的电子设备的标识中包括第一设备的标识；第三设备检测到用户输入的第二操作，第二操作作用于第一设备的标识；响应于第二操作，第三设备通过第二远程协助应用向第一设备发送第一请求，第一请求中携带有第三设备的账号信息，第一请求用于指示第一设备设置第三设备为第一设备的协助设备；响应于接收该第一请求，第一设备设置第三设备为第一设备的协助设备；第一设备存储第一设备和第三设备的协助关系，第一设备和第三设备的协助关系包括：第一设备的账号信息和第三设备的账号信息的对应关系。其中，搜索到的电子设备可以是第三设备通过蓝牙、NFC或WiFi等方式发现的周围通信范围内的一个或多个设备。
在第一方面的一种可能的实现方式中，在第一设备设置第三设备为第一设备的协助设备之后，还包括：第一设备向第三设备发送第二信息，第二信息携带有第一设备的账号信息，或者第二信息携带有第一设备的账号信息和第三设备的账号信息的协助关系；响应于接收第二信息，第三设备设置第一设备为第三设备的被协助设备；第三设备存储第一设备和第三设备的协助关系。
在本申请实施例中，可以预先为设置第一设备和第三设备的协助关系。在第一方面的一种可能的实现方式中，第一设备设有NFC模块，第一信息为第二设备的NFC标签信息，第一设备在获取到第一信息后，启动第一设备中的第一远程协助应用，包括：第一设备通过NFC模块获取到第二设备的NFC标签信息后，启动第一设备中的第一远程协助应用。
在本申请实施例中，第一设备通过NFC模块获取第二设备的NFC标签信息，这种获取第一信息的方式，无需用户在第一设备上和第二设备上进行操作。对于用户而言，简单方便。
在第一方面的一种可能的实现方式中，响应于接收远程协助请求，第三设备启动第三设备中的第二远程协助应用，包括：响应于接收远程协助请求，第三设备显示第三界面，第三界面包含有第二控件和第三控件，第二控件用于同意远程协助请求，第三控件用于拒绝远程协助请求；检测到用户输入的第三操作，第三操作作用于第二控件；响应于第三操作，第三设备启动第三设备中的第二远程协助应用。
在本申请实施例中，协助用户接收到远程协助请求后，可以提供包含有第二控件和第三控件第三界面，使得协助用户在不方便帮助被协助用户的情况下，协助用户可以通过第 三控件拒绝当前远程协助请求。第三操作可以是用户在第三界面上的触控操作，也可以是用户的语音。提供多样化的触发操作，从协助用户的角度，增强了用户体验。
在第一方面的一种可能的实现方式中，第二远程协助应用中显示有第二应用的操控界面包括：第二远程协助应用中显示有第二应用的入口图标；响应于通过第二应用的入口图标接收到的进入指令，第二远程协助应用显示第二应用的操控界面。
在第一方面的一种可能的实现方式中，系统还包括第一云平台，第一设备通过第一远程协助应用向第三设备发送远程协助请求，包括：第一设备通过第一远程协助应用向第一云平台发送第一远程协助请求，第一远程协助请求携带有第二应用的应用标识，第一远程协助请求用于指示第一云平台向第三设备发送第二远程协助请求；响应于接收第一远程协助请求，第一云平台向第三设备发送第二远程协助请求，第二远程协助请求携带有第二应用的应用标识。
在本申请实施例中，被协助用户通过第一设备向协助用户使用的第三设备求助时，通常第一设备和第三设备位于不同的空间，甚至第一设备和第三设备距离较远，因此，第一设备和第三设备不便于通过短距离通信的方式进行通信。因此，可以通过第一云平台建立第一设备和第三设备之间的通信连接。
在具体实施的过程中，第一远程协助请求和第二远程协助请求可以是相同，也可以不相同，例如，由于不同设备间采用的通信协议不同，虽然第一远程协助请求和第二远程协助请求中均携带第二应用的应用标识，然而，第一远程协助请求和第二远程协助请求中携带的其他信息或者封装格式均可能存在不同。在本申请的具体实施方式中，均以第一远程协助请求和第二远程协助请求相同为例说明远程协助请求的传输过程，并不表示限定了第一远程协助请求和第二远程协助请求相同。
在第一方面的一种可能的实现方式中，系统还包括第一云平台，响应于在第二应用的第一操控界面接收的操控指令，第三设备对第二设备进行远程控制，包括：响应于在第二应用的操控界面接收的第一操控指令，第三设备通过第二远程协助应用向第一云平台发送第一操控指令，第一操控指令用于指示第二设备执行与操控指令对应的操作；响应于接收第一操控指令，第一云平台向第一设备发送第二操控指令，第二操控指令用于指示第二设备执行与操控指令对应的操作；响应于接收第二操控指令，第一设备向第二设备发送第三操控指令，第三操控指令用于指示第二设备执行与操控指令对应的操作。
在本申请实施例中，从第三设备至第二设备的操控指令的传输路径为：第三设备、第一云平台、第一设备、第二设备。由于不同设备间的传输协议可能存在不同，导致第一操控指令、第二操控指令和第三操控指令之间可能存在以下三种情况：全部相同、部分相同、全部不相同。然而，第一操控指令、第二操控指令和第三操控指令均用于指示第二设备执行与操控指令对应的操作。本申请的具体实施例中以第一操控指令、第二操控指令和第三操控指令完全相同为例说明操控指令的传输过程。然而，并不表示限定了第一操控指令、第二操控指令和第三操控指令完全相同。
在第一方面的一种可能的实现方式中，第一信息还包括第二设备的设备标识；在第一设备向第二设备发送第三操控指令之前，该方法还包括：第一设备基于第二设备的设备标识和第一设备建立连接。
在本申请实施例中，若需要通过第一设备向第二设备发送第三操控指令，则需要预先 在第一设备和第二设备之间建立连接。
在第一方面的一种可能的实现方式中，系统还包括第一云平台；
响应于在第二应用的第一操控界面接收的操控指令，第三设备对第二设备进行远程控制，包括：
响应于在第二应用的操控界面接收的操控指令，第三设备通过第二远程协助应用向第一云平台发送第四操控指令，第四操控指令用于指示第二设备执行与操控指令对应的操作；响应于接收第四操控指令，第一云平台向第二设备发送第五操控指令，第五操控指令用于指示第二设备执行与操控指令对应的操作；
或；
响应于在第二应用的第一操控界面接收的操控指令，第三设备通过第二远程协助应用向第一云平台发送第六操控指令，第六操控指令用于指示第二设备执行与操控指令对应的操作；响应于接收第六操控指令，第一云平台向第二云平台发送第七操控指令，第七操控指令用于指示第二设备执行与操控指令对应的操作，第七操控指令用于指示第二云平台向第二设备发送第八操控指令，第八操控指令用于指示第二设备执行与操控指令对应的操作。
在本申请实施例中，提供了多种方式实现操控指令从协助设备到被控设备的传输。提高了本申请实施时的灵活性。本申请实施例中，第一操控指令至第八操控指令也可能存在如下几种情况：完全相同、部分相同、完全不相同。在本申请具体的实施例中，以第一操控指令至第八操控指令相同为例说明操控指令的传输过程，并不表示限定了第一操控指令至第八操控指令相同。另外，为了便于区分，将第三设备的第二远程协助应用显示的第二应用的操控界面记为第一操控界面，将第一设备的第一远程协助应用显示的第一应用的操控界面记为第二操控界面。第一操控界面和第二操控界面的功能相同，由于第一设备和第三设备的操作系统可能不同，因此，第一操控界面和第二操控界面的布局和/或显示的内容可能存在一些不同。在具体实施方式中，虽然均以操控界面为例，然而，并不表示限定了第一操控界面和第二操控界面一定相同。
在第一方面的一种可能的实现方式中，在第一设备启动第一设备中的第一远程协助应用之后，该方法还包括：第一设备中的第一远程协助应用显示第二应用的第二操控界面。
在本申请实施例中，对于被协助用户使用的第一设备，也可以显示第二应用的第二操控界面，从而使得被协助用户也可以在第一设备上显示的第二应用的第二操控界面输入操控指令，提供了更加灵活的控制第二设备的方式。
在第一方面的一种可能的实现方式中，该方法还包括：第一设备中的第一远程协助应用的操控界面包括第四控件，其中，第四控件用于向第三设备发起求助；响应于第四操作，第一设备通过第一远程协助应用向第三设备发送远程协助请求，第四操作作用于第四控件。
在本申请实施例中，通过在被协助设备的第一远程协助应用的操控界面中设置第四控件以向第三设备发起求助；提高了本申请实施例提供的远程协助方法在实施时的灵活性。
在第一方面的一种可能的实现方式中，在第一设备通过第一远程协助应用向第三设备发送远程协助请求之前，该方法还包括：第一设备获取到第三信息，第三信息包括用于控制第四设备的第四应用的应用标识和用于表征第四设备支持远程控制的标识；第一设备通过第一远程协助应用显示第四应用的操控界面；第一设备通过第一远程协助应用向第三设备发送远程协助请求，具体为：第一设备通过第一远程协助应用向第三设备发送远程协助 请求，远程协助请求中携带有第二应用的应用标识和第四应用的应用标识。
在本申请实施例中，被协助用户可以控制第一设备靠近多个被控设备获得多个被控设备的信息(例如，第一信息、一个或多个第三信息)，然后再发起求助，使得一次求助过程能够实现对多个被控设备的控制；提供多样化的远程协助方式。
在第一方面的一种可能的实现方式中，在第一设备通过第一远程协助应用向第三设备发送远程协助请求之后，还包括：第一设备获取到第四信息，第四信息包括用于控制第五设备的第五应用的应用标识和用于表征第五设备支持远程控制的标识；第一设备通过第一远程协助应用显示第五应用的操控界面；第一设备向第三设备发送第五应用的应用标识。
在本申请实施例中，即使用户已经通过第一设备向第三设备发起求助，用户也可以控制第一设备靠近至少一个被控设备获得该至少一个被控设备的信息(例如，至少一个第四信息)，此种情况下，无需被协助用户再次发起求助。提供多样化的远程协助方式。
在第一方面的一种可能的实现方式中，第三设备的第二远程协助应用接收到至少两个被控设备的控制应用的应用标识，至少两个被控设备包括第二设备和第四设备，第三设备通过第二远程协助应用显示第二应用的第一操控界面之后，方法还包括：响应于接收到的第一切换指令，第三设备的第二远程协助应用中显示的第二应用的第一操控界面切换为第四应用的操控界面。
在第一方面的一种可能的实现方式中，第三设备的第二远程协助应用接收到至少两个被控设备的控制应用的应用标识后，其中，至少两个被控设备包括第二设备时，至少两个被控设备的控制应用包括第二应用，至少两个被控设备包括第四设备时，至少两个被控设备的控制应用包括第四应用，至少两个被控设备包括第五设备时，至少两个被控设备的控制应用包括第五应用，方法还包括：
第三设备通过第二远程协助应用显示第一个操控界面，其中，第一个操控界面为至少两个被控设备的控制应用的操控界面中的任一个；
响应于接收到的第一切换指令，第三设备的第二远程协助应用中显示的第一个操控界面切换为第二个操控界面，其中，第二个操控界面为至少两个被控设备的控制应用的操控界面中除第一个操控界面外的任一个。
在本申请实施例中，第三设备接收到至少两个被控设备的控制应用的应用标识的情况，可以以切换显示的方式显示多个被控设备的控制应用的操控界面。
在第一方面的一种可能的实现方式中，该方法还包括：第一设备通过靠近或触碰第二设备，获取第一信息。
本申请实施例中，第一设备通过靠近或触碰第二设备获取第一信息的方式可以是NFC的方式、蓝牙靠近发现的方式和Wi-Fi Aware的靠近发现。
在第一方面的一种可能的实现方式中，第一设备通过第一远程协助应用向第三设备发送远程协助请求之前，方法还包括：第一设备通过存储的协助关系查找第一设备的协助设备，第一设备的协助设备包括第三设备。
在本申请实施例中，第一设备和第三设备之间的协助关系已经预先存储在第一设备中，且第一设备和第三设备的协助关系确定了第一设备为第三设备的被协助设备，第三设备为第一设备的协助设备。因此，第一设备可以查找预先存储的第一设备的协助设备。
在第一方面的一种可能的实现方式中，该方法还包括：当第一设备的协助设备为至少 两个时，第三设备为第一设备的协助设备中优先级最高的一个。
在本申请实施例中，一个第一设备可以设置多个协助设备，例如，老人的多个子女的手机均可以被设置为老人手机的协助设备，并且，多个协助设备还可以进行优先级排序，每次可以向优先级最高的协助设备发起求助，在向优先级最高的协助设备求助不成功的情况下，可以向优先级次高的协助设备发起求助。增强了本申请实施例提供的远程协助方法实施时的用户体验。
第二方面，本申请实施例提供一种远程协助方法，应用于第一设备，该方法包括：第一设备在获取到第一信息后，启动第一设备中的第一远程协助应用，其中，第一信息包括用于控制第二设备的第二应用的应用标识和用于表征第二设备支持远程控制的标识，第一设备为预设的被协助设备，第二设备为被控设备；第一设备通过第一远程协助应用向第三设备发送远程协助请求，其中，第三设备为第一设备的协助设备，远程协助请求中携带有第二应用的应用标识，远程协助请求用于指示第三设备启动第二远程协助应用，并基于第二远程协助应用和第二应用对第二设备进行远程控制。
在第二方面的一种可能的实现方式中，响应于接收第一请求，第一设备设置第三设备为第一设备的协助设备，其中，第一请求为第三设备向第一设备发送的，第一请求中携带有第三设备的账号信息；第一设备存储第一设备和第三设备的协助关系，第一设备和第三设备的协助关系包括：第一设备的账号信息和第三设备的账号信息的对应关系；第一设备向第三设备发送第二信息，第二信息携带有第一设备的账号信息，或者第二信息携带有第一设备的账号信息和第三设备的账号信息的对应关系；第二信息用于指示第三设备设置第一设备为第三设备的被协助设备。
在第二方面的一种可能的实现方式中，第一设备设有NFC模块，第一信息为第二设备的NFC标签信息，第一设备在获取到第一信息后，响应于根据用于表征第二设备支持远程控制的标识确定第二设备支持远程控制，启动第一设备中的第一远程协助应用，包括：第一设备通过NFC模块获取到第二设备的NFC标签信息后，启动第一设备中的第一远程协助应用。
在第二方面的一种可能的实现方式中，第一设备通过第一远程协助应用向第三设备发送远程协助请求包括：第一设备通过第一远程协助应用向第一云平台发送第一远程协助请求，第一远程协助请求携带有第二应用的应用标识，第一远程协助请求用于指示第一云平台向第三设备发送第二远程协助请求，第二远程协助请求携带有第二应用的应用标识。
在第二方面的一种可能的实现方式中，在第一设备启动第一设备中的第一远程协助应用之后，该方法还包括：第一设备中的第一远程协助应用显示第二应用的操控界面。
在第二方面的一种可能的实现方式中，该方法还包括：第一设备中的第一远程协助应用的操控界面包括第四控件，其中，第四控件用于向第三设备发起求助；检测到用户输入的第四操作，第四操作作用于第四控件；响应于第四操作，第一设备通过第一远程协助应用向第三设备发送远程协助请求。
在第二方面的一种可能的实现方式中，在第一设备通过第一远程协助应用向第三设备发送远程协助请求之前，该方法还包括：第一设备获取到第三信息，第三信息包括用于控制第四设备的第四应用的应用标识和用于表征第四设备支持远程控制的标识；第一设备通过第一远程协助应用显示第四应用的操控界面；第一设备通过第一远程协助应用向第三设 备发送远程协助请求，具体为：第一设备通过第一远程协助应用向第三设备发送远程协助请求，远程协助请求中携带有第二应用的应用标识和第四应用的应用标识。
在第二方面的一种可能的实现方式中，在第一设备通过第一远程协助应用向第三设备发送远程协助请求之后，还包括：第一设备获取到第四信息，第一设备通过第一远程协助应用显示第五应用的操控界面，其中，第四信息包括用于控制第五设备的第五应用的应用标识和用于表征第五设备支持远程控制的标识；第一设备通过第一远程协助应用显示第五应用的操控界面；第一设备向第三设备发送第五应用的应用标识。
在第二方面的一种可能的实现方式中，第一设备获取到至少两个被控设备的控制应用的应用标识，至少两个被控设备包括第二设备和第四设备第一设备中的第一远程协助应用显示第二应用的第二操控界面之后，方法还包括：响应于接收到的第二切换指令，第一设备的第一远程协助应用中当前显示的第二应用的操控界面切换为第四应用的操控界面。
在第二方面的一种可能的实现方式中，该方法还包括：第一设备通过靠近或触碰第二设备，获取第一信息。
在第二方面的一种可能的实现方式中，第一设备通过第一远程协助应用向第三设备发送远程协助请求之前，方法还包括：第一设备通过存储的协助关系查找第一设备的协助设备，第一设备的协助设备包括第三设备。
在第二方面的一种可能的实现方式中，方法还包括：当第一设备的协助设备为至少两个时，第三设备为第一设备的协助设备中优先级最高的一个。
第三方面，本申请实施例提供一种远程协助方法，应用于第三设备，该方法包括：响应于接收远程协助请求，第三设备启动第三设备中的第二远程协助应用，其中，远程协助请求为第一设备通过第一远程协助应用向第三设备发送的，远程协助请求中携带有用于控制第二设备的第二应用的应用标识；第三设备中的第二远程协助应用中显示有第二应用的操控界面；响应于在第二应用的操控界面接收的操控指令，第三设备对第二设备进行远程控制。
在第三方面的一种可能的实现方式中，该方法还包括：第三设备的第二远程协助应用显示第一界面，第一界面包括第一控件，第一控件用于指示第三设备搜索电子设备；第三设备检测到第一操作，第一操作作用于第一控件；响应于第一操作，第三设备的第二远程协助应用显示第二界面，第二界面显示有搜索到的电子设备的标识，搜索到的电子设备的标识中包括第一设备的标识；第三设备检测到第二操作，第二操作作用于第一设备的标识；响应于第二操作，第三设备通过第二远程协助应用向第一设备发送第一请求，第一请求中携带有第三设备的账号信息，第一请求用于指示第一设备设置第三设备为第一设备的协助设备。
在第三方面的一种可能的实现方式中，响应于接收远程协助请求，第三设备启动第三设备中的第二远程协助应用，包括：响应于接收远程协助请求，第三设备显示第三界面，第三界面包含有第二控件和第三控件，第二控件用于同意远程协助请求，第三控件用于拒绝远程协助请求；检测到用户输入的第三操作，第三操作作用于第二控件；响应于第三操作，第三设备启动第三设备中的第二远程协助应用。
在第三方面的一种可能的实现方式中，第三设备中的第二远程协助应用中显示有第二应用的操控界面包括：第三设备中的第二远程协助应用中显示有第二应用的入口图标；响 应于通过第二应用的入口图标接收到的进入指令，第二远程协助应用显示第二应用的操控界面。
在第三方面的一种可能的实现方式中，响应于在第二应用的操控界面接收的操控指令，第三设备对第二设备进行远程控制，包括：
响应于在第二应用的操控界面接收的操控指令，第三设备通过第二远程协助应用向第一云平台发送第一操控指令，第一操控指令用于指示第一云平台向第一设备发送第二操控指令，第二操控指令用于指示第一设备向第二设备发送第三操控指令，第一操控指令、第二操控指令和第三操控指令均用于指示第二设备执行与操控指令对应的操作；
或，响应于在第二应用的操控界面接收的操控指令，第三设备通过第二远程协助应用向第一云平台发送第四操控指令，第四操控指令用于指示第一云平台向第二设备发送第五操控指令，第四操控指令和第五操控指令均用于指示第二设备执行与操控指令对应的操作；
或，响应于在第二应用的操控界面接收的操控指令，第三设备通过第二远程协助应用向第一云平台发送第六操控指令，第六操控指令用于指示第一云平台向第二云平台发送第七操控指令，第七操控指令用于指示第二云平台向第二设备发送第八操控指令，其中，第六操控指令、第七操控指令和第八操控指令均用于指示第二设备执行与操控指令对应的操作。
在第三方面的一种可能的实现方式中，远程协助请求中还携带有用于控制第四设备的第四应用的应用标识，其中，第四设备为被控设备，该方法还包括：第三设备在第二远程协助应用中显示第二应用的操纵界面或第四应用的操控界面。
在第三方面的一种可能的实现方式中，在第三设备启动第三设备中的第二远程协助应用之后，还包括：接收用于控制第五设备的第五应用的应用标识，第三设备在第二远程协助应用中显示第五应用的操控界面。
在第三方面的一种可能的实现方式中，第三设备的第二远程协助应用接收到至少两个被控设备的控制应用的应用标识，至少两个被控设备包括第二设备和第四应用，第三设备通过第二远程协助应用显示第二应用的第一操控界面之后，方法还包括：响应于接收到的第一切换指令，第三设备的第二远程协助应用中当前显示的第二应用的操控界面切换为第四应用的操控界面。
第四方面，提供一种电子设备，包括：
第一远程协助应用启动单元，用于在获取到第一信息后，启动第一远程协助应用，其中，第一信息包括用于控制第二设备的第二应用的应用标识和用于表征第二设备支持远程控制的标识，第一设备为预设的被协助设备，第二设备为被控设备；
远程协助单元，用于通过第一远程协助应用向第三设备发送远程协助请求，其中，第三设备为第一设备的协助设备，远程协助请求中携带有第二应用的应用标识，远程协助请求用于指示第三设备启动第二远程协助应用。
第五方面，提供一种电子设备，包括：
第二远程协助应用启动单元，用于响应于接收远程协助请求，启动第三设备中的第二远程协助应用，其中，远程协助请求为第一设备通过第一远程协助应用向第三设备发送的，远程协助请求中携带有用于控制第二设备的第二应用的应用标识，第二设备为被控设备；第二远程协助应用中显示有第二应用的操控界面；
远程控制单元，用于响应于在第二应用的操控界面接收的操控指令，第三设备对第二设备进行远程控制。
第六方面，提供一种电子设备，包括处理器，处理器用于运行存储器中存储的计算机程序，实现本申请第二方面任一项的方法。
第七方面，提供一种电子设备，包括处理器，处理器用于运行存储器中存储的计算机程序，实现本申请第三方面任一项的方法。
第八方面，提供一种远程协助系统，包括第六方面提供的电子设备和第七方面提供的电子设备。
第九方面，提供一种芯片系统，包括处理器，处理器与存储器耦合，处理器执行存储器中存储的计算机程序，以实现本申请第二方面任一项的方法和/或第三方面任一项的方法。
第十方面，提供一种计算机可读存储介质，计算机可读存储介质存储有计算机程序，计算机程序被一个或多个处理器执行时实现本申请第二方面任一项的方法和/或第三方面任一项的方法。
第十一方面，本申请实施例提供了一种计算机程序产品，当计算机程序产品在设备上运行时，使得设备执行本申请第二方面任一项的方法和/或第三方面任一项的方法。
可以理解的是，上述第二方面至第十一方面的有益效果可以参见上述第一方面中的相关描述，在此不再赘述。
附图说明
图1为本申请实施例提供的远程协助方法的一种应用场景示意图；
图2为本申请实施例提供的执行远程协助方法的一种电子设备的硬件结构示意图；
图3为本申请实施例提供的一种远程协助方法的流程示意图；
图4为本申请实施例提供的一种远程协助方法的应用场景示意图；
图5为图4所示实施例的步骤1表示的一种绑定两个电子设备的过程示意图；
图6为图4所示实施例的步骤3表示的一种被协助设备与协助设备建立远程协助会话的过程示意图；
图7为图4所示实施例中被协助设备和协助设备的显示界面的示意图；
图8为本申请实施例提供的一种远程协助方法的技术架构图；
图9为基于图8所示实施例提供的一种技术架构图的远程协助方法的时序过程示意图；
图10为本申请实施例提供的另一种远程协助方法的技术架构图；
图11为基于图10所示实施例提供的一种技术架构图的远程协助方法的时序过程示意图；
图12为本申请实施例提供的一种远程协助方法的应用场景示意图；
图13为本申请实施例提供的一种远程协助方法的应用场景示意图；
图14为本申请实施例提供的一种远程协助方法的应用场景示意图；
图15为本申请实施例提供的第一设备显示控制应用的操控界面的过程示意图；
图16为本申请实施例提供的以第一设备为执行主体的远程协助方法的流程示意图；
图17为本申请实施例提供的以第三设备为执行主体的远程协助方法的流程示意图；
图18为本申请实施例提供的执行远程协助方法的第一设备的功能架构单元化的示意性框图；
图19为本申请实施例提供的执行远程协助方法的第三设备的功能架构单元化的示意性框图。
具体实施方式
以下描述中，为了说明而不是为了限定，提出了诸如特定系统结构、技术之类的具体细节，以便透彻理解本申请实施例。然而，本领域的技术人员应当清楚，在没有这些具体细节的其它实施例中也可以实现本申请。
应当理解，当在本申请说明书和所附权利要求书中使用时，术语“包括”指示所描述特征、整体、步骤、操作、元素和/或组件的存在，但并不排除一个或多个其它特征、整体、步骤、操作、元素、组件和/或其集合的存在或添加。
还应当理解，在本申请实施例中，“一个或多个”是指一个、两个或两个以上；“和/或”，描述关联对象的关联关系，表示可以存在三种关系；例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B的情况，其中A、B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。
另外，在本申请说明书和所附权利要求书的描述中，术语“第一”、“第二”、“第三”、“第四”等仅用于区分描述，而不能理解为指示或暗示相对重要性。
在本申请说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此，在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例，而是意味着“一个或多个但不是所有的实施例”，除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”，除非是以其他方式另外特别强调。
本申请实施例提供的远程协助方法可以应用在图1所示的应用场景中。如图1所示，智能音箱等电子设备可以作为被控设备，被控设备上设置NFC(Near Field Communication)模块。手机1可以作为被协助设备供被协助用户使用，手机1设置NFC模块。智能音箱和手机1位于同一空间，例如，智能音响和手机1位于手机1对应的被协助用户的家里。手机2与手机1位于不同的空间，例如，手机2位于手机2对应的协助用户的家里或公司等。手机2作为协助设备供协助用户使用，例如，当被协助用户为老人时，协助用户可以是老人的子女。
当被协助用户需要操控智能音箱时，可以通过被协助用户使用的手机1贴近智能音箱，手机1接收智能音箱的NFC标签信息，该NFC标签信息中包含了智能音箱的控制应用的应用标识以及智能音箱支持远程控制的标识，手机1向手机2发送携带有智能音箱的控制应用的应用标识的远程协助请求，手机2基于接收到的应用标识对应的控制应用实现对智能音箱的远程控制。
需要说明，为了后续方便描述，被协助设备贴近被控设备以获得被控设备的NFC标签信息的场景后续将用“碰一碰”场景代替。
另外，图1所示的远程协助的方法的应用场景仅用于示例，并不对本申请实施例造成任何限制。
本申请实施例提供的一种远程协助方法可以适用于多个电子设备组成的系统中。该系统中的电子设备不局限于上述应用场景中描述的手机1和手机2，还可以是其他电子设备， 例如，平板电脑、可穿戴设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)等电子设备。本申请实施例对电子设备的具体类型不作限定。
图2示出了一种电子设备的结构示意图。电子设备200可以包括处理器210，内部存储器221，天线1，天线2，移动通信模块250，无线通信模块260，音频模块270，扬声器270A，受话器270B，麦克风270C，耳机接口270D，传感器模块280，指示器292，摄像头293，显示屏294，以及用户标识模块(subscriber identification module，SIM)卡接口295等。其中传感器模块280可以包括压力传感器280A，磁传感器280D，距离传感器280F，触摸传感器280K等。
可以理解的是，本申请实施例示意的结构并不构成对电子设备200的具体限定。在本申请另一些实施例中，电子设备200可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器210可以包括一个或多个处理单元，例如：处理器210可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。处理器210用于执行本申请实施例中的远程协助方法，例如，下述步骤301～步骤304等。
其中，控制器可以是电子设备200的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。
处理器210中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器210中的存储器为高速缓冲存储器。该存储器可以保存处理器210刚用过或循环使用的指令或数据。如果处理器210需要再次使用该指令或数据，可从存储器中直接调用。避免了重复存取，减少了处理器210的等待时间，提高了系统的效率。
在一些实施例中，处理器210可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口等。
I2C接口是一种双向同步串行总线，包括一根串行数据线(serial data line，SDA)和一根串行时钟线(derail clock line，SCL)。在一些实施例中，处理器210可以包含多组I2C总线。处理器210可以通过不同的I2C总线接口分别耦合触摸传感器280K，充电器，闪光灯，摄像头293等。例如：处理器210可以通过I2C接口耦合触摸传感器280K，使处理器210与触摸传感器280K通过I2C总线接口通信，实现电子设备200的触摸功能，例如，本申请实施例中协助用户通过触摸第三设备的显示屏显示的控制应用的操控界面生成操控指令。
I2S接口可以用于音频通信。在一些实施例中，处理器210可以包含多组I2S总线。处理器210可以通过I2S总线与音频模块270耦合，实现处理器210与音频模块270之间的通信。在一些实施例中，音频模块270可以通过I2S接口向无线通信模块260传递音频信号，实现通过蓝牙耳机接听电话的功能。例如，被协助用户通过耳机接听协助用户的视频或音频会话中声音信息。
PCM接口也可以用于音频通信，将模拟信号抽样，量化和编码。在一些实施例中，音频模块270与无线通信模块260可以通过PCM总线接口耦合。
在一些实施例中，音频模块270也可以通过PCM接口向无线通信模块260传递音频信号，实现通过蓝牙耳机接听电话的功能。I2S接口和PCM接口都可以用于音频通信。
UART接口是一种通用串行数据总线，用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。
在一些实施例中，UART接口通常被用于连接处理器210与无线通信模块260。
可以理解的是，本申请实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对电子设备200的结构限定。在本申请另一些实施例中，电子设备200也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。
电子设备200的无线通信功能可以通过天线1，天线2，移动通信模块250，无线通信模块260，调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备200中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。
移动通信模块250可以提供应用在电子设备200上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块250可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块250可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块250还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。
在一些实施例中，移动通信模块250的至少部分功能模块可以被设置于处理器210中。在一些实施例中，移动通信模块250的至少部分功能模块可以与处理器210的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中，调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后，被传递给应用处理器。应用处理器通过音频设备(不限于扬声器270A，受话器270B等)输出声音信号，或通过显示屏294显示图像或视频。在一些实施例中，调制解调处理器可以是独立的器件。在另一些实施例中，调制解调处理器可以独立于处理器210，与移动通信模块250或其他功能模块设置在同一个器件中。
无线通信模块260可以提供应用在电子设备200上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(blue tooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无 线通信的解决方案。无线通信模块260可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块260经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器210。无线通信模块260还可以从处理器210接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。例如，被协助设备可以通过其中的蓝牙或Wi-Fi模块向被控设备传输操控指令。
在一些实施例中，电子设备200的天线1和移动通信模块250耦合，天线2和无线通信模块260耦合，使得电子设备200可以通过无线通信技术与网络以及其他设备通信。无线通信技术可以包括全球移动通讯系统(global system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，BT，GNSS，WLAN，NFC，FM，和/或IR技术等。GNSS可以包括全球卫星定位系统(global positioning system，GPS)，全球导航卫星系统(global navigation satellite system，GLONASS)，北斗卫星导航系统(beidou navigation satellite system，BDS)，准天顶卫星系统(quasi-zenith satellite system，QZSS)和/或星基增强系统(satellite based augmentation systems，SBAS)。
电子设备200通过GPU，显示屏294，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏294和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器210可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏294用于显示图像，视频等。显示屏294包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，电子设备200可以包括1个或N个显示屏294，N为大于1的正整数。
例如，被协助设备和协助设备之间的视频会话，可以通过ISP，摄像头293，视频编解码器，GPU，显示屏294以及应用处理器等实现。
ISP用于处理摄像头293反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头293中。
摄像头293用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一些实施例中，电子设备200可以包括1个或N个摄像头293，N为大于1的正整数。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。
视频编解码器用于对数字视频压缩或解压缩。电子设备200可以支持一种或多种视频编解码器。这样，电子设备200可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。
内部存储器221可以用于存储计算机可执行程序代码，可执行程序代码包括指令。处理器210通过运行存储在内部存储器221的指令，从而执行电子设备200的各种功能应用以及数据处理。内部存储器221可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如被控设备的控制应用等)。存储数据区可存储电子设备200使用过程中所创建的数据。
此外，内部存储器221可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。
电子设备200可以通过音频模块270，扬声器270A，受话器270B，麦克风270C，耳机接口270D，以及应用处理器等实现音频功能。例如被协助设备和协助设备之间的音频会话等。
音频模块270用于将数字音频信号转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块270还可以用于对音频信号编码和解码。在一些实施例中，音频模块270可以设置于处理器210中，或将音频模块270的部分功能模块设置于处理器210中。
扬声器270A，也称“喇叭”，用于将音频电信号转换为声音信号。电子设备200可以通过扬声器270A收听音乐，或收听免提通话。
受话器270B，也称“听筒”，用于将音频电信号转换成声音信号。当电子设备200接听电话或语音信息时，可以通过将受话器270B靠近人耳接听语音。
麦克风270C，也称“话筒”，“传声器”，用于将声音信号转换为电信号。当拨打电话或发送语音信息时，用户可以通过人嘴靠近麦克风270C发声，将声音信号输入到麦克风270C。电子设备200可以设置至少一个麦克风270C。在另一些实施例中，电子设备200可以设置两个麦克风270C，除了采集声音信号，还可以实现降噪功能。在另一些实施例中，电子设备200还可以设置三个，四个或更多麦克风270C，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。
耳机接口270D用于连接有线耳机。耳机接口270D可以是USB接口230，也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform，OMTP)标准接口，美国蜂窝电信工业协会(cellular telecommunications industry association of the USA，CTIA)标准接口。
压力传感器280A用于感受压力信号，可以将压力信号转换成电信号。在一些实施例中，压力传感器280A可以设置于显示屏294。压力传感器280A的种类很多，如电阻式压力传感器，电感式压力传感器，电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器280A，电极之间的电容改变。电子设备200根据电容的变化确定压力的强度。当有触摸操作作用于显示屏294，电子设备200根据压力传感器280A检测触摸操作强度。电子设备200也可以根据压力传感器280A的检测信号计算触摸的位置。
距离传感器280F，用于测量距离。电子设备200可以通过红外或激光测量距离。在一些实施例中，被协助设备可以利用蓝牙测距的方式接受NFC标签信息，蓝牙测距时通过距离传感器280F测距。
触摸传感器280K，也称“触控面板”。触摸传感器280K可以设置于显示屏294，由触摸传感器280K与显示屏294组成触摸屏，也称“触控屏”。触摸传感器280K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏294提供与触摸操作相关的视觉输出。在另一些实施例中，触摸传感器280K也可以设置于电子设备200的表面，与显示屏294所处的位置不同。
SIM卡接口295用于连接SIM卡。SIM卡可以通过插入SIM卡接口295，或从SIM卡接口295拔出，实现和电子设备200的接触和分离。电子设备200可以支持1个或N个SIM卡接口，N为大于1的正整数。SIM卡接口295可以支持Nano SIM卡，Micro SIM卡，SIM卡等。同一个SIM卡接口295可以同时插入多张卡。多张卡的类型可以相同，也可以不同。SIM卡接口295也可以兼容不同类型的SIM卡。SIM卡接口295也可以兼容外部存储卡。电子设备200通过SIM卡和网络交互，实现通话以及数据通信等功能。在一些实施例中，电子设备200采用eSIM，即：嵌入式SIM卡。eSIM卡可以嵌在电子设备200中，不能和电子设备200分离。
本申请实施例并未特别限定一种远程协助方法的执行主体的具体结构，只要可以通过运行记录有本申请实施例的一种远程协助方法的代码的程序，以根据本申请实施例提供的一种远程协助方法进行通信即可。例如，本申请实施例提供的一种远程协助方法的执行主体可以是电子设备中能够调用程序并执行程序的功能模块，或者为应用于电子设备中的通信装置，例如，芯片。
下面将对本申请实施例提供的远程协助方法进行详细的描述。为了便于描述，图1对应的应用场景中的被协助设备(手机1)可以记为第一设备，协助设备(手机2)可以记为第三设备，图1对应的应用场景中的被控设备(智能音箱)可以记为第二设备，图1对应应用场景中的被控设备的控制应用可以记为第二应用，本申请实施例提供的远程协助系统包括：第一设备和第三设备，也可以包括第二设备。
参见图3，图3为本申请实施例提供的一种远程协助方法的流程示意图，如图所示，该方法包括：
步骤301，第一设备在获取到第一信息后，启动第一设备中的第一远程协助应用，其中，第一设备为预设的被协助设备，第一信息包括用于控制第二设备的第二应用的应用标识和用于表征第二设备支持远程控制的标识，第二设备为被控设备。
在本申请实施例中，第一设备作为被协助设备获取第一信息的方式，可以是通过短距离的通信方式获取。作为举例，可以通过Wi-Fi Aware无线感知的方式，也可以通过蓝牙测距的方式，还可以通过NFC的方式。
第一信息还可以包括第二设备的设备标识。第二设备的设备标识用于在后续的步骤304中，第三设备对第二设备进行远程控制时，基于该设备标识确定待远程控制的第二设备。
以第一设备获取第一信息的方式为NFC的方式为例，所述第一信息可以是第二设备的NFC标签信息。
作为举例，NFC标签信息包含至少三个字段，第一字段为：第二应用的应用标识，第二字段为：第二设备的设备标识，第三字段为：第二设备是否支持远程控制的标识。
在本申请实施例提供的远程协助方法实施之前，需要预先将第一设备设置为被协助设备，可以理解为：预先被设置为被协助设备的电子设备为第一设备。预先将第三设备设置为第一设备的协助设备，可以理解为：预先被设置为第一设备的协助设备的电子设备为第三设备。在第一设备预先被设置为被协助设备的情况下，第一设备获取到第一信息，若第一信息中表征第二设备是否支持远程控制的标识为“第二设备支持远程控制”，则第一设备会启动第一设备中的第一远程协助应用。第一信息中表征第二设备是否支持远程控制的标识为“第二设备不支持远程控制”，则第一设备会启动第一信息中的应用标识对应的第二应用，第二应用用于控制第二设备。在第一设备预先未被设置为被协助设备的情况下，第一设备获取到第一信息，即使第一信息中表征第二设备是否支持远程控制的标识为“第二设备支持远程控制”，第一设备不会启动第一远程协助应用，而是会启动与第一信息中的应用标识对应的第二应用，即用于控制第二设备的第二应用。
步骤302，第一设备通过第一远程协助应用向第三设备发送远程协助请求，该远程协助请求中携带有第二应用的应用标识，第三设备为第一设备的协助设备。
在本申请实施例中，远程协助请求可以包含以下内容：远程协助请求命令、第二应用的应用标识、以及与第二应用的应用标识一一对应的第二设备的设备标识。
在此需要说明，第一设备接收到的NFC标签信息中包括的内容可能多于远程协助请求中携带的信息，例如，NFC标签信息中的第一字段和第二字段可以携带在远程协助请求中，而第三字段无需携带在远程协助请求中。
步骤303，第三设备在接收到远程协助请求后，启动第三设备中的第二远程协助应用，在所述第二远程协助应用中显示所述第二应用的操控界面。
在本申请实施例中，第三设备接收到远程协助请求后，第三设备可以显示界面，该界面中存在同意或拒绝该远程协助请求的选项，协助用户通过第三设备显示的该界面同意该远程协助请求后，表示第一设备与第三设备之间建立远程协助会话。
第三设备的该界面接收到同意所述远程协助请求的信息后，所述第三设备启动所述第三设备中的第二远程协助应用，所述第三设备的第二远程协助应用可以显示远程协助请求中携带的应用标识对应的第二应用的操控界面。
第三设备需要获取远程协助请求中的应用标识对应的第二应用，具体获取的方式可以是从预设服务器下载，还可以从第三设备的存储空间中获取。在第三设备的存储空间中存在第二应用的情况下，第三设备的第二远程协助应用可以显示第二应用的操控界面，以对第二设备进行远程控制。
在此需要说明，某个应用标识可能是微波炉的控制应用的应用标识。然而，由于即使同一厂商同一型号的微波炉的控制应用可能存在多个版本(例如，低版本、不断升级的中间版本、当前的最高版本)，不同的协助设备基于应用标识下载的控制应用可能属于不同的版本。当被协助设备也需要下载应用标识对应的控制应用时，被协助设备和协助设备分别下载的控制应用的版本也可能不相同。实际上，无论下载的控制应用属于何种版本，均可以对被控设备进行控制，因此，本申请实施例中的第二应用包含了用于控制第二设备的各个版本的控制应用。
对于同一电子设备，当该电子设备被设置为被协助设备的情况下，该电子设备为第一设备，该电子设备中的远程协助应用为第一远程协助应用，当该电子设备被设置为协助设备的情况下，该电子设备为第三设备，该电子设备中的远程协助应用为第二远程协助应用。对于同一电子设备而言，在安装了远程协助应用的情况下，处于被协助设备的角色，获取到包含控制应用的应用标识的NFC标签信息，启动预先安装的远程协助应用，只是该远程协助应用命名为第一远程协助应用。处于协助设备的角色，接收到携带控制应用的应用标识的远程协助请求，也启动该预先安装的远程协助应用，协助设备上的远程协助应用可以命名为第二远程协助应用。
实际应用中，由于协助用户需要在协助设备的远程协助应用中设置该协助设备的被协助设备，因此，协助设备中需要预先安装远程协助应用或者添加远程协助应用小程序，以方便协助用户在协助设备上启动远程协助应用(或打开远程协助应用小程序)后设置被协助设备。然而，对于协助用户选中的待设置为被协助设备的电子设备(例如，电子设备1)，可以未预先安装远程协助应用或添加远程协助应用小程序。在电子设备1同意了设置请求(将电子设备1设置被其他电子设备的被协助设备的请求)后，电子设备1才获得了被协助设备的角色。电子设备1可以在同意了设置请求后，电子设备1基于该设置请求(或由用户自主)从应用商店(或者第一云平台)下载远程协助应用；或，电子设备1可以在同意了设置请求后，电子设备1基于该设置请求(或由用户自主)添加远程协助应用的小程序。
另外，需要说明，当该电子设备处于协助设备的角色或者预先未被设置角色的情况下，获取到包含控制应用的应用标识和表征被控设备支持远程控制的标识的NFC标签信息，则启动NFC标签信息中的应用标识对应的控制应用。
步骤304，响应于在第二应用的操控界面接收的操控指令，第三设备对第二设备进行远程控制。
在本申请实施例中，第三设备中的第二远程协助应用可以获取并显示该应用标识对应的第二应用的操控界面，协助用户可以通过第二远程协助应用显示的第二应用的操控界面接收操控指令，通过该操控指令对该第二应用对应的第二设备进行远程控制。
本申请实施例中，第一设备可以作为需要被协助的用户使用的被协助设备，被协助用户在使用被协助设备的过程中，可以通过短距离的通信方式触发被协助设备获取到被控设备的第一信息，后续被协助用户无需在被协助设备上做进一步操作，就能够通知作为协助设备的第三设备侧的协助用户对作为被控设备的第二设备进行远程控制，简化了被协助用户的操作；而且，由于被协助设备向协助设备发送的是携带被控设备的控制应用(例如，被控设备为第二设备时，控制应用为第二应用)的应用标识的远程协助请求，因此，不会对网络质量有过高的要求；最后，由于对被控设备的控制是在协助设备上完成的，因此被协助设备上可以不安装每个被控设备对应的控制应用，因此，不会过多占用被协助用户使用的被协助设备的存储空间。
作为本申请另一实施例，步骤302中，第一设备通过第一远程协助应用向第三设备发送远程协助请求包括：
第一设备通过第一远程协助应用向第一云平台发送远程协助请求，以指示第一云平台向第三设备发送远程协助请求，该远程协助请求中携带有第二应用的应用标识。
在本申请实施例中，第一设备和第三设备之间可以通过第一云平台进行通信。第一云平台中存储了第一设备和第三设备之间的绑定关系。第一云平台是为远程协助应用提供支持的服务器。第一设备和第三设备之间的绑定关系具体可参照后续实施例的描述。
作为本申请另一实施例，步骤304中，响应于所述第二应用的操控界面接收的操控指令，对所述第二设备进行远程控制包括：
响应于所述第二应用的操控界面接收的操控指令，第三设备通过第二远程协助应用向第一设备发送操控指令；
响应于接收到的第三设备发送的操控指令，第一设备向第二设备发送接收到的操控指令；
或，响应于所述第二应用的操控界面接收的操控指令，第三设备通过第二远程协助应用向第一云平台发送操控指令，以指示第一云平台向第二设备发送操控指令；
或，响应于所述第二应用的操控界面接收的操控指令，第三设备通过第二远程协助应用向第一云平台发送操控指令，以指示第一云平台通过第二云平台向第二设备发送操控指令。
在本申请实施例中，第三设备和第二设备之间的操控指令可以通过第一设备转发；也可以通过第一云平台转发；还可以通过多个云平台转发，例如通过第一云平台转发给第二云平台，再通过第二云平台转发给第二设备，该操控指令用于指示第二设备执行与该操控指令对应的响应。
其中，第一云平台为与远程协助应用对应的服务器，第二云平台为与控制应用对应的服务器。这是由于远程协助应用的开发商和控制应用的开发商可能为不同的开发商，控制应用的开发商可能不希望其他开发商的云平台直接控制控制应用的开发商的被控设备，这样通过云平台对接的方式，被控设备对应的开发商能够掌握自己的被控设备的控制权。
图3所示实施例提供的远程协助方法可以应用在包括第一设备和第三设备的远程协助系统中。
上述实施例重点描述了第一设备和第三设备之间的交互过程，为了对上述实施例中的交互过程具有更清晰的理解，参见图4，图4为上述实施例的一个应用场景的示意图。
参照图4中的步骤1，本申请实施例提供的远程协助方法在实施时，需要预先将两个电子设备进行绑定，绑定的时候预先设置了被协助设备和该被协助设备的协助设备，或者预先设置了协助设备以及该协助设备的被协助设备。被设置为被协助设备的电子设备为上述实施例描述的第一设备(例如，老人手机)，被设置为协助设备的电子设备为上述实施例描述的第三设备(例如，子女手机)。
在此需要说明，实际应用中，绑定的可以是第一设备和第三设备，也可以是第一设备具有关联关系的第一账号和第三设备具有关联关系的第二账号。老人可以自己或者请求家人帮助其在第一云平台上注册第一账号，子女可以在第一云平台上注册第二账号。第一设备与第一账号之间的关联关系可以是：第一设备中的SIM卡号与第一账号存在对应关系；第一设备的设备标识与第一账号存在对应关系；或者，第一设备中登录远程协助应用的账号为第一账号。第三设备与第二账号之间的关联关系参照第一设备与第一账号之间的关联关系，在此不再赘述。
其中，预先将两个电子设备进行绑定的过程可以参照图5所示，协助用户(例如，老 人的子女)可以在设备A(例如，子女手机)上通过设备A中的负一屏搜索远程协助应用的方式或点击设备A的桌面上的远程协助应用的方式打开远程协助应用，在设备A的远程协助应用打开后，如图5中的(a)所示的显示界面(可以记为第一界面)，由于此时绑定的目的是将设备A设置为协助用户或者设置其他电子设备为设备A的被协助设备。设备A关联的为第二账号，若设备A或设备A关联的第二账号已经添加过一些被协助设备，则该显示界面可以显示已经添加过的被协助设备，例如，图5中的(a)所示的界面中存在远程协助应用的开关按钮，用户打开远程协助功能后，图5中的(a)所示的显示界面中显示已添加被协助设备列表，例如，图5中的(a)已添加被协助设备列表中显示的Nick的平板、老妈的P30。已添加被协助设备列表中显示的电子设备就为设备A已经添加过的被协助设备。该显示界面中可以存在虚拟按钮“添加被协助设备”(可以记为第一控件)，协助用户通过点击该“添加被协助设备”虚拟按钮(可以记为第一操作)控制设备A通过蓝牙或Wi-Fi等方式(仅用于举例，实际应用中，还可以是其他方式)搜索附近的其他电子设备，在搜索到其他电子设备后，设备A可以以列表的形式显示搜索到的其他电子设备(图5中的(b)所示的可信设备)，如图5中的(b)所示的显示界面(可以记为第二界面)，该显示界面中显示搜索到的可信设备，该可信设备包括：老爸的Mate 30、丸子的手机、小猪的手机、美女的手机。如图5中的(b)所示的显示界面中每个被搜索到的可信设备的设备名称对应设置可选按钮，协助用户通过点击该可选按钮选中要添加的被协助设备。当然，协助用户可以一次添加一个或多个被协助设备。在该图5中的(b)所示的显示界面中还存在“确定”和“取消”按钮，协助用户可以通过“确认”按钮将选中的一个或多个可信设备设置为设备A的被协助设备。可以将用户点击“老爸的Mate 30”的标识的操作记为第二操作，即不存在“确认“按钮，通过用户点击“老爸的Mate 30”的标识的操作触发发送设备添加请求，也可以将用户点击“老爸的Mate 30”的标识的操作和点击“确认”虚拟按钮的操作记为第二操作。当然，出于用户数据的安全角度考虑，设备A还需要向被选中的每个可信设备发送设备添加请求(可以记为第一请求)，例如，协助用户点击图5中的(b)所示的显示界面中的“确认”按钮向被选中的可信设备发送设备添加请求，添加请求中携带设备A的第二账号，对于被选中的可信设备(设备B，例如，老爸的Mate 30)接收到该设备添加请求后，可以显示图5中的(c)所示的显示界面(可以记为第三界面)，提示被选中的可信设备(设备B)侧的用户确认本电子设备(设备B)被添加为设备A的被协助设备的后果以及确认是否添加本电子设备(设备B)为设备A的被协助设备。“添加”虚拟按钮可以记为第二控件，“拒绝”虚拟按钮可以理解为第三控件，用户点击第二控制的操作可以自己为第三操作。在被选中的可信设备(设备B)侧的用户同意添加后，则设备B为设备A的被协助设备，设备A为设备B的协助设备。也可以理解为，设备B为第一设备，设备A为第三设备。设备A和设备B之间的绑定关系可以通过设备A关联的第二账号和设备B关联的第一账号之间的绑定关系体现。设备B同意添加后，设备B存储设备A和设备B之间的绑定关系。同时，设备B还可以向设备A反馈响应信息，例如，响应信息(可以记为第二信息)可以携带设备A和设备B之间的绑定关系，从而使得设备A存储设备A和设备B之间的绑定关系。响应信息也可以携带设备B的第一账号，使得设备A可以生成设备A和设备B的绑定关系并存储。当然，实际应用中，设备B还可以通过第一账号向第一云平台发送设备A和设备B之间的绑定关系，设备A也可以通过第二账号向第一云平台发送设备A和 设备B的绑定关系，使得第一云平台存储设备A和设备B的绑定关系。
在实际应用中，设备A和设备B除了可以是一一对应的关系以外，设备A也可以将多个设备B设置为设备A的被协助设备，即一个协助设备可以协助多个被协助设备；同样，多个设备A也可以将同一个设备B均设置为被协助设备，即一个被协助设备可以向多个协助设备求助。
图5所示的应用场景为在设备A上添加设备B为设备A的被协助设备的应用场景。实际应用中，也可以在设备A中添加设备B为设备A的协助设备。作为举例，在设备A的远程协助应用中点击第一设置控件，进入如图5中(a)所示的添加被协助设备的界面。在设备A的远程协助应用中点击第二设置控件，进入添加协助设备的界面。同样，添加协助设备的界面也可以显示已经添加过的协助设备的列表，也可以存在“添加协助设备”的虚拟按钮，用户点击“添加协助设备”的虚拟按钮，可以进入包含可信设备列表和“确认”虚拟按钮的界面，用户选中至少一个可信设备，点击“确认”虚拟按钮，从而向设备B发送设备添加请求。然而，此种情况下，设备添加请求表示：设备A请求添加设备B为设备A的协助设备。该应用场景中设备A和设备B的绑定关系和图5所示的场景中设备A和设备B的绑定关系中协助设备和被协助设备的角色相反。为一个电子设备添加协助设备的过程具体可参照为一个电子设备添加被协助设备的过程，具体不再详细描述。
参照图4中的步骤2，作为被协助设备侧的被协助用户可以通过“碰一碰”场景将被协助设备(例如，老人手机)贴近支持远程控制的被控设备(例如，微波炉)，当然，被控设备还可以是智能音箱、自助购票机等其他电子设备。这些被控设备中设有NFC模块，被协助设备中也设有NFC模块，被协助设备贴近支持远程控制的被控设备后，被协助设备可以获取到被控设备的NFC标签信息，作为举例，第一设备贴近微波炉，获得微波炉的NFC标签信息，微波炉的NFC标签信息包括：第一字段，微波炉的控制应用的应用标识；第二字段，微波炉的设备标识；第三字段，微波炉是否支持远程控制的标识。本应用场景中的被控设备默认均支持远程控制。当然，被协助设备贴近微波炉后，还可以继续贴近智能音箱(图4中未示出)，第一设备获取智能音箱的NFC标签信息，智能音箱的NFC标签信息包括：第一字段，智能音箱的控制应用的应用标识；第二字段，智能音箱的设备标识；第三字段，智能音箱是否支持远程控制的标识。在实际应用中，被协助设备的远程控制应用未启动状态下，被协助设备贴近第一个被控设备获取到第一个被控设备的NFC标签信息之后，若第一个NFC标签信息中的第三字段为支持远程控制的标识，则被协助设备启动远程协助应用，在被协助设备的远程协助应用启动后，被协助设备贴近第二个被控设备获取到第二个被控设备的NFC标签信息后，不再执行启动被协助设备中的远程协助应用的操作。当然，在被协助用户发起求助之前，被协助用户可以通过“碰一碰”场景获取到多个被控设备的NFC标签信息，从而获取到多个被控设备的控制应用的应用标识，被协助设备获取到一个或多个被控设备的控制应用的应用标识后，可以获取每个应用标识对应的控制应用，进而获取到每个控制应用的入口。
参照图4中的被协助设备的远程协助应用的显示界面，被协助设备的远程协助应用将每个控制应用的入口添加到被协助设备的远程协助应用的容器管理模块中，该远程协助应用可以显示容器管理模块中的控制应用的入口，可以将每个控制应用的图标作为每个控制应用的入口。即被协助设备的远程协助应用可以显示微波炉应用的图标，还可以显示智能 音箱应用的图标(图4中未示出被协助设备碰一碰智能音箱的步骤)。被协助用户点击图标可以进入并显示该图标对应的控制应用的操控界面。
当然，实际应用中，被协助设备的远程协助应用也可以不通过图标的形式显示控制应用的入口，而是远程协助应用直接启动被控设备的控制应用，并显示启动后的控制应用的操控界面，具体可参照图6所示。如图6中的(a)所示，被协助用户通过“碰一碰”场景将被协助设备贴近至少两个被控设备，例如图示中的微波炉和智能音箱，被协助设备通过远程协助应用显示微波炉的操控界面和智能音箱的操控界面，例如图6中的(b)所示，当然，远程协助应用显示至少两个控制应用的操控界面时，被协助用户还可以通过切换手势(例如，滑动手势)切换显示不同的控制应用的操控界面，如图6中的(b)和图6中的(c)所示，通过滑动手势可以将被协助设备的远程协助应用显示的操控界面由智能音箱的控制应用的操控界面切换为微波炉的控制应用的操控界面。
参照图4中的步骤3，在被协助设备通过远程协助应用显示被控设备的控制应用的操控界面之后，被协助设备可以向协助设备发起远程协助请求。参照图6中的(b)和图6中的(c)，远程协助应用还可以显示用于发起远程协助请求的“发起求助”按钮(可以记为第四控件)，被协助用户点击虚拟按钮“发起求助”(可以记为第四操作)，被协助设备向协助设备发送携带微波炉的控制应用的应用标识和智能音箱的控制应用的应用标识的远程协助请求。参照图6中的(d)，协助设备的显示界面中包含同意或拒绝按钮，协助用户可以在协助设备当前的显示界面中点击同意按钮，以使得被协助设备和协助设备之间建立远程协助会话，同时被协助设备和协助设备之间建立视频会话或音频会话，协助用户可以在当前的显示界面中点击拒绝按钮，以拒绝该远程协助请求。
需要说明，被协助设备存在多个协助设备的情况下，被协助设备可以从多个协助设备中选择其中一个作为当前远程协助请求的接收设备。若当前远程协助请求的接收设备拒绝了当前远程协助请求，被协助设备还可以继续选择其他协助设备作为远程协助请求的接收设备，直到存在某次远程协助请求的接收设备同意了远程协助请求或所有的协助设备均拒绝了远程协助请求。
当然，被协助设备存在多个协助设备的情况下，多个协助设备之间还可以预先设置优先级，即对多个协助设备按照优先级进行排序，优先选择优先级最高的一个作为当前远程协助请求的接收设备，在优先级最高的一个接收设备拒绝当前远程协助请求后，继续向优先级次高的协助设备发送远程协助请求，直到存在某次远程协助请求的接收设备同意了远程协助请求或所有的协助设备均拒绝了远程协助请求。
另外，被协助设备和协助设备之间的视频会话或音频会话，可以用于被协助用户和协助用户之间的身份确认，另外，协助用户还可以通过该视频会话或音频会话指导被协助用户如何对被控设备进行操控。
参照图4中的协助设备的显示界面，协助用户在协助设备的显示界面中接收了被协助设备发送的远程协助请求后，协助设备启动协助设备中的远程协助应用。协助设备接收到的远程协助请求包含了被控设备的控制应用的应用标识，协助设备中的远程协助应用可以获取该应用标识对应的控制应用，协助设备的远程协助应用可以显示各个控制应用的图标，协助用户点击任一个控制应用的图标，协助设备的远程协助应用可以显示该图标对应的控制应用的操控界面。当然，协助设备的远程协助应用也可以直接显示控制应用的操控界面， 例如，图7中的(b)所示的协助设备显示的微波炉的控制应用的操控界面。同样的，当协助设备的远程协助应用获取到多个被控设备的控制应用的操控界面的情况下，协助用户也可以在协助设备中通过切换手势，指示协助设备的远程协助应用将当前显示的微波炉的控制应用的操控界面切换为其他被控设备的控制应用的操控界面。协助用户可以在协助设备的远程协助应用显示的操控界面中进行操作，以生成操控指令，具体可参照图7中的(b)，协助用户在协助设备的远程协助应用显示的微波炉的控制应用的操控界面中触摸按钮“牛奶”，然后触摸按钮“开始”，则生成表示“微波炉按照牛奶程序运行”的操控指令。
图7中的(a)显示的操控界面为被协助设备的远程协助应用显示的第二操控界面，图7中的(b)显示的操控界面为协助设备的远程协助应用显示的第一操控界面，如图7中的(a)和图7中的(b)所示，被协助设备和协助设备的远程协助应用中均可以显示视频会话的画面，例如，被协助设备中显示的画面A为协助用户的画面，协助设备中的显示的画面B为被协助用户的画面，其中，协助用户的画面可以是协助用户使用的协助设备的摄像头拍摄到的画面，被协助用户的画面可以是被协助用户使用的被协助设备的摄像头拍摄到的画面。
当然，在被协助设备和协助设备之间建立远程协助会话后，被协助设备和协助设备的远程协助应用中均可以显示“断开链接”按钮，被协助用户点击被协助设备中的“断开链接”按钮或协助用户点击协助设备中的“断开链接”的按钮，均可以断开当前的远程协助会话，同时视频会话(或音频会话)也会中断。
若被协助用户在被协助设备的远程协助应用中点击“断开链接”按钮，导致被协助设备和协助设备之间的远程协助会话中断，则被协助设备和协助设备均可以关闭各自的远程协助应用，同时，清理掉远程协助应用的容器管理模块中的各个控制应用的入口图标或操控界面。
若协助用户在协助设备的远程协助应用中点击“断开链接”按钮，导致被协助设备和协助设备之间的远程协助会话中断，则协助设备均可以关闭远程协助应用，同时，清理掉协助设备的远程协助应用的容器管理模块中的各个控制应用的入口图标或操控界面。但是，被协助设备中的远程协助应用可以不关闭，被协助设备中的远程协助应用的容器管理模块中入口图标和操控界面也可以不清理，被协助用户可以继续通过“发起求助”按钮，向其他协助设备发起远程协助请求，在被协助用户确认不再需要发起求助的情况下，被协助用户可以退出被协助设备中改的远程协助应用，同时清理掉被协助设备的远程协助应用的容器管理模块中的各个控制应用的入口图标或操控界面。
当然，在实际应用中，还可以设置为：若协助用户在协助设备的远程协助应用中点击“断开链接”按钮，导致被协助设备和协助设备之间的远程协助会话中断，则被协助设备和协助设备均可以关闭各自的远程协助应用，同时，清理掉远程协助应用的容器管理模块中的各个控制应用的入口图标或操控界面。
参照图4中的步骤4，协助用户通过协助设备的远程协助应用显示的操控界面接收到操控指令后，协助设备将该操控指令发送给被协助设备。
参照图4中的步骤5，被协助设备将该操控指令转发给微波炉。
参照图4中的步骤6，协助设备也可以将该操控指令通过云平台转发至微波炉。具体可以为：协助设备可以将该操控指令发送给第一云平台，通过第一云平台将该操控指令转 发给微波炉。或者将该操控指令发送给第一云平台，第一云平台再将该操控指令发送给第二云平台，第二云平台将该操控指令发送至微波炉。其中，第一云平台可以为远程协助应用对应的服务器，第二云平台可以为被控设备的服务器。
在一些应用场景中，可能还存在以下情况，该应用场景中存在两个或两个以上的微波炉，而且，这些微波炉可能属于同一厂家同一系列的产品，这些微波炉的控制应用可能相同，在协助设备将该操控指令发送至微波炉的过程中，为了使得被协助设备、第一云平台或第二云平台能够将操控指令准确的发送至相应的微波炉，在被协助设备“碰一碰”微波炉时获取到的微波炉的NFC标签信息中还可以包括微波炉的设备标识，被协助设备向协助设备发送的远程协助请求中还可以包括微波炉的设备标识，并且微波炉的设备标识与微波炉的控制应用的应用标识为一一对应的关系，协助设备将操控指令发送给被协助设备或平云台的过程中也可以随着操控指令发送该操控指令对应的被控设备的设备标识。
微波炉收到该操控指令后，根据该操控指令执行相应的操作。
本申请实施例通过图4，并结合图5至图7，描述了本申请实施例提供的远程协助方法的应用场景。在本申请实施例提供的远程协助方法的具体实现过程中，还可以存在其他的应用场景。图4至图7中描述的内容并不对本申请实施例造成任何限制。
为了对本申请实施例提供的远程协助方法具有更清晰的理解，参照图8，图8为本申请实施例提供的一种远程协助方法的技术架构图，图9为本申请实施例提供的基于图8所示的技术架构图的远程协助方法的时序图。
结合图8所示的技术架构图，描述图9所示的远程协助方法的时序过程。
图9中的步骤A，绑定被协助设备和协助设备。该绑定过程可以是通过被协助设备中的远程协助应用和协助设备中远程协助应用实现的。如果绑定的过程是通过被协助设备关联的第一账号和协助设备关联的第二账号进行绑定的，则该绑定过程可以通过第一账号和第二账号对应的第一云平台实现。参照图8所示，被协助设备和协助设备在系统上层均存在远程协助应用。另外，被协助设备、协助设备和第一云平台中均存在账户管理模块，被协助设备和协助设备之间的绑定关系可以存储在被协助设备的远程协助应用中的账户管理模块、协助设备的远程协助应用中的账户管理模块、第一云平台的账户管理模块中。
图9中的步骤B，被协助设备的NFC模块获取被控设备的NFC标签信息，该NFC标签信息包括被控设备的控制应用的应用标识、被控设备的设备标识和被控设备是否支持远程控制的标识。参照图8所示，被控设备中设有NFC模块，实际上，被协助设备中也设有NFC模块，用户将被协助设备贴近协助设备，被协助设备中的设备发现模块发现设有NFC模块的被控设备(图8中NFC模块和设备发现模块之间虚线)，并在被协助设备发现设有NFC模块的被控设备后，被协助设备中的NFC模块(图8中未示出)可以获取被控设备的NFC标签信息。
图8中所示的设备发现模块支持的近距离的通信方式仅示出了支持NFC的靠近发现，实际应用中还可以支持wifi Aware的靠近发现，蓝牙的靠近发现等。例如，以蓝牙靠近发现为例，被协助设备中的设备发现模块可以发现设有蓝牙模块的被控设备。被协助设备中的设备发现模块发现设有蓝牙模块的被控设备后，被协助设备的蓝牙模块可以通过蓝牙传输的方式获取被控设备的控制应用的应用标识、被控设备的设备标识和被控设备是否支持远程控制的标识。
图9中的步骤C，被协助设备中的NFC模块向应用管理模块发送携带NFC标签信息的调用指令，该调用指令为调用应用管理模块中的接口的指令，该接口有启动远程协助应用的功能。该调用指令中携带了NFC标签信息。参照图8所示，被协助设备的系统层有应用管理模块，该应用管理模块可以启动位于系统上层的应用程序。
图9中的步骤D，被协助设备中的应用管理模块启动远程协助应用。可以以启动指令的形式启动远程协助应用，启动指令中可以携带NFC标签信息中的应用标识和设备标识。在该步骤中，被协助设备中的应用管理模块接收到NFC标签信息后，在NFC标签信息中被控设备是否支持远程控制的标识表示“是”、且当前电子设备被设置为被协助设备的情况下，被协助设备中的应用管理模块向远程协助应用发送启动指令，此时，启动指令不再携带被控设备是否支持远程控制的标识，启动指令可以携带应用标识和设备标识。
图9中的步骤E，被协助设备系统上层的远程协助应用启动。被协助设备的远程协助应用获得应用标识和设备标识。
图9中的步骤F，被协助设备系统上层的远程协助应用根据设备标识与被控设备建立连接。参照图8所示，被协助设备系统上层的远程协助应用中设有控制管理模块，控制管理模块和Kit(Kit中开放相关控制接口给上层应用使用)建立连接关系，Kit可以集成在上层应用软件中，例如，集成在远程协助应用中。Kit和系统层的传输管理模块建立连接关系，被协助设备的系统层中还存在连接管理模块，被协助设备和被控设备之间以蓝牙的方式建立近场通信连接时，被协助设备的系统层中的连接管理模块和被控设备中的连接管理模块共同负责被控设备的蓝牙和被协助设备的蓝牙之间建立连接。在被协助设备和被控设备之间成功建立蓝牙连接后，形成被协助设备的传输管理模块-被协助设备的蓝牙-被控设备的蓝牙-被控设备的连接管理模块之间的传输通道，该传输通道用于后续传输操控指令。被控设备的连接管理模块负责将接收到的操控指令通过集成的接口(例如，软件工具开发包中提供的接口)传输至控制管理模块，从而实现对被控设备的控制。
通过上述描述可以理解，操控指令从被协助设备的控制管理模块向被控设备的控制管理模块传输的路径为：被协助设备的控制管理模块-Kit模块-传输管理模块-被协助设备的蓝牙或Wi-Fi-被控设备的蓝牙或Wi-Fi-被控设备的连接管理模块-被控设备的控制管理模块。参见图8和图9中的步骤F表示被协助设备和协助设备之间建立的连接，该连接提供了后续操控指令的传输通道。
图9中的步骤G，被协助设备中远程协助应用将应用标识对应的控制应用的入口或操控界面添加到远程协助应用的容器管理模块。参照图8所示，远程协助应用中设有容器管理模块。该容器管理模块用于容纳或控制应用的入口或操控界面。实际应用中，被协助设备的远程协助应用的显示界面显示容器管理模块中的控制应用的入口或操控界面。
具体实现过程中，远程协助应用调用系统层提供的启动被控设备的控制应用的方法，例如，调用start ability()函数，同时传入被控设备的控制应用的应用标识和被控设备的设备标识。系统层可以通过应用管理模块接收到的NFC标签信息中的“被控设备是否支持远程控制的标识”验证被控设备的控制应用是否允许被远程协助应用启动，若被控设备的控制应用允许被远程协助应用启动，则启动被控设备的控制应用，同时将控制应用的入口或操控界面添加在远程协助应用的容器管理模块中，远程协助应用可以显示容器管理模块中的入口或操控界面。
实际应用中，由于对被控设备的控制可以交由协助设备侧的用户完成，因此，在被协助设备的远程协助应用中可以不显示被控设备的控制应用的入口或操控界面。即在实际应用中，可以取消步骤G。
图9中的步骤H，被协助设备的远程协助应用从账户管理模块查找绑定的协助设备。参照图9中步骤A的描述，被协助设备和协助设备的绑定关系已经预先存储在被协助设备的账户管理模块中。
图9中的步骤I，被协助设备的远程协助应用中的会话管理模块可以发起远程协助会话，例如，可以生成远程协助请求，生成的远程协助请求中携带有控制应用的应用标识。
图9中的步骤J，被协助设备的远程协助应用将远程协助请求发送给第一云平台。
图9中的步骤K，第一云平台向协助设备发送远程协助请求。
图9中的步骤L，协助设备中的应用管理模块接收到远程协助请求后，应用管理模块启动远程协助应用。参照图8所示，协助设备的系统层存在应用管理模块，系统层的上层存在远程协助应用。
图9中的步骤M，协助设备中的远程协助应用启动。
图9中的步骤N，协助设备的远程协助应用中的账户管理模块验证被协助设备的信息。协助设备的账户管理模块也预先存储了被协助设备和协助设备之间的绑定关系，账户管理模块可以确定当前接收到远程协助请求的发起者是否为本设备存在绑定关系的被协助设备。
图9中的步骤O，用户同意远程协助会话。在账户管理模块确定当前接收到的远程协助请求的发起者为本设备存在绑定关系的被协助设备的情况下，协助设备的远程协助应用可以显示界面，该界面存在“同意”或“拒绝”按钮，用户可以点击“同意”表示用户同意远程协助会话。
图9中的步骤P，协助设备的远程协助应用和被协助设备的远程协助应用之间建立远程协助会话。参照图8中所示的步骤P，被协助设备的远程协助应用中的会话管理模块—第一云平台中的会话管理模块—协助设备的远程协助应用的会话管理模块，三者之间使得被协助设备的远程协助应用和协助设备的远程协助应用之间建立远程协助会话。
需要说明，建立远程协助会话的同时，被协助设备和协助设备之间还可以建立视频会话或音频会话。
协助设备和被协助设备之间的远程协助会话可以是以Session的形式存在，例如，被协助设备向协助设备发送远程协助请求时，协助设备创建一个session，协助设备为session赋予一个ID，将该ID发送给被协助设备，被协助设备向协助设备发送其他信息时，可以在其他信息中携带该ID，这样，协助设备在接收到携带该ID的信息的情况下，就可以将当前接收到的携带该ID的信息与之前接收到的具有相同ID的信息关联，从而维持协助设备和被协助设备之间的会话。为描述简略，上述会话的描述忽略了第一云平台的转发过程。
作为举例，被协助设备“碰一碰”微波炉后，被协助设备向协助设备发送远程协助请求，该远程协助请求携带微波炉的控制应用的应用标识和设备标识。协助设备可以向被协助设备返回session ID，被协助设备再“碰一碰”智能音箱后，被协助设备向协助设备发送智能音箱的控制应用的应用标识，同时携带session ID，协助设备接收到携带session ID的智能音箱的控制应用的应用标识后，协助设备确定智能音箱的控制应用的应用标识和微波炉的控 制应用的应用标识来自与同一被协助设备的同一次远程协助会话中。
图9中的步骤Q，协助设备的远程协助应用将应用标识对应的控制应用的入口或操控界面添加到容器管理模块。参照图8所示，协助设备的远程协助应用中也存在容器管理模块，该容器管理模块可以和被协助设备中的容器管理模块的作用相同，在此不再赘述。
图9中的步骤R，用户在控制应用的操控界面中进行操作，从而生成操控指令。协助设备的远程协助应用可以显示容器管理模块中控制应用的操控界面，用户在操控界面中进行操作，生成对被控设备的操控指令。
图9中的步骤S，协助设备的远程协助应用调用控制管理模块。如图8所述，协助设备中的远程协助应用中设有控制管理模块，控制管理模块可以将操控指令发送第一云平台的控制管理模块。
图9中的步骤T，协助设备的远程协助应用中的控制管理模块向第一云平台发送操控指令。
图9中的步骤U，第一云平台向被协助设备发送操控指令。
参照图8所示，协助设备的远程协助应用中的控制管理模块向第一云平台的控制管理模块发送操控指令，第一云平台的控制管理模块再向被协助设备的远程协助应用中的控制管理模块发送该操控指令。
图9中的步骤V，被协助设备的远程协助应用中的控制管理模块调用Kit提供的接口，参照步骤F中的描述，Kit提供的接口可以在被协助设备和协助设备之间提供传输操控指令的通道。
图9中的步骤W，被协助设备通过被协助设备和协助设备之间预先建立的通道发送操控指令至被控设备的连接管理模块，在本实施例中，参见图8所示，被控设备中存在连接管理模块，该连接管理模块中可以包括软件工具开发包(Software Development Kit，SDK)，SDK中集成了被控设备的控制管理模块和底层的蓝牙模块之间通信的接口，或者被控设备的控制管理模块和Wi-Fi模块之间通信的接口，从而提供被控设备的控制管理模块和蓝牙模块通信的通道或者被控设备的控制管理模块和Wi-Fi模块通信的通道。
如前所述，图8和图9中的步骤F表示被协助设备和被控设备之间传输操控指令的通道的建立过程。图8和图9中的步骤W表示：通过图8和图9中的步骤F建立的通道发送操控指令的过程。
图9中的步骤X，被控设备中的连接管理模块提供SDK接口发送操控指令至控制管理模块，该控制管理模块用于基于操控指令控制相应的软硬件进行响应。
通过图9中的步骤V至步骤X以及结合图8可以理解，操控指令从被协助设备到被控设备之间的传输过程为：被协助设备的远程协助应用中的控制管理模块—Kit—被协助设备的系统层中的传输管理模块—被协助设备的蓝牙或Wi-Fi模块—被控设备的蓝牙或Wi-Fi—被控设备的连接管理模块—被控设备的控制管理模块—被控设备对应的软硬件。
作为本申请另一实施例，参照图10，图10为本申请实施例提供的一种远程协助方法的技术架构图，图11为本申请实施例提供的基于图10所示的技术架构图的远程协助方法的时序图。
图10结合图11对应的实施例和图8结合图9对应的实施例之间存在部分差异，如图所示，图10结合图11对应的实施例中对被控设备的操控指令的传输过程为：协助设备— 第一云平台—被控设备(该实施例中，协助设备向第一云平台发送的指令记为第四操控指令，第一云平台向被控设备发送的指令记为第五操控指令)，或协助设备—第一云平台—第二云平台—被控设备(该实施例中，协助设备向第一云平台发送的指令记为第六操控指令，第一云平台向第二云平台发送的指令记为第七操控指令，第二云平台向被控设备的指令记为第八操控指令)。图8结合图9对应的实施例中对被控设备的操控指令的传输过程为：协助设备—第一云平台—被协助设备—被控设备(该实施例中，协助设备向第一云平台发送的指令记为第一操控指令，第一云平台向被协助设备发送的操控指令记为第二操控指令，所述被协助设备向被控设备发送的指令记为第三操控指令)。
由于图10结合图11对应的实施例中不存在被协助设备和被控设备之间的操控指令的传输，因此，本实施例中，无需在被协助设备和被控设备之间建立连接(即可以取消图9中的步骤F)。而是通过第一云平台、或第一云平台和第二云平台向被控设备转发操控指令。若是通过第一云平台则是向被控设备的连接管理模块发送操控指令，由连接管理模块向被控设备的应用层中的控制管理模块发送操控指令。若是通过第一云平台向第二云平台发送操控指令，再由第二云平台向被控设备发送操控指令，则可以由第二云平台向被控设备的应用层的控制管理模块发送操控指令。第二云平台为被控设备的厂商对应的云平台。
参见图10所示，被控设备中存在连接管理模块，该连接管理模块中可以包括软件工具开发包(Software Development Kit，SDK)，SDK中集成了被控设备的控制管理模块和第一云平台之间通信的接口，从而提供被控设备的控制管理模块和第一云平台的控制管理模块之间的通道传输操控指令。
在实际应用中，本申请实施例提供的远程协助方法还可以存在其他的应用场景。为了比较不同应用场景之间的差异，参照图12至图14所示应用场景。其中，图12所示应用场景为被协助用户只需要协助用户帮忙远程控制微波炉。图13所示应用场景为被协助用户需要协助用户帮忙远程控制微波炉和智能音箱。图14所示应用场景为在图13所示应用场景的基础上，还需要协助用户帮忙远程控制自助购票机。图12至图14中的应用场景中的被控设备默认均支持远程控制。
如图12所示，被协助用户只需要协助用户帮忙控制微波炉加热牛奶的场景中，如图12中的(a)所示，被协助用户通过被协助设备“碰一碰”微波炉，被协助设备获取到微波炉的NFC标签信息。如图12中的(b)所示，被协助设备启动远程协助应用，远程协助应用获取应用标识对应的控制应用的操控界面(微波炉的操控界面)。远程协助应用显示微波炉的控制应用的操控界面。用户可以通过被协助设备的远程协助应用中“发起求助”按钮向协助设备发起求助，被协助设备向协助设备发送远程协助请求，该远程协助请求携带了微波炉的控制应用的应用标识。协助设备接收到远程协助请求后，协助设备显示如图12中的(c)所示的界面，协助用户可以通过图12中的(c)所示的界面中的同意按钮，在被协助设备和协助设备之间建立远程协助会话。协助用户在协助设备侧通过远程协助请求中的应用标识对应的控制应用(微波炉的控制应用)实现对微波炉的远程控制。
图12所示场景中，微波炉为被协助设备“碰一碰”的第一个被控设备。对应于被协助设备“碰一碰”的第一个被控设备，被协助设备需要启动被协助设备中的远程协助应用。被协助设备向协助设备发送第一个被控设备的控制应用的应用标识时，该应用标识是和远程协助请求一起发送的。
如图13所示，被协助用户需要协助用户帮忙控制微波炉加热牛奶，还需要协助用户帮忙将智能音箱连接上无线网络的场景中。如图13中的(a)所示，被协助用户将被协助设备“碰一碰”微波炉，被协助设备获取到微波炉的NFC标签信息，如图13中的(b)所示，被协助设备启动远程协助应用。此时，被协助用户可以不通过远程协助应用发起求助，而是继续按照如图13中的(c)所示，被协助用户将被协助设备“碰一碰”智能音箱，被协助设备获取到智能音箱的NFC标签信息。由于此时被协助设备中的远程协助应用已经处于启动状态，因此，被协助设备不再对获取到的智能音箱的NFC标签信息进行“启动远程协助应用”的响应，而是如图13中的(d)所示，可以通过已经启动的远程协助应用显示智能音箱的控制应用的操控界面。同理，在远程协助应用启动后、被协助用户通过远程协助应用发起求助之前，被协助设备均不再对通过“碰一碰”获取到的任何被控设备的NFC标签信息进行“启动远程协助应用”的响应，而是可以通过已经启动的远程协助应用显示当前“碰一碰”获取到的应用标识对应的控制应用的操控界面。被协助用户可以通过图13中的(d)所示的界面中的“发起求助”按钮发起求助，此时被协助设备向协助设备发送的远程协助请求中携带了：微波炉的控制应用的应用标识以及智能音箱的控制应用的应用标识。协助设备接收到远程协助请求后，参照图13中的(e)所示，协助用户在协助设备侧同意该远程协助请求，在被协助设备和协助设备之间建立远程协助会话。协助用户在协助设备侧通过远程协助请求中的应用标识对应的微波炉的控制应用实现对微波炉的远程控制。协助用户在协助设备侧通过远程协助请求中的应用标识对应的智能音箱的控制应用实现对智能音箱的远程控制。
图13所示场景中，微波炉为被协助设备“碰一碰”的第1个被控设备。对应于被协助设备“碰一碰”的第一个被控设备，被协助设备需要启动被协助设备中的远程协助应用。智能音箱为被协助设备“碰一碰”的第2个被控设备。对应于被协助设备“碰一碰”的第2个被控设备，被协助设备不需要启动被协助设备中的远程协助应用。当然，用户在发起求助之前，被协助设备“碰一碰”的第3个、第4个、……、第i个被控设备，被协助设备均不需要启动被协助设备中的远程协助应用。用户被协助设备侧发起求助时，发送的远程协助请求中携带第1个至第i个被控设备的控制应用的应用标识。
实际应用中，被协助设备“碰一碰”被控设备后，若获取到被控设备的NFC标签信息，可以先判断被协助设备是否启动了远程协助应用；
若未启动远程协助应用，表示当前获取到的NFC标签信息为第1个被控设备的NFC标签信息，则可以启动远程协助应用；
若已经启动远程协助应用，表示当前获取到的NFC标签信息为第2个、第3个、……第i个被控设备的NFC标签信息，则可以等待发起求助。
如图14所示，在图13所示应用场景(实际应用中，也可以是图12所示应用场景)的基础上，协助用户在协助设备侧同意远程协助请求后，如图14中的(f)所示，在被协助设备和协助设备之间建立远程协助会话，被协助设备的远程协助应用的显示界面中不再显示“发起求助”按钮。其中，图14中的(a)至图14中的(e)可参照图13中的(a)至图13中的(e)的描述，不再赘述。
在被协助设备和协助设备之间建立远程协助会话之后，如图14中的(g)所示，被协助用户还可以再次将被协助设备“碰一碰”自助购票机获取自助购票机的NFC标签信息。由 于已经启动被协助设备中的远程协助应用，且已经通过远程协助请求在被协助设备和协助设备之间建立了远程协助会话，因此，被协助设备不再进行“启动远程协助应用”的响应，如图14中的(h)所示，被协助设备的远程协助应用的界面中也不再显示“发起求助”的按钮，被协助设备可以将获取到的自助购票机的控制应用的应用标识发送给协助设备，而无需像第2个、……、第i个被控设备的控制应用的应用标识那样携带在远程协助请求中。如图14中的(i)所示，协助设备也不再显示同意或拒绝远程协助请求的界面，而是通过已经启动的远程协助应用显示自助购票机的控制应用的操控界面。
以图14中的(h)和图14中的(i)所示，被协助用户需要协助用户对微波炉、智能音箱和自助购票机进行远程协助。协助设备中的远程协助应用可以接收到微波炉的控制应用的应用标识、智能音箱的控制应用的应用标识和自助购票机的控制应用的应用标识。因此，协助设备的远程协助应用可以显示微波炉的控制应用的操控界面、智能音箱的控制应用的操控界面和自助购票机的控制应用的操控界面，协助设备还可以切换显示每个控制应用的操控界面。
图14所示场景中，微波炉为被协助设备“碰一碰”的第1个被控设备。对应于被协助设备“碰一碰”的第1个被控设备，被协助设备需要启动被协助设备中的远程协助应用。智能音箱为被协助设备“碰一碰”的第2个被控设备。对应于被协助设备“碰一碰”的第2个被控设备，被协助设备不需要启动被协助设备中的远程协助应用。当然，用户在发起求助之前，被协助设备“碰一碰”的第3个、第4个、……、第i个被控设备，被协助设备均不需要启动被协助设备中的远程协助应用。用户被协助设备侧发起求助时，发送的远程协助请求中携带第1个至第i个被控设备的控制应用的应用标识。对于在被协助设备和协助设备之间的远程协助会话建立之后，被协助设备之后“碰一碰”的每一个被控设备(第i+1个、第i+2个、……、第i+j个被控设备)，被协助设备不再执行“启动远程协助应用”的响应，不再发送“远程协助请求”。被协助设备需要执行的是将之后“碰一碰”的每一个被控设备(第i+1个、第i+2个、……、第i+j个被控设备)的控制应用的应用标识发送给协助设备。
上述示例中的第2个、第3个、第4个、……、第i个被控设备的NFC标签信息均可以记为第三信息；第i+1个、第i+2个、……、第i+j个被控设备的NFC的标签信息均可以记为第四信息。
实际应用中，被协助设备启动远程协助应用后，被协助设备“碰一碰”被控设备，若获取到被控设备的NFC标签信息，可以先判断被协助设备和协助设备之间是否已经建立远程协助会话；
若未建立远程协助会话，表示当前获取的应用标识为第2个、第3个、……、第i个被控设备的MFC标签信息，则可以等待发起求助；
若已经建立远程协助会话，表示当前获取的应用标识为第i+1个、第i+2个、……、第i+j个被控设备的NFC标签信息，则将当前获取的NFC标签信息中的应用标识发送给协助设备。
其中，i为≥2的正整数，j为≥1的正整数。
作为本申请另一实施例，图15所示应用场景中，被协助设备的远程协助应用显示被控设备的控制应用的操控界面的过程包括：
被协助设备通过远程协助应用显示被控设备的控制应用的图标；
响应于通过图标接收到的第一启动指令，被协助设备通过远程协助应用启动被控设备的控制应用，并显示启动后的被控设备的控制应用的操控界面。
在本申请实施例中，被协助设备可以请求协助设备进行远程协助，因此设置了：被协助设备“碰一碰”支持远程控制的被控设备时，被协助设备启动被协助设备中的远程协助应用，以通过远程协助应用向协助设备发送远程协助请求。然而，为了使得被协助用户在具有自主控制被控设备的能力的情况下，能够自主对被控设备进行控制，可以在被协助设备的远程协助应用中显示被控设备的控制应用的入口。如图15所示，被协助设备的远程协助应用可以显示被控设备的控制应用的图标，例如，图15中的(a)所示的微波炉的控制应用的图标、智能音箱的控制应用的图标和自助购票机的控制应用的图标。被协助用户可以通过触摸显示的图标进入该控制应用的操控界面。如图15中的(a)所示，用户触摸被协助设备的远程协助应用中显示的微波炉的控制应用的图标，如图15中的(b)所示，被协助设备的远程协助应用显示微波炉的控制应用的操控界面。如图15中的(a)所示，用户触摸被协助设备的远程协助应用中显示的智能音箱的控制应用的图标，如图15中的(c)所示，被协助设备的远程协助应用显示智能音箱的控制应用的操控界面。如图15中的(a)所示，用户触摸被协助设备的远程协助应用中显示的自助购票机的控制应用的图标，如图15中的(d)所示，被协助设备的远程协助应用显示自助购票机的控制应用的操控界面。当然，也可以在第一设备的第一远程协助应用中直接显示被控设备的操控界面，具体可参照图6中的(b)和(c)所示的被协助设备的远程协助应用显示操控界面。
图15以被协助设备为例描述显示被控设备的控制应用的操控界面的过程，协助设备显示被控设备的控制应用的操控界面的过程可参照图15对应的描述，在此不再赘述。
当然，实际应用中，被协助设备通过远程协助应用启动被控设备的控制应用后，也可以直接显示启动后的被控设备的控制应用的操控界面。
在描述了第一设备和第三设备之间的交互过程之后，下面重点以第一设备和第三设备分别作为执行主体描述本申请实施例提供的远程协助方法。
参见图16，图16为本申请实施例提供的远程协助方法的流程示意图，应用于第一设备，该方法包括：
步骤1601，第一设备在获取到第一信息后，启动第一设备中的第一远程协助应用，其中，第一信息包括用于控制第二设备的第二应用的应用标识和用于表征第二设备支持远程控制的标识，第一设备为预设的被协助设备，第二设备为被控设备。
步骤1602，第一设备通过第一远程协助应用向第三设备发送远程协助请求，其中，第三设备为第一设备的协助设备，远程协助请求中携带有第二应用的应用标识，远程协助请求用于指示第三设备启动第二远程协助应用，并基于第二远程协助应用和第二应用对第二设备进行远程控制。
作为本申请另一实施例，方法还包括：
响应于第一请求，第一设备设置第三设备为第一设备的协助设备，其中，第一请求为第三设备发送的，第一请求中携带有第三设备的账号信息；
第一设备存储第一设备和第三设备的协助关系，第一设备和第三设备的协助关系包括：第一设备的账号信息和第三设备的账号信息的对应关系；
第一设备向第三设备发送第二信息，第二信息携带有第一设备的账号信息，或者第二 信息携带有第一设备的账号信息和第三设备的账号信息的对应关系；
第二信息用于指示第三设备设置第一设备为第三设备的被协助设备。
作为本申请另一实施例，第一设备设有NFC模块，第一信息为第二设备的NFC标签信息；
第一设备在获取到第一信息后，启动第一设备中的第一远程协助应用，包括：
第一设备通过NFC模块获取到第二设备的NFC标签信息后，响应于根据用于表征第二设备支持远程控制的标识确定第二设备支持远程控制，启动第一设备中的第一远程协助应用。
作为本申请另一实施例，第一设备通过第一远程协助应用向第三设备发送远程协助请求包括：
第一设备通过第一远程协助应用向第一云平台发送第一远程协助请求，第一远程协助请求携带有第二应用的应用标识，第一远程协助请求用于指示第一云平台向第三设备发送第二远程协助请求，第二远程协助请求携带有第二应用的应用标识。
作为本申请另一实施例，在第一设备启动第一设备中的第一远程协助应用之后，该方法还包括：
第一设备中的第一远程协助应用显示第二应用的操控界面。
作为本申请另一实施例，该方法还包括：
第一设备中的第一远程协助应用的操控界面包括第四控件，第四控件用于向第三设备发起求助；
检测到用户输入的第四操作，第四操作作用于第四控件；
响应于第四操作，第一设备通过第一远程协助应用向第三设备发送远程协助请求。
作为本申请另一实施例，在第一设备通过第一远程协助应用向第三设备发送远程协助请求之前，该方法还包括：
第一设备获取到第三信息，第三信息包括用于控制第四设备的第四应用的应用标识和用于表征第四设备支持远程控制的标识；
第一设备通过第一远程协助应用显示第四应用的操控界面；
第一设备通过第一远程协助应用向第三设备发送远程协助请求，具体为：
第一设备通过第一远程协助应用向第三设备发送远程协助请求，远程协助请求中携带有第二应用的应用标识和第四应用的应用标识。
作为本申请另一实施例，在第一设备通过第一远程协助应用向第三设备发送远程协助请求之后，还包括：
第一设备获取到第四信息，第四信息包括用于控制第五设备的第五应用的应用标识和用于表征第五设备支持远程控制的标识；
第一设备通过第一远程协助应用显示第五应用的操控界面；
第一设备向第三设备发送第五应用的应用标识。
作为本申请另一实施例，第一设备获取到至少两个被控设备的控制应用的应用标识，至少两个被控设备包括第二设备和第四设备第一设备中的第一远程协助应用显示第二应用的第二操控界面之后，方法还包括：
响应于接收到的第二切换指令，第一设备的第一远程协助应用中当前显示的第二应用 的操控界面切换为第四应用的操控界面。
作为本申请另一实施例，该方法还包括：
第一设备通过靠近或触碰第二设备，获取第一信息。
作为本申请另一实施例，第一设备通过第一远程协助应用向第三设备发送远程协助请求之前，方法还包括：
第一设备通过存储的协助关系查找第一设备的协助设备，第一设备的协助设备包括第三设备。
作为本申请另一实施例，方法还包括：
当第一设备的协助设备为至少两个时，第三设备为第一设备的协助设备中优先级最高的一个。
本申请实施例中，第一设备中的第一远程协助应用显示第四应用和第五应用的操控界面的方式可以参照显示第二应用的操纵界面的方式，在此不再赘述。第一设备的远程协助应用切换显示不同操控界面的方式可以参照上述实施例中的第三设备的远程协助应用切换显示不同操控界面的方式。
参见图17，图17为本申请实施例提供的远程协助方法的流程示意图，应用于第三设备，该方法包括：
步骤1701，响应于接收远程协助请求，第三设备启动第三设备中的第二远程协助应用，其中，远程协助请求中携带有用于控制第二设备的第二应用的应用标识，第二设备为被控设备，第二远程协助应用中显示有第二应用的操控界面。
步骤1702，响应于在第二应用的操控界面接收的操控指令，第三设备对第二设备进行远程控制。
作为本申请另一实施例，第三设备的第二远程协助应用显示第一界面，第一界面包括第一控件，第一控件用于指示第三设备搜索电子设备；
第三设备检测到第一操作，第一操作作用于第一控件；
响应于第一操作，第三设备的第二远程协助应用显示第二界面，第二界面显示有搜索到的电子设备的标识，搜索到的电子设备的标识中包括第一设备的标识；
第三设备检测到第二操作，第二操作作用于第一设备的标识；
响应于第二操作，第三设备通过第二远程协助应用向第一设备发送第一请求，第一请求中携带有第三设备的账号信息，第一请求用于指示第一设备设置第三设备为第一设备的协助设备。
作为本申请另一实施例，响应于接收远程协助请求，第三设备启动第三设备中的第二远程协助应用，包括：
响应于接收远程协助请求，第三设备显示第三界面，第三界面包含有第二控件和第三控件，第二控件用于同意远程协助请求，第三控件用于拒绝远程协助请求；
检测到用户输入的第三操作，第三操作作用于第二控件；
响应于第三操作，第三设备启动第三设备中的第二远程协助应用。
作为本申请另一实施例，第三设备中的第二远程协助应用中显示有第二应用的操控界面包括：
第三设备中的第二远程协助应用中显示有第二应用的入口图标；
响应于通过第二应用的入口图标接收到的进入指令，第二远程协助应用显示第二应用的操控界面。
作为本申请另一实施例，响应于在第二应用的操控界面接收的操控指令，第三设备对第二设备进行远程控制，包括：
响应于在第二应用的操控界面接收的操控指令，第三设备通过第二远程协助应用向第一云平台发送第一操控指令，第一操控指令用于指示第一云平台向第一设备发送第二操控指令，第二操控指令用于指示第一设备向第二设备发送第三操控指令，第一操控指令、第二操控指令和第三操控指令均用于指示第二设备执行与操控指令对应的操作；
或，响应于在第二应用的操控界面接收的操控指令，第三设备通过第二远程协助应用向第一云平台发送第四操控指令，第四操控指令用于指示第一云平台向第二设备发送第五操控指令，第四操控指令和第五操控指令均用于指示第二设备执行与操控指令对应的操作；
或，响应于在第二应用的操控界面接收的操控指令，第三设备通过第二远程协助应用向第一云平台发送第六操控指令，第六操控指令用于指示第一云平台向第二云平台发送第七操控指令，第七操控指令用于指示第二云平台向第二设备发送第八操控指令，其中，第六操控指令、第七操控指令和第八操控指令均用于指示第二设备执行与操控指令对应的操作。
作为本申请另一实施例，远程协助请求中还携带有用于控制第四设备的第四应用的应用标识，其中，第四设备为被控设备，该方法还包括：
第三设备在第二远程协助应用中显示第二应用的操纵界面或第四应用的操控界面。
作为本申请另一实施例，在第三设备启动第三设备中的第二远程协助应用之后，还包括：
接收用于控制第五设备的第五应用的应用标识，第三设备在第二远程协助应用中显示第五应用的操控界面。
作为本申请另一实施例，第三设备的第二远程协助应用接收到至少两个被控设备的控制应用的应用标识，至少两个被控设备包括第二设备和第四应用，第三设备通过第二远程协助应用显示第二应用的第一操控界面之后，方法还包括：
响应于接收到的第一切换指令，第三设备的第二远程协助应用中当前显示的第二应用的操控界面切换为第四应用的操控界面。
应理解，上述实施例中各步骤的序号的大小并不意味着执行顺序的先后，各过程的执行顺序应以其功能和内在逻辑确定，而不应对本申请实施例的实施过程构成任何限定。
本申请实施例可以根据上述方法示例对第一设备进行功能单元的划分，例如，可以对应每一个功能划分每一个功能单元，也可以将两个或两个以上的功能集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。需要说明的是，本申请实施例中对单元的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。下面以采用对应每一个功能划分每一个功能单元为例进行说明：
参照图18，该第一设备1800包括：
第一处理单元1801，用于在获取到第一信息后，启动第一远程协助应用，其中，第一信息包括用于控制第二设备的第二应用的应用标识和用于表征第二设备支持远程控制的 标识，第一设备为预设的被协助设备，第二设备为被控设备；
远程协助单元1802，用于通过第一远程协助应用向第三设备发送远程协助请求，其中，第三设备为第一设备的协助设备，远程协助请求中携带有第二应用的应用标识，远程协助请求用于指示第三设备启动第二远程协助应用，并基于第二远程协助应用和第二应用对第二设备进行远程控制。
作为本申请另一实施例，第一处理单元1801还用于：
响应于第一请求设置第三设备为第一设备的协助设备，其中，第一请求为第三设备发送的，第一请求中携带有第三设备的账号信息；
存储第一设备和第三设备的协助关系，第一设备和第三设备的协助关系包括：第一设备的账号信息和第三设备的账号信息的对应关系；
向第三设备发送第二信息，第二信息携带有第一设备的账号信息，或者第二信息携带有第一设备的账号信息和第三设备的账号信息的对应关系；第二信息用于指示第三设备设置第一设备为第三设备的被协助设备。
作为本申请另一实施例，第一设备设有NFC模块，第一信息为第二设备的NFC标签信息；
该第一处理单元1801还用于：通过NFC模块获取到第二设备的NFC标签信息后，响应于根据用于表征第二设备支持远程控制的标识确定第二设备支持远程控制，启动第一设备中的第一远程协助应用。
作为本申请另一实施例，第一处理单元1801还用于：通过第一远程协助应用向第三设备发送远程协助请求之前，查找第一设备的协助设备，第一设备的协助设备包括第三设备。
作为本申请另一实施例，第一设备的协助设备为至少两个时，第三设备为协助设备中优先级最高的一个。
作为本申请另一实施例，远程协助单元1802还用于：
通过第一远程协助应用向第一云平台发送第一远程协助请求，第一远程协助请求携带有第二应用的应用标识，第一远程协助请求用于指示第一云平台向第三设备发送第二远程协助请求，第二远程协助请求携带有第二应用的应用标识。
作为本申请另一实施例，第一处理单元1801用于控制第一远程协助应用显示第二应用的操控界面。
作为本申请另一实施例，第一设备中的第一远程协助应用的操控界面包括第四控件，第四控件用于向第三设备发起求助；
第一处理单元1801检测到用户输入的第四操作，第四操作作用于第四控件；
远程协助单元1802还用于：
响应于第四操作，第一设备通过第一远程协助应用向第三设备发送远程协助请求。
作为本申请另一实施例，第一处理单元1801还用于：
在通过第一远程协助应用向第三设备发送远程协助请求之前，获取到第三信息，第三信息包括用于控制第四设备的第四应用的应用标识和用于表征第四设备支持远程控制的标识；
通过第一远程协助应用显示第四应用的操控界面；
通过第一远程协助应用向第三设备发送远程协助请求中携带有第二应用的应用标识和第四应用的应用标识。
作为本申请另一实施例，第一处理单元1801还用于：
获取到第四信息，第四信息包括用于控制第五设备的第五应用的应用标识和用于表征第五设备支持远程控制的标识；
通过第一远程协助应用显示第五应用的操控界面；
远程协助单元1802还用于：向第三设备发送第五应用的应用标识。
作为本申请另一实施例，第一处理单元1801还用于：
第一设备获取到至少两个被控设备的控制应用的应用标识，至少两个被控设备包括第二设备和第四设备第一设备中的第一远程协助应用显示第二应用的第二操控界面之后，响应于接收到的第二切换指令，控制第一远程协助应用中当前显示的第二应用的操控界面切换为第四应用的操控界面。
作为本申请另一实施例，第一处理单元1801还用于：
在第一设备通过靠近或触碰第二设备，获取第一信息。
需要说明的是，上述第一设备/单元之间的信息交互、执行过程等内容，由于与本申请方法实施例基于同一构思，其具体功能及带来的技术效果，具体可参见方法实施例部分，此处不再赘述。
本申请实施例可以根据上述方法示例对第三设备进行功能单元的划分，例如，可以对应每一个功能划分每一个功能单元，也可以将两个或两个以上的功能集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。需要说明的是，本申请实施例中对单元的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。下面以采用对应每一个功能划分每一个功能单元为例进行说明：
参照图19，该第三设备1900包括：
第二处理单元1901，用于响应于接收远程协助请求，启动第三设备中的第二远程协助应用，其中，远程协助请求中携带有用于控制第二设备的第二应用的应用标识，第二设备为被控设备；第二远程协助应用中显示有第二应用的操控界面；
远程控制单元1902，用于响应于在第二应用的操控界面接收的操控指令，第三设备对第二设备进行远程控制。
作为本申请另一实施例，第二处理单元1901还用于：
控制第二远程协助应用显示第一界面，第一界面包括第一控件，第一控件用于指示第三设备搜索电子设备；
检测到第一操作，第一操作作用于第一控件；
响应于第一操作，控制第二远程协助应用显示第二界面，第二界面显示有搜索到的电子设备的标识，搜索到的电子设备的标识中包括第一设备的标识；
检测到第二操作，第二操作作用于第一设备的标识；
响应于第二操作，通过第二远程协助应用向第一设备发送第一请求，第一请求中携带有第三设备的账号信息，第一请求用于指示第一设备设置第三设备为第一设备的协助设备。
作为本申请另一实施例，第二处理单元1901还用于：
响应于接收远程协助请求，显示第三界面，第三界面包含有第二控件和第三控件，第二控件用于同意远程协助请求，第三控件用于拒绝远程协助请求；
检测到用户输入的第三操作，第三操作作用于第二控件；
响应于第三操作，启动第三设备中的第二远程协助应用。
作为本申请另一实施例，第二处理单元1901还用于：
控制第二远程协助应用中显示有第二应用的入口图标；
响应于通过第二应用的入口图标接收到的进入指令，控制第二远程协助应用显示第二应用的操控界面。
作为本申请另一实施例，远程控制单元1902还用于：
响应于在第二应用的操控界面接收的操控指令，通过第二远程协助应用向第一云平台发送第一操控指令，其中，第一设备为第三设备的被协助设备，第一操控指令用于指示第一云平台向第一设备发送第二操控指令，第二操控指令用于指示第一设备向第二设备发送第三操控指令，第一操控指令、第二操控指令和第三操控指令均用于指示第二设备执行与操控指令对应的操作；
或，响应于在第二应用的操控界面接收的操控指令，通过第二远程协助应用向第一云平台发送第四操控指令，第四操控指令用于指示第一云平台向第二设备发送第五操控指令，第四操控指令和第五操控指令均用于指示第二设备执行与操控指令对应的操作；
或，响应于在第二应用的操控界面接收的操控指令，通过第二远程协助应用向第一云平台发送第六操控指令，第六操控指令用于指示第一云平台向第二云平台发送第七操控指令，第七操控指令用于指示第二云平台向第二设备发送第八操控指令，其中，第六操控指令、第七操控指令和第八操控指令均用于指示第二设备执行与操控指令对应的操作。
作为本申请另一实施例，远程协助请求中还携带有用于控制第四设备的第四应用的应用标识，其中，第四设备为被控设备；
第二处理单元1901还用于：
在第二远程协助应用中显示第二应用的操纵界面或第四应用的操控界面。
作为本申请另一实施例，第二处理单元1901还用于：
接收用于控制第五设备的第五应用的应用标识，在第二远程协助应用中显示第五应用的操控界面。
作为本申请另一实施例，第三设备的第二远程协助应用接收到至少两个被控设备的控制应用的应用标识，至少两个被控设备包括第二设备和第四应用，第二处理单元1901还用于：
第三设备通过第二远程协助应用显示第二应用的第一操控界面之后，响应于接收到的第一切换指令，第三设备的第二远程协助应用中当前显示的第二应用的操控界面切换为第四应用的操控界面。
需要说明的是，上述第三设备/单元之间的信息交互、执行过程等内容，由于与本申请方法实施例基于同一构思，其具体功能及带来的技术效果，具体可参见方法实施例部分，此处不再赘述。
所属领域的技术人员可以清楚地了解到，为了描述的方便和简洁，仅以上述各功能单元的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能单元 完成，即将第一设备(或第三设备)的内部结构划分成不同的功能单元，以完成以上描述的全部或者部分功能。实施例中的各功能单元可以集成在一个单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中，上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。另外，各功能单元的具体名称也只是为了便于相互区分，并不用于限制本申请的保护范围。上述系统中单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
本申请实施例还提供了一种计算机可读存储介质，计算机可读存储介质存储有计算机程序，计算机程序被处理器执行时可实现上述各个方法实施例中的步骤。
本申请实施例还提供了一种计算机程序产品，当计算机程序产品在第一设备上运行时，使得第一设备可实现上述各个方法实施例中的步骤。
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请实现上述实施例方法中的全部或部分流程，可以通过计算机程序来指令相关的硬件来完成，的计算机程序可存储于一计算机可读存储介质中，该计算机程序在被处理器执行时，可实现上述各个方法实施例的步骤。其中，计算机程序包括计算机程序代码，计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。计算机可读介质至少可以包括：能够将计算机程序代码携带到第一设备的任何实体或装置、记录介质、计算机存储器、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、电载波信号、电信信号以及软件分发介质。例如U盘、移动硬盘、磁碟或者光盘等。在某些司法管辖区，根据立法和专利实践，计算机可读介质不可以是电载波信号和电信信号。
本申请实施例还提供了一种芯片系统，芯片系统包括处理器，处理器与存储器耦合，处理器执行存储器中存储的计算机程序，以实现本申请任一方法实施例的步骤。芯片系统可以为单个芯片，或者多个芯片组成的芯片模组。
在上述实施例中，对各个实施例的描述都各有侧重，某个实施例中没有详述或记载的部分，可以参见其它实施例的相关描述。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及方法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
以上实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围，均应包含在本申请的保护范围之内。

Claims (42)

  1. 一种远程协助方法，其特征在于，应用于包括第一设备、第二设备和第三设备的系统，所述第三设备为所述第一设备的协助设备，所述方法包括：
    所述第一设备在获取到第一信息后，启动所述第一设备中的第一远程协助应用，其中，所述第一信息包括用于控制所述第二设备的第二应用的应用标识和用于表征所述第二设备支持远程控制的标识；
    所述第一设备通过所述第一远程协助应用向所述第三设备发送远程协助请求，所述远程协助请求中携带有所述第二应用的应用标识；
    响应于接收所述远程协助请求，所述第三设备启动所述第三设备中的第二远程协助应用，所述第二远程协助应用中显示有所述第二应用的第一操控界面；
    响应于在所述第二应用的第一操控界面接收的操控指令，所述第三设备对所述第二设备进行远程控制。
  2. 如权利要求1所述的方法，其特征在于，所述方法还包括：
    所述第三设备的第二远程协助应用显示第一界面，所述第一界面包括第一控件，所述第一控件用于指示所述第三设备搜索电子设备；
    所述第三设备检测到用户输入的第一操作，所述第一操作作用于所述第一控件；
    响应于所述第一操作，所述第三设备的第二远程协助应用显示第二界面，所述第二界面显示有搜索到的电子设备的标识，所述搜索到的电子设备的标识中包括所述第一设备的标识；
    所述第三设备检测到用户输入的第二操作，第二操作作用于所述第一设备的标识；
    响应于所述第二操作，所述第三设备通过第二远程协助应用向所述第一设备发送第一请求，所述第一请求中携带有所述第三设备的账号信息，所述第一请求用于指示所述第一设备设置所述第三设备为所述第一设备的协助设备；
    响应于接收所述第一请求，所述第一设备设置所述第三设备为所述第一设备的协助设备；
    所述第一设备存储所述第一设备和所述第三设备的协助关系，所述第一设备和所述第三设备的协助关系包括：所述第一设备的账号信息和所述第三设备的账号信息的对应关系。
  3. 如权利要求2所述的方法，其特征在于，在所述第一设备设置所述第三设备为所述第一设备的协助设备之后，还包括：
    所述第一设备向所述第三设备发送第二信息，所述第二信息携带有所述第一设备的账号信息，或者所述第二信息携带有所述第一设备的账号信息和所述第三设备的账号信息的协助关系；
    响应于接收所述第二信息，所述第三设备设置所述第一设备为所述第三设备的被协助设备；
    所述第三设备存储所述第一设备和所述第三设备的协助关系。
  4. 如权利要求1至3任一项所述的方法，其特征在于，所述第一设备设有NFC模块，所述第一信息为所述第二设备的NFC标签信息，
    所述第一设备在获取到第一信息后，启动所述第一设备中的第一远程协助应用，包括：
    所述第一设备通过所述NFC模块获取到所述第二设备的NFC标签信息后，响应于根 据所述用于表征所述第二设备支持远程控制的标识确定所述第二设备支持远程控制，所述第一设备启动所述第一设备中的第一远程协助应用。
  5. 如权利要求1至4任一项所述的方法，其特征在于，所述响应于接收所述远程协助请求，所述第三设备启动所述第三设备中的第二远程协助应用，包括：
    响应于接收所述远程协助请求，所述第三设备显示第三界面，所述第三界面包含有第二控件和第三控件，所述第二控件用于同意所述远程协助请求，所述第三控件用于拒绝所述远程协助请求；
    检测到用户输入的第三操作，所述第三操作作用于所述第二控件；
    响应于所述第三操作，所述第三设备启动所述第三设备中的第二远程协助应用。
  6. 如权利要求5所述的方法，其特征在于，所述第二远程协助应用中显示有所述第二应用的第一操控界面包括：
    所述第二远程协助应用中显示有所述第二应用的入口图标；
    响应于通过所述第二应用的入口图标接收到的进入指令，所述第二远程协助应用显示所述第二应用的第一操控界面。
  7. 如权利要求1至6任一项所述的方法，其特征在于，所述系统还包括第一云平台，所述第一设备通过所述第一远程协助应用向第三设备发送远程协助请求，包括：
    所述第一设备通过所述第一远程协助应用向所述第一云平台发送第一远程协助请求，所述第一远程协助请求携带有所述第二应用的应用标识，所述第一远程协助请求用于指示所述第一云平台向所述第三设备发送第二远程协助请求；
    响应于接收所述第一远程协助请求，所述第一云平台向所述第三设备发送所述第二远程协助请求，所述第二远程协助请求携带有所述第二应用的应用标识。
  8. 如权利要求1至7任一项所述的方法，其特征在于，所述系统还包括第一云平台，所述响应于在所述第二应用的第一操控界面接收的操控指令，所述第三设备对所述第二设备进行远程控制，包括：
    响应于在所述第二应用的第一操控界面接收的操控指令，所述第三设备通过所述第二远程协助应用向所述第一云平台发送第一操控指令，所述第一操控指令用于指示所述第二设备执行与所述操控指令对应的操作；
    响应于接收所述第一操控指令，所述第一云平台向所述第一设备发送第二操控指令，所述第二操控指令用于指示所述第二设备执行与所述操控指令对应的操作；
    响应于接收所述第二操控指令，所述第一设备向所述第二设备发送第三操控指令，所述第三操控指令用于指示所述第二设备执行与所述操控指令对应的操作。
  9. 如权利要求8所述的方法，其特征在于，所述第一信息还包括所述第二设备的设备标识；
    在所述第一设备向所述第二设备发送第三操控指令之前，所述方法还包括：
    所述第一设备基于所述第二设备的设备标识和所述第一设备建立连接。
  10. 如权利要求1至7任一项所述的方法，其特征在于，
    所述系统还包括第一云平台，所述响应于在所述第二应用的第一操控界面接收的操控指令，所述第三设备对所述第二设备进行远程控制，包括：
    响应于在所述第二应用的第一操控界面接收的操控指令，所述第三设备通过所述第二 远程协助应用向第一云平台发送第四操控指令，所述第四操控指令用于指示所述第二设备执行与所述操控指令对应的操作；
    响应于接收所述第四操控指令，所述第一云平台向所述第二设备发送第五操控指令，所述第五操控指令用于指示所述第二设备执行与所述操控指令对应的操作；
    或，
    响应于在所述第二应用的第一操控界面接收的操控指令，所述第三设备通过所述第二远程协助应用向第一云平台发送第六操控指令，所述第六操控指令用于指示所述第二设备执行与所述操控指令对应的操作；
    响应于接收所述第六操控指令，所述第一云平台向第二云平台发送第七操控指令，所述第七操控指令用于指示所述第二设备执行与所述操控指令对应的操作，所述第七操控指令用于指示所述第二云平台向所述第二设备发送第八操控指令，所述第八操控指令用于指示所述第二设备执行与所述操控指令对应的操作。
  11. 如权利要求1至10任一项所述的方法，其特征在于，在所述第一设备启动所述第一设备中的第一远程协助应用之后，所述方法还包括：
    所述第一设备中的第一远程协助应用显示所述第二应用的第二操控界面。
  12. 如权利要求11所述的方法，其特征在于，所述方法还包括：
    所述第一设备中的第一远程协助应用的操控界面包括第四控件，所述第四控件用于向所述第三设备发起求助；
    检测到用户输入的第四操作，所述第四操作作用于所述第四控件；
    响应于所述第四操作，所述第一设备通过所述第一远程协助应用向所述第三设备发送远程协助请求。
  13. 如权利要求12所述的方法，其特征在于，在所述第一设备通过所述第一远程协助应用向第三设备发送远程协助请求之前，所述方法还包括：
    所述第一设备获取到第三信息，所述第三信息包括用于控制第四设备的第四应用的应用标识和用于表征所述第四设备支持远程控制的标识；
    所述第一设备通过所述第一远程协助应用显示所述第四应用的操控界面；
    所述第一设备通过所述第一远程协助应用向第三设备发送远程协助请求，具体为：
    所述第一设备通过所述第一远程协助应用向第三设备发送远程协助请求，所述远程协助请求中携带有所述第二应用的应用标识和所述第四应用的应用标识。
  14. 如权利要求12或13所述的方法，其特征在于，在所述第一设备通过所述第一远程协助应用向第三设备发送远程协助请求之后，还包括：
    所述第一设备获取到第四信息，所述第四信息包括用于控制第五设备的第五应用的应用标识和用于表征所述第五设备支持远程控制的标识；
    所述第一设备通过所述第一远程协助应用显示所述第五应用的操控界面；
    所述第一设备向所述第三设备发送所述第五应用的应用标识。
  15. 如权利要求13所述的方法，其特征在于，所述第三设备的第二远程协助应用接收到至少两个被控设备的控制应用的应用标识，所述至少两个被控设备包括所述第二设备和所述第四设备，所述第三设备通过所述第二远程协助应用显示所述第二应用的第一操控界面之后，所述方法还包括：
    响应于接收到的第一切换指令，所述第三设备的所述第二远程协助应用中显示的所述第二应用的第一操控界面切换为所述第四应用的操控界面。
  16. 如权利要求1至15任一项所述的方法，其特征在于，所述方法还包括：
    所述第一设备通过靠近或触碰所述第二设备，获取所述第一信息。
  17. 如权利要求2所述的方法，其特征在于，所述第一设备通过所述第一远程协助应用向所述第三设备发送远程协助请求之前，所述方法还包括：
    所述第一设备通过存储的所述协助关系查找所述第一设备的协助设备，所述第一设备的协助设备包括所述第三设备。
  18. 如权利要求17所述的方法，其特征在于，所述方法还包括：
    当所述第一设备的协助设备为至少两个时，所述第三设备为所述第一设备的协助设备中优先级最高的一个。
  19. 一种远程协助方法，其特征在于，包括：
    第一设备在获取到第一信息后，启动所述第一设备中的第一远程协助应用，其中，所述第一信息包括用于控制第二设备的第二应用的应用标识和用于表征所述第二设备支持远程控制的标识；
    所述第一设备通过所述第一远程协助应用向第三设备发送远程协助请求，所述第三设备为所述第一设备的协助设备，所述远程协助请求中携带有第二应用的应用标识，所述远程协助请求用于指示所述第三设备启动第二远程协助应用。
  20. 如权利要求19所述的方法，其特征在于，所述方法还包括：
    响应于接收第一请求，所述第一设备设置所述第三设备为所述第一设备的协助设备，其中，所述第一请求为所述第三设备向所述第一设备发送的，所述第一请求中携带有第三设备的账号信息；
    所述第一设备存储所述第一设备和所述第三设备的协助关系，所述第一设备和所述第三设备的协助关系包括：所述第一设备的账号信息和所述第三设备的账号信息的对应关系；
    所述第一设备向所述第三设备发送第二信息，所述第二信息携带有所述第一设备的账号信息，或者所述第二信息携带有所述第一设备的账号信息和所述第三设备的账号信息的对应关系，所述第二信息用于指示所述第三设备设置所述第一设备为所述第三设备的被协助设备。
  21. 如权利要求19或20所述的方法，其特征在于，所述第一设备设有NFC模块，所述第一信息为所述第二设备的NFC标签信息，
    所述第一设备在获取到第一信息后，启动所述第一设备中的第一远程协助应用，包括：
    所述第一设备通过所述NFC模块获取到所述第二设备的NFC标签信息后，响应于根据所述用于表征所述第二设备支持远程控制的标识确定所述第二设备支持远程控制，启动所述第一设备中的第一远程协助应用。
  22. 如权利要求19至21任一项所述的方法，其特征在于，所述第一设备通过所述第一远程协助应用向第三设备发送远程协助请求包括：
    所述第一设备通过所述第一远程协助应用向第一云平台发送第一远程协助请求，所述第一远程协助请求携带有所述第二应用的应用标识，所述第一远程协助请求用于指示所述第一云平台向所述第三设备发送第二远程协助请求，所述第二远程协助请求携带有所述第 二应用的应用标识。
  23. 如权利要求19至22任一项所述的方法，其特征在于，在所述第一设备启动所述第一设备中的第一远程协助应用之后，所述方法还包括：
    所述第一设备中的第一远程协助应用显示所述第二应用的操控界面。
  24. 如权利要求23所述的方法，其特征在于，所述方法还包括：
    所述第一设备中的第一远程协助应用的操控界面包括第四控件，所述第四控件用于向所述第三设备发起求助；
    检测到用户输入的第四操作，所述第四操作作用于所述第四控件；
    响应于所述第四操作，所述第一设备通过所述第一远程协助应用向所述第三设备发送远程协助请求。
  25. 如权利要求24所述的方法，其特征在于，在所述第一设备通过所述第一远程协助应用向第三设备发送远程协助请求之前，所述方法还包括：
    所述第一设备获取到第三信息，所述第三信息包括用于控制第四设备的第四应用的应用标识和用于表征所述第四设备支持远程控制的标识；
    所述第一设备通过所述第一远程协助应用显示第四应用的操控界面；
    所述第一设备通过所述第一远程协助应用向第三设备发送远程协助请求，具体为：
    所述第一设备通过所述第一远程协助应用向第三设备发送远程协助请求，所述远程协助请求中携带有所述第二应用的应用标识和所述第四应用的应用标识。
  26. 如权利要求24或25所述的方法，其特征在于，在所述第一设备通过所述第一远程协助应用向第三设备发送远程协助请求之后，还包括：
    所述第一设备获取到第四信息，所述第四信息包括用于控制第五设备的第五应用的应用标识和用于表征所述第五设备支持远程控制的标识；
    所述第一设备通过所述第一远程协助应用显示第五应用的操控界面；
    所述第一设备向所述第三设备发送所述第五应用的应用标识。
  27. 如权利要求25所述的方法，其特征在于，所述第一设备获取到至少两个被控设备的控制应用的应用标识，所述至少两个被控设备包括所述第二设备和所述第四设备所述第一设备中的第一远程协助应用显示所述第二应用的第二操控界面之后，所述方法还包括：
    响应于接收到的第二切换指令，所述第一设备的所述第一远程协助应用中当前显示的所述第二应用的操控界面切换为所述第四应用的操控界面。
  28. 如权利要求19至27任一项所述的方法，其特征在于，所述方法还包括：
    所述第一设备通过靠近或触碰所述第二设备，获取所述第一信息。
  29. 如权利要求20所述的方法，其特征在于，所述第一设备通过所述第一远程协助应用向所述第三设备发送远程协助请求之前，所述方法还包括：
    所述第一设备通过存储的所述协助关系查找所述第一设备的协助设备，所述第一设备的协助设备包括所述第三设备。
  30. 如权利要求29所述的方法，其特征在于，所述方法还包括：
    当所述第一设备的协助设备为至少两个时，所述第三设备为所述第一设备的协助设备中优先级最高的一个。
  31. 一种远程协助方法，其特征在于，包括：
    响应于接收远程协助请求，第三设备启动所述第三设备中的第二远程协助应用，其中，所述远程协助请求为第一设备通过第一远程协助应用向所述第三设备发送的，所述远程协助请求中携带有用于控制第二设备的第二应用的应用标识，所述第二远程协助应用中显示有所述第二应用的操控界面；
    响应于在所述第二应用的操控界面接收的操控指令，所述第三设备对所述第二设备进行远程控制。
  32. 如权利要求31所述的方法，其特征在于，所述方法还包括：
    所述第三设备的第二远程协助应用显示第一界面，所述第一界面包括第一控件，所述第一控件用于指示所述第三设备搜索电子设备；
    所述第三设备检测到用户输入的第一操作，所述第一操作作用于所述第一控件；
    响应于所述第一操作，所述第三设备的第二远程协助应用显示第二界面，所述第二界面显示有搜索到的电子设备的标识，所述搜索到的电子设备的标识中包括所述第一设备的标识；
    所述第三设备检测到用户输入的第二操作，第二操作作用于所述第一设备的标识；
    响应于所述第二操作，所述第三设备通过第二远程协助应用向所述第一设备发送第一请求，所述第一请求中携带有所述第三设备的账号信息，所述第一请求用于指示所述第一设备设置所述第三设备为所述第一设备的协助设备。
  33. 如权利要求31或32所述的方法，其特征在于，所述响应于接收所述远程协助请求，所述第三设备启动所述第三设备中的第二远程协助应用，包括：
    响应于接收所述远程协助请求，所述第三设备显示第三界面，所述第三界面包含有第二控件和第三控件，所述第二控件用于同意所述远程协助请求，所述第三控件用于拒绝所述远程协助请求；
    检测到用户输入的第三操作，所述第三操作作用于所述第二控件；
    响应于所述第三操作，所述第三设备启动所述第三设备中的第二远程协助应用。
  34. 如权利要求33所述的方法，其特征在于，所述第三设备中的所述第二远程协助应用中显示有所述第二应用的操控界面包括：
    所述第三设备中的所述第二远程协助应用中显示有所述第二应用的入口图标；
    响应于通过所述第二应用的入口图标接收到的进入指令，所述第二远程协助应用显示所述第二应用的操控界面。
  35. 如权利要求30至34任一项所述的方法，其特征在于，所述响应于在所述第二应用的操控界面接收的操控指令，所述第三设备对所述第二设备进行远程控制，包括：
    响应于在所述第二应用的操控界面接收的操控指令，所述第三设备通过所述第二远程协助应用向第一云平台发送第一操控指令，所述第一操控指令用于指示所述第一云平台向所述第一设备发送第二操控指令，所述第二操控指令用于指示所述第一设备向所述第二设备发送第三操控指令，所述第一操控指令、第二操控指令和所述第三操控指令均用于指示所述第二设备执行与所述操控指令对应的操作；
    或，响应于在所述第二应用的操控界面接收的操控指令，所述第三设备通过所述第二远程协助应用向第一云平台发送第四操控指令，所述第四操控指令用于指示所述第一云平 台向所述第二设备发送第五操控指令，所述第四操控指令和所述第五操控指令均用于指示所述第二设备执行与所述操控指令对应的操作；
    或，响应于在所述第二应用的操控界面接收的操控指令，所述第三设备通过所述第二远程协助应用向第一云平台发送第六操控指令，所述第六操控指令用于指示所述第一云平台向第二云平台发送第七操控指令，所述第七操控指令用于指示第二云平台向所述第二设备发送第八操控指令，其中，所述第六操控指令、所述第七操控指令和所述第八操控指令均用于指示所述第二设备执行与所述操控指令对应的操作。
  36. 如权利要求30至35任一项所述的方法，其特征在于，所述远程协助请求中还携带有用于控制第四设备的第四应用的应用标识，所述方法还包括：
    所述第三设备在所述第二远程协助应用中显示所述第二应用的操纵界面或所述第四应用的操控界面。
  37. 如权利要求30至36任一项所述的方法，其特征在于，在所述第三设备启动所述第三设备中的第二远程协助应用之后，还包括：
    接收用于控制第五设备的第五应用的应用标识，所述第三设备在所述第二远程协助应用中显示所述第五应用的操控界面。
  38. 如权利要求36所述的方法，其特征在于，所述第三设备的第二远程协助应用接收到至少两个被控设备的控制应用的应用标识，所述至少两个被控设备包括所述第二设备和所述第四应用，所述第三设备通过所述第二远程协助应用显示所述第二应用的第一操控界面之后，所述方法还包括：
    响应于接收到的第一切换指令，所述第三设备的所述第二远程协助应用中当前显示的所述第二应用的操控界面切换为所述第四应用的操控界面。
  39. 一种电子设备，其特征在于，所述电子设备包括处理器，所述处理器用于运行存储器中存储的计算机程序，以使得所述电子设备实现如权利要求19至30任一项所述的方法。
  40. 一种电子设备，其特征在于，所述电子设备包括处理器，所述处理器用于运行存储器中存储的计算机程序，以使得所述电子设备实现如权利要求31至38任一项所述的方法。
  41. 一种远程协助系统，其特征在于，所述远程协助系统包括如权利要求39所述的电子设备，以及如权利要求40所述的电子设备。
  42. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质中存储计算机程序，所述计算机程序在处理器上运行时实现如权利要求19至30任一项所述的方法和/或如权利要求31至38任一项所述的方法。
PCT/CN2021/116514 2020-10-27 2021-09-03 一种远程协助方法、电子设备、系统及存储介质 WO2022088991A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP21884722.6A EP4216060A4 (en) 2020-10-27 2021-09-03 REMOTE ASSISTANCE METHOD AND SYSTEM AND ELECTRONIC DEVICE AND STORAGE MEDIUM
US18/307,242 US20230262110A1 (en) 2020-10-27 2023-04-26 Remote Assistance Method and System, Electronic Device, and Storage Medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011167175.3 2020-10-27
CN202011167175.3A CN114510303A (zh) 2020-10-27 2020-10-27 一种远程协助方法、电子设备、系统及存储介质

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/307,242 Continuation US20230262110A1 (en) 2020-10-27 2023-04-26 Remote Assistance Method and System, Electronic Device, and Storage Medium

Publications (1)

Publication Number Publication Date
WO2022088991A1 true WO2022088991A1 (zh) 2022-05-05

Family

ID=81381845

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/116514 WO2022088991A1 (zh) 2020-10-27 2021-09-03 一种远程协助方法、电子设备、系统及存储介质

Country Status (4)

Country Link
US (1) US20230262110A1 (zh)
EP (1) EP4216060A4 (zh)
CN (1) CN114510303A (zh)
WO (1) WO2022088991A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105025373A (zh) * 2014-04-21 2015-11-04 深圳Tcl新技术有限公司 电视机、远程控制系统及其控制方法
CN108510984A (zh) * 2017-02-24 2018-09-07 九阳股份有限公司 一种智能家电设备的语音协同控制方法
CN108710517A (zh) * 2017-04-10 2018-10-26 佛山市顺德区美的电热电器制造有限公司 家用电器远程协助控制方法及控制系统
US20190296930A1 (en) * 2018-03-20 2019-09-26 Essential Products, Inc. Remote control of an assistant device using an adaptable user interface

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014092441A1 (en) * 2012-12-13 2014-06-19 Samsung Electronics Co., Ltd. Device control method for registering device information of peripheral device, and device and system thereof
CN104135443B (zh) * 2014-06-27 2018-07-27 小米科技有限责任公司 路由器控制方法及装置
CN104038560A (zh) * 2014-06-30 2014-09-10 北京奇虎科技有限公司 移动终端间的远程协助方法、客户端、电子设备及系统
CN106161496B (zh) * 2015-03-25 2019-07-23 阿里巴巴集团控股有限公司 终端的远程协助方法及装置、系统
CN108668139B (zh) * 2017-03-27 2021-03-19 腾讯科技（深圳）有限公司 直播互动系统、方法及装置
CN109587536A (zh) * 2017-09-29 2019-04-05 中兴通讯股份有限公司 一种远程遥控方法、设备、服务器和系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105025373A (zh) * 2014-04-21 2015-11-04 深圳Tcl新技术有限公司 电视机、远程控制系统及其控制方法
CN108510984A (zh) * 2017-02-24 2018-09-07 九阳股份有限公司 一种智能家电设备的语音协同控制方法
CN108710517A (zh) * 2017-04-10 2018-10-26 佛山市顺德区美的电热电器制造有限公司 家用电器远程协助控制方法及控制系统
US20190296930A1 (en) * 2018-03-20 2019-09-26 Essential Products, Inc. Remote control of an assistant device using an adaptable user interface

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4216060A4

Also Published As

Publication number Publication date
EP4216060A4 (en) 2024-04-03
US20230262110A1 (en) 2023-08-17
CN114510303A (zh) 2022-05-17
EP4216060A1 (en) 2023-07-26

Similar Documents

Publication Publication Date Title
WO2020224486A1 (zh) 一种通话方法、设备及系统
US11800172B2 (en) Terminal device, method and system for realizing one-touch screen projection through remote control
EP4030276B1 (en) Content continuation method and electronic device
US20220004315A1 (en) Multimedia Data Playing Method and Electronic Device
WO2021036835A1 (zh) 一种蓝牙搜索方法、系统及相关装置
WO2020224449A1 (zh) 一种分屏显示的操作方法及电子设备
JP2022529033A (ja) ブルートゥース接続方法、デバイス、およびシステム
WO2022100610A1 (zh) 投屏方法、装置、电子设备及计算机可读存储介质
EP4002144A1 (en) File sharing method and device for mobile terminal
WO2021023046A1 (zh) 一种电子设备控制方法及一种电子设备
WO2022042326A1 (zh) 显示控制的方法及相关装置
WO2020088633A1 (zh) 支付方法、装置和用户设备
US11949805B2 (en) Call method and apparatus
EP4250075A1 (en) Content sharing method, electronic device, and storage medium
WO2020216160A1 (zh) 一种se的自动路由方法及电子设备
WO2020221062A1 (zh) 一种导航操作方法及电子设备
CN113365274B (zh) 一种网络接入方法和电子设备
WO2020062304A1 (zh) 一种文件传输方法及电子设备
EP4354831A1 (en) Cross-device method and apparatus for synchronizing navigation task, and device and storage medium
WO2023020012A1 (zh) 设备之间的数据通信方法、设备、存储介质及程序产品
WO2022088991A1 (zh) 一种远程协助方法、电子设备、系统及存储介质
WO2021218544A1 (zh) 一种提供无线上网的系统、方法及电子设备
WO2024087807A1 (zh) 协同控制方法、装置、电子设备及可读存储介质
WO2023025059A1 (zh) 一种通信系统及通信方法
WO2024093614A1 (zh) 设备输入方法、系统、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21884722

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021884722

Country of ref document: EP

Effective date: 20230417

NENP Non-entry into the national phase

Ref country code: DE