EP3136230B1 - Method and client terminal for remote assistance - Google Patents

Method and client terminal for remote assistance Download PDF

Info

Publication number
EP3136230B1
EP3136230B1 EP16178604.1A EP16178604A EP3136230B1 EP 3136230 B1 EP3136230 B1 EP 3136230B1 EP 16178604 A EP16178604 A EP 16178604A EP 3136230 B1 EP3136230 B1 EP 3136230B1
Authority
EP
European Patent Office
Prior art keywords
terminal
file
script file
user
remote assistance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP16178604.1A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP3136230A1 (en
Inventor
Liangliang HE
Zesheng WU
Honghua Feng
Qiming CHENG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xiaomi Inc
Original Assignee
Xiaomi Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xiaomi Inc filed Critical Xiaomi Inc
Publication of EP3136230A1 publication Critical patent/EP3136230A1/en
Application granted granted Critical
Publication of EP3136230B1 publication Critical patent/EP3136230B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G06F9/453—Help systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/70—Software maintenance or management
    • G06F8/71—Version control; Configuration management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08—Configuration management of networks or network elements
    • H04L41/0803—Configuration setting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/02—Terminal devices

Definitions

  • the present disclosure generally relates to the field of communication technology, and more particularly, to a method and a client terminal for remote assistance.
  • mobile terminals tend to have more and more functions for users.
  • the user may wish to introduce a function on the mobile terminal to another user in a remote place.
  • how to facilitate the user to introduce a function on the mobile terminal to another user in a remote place more clearly and conveniently is a critical issue for improving user experience.
  • the present disclosure provides a method and a client terminal for remote assistance.
  • the remote assistance file further contains an execution result of the script file; and if the script file is compatible with the controlled terminal, executing the script file to perform the user operation corresponding to the script file includes:
  • the execution result of the script file contains an execution result in a text format or an execution result in an image format, wherein the execution result in an image format contains a screenshot of the execution result or any one frame of image in the video file.
  • a device for remote assistance as defined by claim 4.
  • the remote assistance file received by the receiving module further contains an execution result of the script file; and the executing module includes:
  • the execution result of the script file displayed by the displaying sub-module contains an execution result in a text format or an execution result in an image format, wherein the execution result in an image format contains a screenshot of the execution result or any one frame of image in the video file.
  • the remote assistance file sent by the controlling terminal is received.
  • the remote assistance file contains a script file generated by the controlling terminal based on user operation. It is decided whether the script is compatible with the controlled terminal. If the script is compatible with the controlled terminal, the script file is executed to perform the user operation corresponding to the script file. Thereby, by transmitting a script file generated based on user operation between the controlled terminal and the controlling terminal, remote assistance can be performed more conveniently and user experience can be improved.
  • first element can also be referred to as a second element.
  • second element can also be referred to as a first element.
  • a term “if” as used herein can be interpreted as "when", “where” or "in response to”.
  • Remote assistance refers to technology that a controlling terminal remotely controls a controlled terminal over a network.
  • a remote connection is typically required to be established between the controlling terminal and the controlled terminal.
  • the controlled terminal shares local data (for example, share the desktop) to the controlling terminal through the established remote connection in real time.
  • the controlling terminal sends a remote control instruction in real time to the controlled terminal through the remote connection according to data shared by the controlled terminal for the controlled terminal to perform the remote control instruction to complete the remote control.
  • the remote assistance between the controlling terminal and the controlled terminal typically relies on the remote connection established between these devices. That is, in the remote assistance, once the remote connection between the devices is interrupted due to failure in the network, the remote assistance will fail, which causes inconvenience.
  • the remote assistance file sent by the controlling terminal is received.
  • the remote assistance file contains a script file generated by the controlling terminal based on user operation. It is decided whether the script is compatible with the controlled terminal. If the script is compatible with the controlled terminal, the script file is executed to perform the user operation corresponding to the script file. Thereby, by transmitting a script file generated based on user operation between the controlled terminal and the controlling terminal, remote assistance can be performed more conveniently and user experience can be improved.
  • Fig. 1 is a flow chart illustrating a method for remote assistance according to an exemplary embodiment.
  • the method for remote assistance is applied in a terminal, and includes the following steps.
  • step 101 a remote assistance file sent by a controlling terminal is received, the remote assistance file containing a script file generated by the controlling terminal based on user operation.
  • step 102 it is decided whether the script file is compatible with the controlled terminal.
  • step 103 if the script file is compatible with the controlled terminal, the script file is executed to perform the user operation corresponding to the script file.
  • the above terminal can be a mobile terminal.
  • the mobile terminal can be a smart phone.
  • Remote assistance between a user of the controlled terminal and a user of the controlling terminal typically is implemented through client software installed on the terminals.
  • the client software can be a client APP installed on the terminals to be used for providing a function of remote assistance.
  • the client software can be at a system level, or can be third party client software which has root permission.
  • the client software can be a dedicated APP in an operating system of a mobile phone of a user, which is configured to implement the function of remote assistance; or the client software can be a third party APP having root permission, which is integrated with the function of remote assistance.
  • the third party APP can be a communication application such as Mitalk, Wechat or the like.
  • the controlling terminal can provide remote assistance to the controlled terminal by sending a remote assistance file to the controlled terminal.
  • the process of remote assistance between the controlled terminal and the controlling terminal will be described in detail with reference to an example in which the controlled terminal is a controlled terminal and the controlling terminal is a controlling terminal.
  • the first user of the controlled terminal when a first user of the controlled terminal, in use of the terminal, cannot properly perform an operation of a function of the terminal, the first user of the controlled terminal can send an instant message to a second user of the controlling terminal informing the second user of the controlling terminal about the situation.
  • the first user of the controlled terminal can send it through the above client software, or can send it through other instant communication software (such as Wechat, Mitalk and other communication software) or other manners (such as a short message). This is not specifically limited by the present embodiment.
  • the second user of the controlling terminal After the second user of the controlling terminal receives the above instant message, the second user can perform an operation of the same function on the local terminal. Then, the above client software installed on the local terminal can generate a script file and a video file corresponding to the operation performed by the second user.
  • a Start Recording button can be provided on the interface of the above client software.
  • the Start Recording button When the above second user, in the foreground, presses the Start Recording button, it can trigger a recording instruction to be sent to the client software in the background.
  • the client software receives the recording instruction in the background, the recording function is started, to record the operation of the second user as a corresponding script file and a corresponding video file.
  • a Finish Recording button can be provided on the interface of the above client software.
  • the above second user in the foreground, presses the Finish Recording button, it can trigger a finish recording instruction to be sent to the client software in the background.
  • the client software receives the finish recording instruction in the background, the client software finishes the recording, and stores the recorded script file and the recorded video file in locally.
  • the above client software can record the operation performed by the second user as a corresponding script file and a corresponding video file, through a preset script recording tool and a preset video recording tool which are run in the background.
  • the above client software can run the preset script recording tool, and capture relevant script instructions called at the background during the operation performed by the second user. Then, a corresponding script file is generated based on the captured script instructions.
  • the above client software can run the preset video recording tool, and capture screenshots of the desktop of the system with a certain interval between frames during the operation of the above second user. Then, a corresponding video file is generated based on the captured screenshots.
  • the above client software of the second user can generate a remote assistance file based on the recorded script file and the recorded video file, and send the remote assistance file to the above first user, to provide remote assistance to the first user.
  • the remote assistance file can be sent by the second user manually, or can be sent automatically by the client software.
  • a user list can be presented to the second user. The second user can select a receiving user (the receiving user can be multiple users including the first user) from the list.
  • the client software can be triggered to send the remote assistance file to the receiving user selected by the second user.
  • the client software can immediately send the generated remote assistance file to the sending party (i.e. the first user) of the above instant message which is received by the second user.
  • the above remote assistance file generated by the above client software of the second user can include the above script file, an execution result of the script file and the above video file.
  • the execution result of the script file can be an execution result in a text format, or can be an execution result in an image format.
  • the execution result in the image format can be a screenshot of the execution result or any one frame of image in the recorded video file.
  • the above second user provides remote assistance to the above first user as how to operate a function A in a mobile phone.
  • the client software of the above second user records the operation corresponding to the function A performed by the above second user on the mobile phone as a corresponding script file and a video file
  • the execution result of the script file can be a text message "The script file is for performing function A", or can be any one frame of image from the recorded video file such as a last frame of image in the video file, or can be a frame of image designated by the second user.
  • script file is recorded by the above second user with the client software, whether the script file can be properly played depends on whether the software environment of the receiving party is identical to the software environment of the party which records the script file.
  • the software environment of the receiving party is identical to the software environment of the party which records the script file, it means that the script file is compatible with the receiving party, and the receiving party can properly play the script file.
  • the above remote assistance file generated based on the script file and the video file recorded by the above client software of the second user can also include version data of client software and version data of an operating system on the terminal of the above second user which can describe the version data of client software and version data of an operating system of the controlling terminal of the above second user.
  • the remote assistance file can be firstly parsed to obtain information contained in the remote assistance file. Also, it is decided whether both of the version data of the client software and the version data of the operating system of the controlling terminal contained in the remote assistance file are identical to the version data of the client software and the version data of the operating system of the controlled terminal. If they are identical, it means that the local software environment of the client software is identical to the software environment of the above script file recorded by the second user. In this case, the local client software is compatible with the script file in the remote assistance file.
  • the execution result of the script file in the remote assistance file can be displayed to the above first user, to prompt the first user whether to execute the script file.
  • the client software can present a text prompt message "The script file is for performing function XX, whether to execute it?" to the first user.
  • the first user selects yes, it can trigger an instruction for executing the script file to be sent to the client software at the background; it is assumed that the execution result is an execution result in an image format, then the client software can output an image corresponding to the execution result to the user, and display a text prompt message "Whether to execute the script file?" at a preset position of the image.
  • the first user selects yes, it can trigger an instruction for executing the script file to be sent to the client software in the background.
  • the client software When the client software detects an instruction for executing the script file which is input by the first user, the client software executes the script file, to perform user operation corresponding to the local script file. Then, the remote assistance is completed.
  • the local client software After the above first user receives the remote assistance file, if either of the version data of the client software or the version data of the operating system contained in the remote assistance file is different from that of the local terminal, the local client software is not compatible with the script file in the remote assistance file.
  • the client software can play the video file in the remote assistance file, to demonstrate to the first user the operation performed by the second user which corresponds to the video file. After the first user watches the video file, the first user can learn the operation in the video file and perform the same operation on the local terminal.
  • the second user as the controlling party, can directly send the script file recorded based on the operation performed by the second user to the first user through offline transmission.
  • the first user can run the script file locally to complete the remote assistance.
  • the first user as the controlled party is not required to establish remote connection with the second user to share local data in real time.
  • the second user is not required to establish remote connection with the first user to send remote control instruction to the first user in real time.
  • the remote assistance between the first user and the second user is not required to establish remote connection, and even if any of the terminals is disconnected from the current network, the first user can nevertheless run the script file to complete the remote assistance as long as the second user has properly sent the above script file to the first user through offline transmission in advance.
  • remote assistance can be performed more conveniently and user experience can be improved.
  • the above remote assistance file can exclude the above video file and the version data of the above client software and the version data of the operating system.
  • the process of remote assistance between the controlled terminal and the controlling terminal with an example in which the controlled terminal is the controlling terminal and the controlling terminal is the controlled terminal, the process of the remote assistance between the controlled terminal and the controlling terminal is similar to the implementation described in the above embodiment, which is not repeated herein.
  • the remote assistance file sent by the controlling terminal is received.
  • the remote assistance file contains a script file generated by the controlling terminal based on user operation. It is decided whether the script is compatible with the controlled terminal. If the script is compatible with the controlled terminal, the script file is executed to perform the user operation corresponding to the script file. Thereby, by transmitting a script file generated based on user operation between the controlled terminal and the controlling terminal, remote assistance can be performed more conveniently and user experience can be improved.
  • Fig. 2 is a flow chart illustrating another method for remote assistance according to an exemplary embodiment.
  • the method for remote assistance is applied in a terminal, and includes the following steps.
  • a remote assistance file sent by a controlling terminal is received, the remote assistance file containing a script file generated by the controlling terminal based on user operation, a video file recorded by the controlling terminal based on user operation, version data of client software and version data of an operating system of the controlling terminal, and an execution result of the script file.
  • step 202 it is decided whether both of the version data of the client software and the version data of the operating system of the controlling terminal are identical to version data of client software and version data of an operating system of the controlled terminal.
  • step 203a when both of the version data of the client software and the version data of the operating system are identical to version data of client software and version data of an operating system of the controlled terminal, it is determined that the script file is compatible with the controlled terminal.
  • step 204a following the step 203 a the execution result is displayed to prompt a user of the controlled terminal whether to execute the script file.
  • step 205a upon an instruction input by the user for executing the script file being detected, the script file is executed to perform the user operation corresponding to the script file.
  • step 203b parallel to the step 203a, if the script file is not compatible with the controlled terminal, the video file is played to demonstrate the user operation corresponding to the video file.
  • the above step 203b includes: if either of the version data of the client software and the version data of the operating system is not identical to version data of client software or version data of an operating system of the controlled terminal, it is determined that the script file is not compatible with the controlled terminal, and the video file is played to demonstrate the user operation corresponding to the video file.
  • the above terminal can be a mobile terminal.
  • the mobile terminal can be a smart phone.
  • Remote assistance between a user of the controlled terminal and a user of the controlling terminal typically is implemented through client software installed on the terminals.
  • the client software can be a client APP installed on the terminals to be used for providing a function of remote assistance.
  • the client software can be at a system level, or can be third party client software which has root permission.
  • the client software can be a dedicated APP in an operating system of a mobile phone of a user, which is configured to implement the function of remote assistance; or the client software can be a third party APP having root permission, which is integrated with the function of remote assistance.
  • the third party APP can be a communication application such as Mitalk, Wechat or the like.
  • the first user terminal can be referred to as a controlled terminal and the second user terminal can be referred to as a controlling terminal.
  • the controlling terminal can provide remote assistance to the controlled terminal by sending a remote assistance file to the controlled terminal.
  • the process of remote assistance between the controlled terminal and the controlling terminal will be described in detail with reference to an example in which the first user terminal is a controlled terminal and the second user terminal is a controlling terminal.
  • the first user of the controlled terminal when a first user of the controlled terminal, in use of the terminal, cannot properly perform an operation of a function of the terminal, the first user of the controlled terminal can send an instant message to a second user of the controlling terminal informing the second user of the controlling terminal about the situation.
  • the first user of the controlled terminal can send it through the above client software, or can send it through other instant communication software (such as Wechat, Mitalk and other communication software) or other manners (such as a short message). This is not specifically limited by the present embodiment.
  • the second user of the controlling terminal After the second user of the controlling terminal receives the above instant message, the second user can perform an operation of the same function on the local terminal. Then, the above client software installed on the local terminal can generate a script file and a video file corresponding to the operation performed by the second user.
  • a Start Recording button can be provided on the interface of the above client software.
  • the Start Recording button When the above second user, in the foreground, presses the Start Recording button, it can trigger a recording instruction to be sent to the client software in the background.
  • the client software receives the recording instruction in the background, the recording function is started, to record the operation of the second user as a corresponding script file and a corresponding video file.
  • a Finish Recording button can be provided on the interface of the above client software.
  • the above second user in the foreground, presses the Finish Recording button, it can trigger a finish recording instruction to be sent to the client software in the background.
  • the client software receives the finish recording instruction in the background, the client software finishes the recording, and stores the recorded script file and the recorded video file in local.
  • the above client software can record the operation performed by the second user as a corresponding script file and a corresponding video file, through a preset script recording tool and a preset video recording tool which are run in the background.
  • the above client software can run the preset script recording tool, and capture relevant script instructions called in the background during the operation performed by the second user. Then, a corresponding script file is generated based on the captured script instructions.
  • the above client software can run the preset video recording tool, and capture screenshots of the desktop of the system with a certain interval between frames during the operation of the above second user. Then, a corresponding video file is generated based on the captured screenshots.
  • the above client software of the second user can generate a remote assistance file based on the recorded script file and the recorded video file, and send the remote assistance file to the above first user, to provide remote assistance to the first user.
  • the remote assistance file can be sent by the second user manually, or can be sent automatically by the client software.
  • a user list can be presented to the second user. The second user can select a receiving user (the receiving user can be multiple users including the first user) from the list.
  • the client software can be triggered to send the remote assistance file to the receiving user selected by the second user.
  • the client software can immediately send the generated remote assistance file to the sending party (i.e. the first user) of the above instant message which is received by the second user.
  • the above remote assistance file generated by the above client software of the second user can include the above script file, an execution result of the script file and the above video file.
  • the execution result of the script file can be an execution result in a text format, or can be an execution result in an image format.
  • the execution result in the image format can be a screenshot of the execution result or any one frame of image in the recorded video file.
  • the above second user provides remote assistance to the above first user as how to operate a function A in a mobile phone.
  • the client software of the above second user records the operation corresponding to the function A performed by the above second user on the mobile phone as a corresponding script file and a video file
  • the execution result of the script file can be a text message "The script file is for performing function A", or can be any one frame of image from the recorded video file such as a last frame of image in the video file, or can be a frame of image designated by the second user.
  • script file is recorded by the above second user with the client software, whether the script file can be properly played depends on whether the software environment of the receiving party is identical to the software environment of the party which records the script file.
  • the software environment of the receiving party is identical to the software environment of the party which records the script file, it means that the script file is compatible with the receiving party, and the receiving party can properly play the script file.
  • the above remote assistance file generated based on the script file and the video file recorded by the above client software of the second user also includes version data of client software and version data of an operating system on the terminal of the above second user which can describe the version data of client software and version data of an operating system of the controlling terminal of the above second user.
  • the remote assistance file can be firstly parsed to obtain information contained in the remote assistance file. Also, it is decided whether both of the version data of the client software and the version data of the operating system of the controlling terminal contained in the remote assistance file are identical to the version data of the client software and the version data of the operating system of the controlled terminal. If they are identical, it means that the software environment of the client software in local is identical to the software environment of the above script file recorded by the second user. In this case, the local client software is compatible with the script file in the remote assistance file.
  • the execution result of the script file in the remote assistance file can be displayed to the above first user, to prompt the first user whether to execute the script file.
  • the client software can present a text prompt message "The script file is for performing function XX, whether to execute it?" to the first user.
  • the first user selects yes, it can trigger an instruction for executing the script file to be sent to the client software in the background; it is assumed that the execution result is an execution result in an image format, then the client software can output an image corresponding to the execution result to the user, and display a text prompt message "Whether to execute the script file?" at a preset position of the image.
  • the first user selects yes, it can trigger an instruction for executing the script file to be sent to the client software in the background.
  • the client software When the client software detects an instruction for executing the script file which is input by the first user, the client software executes the script file, to perform user operation corresponding to the script file locally. Then, the remote assistance is completed.
  • the local client software After the above first user receives the remote assistance file, if either of the version data of the client software or the version data of the operating system contained in the remote assistance file is different from that of the local terminal, the local client software is not compatible with the script file in the remote assistance file.
  • the client software plays the video file in the remote assistance file, to demonstrate to the first user the operation performed by the second user which corresponds to the video file. After the first user watches the video file, the first user can learn the operation in the video file and perform the same operation on the local terminal.
  • the second user in the remote assistance between the first user and the second user, the second user as the controlling party, can directly send the script file recorded based on the operation performed by the second user to the first user through offline transmission.
  • the first user can run the script file locally to complete the remote assistance.
  • the first user as the controlled party is not required to establish remote connection with the second user to share local data in real time.
  • the second user is not required to establish remote connection with the first user to send remote control instruction to the first user in real time.
  • the remote assistance between the first user and the second user is not required to establish remote connection, and even if any of the terminals is disconnected from the current network, the first user can nevertheless run the script file to complete the remote assistance as long as the second user has properly sent the above script file to the first user through offline transmission in advance.
  • remote assistance can be performed more conveniently and user experience can be improved.
  • the above remote assistance file can exclude the above video file and the version data of the above client software and the version data of the operating system.
  • the process of remote assistance between the controlled terminal and the controlling terminal with an example in which the controlled is the controlled terminal and the controlling terminal is the controlling terminal, when the controlled terminal is the controlling terminal and the controlling terminal is the controlled terminal, the process of the remote assistance between the controlled terminal and the controlling terminal is similar to the implementation described in the above embodiment, which is not repeated herein.
  • the remote assistance file sent by the controlling terminal is received.
  • the remote assistance file contains a script file generated by the controlling terminal based on user operation. It is decided whether the script is compatible with the controlled terminal. If the script is compatible with the controlled terminal, the script file is executed to perform the user operation corresponding to the script file. Thereby, by transmitting a script file generated based on user operation between the controlled terminal and the controlling terminal, remote assistance can be performed more conveniently and user experience can be improved.
  • the present disclosure also provides embodiments regarding a client terminal for remote assistance.
  • Fig. 3 is a block diagram of a device for remote assistance according to an exemplary embodiment.
  • a device 300 for remote assistance includes: a receiving module 301, a deciding module 302 and an executing module 303.
  • the remote assistance file sent by the controlling terminal is received.
  • the remote assistance file contains a script file generated by the controlling terminal based on user operation. It is decided whether the script is compatible with the controlled terminal. If the script is compatible with the controlled terminal, the script file is executed to perform the user operation corresponding to the script file. Thereby, by transmitting a script file generated based on user operation between the controlled terminal and the controlling terminal, remote assistance can be performed more conveniently and user experience can be improved.
  • Fig. 4 is a block diagram of another device for remote assistance according to an exemplary embodiment.
  • the remote assistance file received by the receiving module 301 further contains version data of a client terminal and version data of an operating system of the controlling terminal; and the deciding module 302 includes: a deciding sub-module 302A and a determining sub-module 302B.
  • Fig. 5 is a block diagram of another device for remote assistance according to an exemplary embodiment.
  • the remote assistance file received by the receiving module 301 further contains a video file recorded by the controlling terminal based on user operation; and the device 300 further includes: a playing module 304.
  • the playing module 304 is configured to, when the deciding module 302 decides that the script file is not compatible with the controlled terminal, play the video file to demonstrate the user operation corresponding to the video file.
  • the above configuration of the playing module 304 shown in the above device embodiment in Fig. 5 can also be included in the above device embodiment in Fig. 4 . This is not limited in the present disclosure.
  • Fig. 6 is a block diagram of another device for remote assistance according to an exemplary embodiment.
  • the remote assistance file received by the receiving module 301 further contains an execution result of the script file; and the executing module 303 can include: a displaying sub-module 303A and an executing sub-module 303B.
  • the above configuration of the displaying sub-module 303A and the executing sub-module 303B shown in the above device embodiment in Fig. 6 can also be included in the above device embodiments in Figs. 4-5 . This is not limited in the present disclosure.
  • the execution result of the script file displayed by the displaying sub-module 303A contains an execution result in a text format or an execution result in an image format, wherein the execution result in an image format contains a screenshot of the execution result or any one frame of image in the video file.
  • the device embodiments since they correspond to the method embodiments, they can refer to the related parts of the description of the method embodiments.
  • the device embodiments described above are merely illustrative.
  • the units described as separate may be or may not be physically separate, and the components illustrated as a units may be or may not be physical units, and may be at the same location, or may be distributed to multiple units over the network.
  • a part of or all of the modules can be selected to achieve the controlling of the present disclosure as desired.
  • One skilled in the art can understand and practice the embodiments without inventive skill.
  • the present disclosure also provides a device for remote assistance, including:
  • the present disclosure also provides a terminal, including a memory and one or more programs, wherein, the one or more programs are stored in the memory, and one or more processors are configured to execute the one or more programs that contain instructions to cause the one or more processors to perform:
  • Fig. 7 is a block diagram of a device for remote assistance according to an exemplary embodiment.
  • the device 700 can be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a gaming console, a tablet, a medical device, exercise equipment, a personal digital assistant, and the like.
  • the device 700 can include one or more of the following components: a processing component 701, a memory 702, a power component 703, a multimedia component 704, an audio component 705, an input/output (I/O) interface 706, a sensor component 707, and a communication component 708.
  • a processing component 701 a memory 702
  • a power component 703 a multimedia component 704
  • an audio component 705 an input/output (I/O) interface 706, a sensor component 707, and a communication component 708.
  • I/O input/output
  • the processing component 701 typically controls overall operations of the device 700, such as the operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • the processing component 701 can include one or more processors 709 to execute instructions to perform all or part of the steps in the above described methods.
  • the processing component 701 can include one or more modules which facilitate the interaction between the processing component 701 and other components.
  • the processing component 701 can include a multimedia module to facilitate the interaction between the multimedia component 704 and the processing component 701.
  • the memory 702 is configured to store various types of data to support the operation of the device 700. Examples of such data include instructions for any applications or methods operated on the device 700, contact data, phonebook data, messages, pictures, video, etc.
  • the memory 702 can be implemented using any type of volatile or non-volatile memory devices, or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic or optical disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EPROM erasable programmable read-only memory
  • PROM programmable read-only memory
  • ROM read-only memory
  • magnetic memory a magnetic memory
  • flash memory a flash memory
  • magnetic or optical disk a magnetic or optical
  • the power component 703 provides power to various components of the device 700.
  • the power component 703 can include a power management system, one or more power sources, and any other components associated with the generation, management, and distribution of power in the device 700.
  • the multimedia component 704 includes a screen providing an output interface between the device 700 and the user.
  • the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes the touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can not only sense a boundary of a touch or swipe action, but also sense a period of time and a pressure associated with the touch or swipe action.
  • the multimedia component 704 includes a front camera and/or a rear camera. The front camera and the rear camera can receive an external multimedia datum while the device 700 is in an operation mode, such as a photographing mode or a video mode. Each of the front camera and the rear camera can be a fixed optical lens system or have focus and optical zoom capability.
  • the audio component 705 is configured to output and/or input audio signals.
  • the audio component 705 includes a microphone ("MIC") configured to receive an external audio signal when the device 700 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode.
  • the received audio signal can be further stored in the memory 702 or transmitted via the communication component 708.
  • the audio component 705 further includes a speaker to output audio signals.
  • the I/O interface 706 provides an interface between the processing component 701 and peripheral interface modules, such as a keyboard, a click wheel, buttons, and the like.
  • the buttons can include, but are not limited to, a home button, a volume button, a starting button, and a locking button.
  • the sensor component 707 includes one or more sensors to provide status assessments of various aspects of the device 700. For instance, the sensor component 707 can detect an open/closed status of the device 700, relative positioning of components, e.g., the display and the keypad, of the device 700, a change in position of the device 700 or a component of the device 700, a presence or absence of user contact with the device 700, an orientation or an acceleration/deceleration of the device 700, and a change in temperature of the device 700.
  • the sensor component 707 can include a proximity sensor configured to detect the presence of nearby controllings without any physical contact.
  • the sensor component 707 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor component 707 can also include an accelerometer sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • the communication component 708 is configured to facilitate communication, wired or wirelessly, between the device 700 and other devices.
  • the device 700 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof.
  • the communication component 708 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel.
  • the communication component 708 further includes a near field communication (NFC) module to facilitate short-range communications.
  • the NFC module can be implemented based on a radio frequency identification (RFID) technology, an infrared data association (IrDA) technology, an ultra-wideband (UWB) technology, a Bluetooth (BT) technology, and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • BT Bluetooth
  • the device 700 can be implemented with one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components, for performing the above described methods.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays
  • controllers micro-controllers, microprocessors, or other electronic components, for performing the above described methods.
  • non-transitory computer-readable storage medium including instructions, such as included in the memory 702, executable by the processor 709 in the device 700, for performing the above-described methods.
  • the non-transitory computer-readable storage medium can be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disc, an optical data storage device, and the like.
  • the mobile terminal when instructions in the storage medium are executed by a processor of a mobile terminal, the mobile terminal is caused to perform a method for remote assistance, including: receiving a remote assistance file sent by a controlling terminal, the remote assistance file containing a script file generated by the controlling terminal based on user operation; deciding whether the script file is compatible with the controlled terminal; and if the script file is compatible with the controlled terminal, executing the script file to perform the user operation corresponding to the script file.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Transfer Between Computers (AREA)
  • Stored Programmes (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
EP16178604.1A 2015-08-28 2016-07-08 Method and client terminal for remote assistance Active EP3136230B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510543414.3A CN105159672B (zh) 2015-08-28 2015-08-28 远程协助方法和客户端

Publications (2)

Publication Number Publication Date
EP3136230A1 EP3136230A1 (en) 2017-03-01
EP3136230B1 true EP3136230B1 (en) 2024-05-01

Family

ID=54800539

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16178604.1A Active EP3136230B1 (en) 2015-08-28 2016-07-08 Method and client terminal for remote assistance

Country Status (8)

Country Link
US (1) US9800666B2 (ko)
EP (1) EP3136230B1 (ko)
JP (1) JP6285615B2 (ko)
KR (1) KR101799894B1 (ko)
CN (1) CN105159672B (ko)
MX (1) MX360603B (ko)
RU (1) RU2656691C2 (ko)
WO (1) WO2017036039A1 (ko)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105159672B (zh) 2015-08-28 2019-08-30 小米科技有限责任公司 远程协助方法和客户端
CN106201491B (zh) * 2016-07-01 2020-02-07 北京奇虎科技有限公司 移动终端和移动终端远程协助过程控制方法、装置
CN107148012B (zh) * 2017-04-27 2021-01-01 努比亚技术有限公司 一种终端间的远程协助方法及其系统
CN107577489A (zh) * 2017-08-03 2018-01-12 捷开通讯(深圳)有限公司 远程帮助的方法、移动终端和存储装置
CN107544800A (zh) * 2017-08-28 2018-01-05 维沃移动通信有限公司 一种终端操作方法、操作文件的生成方法及终端
CN109714618A (zh) * 2017-10-26 2019-05-03 卓望数码技术（深圳）有限公司 一种基于安卓机顶盒的遥控按键监听方法和装置
CN108984255B (zh) * 2018-07-05 2021-05-28 腾讯科技（深圳）有限公司 一种远程协助方法及相关设备
CN110474979B (zh) * 2019-08-13 2022-06-21 北京软通绿城科技有限公司 一种远程协助系统、方法、平台及存储介质
CN110650199B (zh) * 2019-09-25 2022-08-12 湖南快乐阳光互动娱乐传媒有限公司 远程连接方法及装置
CN111488165B (zh) * 2020-04-14 2023-08-25 爱瑟福信息科技(上海)有限公司 车辆ecu通过脚本升级的方法及其系统
CN111966435A (zh) * 2020-07-14 2020-11-20 维沃移动通信有限公司 电子设备的操作流程分享方法及装置
CN112099890A (zh) * 2020-09-03 2020-12-18 深圳市宝尔爱迪科技有限公司 远程协助移动终端的方法及系统、设备及存储介质
CN112083860A (zh) * 2020-09-07 2020-12-15 珠海格力电器股份有限公司 移动终端的控制方法及装置
US20220398112A1 (en) * 2021-06-11 2022-12-15 International Business Machines Corporation User interface accessibility navigation guide

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001282693A (ja) * 2000-03-31 2001-10-12 Hitachi Software Eng Co Ltd 操作支援システム
JP2003308293A (ja) * 2002-04-16 2003-10-31 Sharp Corp 操作記録装置、操作実行装置、それらの方法、それらのコンピュータ・プログラムおよびそれらのプログラムを記録した記録媒体
JP4095591B2 (ja) * 2004-08-04 2008-06-04 キヤノン株式会社 ユーザインタフェース装置、処理装置、ユーザインタフェース方法、プログラムおよび記憶媒体
JP2006227933A (ja) * 2005-02-17 2006-08-31 Nippon Telegr & Teleph Corp <Ntt> 遠隔操作システムおよび遠隔操作方法
US7533189B2 (en) * 2005-06-21 2009-05-12 Microsoft Corporation Enabling a graphical window modification command to be applied to a remotely generated graphical window
US20070113180A1 (en) * 2005-11-15 2007-05-17 Michael Danninger Method and system for providing improved help functionality to assist new or occasional users of software in understanding the graphical elements of a display screen
JP4865580B2 (ja) * 2006-02-23 2012-02-01 キヤノン株式会社 情報処理システム、情報機器、マクロ実行方法、及びプログラム
JP4849629B2 (ja) * 2007-05-10 2012-01-11 株式会社リコー 画像形成装置、画像形成装置の制御方法およびプログラム
WO2011152041A1 (ja) 2010-05-31 2011-12-08 パナソニック株式会社 制御端末装置及びリモート制御システム
CN102568529B (zh) * 2010-12-10 2015-06-03 金蝶软件（中国）有限公司 一种操作过程录放方法、装置及系统
US20120291011A1 (en) * 2011-05-12 2012-11-15 Google Inc. User Interfaces to Assist in Creating Application Scripts
KR20130033201A (ko) 2011-09-26 2013-04-03 한국전자통신연구원 스크립트 파일을 이용한 원격 실행 시험 시스템, 장치 및 방법
CN102664921B (zh) * 2012-03-28 2016-04-20 北京奇虎科技有限公司 一种远程协助方法及系统
CN102841789B (zh) * 2012-06-29 2016-05-25 北京奇虎科技有限公司 一种对浏览器中的用户操作进行录制和回放的方法和装置
CN103795835A (zh) * 2012-10-29 2014-05-14 北京三星通信技术研究有限公司 一种移动终端及其快捷操作的实现方法
KR20140080726A (ko) 2012-12-14 2014-07-01 한국전자통신연구원 동적 스크립트를 이용한 원격 제어 장치 및 방법
WO2015116189A1 (en) 2014-01-31 2015-08-06 Hewlett-Packard Development Company, L.P. User interface level tutorials
CN105094385B (zh) * 2015-06-30 2018-01-02 北京奇虎科技有限公司 远程控制的方法、装置及系统
CN105159672B (zh) * 2015-08-28 2019-08-30 小米科技有限责任公司 远程协助方法和客户端

Also Published As

Publication number Publication date
CN105159672A (zh) 2015-12-16
KR20170036653A (ko) 2017-04-03
MX360603B (es) 2018-11-09
WO2017036039A1 (zh) 2017-03-09
JP2017531891A (ja) 2017-10-26
CN105159672B (zh) 2019-08-30
RU2016113284A (ru) 2017-10-09
EP3136230A1 (en) 2017-03-01
US9800666B2 (en) 2017-10-24
JP6285615B2 (ja) 2018-02-28
MX2016004309A (es) 2017-05-03
KR101799894B1 (ko) 2017-11-22
US20170064001A1 (en) 2017-03-02
RU2656691C2 (ru) 2018-06-06

Similar Documents

Publication Publication Date Title
EP3136230B1 (en) Method and client terminal for remote assistance
US10908772B2 (en) Method and apparatus for adjusting running state of smart housing device
EP3136793B1 (en) Method and apparatus for awakening electronic device
EP3099042B1 (en) Methods and devices for sending cloud card
EP3249509A1 (en) Method and device for playing live videos
EP3099063A1 (en) Video communication method and apparatus
EP3119040B1 (en) Method and device for controlling a smart device
EP3145128B1 (en) Information collection method and apparatus
EP3136699A1 (en) Method and device for connecting external equipment
EP3125093A1 (en) Method and device for application interaction
EP3176776A1 (en) Luminance adjusting method and apparatus, computer program and recording medium
EP3076745B1 (en) Methods and apparatuses for controlling wireless access point
EP3024211B1 (en) Method and device for announcing voice call
EP3147802B1 (en) Method and apparatus for processing information
EP3322227B1 (en) Methods and apparatuses for controlling wireless connection, computer program and recording medium
EP3327548A1 (en) Method, device and terminal for processing live shows
EP3012725A1 (en) Method, device and electronic device for displaying descriptive icon information
EP3015965A1 (en) Method and apparatus for prompting device connection
EP3276974A1 (en) Video sharing method and apparatus, computer program and recording medium
EP3176982A1 (en) Alarm setting method and apparatus, computer program and recording medium
US20180254014A1 (en) Method and device for adjusting current of backlight, and storage medium
EP3015949A1 (en) Method and device for displaying information
US20160139770A1 (en) Method for presenting prompt on mobile terminal and the same mobile terminal
EP3128722A1 (en) File transmission method and apparatus, computer program and recording medium
EP3328020A1 (en) Control method and apparatus for wireless device, computer program and recording medium

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170828

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180201

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

REG Reference to a national code

Ref document number: 602016087236

Country of ref document: DE

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G06F0009440000

Ipc: G06F0009451000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 8/71 20180101ALI20231221BHEP

Ipc: G06F 9/451 20180101AFI20231221BHEP

INTG Intention to grant announced

Effective date: 20240117

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20240123

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016087236

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D