CN108984255B - Remote assistance method and related equipment - Google Patents
Remote assistance method and related equipment Download PDFInfo
- Publication number
- CN108984255B CN108984255B CN201810731750.4A CN201810731750A CN108984255B CN 108984255 B CN108984255 B CN 108984255B CN 201810731750 A CN201810731750 A CN 201810731750A CN 108984255 B CN108984255 B CN 108984255B
- Authority
- CN
- China
- Prior art keywords
- auxiliary
- information
- floating window
- script
- display interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application discloses a remote assistance method and related equipment, which comprise the following steps: the method comprises the steps that a layer of floating window is created on a display interface by first equipment; the first equipment acquires operation information aiming at the display content on the display interface, which is input by a user, through the floating window, and generates a serialized auxiliary operation script from the operation information; and the first equipment sends the auxiliary operation script to second equipment, wherein the auxiliary operation script is used for indicating the second equipment to execute operations in sequence. By adopting the embodiment of the application, the efficiency of remote assistance can be improved.
Description
Technical Field
The present application relates to the field of electronic technologies, and in particular, to a remote assistance method and a related device.
Background
With the popularity of smart devices, more and more people are beginning to use smart devices, including the elderly and others who have slight obstacles to using or understanding smart phones. In such a situation, a method for remotely assisting such users to use the smart phone is necessary.
In the prior art, a first device obtains a click operation event input by a user, injects the click operation event into a second device for corresponding response, and transmits a picture of the second device back to the first device in real time, so that the user of the first device can perform the next operation. However, this solution requires real-time desktop sharing, is network dependent, and can cause the helper to malfunction if the network status is poor. Moreover, each step needs to be returned to execute the next step, which affects the efficiency of remote assistance.
Disclosure of Invention
The embodiment of the application provides a remote assistance method and related equipment. The efficiency of remote assistance can be improved.
In one aspect, an embodiment of the present application provides a remote assistance method, including:
the method comprises the steps that a layer of floating window is created on a display interface by first equipment;
the first equipment acquires operation information aiming at the display content on the display interface, which is input by a user, through the floating window, and generates a serialized auxiliary operation script from the operation information;
and the first equipment sends the auxiliary operation script to second equipment, wherein the auxiliary operation script is used for indicating the second equipment to execute operations in sequence.
Wherein the operation information comprises at least one of an operation application, an operation page, an operation position and an operation action.
The acquiring, through the floating window, operation information input by a user for display content on the display interface includes:
acquiring interface information on the display interface under the floating window through auxiliary service;
drawing an action area on the suspension window according to the interface information;
when it is detected that the user operates the action area on the floating window, the display content on the corresponding position on the display interface is triggered to operate through the auxiliary service, and the operation information is obtained.
Wherein the generating of the operation information into a serialized auxiliary operation script comprises:
acquiring a recording path of the operation information;
and generating the serialized auxiliary operation script by the operation information according to the recording path.
In another aspect, an embodiment of the present application provides a remote assistance method, including:
the method comprises the steps that a second device receives an auxiliary operation script sent by a first device, wherein the auxiliary operation script is generated by creating a layer of floating window on a display interface by the first device and acquiring operation information input by a user and aiming at display content on the display interface through the floating window;
and the second equipment executes the operation according to the auxiliary operation script in sequence.
Wherein the executing the operations in sequence according to the secondary operation script comprises:
determining an application program to which the auxiliary operation script belongs;
and installing the application program, and operating the application program according to the auxiliary operation script in sequence.
Wherein the executing the operations in sequence according to the secondary operation script comprises:
displaying event information aimed at by the auxiliary operation script;
and when detecting that a user inputs a starting instruction aiming at the event information, sequentially executing operation according to the auxiliary operation script.
In another aspect, an embodiment of the present application provides a first device, including:
the processing module is used for creating a layer of floating window on the display interface;
the acquisition module is used for acquiring operation information which is input by a user and aims at the display content on the display interface through the floating window and generating a serialized auxiliary operation script from the operation information;
and the sending module is used for sending the auxiliary operation script to second equipment, and the auxiliary operation script is used for indicating the second equipment to execute operations in sequence.
Wherein the operation information comprises at least one of an operation application, an operation page, an operation position and an operation action.
The acquisition module is further configured to acquire interface information on the display interface under the floating window through an auxiliary service;
the processing module is further used for drawing an action area on the floating window according to the interface information; when it is detected that the user operates the action area on the floating window, the display content on the corresponding position on the display interface is triggered to operate through the auxiliary service, and the operation information is obtained.
The acquisition module is further configured to acquire a recording path of the operation information;
the processing module is further configured to generate the serialized auxiliary operation script from the operation information according to the recording path.
In another aspect, an embodiment of the present application provides a second device, including:
the device comprises a receiving module and a display module, wherein the receiving module is used for receiving an auxiliary operation script sent by first equipment, and the auxiliary operation script is generated by creating a layer of floating window on a display interface by the first equipment and acquiring operation information input by a user and aiming at display content on the display interface through the floating window;
and the processing module is used for executing operation according to the auxiliary operation script in sequence.
The processing module is further configured to determine an application program to which the auxiliary operation script belongs; and installing the application program, and operating the application program according to the auxiliary operation script in sequence.
The processing module is further configured to display event information targeted by the auxiliary operation script; and when detecting that a user inputs a starting instruction aiming at the event information, sequentially executing operation according to the auxiliary operation script.
In yet another aspect, the present application provides a first device comprising: the remote assistance system comprises a processor, a memory and a communication bus, wherein the communication bus is used for realizing connection communication between the processor and the memory, and the processor executes a program stored in the memory for realizing the steps in the remote assistance method provided by the first aspect.
In one possible design, the first device provided in this application may include a module for performing the corresponding method. The modules may be software and/or hardware.
In yet another aspect, the present application provides a second device comprising: the remote assistance system comprises a processor, a memory and a communication bus, wherein the communication bus is used for realizing connection communication between the processor and the memory, and the processor executes a program stored in the memory for realizing the steps in the remote assistance method provided by the second aspect.
In one possible design, the second device provided in this application may include a module for performing the corresponding method. The modules may be software and/or hardware.
Yet another aspect of the embodiments of the present application provides a computer-readable storage medium having stored thereon a plurality of instructions adapted to be loaded by a processor and to perform the method of the above-mentioned aspects.
Yet another aspect of the embodiments of the present application provides a computer program product containing instructions which, when run on a computer, cause the computer to perform the method of the above-described aspects.
According to the embodiment of the application, first equipment creates a layer of floating window on a display interface; then, operation information aiming at the display content on the display interface and input by a user is obtained through the floating window, and the operation information is generated into a serialized auxiliary operation script; and finally, sending the auxiliary operation script to a second device, wherein the auxiliary operation script is used for indicating the second device to execute the operation in sequence. After the first device records the operation completion information and sends the operation completion information to the second device, the user can be assisted to complete all operations only by clicking one key on the second device, and the efficiency of remote assistance is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram of an architecture of a remote assistance system according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a remote assistance method according to an embodiment of the present application;
FIG. 3 is a schematic view of a floating window provided by an embodiment of the present application;
FIG. 4 is a schematic view of an auxiliary operation flow provided by an embodiment of the present application;
fig. 5 is a flowchart illustrating a remote assistance method according to another embodiment of the present application;
FIG. 6(A) is a schematic diagram of an interface display provided by an embodiment of the present application;
FIG. 6(B) is a schematic illustration of another interface display provided by an embodiment of the present application;
FIG. 7 is a schematic diagram of a first apparatus provided by an embodiment of the present application;
FIG. 8 is a schematic diagram of a second apparatus provided by an embodiment of the present application;
fig. 9 is a schematic structural diagram of another first device proposed in the embodiment of the present application;
fig. 10 is a schematic structural diagram of another second apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating an architecture of a remote assistance system according to an embodiment of the present application. As shown in the figure, the remote assistance system in the embodiment of the present application includes a first device 101 and a second device 102. The first device 101 and the second device 102 may refer to devices that provide voice and/or data connection to a user, may be connected to a computing device such as a laptop or desktop computer, or may be stand-alone devices such as a Personal Digital Assistant (PDA), among others. The first device 101 and the second device 102 may also be Stations (STAs), systems, subscriber units, subscriber stations, mobile stations, remote stations, access points, remote terminals, access terminals, user agents, or user devices. The user of the first device can be an assistor, the user of the second device can be an assisted person, the assistor can generate a serialized auxiliary operation script after recording the operation completion information, then the auxiliary operation script is locally stored and sent to the assisted person, and after the assisted person receives the auxiliary operation script, the assisted person can be assisted to complete operation by clicking one key, so that the efficiency of remote assistance is improved.
Referring to fig. 2, fig. 2 is a flowchart illustrating a remote assistance method according to an embodiment of the present application. As shown in the figures, the steps of the embodiment of the present application include:
s201, the first device creates a layer of floating window on a display interface. The floating window can be a full-screen, transparent and invisible floating window, and can also be a red semitransparent floating window. The user can operate on the display content of the display interface through the floating window.
In a specific implementation, the first device may receive an assistance request of the second device, and after receiving the assistance request, display a prompt message, where the prompt message is used to prompt a user whether to determine assistance, and if so, create a floating window on a display interface, and start to execute the following operation steps.
S202, the first device obtains operation information, which is input by a user and aims at the display content on the display interface, through the floating window, and generates a serialized auxiliary operation script from the operation information.
In specific implementation, interface information on the display interface under the floating window can be acquired through auxiliary service; drawing an action area on the suspension window according to the interface information; when it is detected that the user operates the action area on the floating window, the display content on the corresponding position on the display interface is triggered to operate through the auxiliary service, and the operation information is obtained.
For example, fig. 3 is a schematic view of a floating window provided in an embodiment of the present application. The display interface of the app is covered with a layer of floating window, and interface information of the display interface of the app under the floating window can be acquired through an auxiliary service (access) provided by the Android, wherein the interface information comprises positions and areas of the buttons in the display interface. The app displays the location and region of each button in the interface, generating the same action region at the corresponding location and region in the floating window. As shown in fig. 3, when the user clicks the action region a' in the floating window, the access property related interface is called to trigger the button a at the corresponding position in the display interface of the app, so as to operate the button a, and further obtain the operation information at the corresponding position.
Wherein the operation information comprises at least one of an operation application, an operation page, an operation position and an operation action. For example, opening the display interface of the taxi taking application program of the first device needs to assist the user of the second device in completing taxi taking operations, so after the display interface of the taxi taking application program is opened, firstly the used app is recorded, secondly the page of the opened app is recorded, secondly the operation position of the user on the app page is recorded, and finally the operation performed at the position is recorded. If the user opens a new page of the app again, the page of the app opened this time is recorded first, the operation position of the user on the page of the app is recorded, and finally the operation performed at the position is recorded. And after other pages are opened, recording all the steps according to the mode until the taxi taking operation is finished.
Alternatively, since the remote assistance comprises a plurality of steps, each step must be performed sequentially to ensure that the assisted person is performing the operation. Therefore, a recording path of the operation information can be acquired; and generating the serialized auxiliary operation script by the operation information according to the recording path. For example, the facilitator first opens the display interface of app1, records in sequence the app1 used by the user, the page of the opened app1, the operating position of the user on the page of app1, and the operations made at that position, then opens the display interface of app2, records in sequence the app2 used by the user, the page of the opened app2, the operating position of the user on the page of app2, and the operations made at that position, and completes all recordings. In this process, the recording path includes the app1 used by the user, the page of the open app1, the location of the user's operation on the app1 page and the operations made at that location, and the app2 used by the user, the page of the open app2, the location of the user's operation on the app2 page and the operations made at that location. And generating the operation information into the serialized auxiliary operation script according to the recording path so as to assist the user of the second equipment to complete the operation according to the recording path.
S203, the first device sends the auxiliary operation script to a second device, and the auxiliary operation script is used for indicating the second device to execute operations in sequence.
In a specific implementation, after the second device receives the auxiliary operation script, the user only needs to start by one key, the floating window is displayed on the display interface of the second device, and the second user device can call an auxiliary service (access) to click the display content on the display interface under the floating window according to the auxiliary operation script, and complete the operation according to the sequence. For example, as shown in fig. 4, the secondary operation script is first read, it is determined whether there is a next operation, if so, the application is first opened, then the page of the application is opened, then the button is found on the page, and if so, the operation is performed at the button. After the operation is completed at the button, it is determined whether there is a next operation, and if so, the operation is performed according to the same procedure as described above.
In the embodiment of the application, first, a layer of floating window is created on a display interface by first equipment; then, operation information aiming at the display content on the display interface and input by a user is obtained through the floating window, and the operation information is generated into a serialized auxiliary operation script; and finally, sending the auxiliary operation script to a second device, wherein the auxiliary operation script is used for indicating the second device to execute the operation in sequence. After the first device records the operation completion information and sends the operation completion information to the second device, the user can be assisted to complete all operations only by clicking one key on the second device, and the efficiency of remote assistance is improved.
Referring to fig. 5, fig. 5 is a flowchart illustrating a remote assistance method according to another embodiment of the present application. As shown in the figures, the steps of the embodiment of the present application include:
s501, the first device creates a layer of floating window on the display interface. The floating window can be a full-screen, transparent and invisible floating window, and can also be a red semitransparent floating window. The user can operate on the display content of the display interface through the floating window.
S502, the first device obtains operation information, which is input by a user and aims at the display content on the display interface, through the floating window, and generates a serialized auxiliary operation script from the operation information.
In specific implementation, interface information on the display interface under the floating window is obtained through auxiliary service; drawing an action area on the suspension window according to the interface information; when it is detected that the user operates the action area on the floating window, the display content on the corresponding position on the display interface is triggered to operate through the auxiliary service, and the operation information is obtained.
Wherein the operation information comprises at least one of an operation application, an operation page, an operation position and an operation action. For example, opening the display interface of the taxi taking application program of the first device needs to assist the user of the second device in completing taxi taking operations, so after the display interface of the taxi taking application program is opened, firstly the used app is recorded, secondly the page of the opened app is recorded, secondly the operation position of the user on the app page is recorded, and finally the operation performed at the position is recorded. If the user opens a new page of the app again, the page of the app opened this time is recorded first, the operation position of the user on the page of the app is recorded, and finally the operation performed at the position is recorded. And after other pages are opened, recording all the steps according to the mode until the taxi taking operation is finished.
Alternatively, since the remote assistance comprises a plurality of steps, each step must be performed sequentially to ensure that the assisted person is performing the operation. Therefore, a recording path of the operation information can be acquired; and generating the serialized auxiliary operation script by the operation information according to the recording path.
S503, the first device sends the auxiliary operation script to a second device.
S504, the second device executes the operation according to the auxiliary operation script in sequence.
In a specific implementation, an application program to which the auxiliary operation script belongs may be determined; and installing the application program, and operating the application program according to the auxiliary operation script in sequence.
It should be noted that the embodiment of the present application does not need to know the operation status of the second device, such as resolution, Rom, etc., and does not need to know whether an application program that the second device needs to operate exists. For example, in an operation in which the assistor remotely assists the assistor to go home using the taxi-taking software, in the conventional remote assistance scheme, if the communication between the first device and the second device is interrupted, or if the taxi-taking software is not installed in the cell phone of the assistor, the assistor cannot be assisted in completing the operation. In the embodiment of the application, after the first device sends the auxiliary operation script to the second device, the first device and the second device are not required to keep communication, and the communication terminal is prevented from causing the failure of remote assistance. And if the second device does not install the application program, the second device can automatically install the corresponding application program after reading the auxiliary operation script, so that the assisted person is assisted to complete the operation, and the convenience of remote assistance is improved.
Optionally, the event information for the auxiliary operation script may be displayed first; and when detecting that a user inputs a starting instruction aiming at the event information, sequentially executing operation according to the auxiliary operation script. For example, if the assisting person needs to assist the assisted person in completing the operation of sending the mail, after receiving the auxiliary operation script, the second device first displays the event information "send the mail" and a start button, and after the user clicks the start button, the second device can fully automatically operate to complete all the operation steps according to the auxiliary operation script.
For example, as shown in fig. 6(a), the first device completes recording operation information of taxi-home, video chat, and wechat payment, generates three types of auxiliary operation scripts, displays a sending button corresponding to each auxiliary operation script on the display interface, and the assistor can click the sending button to send the three types of auxiliary operation scripts to the assisted person. As shown in fig. 6(B), after the second device receives the three auxiliary operation scripts, the execution buttons corresponding to the three auxiliary operation scripts are displayed on the display interface, and the assisted person clicks the execution button by one key, so that the second device can actively open one page to complete all operations according to the app, the page, the position button and the action to be operated, which are recorded by the assisted person.
In the embodiment of the application, first, a layer of floating window is created on a display interface by first equipment; then, operation information aiming at the display content on the display interface and input by a user is obtained through the floating window, and the operation information is generated into a serialized auxiliary operation script; and finally, sending the auxiliary operation script to a second device, wherein the auxiliary operation script is used for indicating the second device to execute the operation in sequence. After the first device records the operation completion information and sends the operation completion information to the second device, the user can be assisted to complete all operations only by clicking one key on the second device, and the efficiency of remote assistance is improved.
Referring to fig. 7, fig. 7 is a schematic diagram of a first apparatus according to an embodiment of the present disclosure. As shown in the drawings, a first apparatus of an embodiment of the present application includes:
and the processing module 701 is used for creating a layer of floating window on the display interface. The floating window can be a full-screen, transparent and invisible floating window, and can also be a red semitransparent floating window. The user can operate on the display content of the display interface through the floating window.
In a specific implementation, the first device may receive an assistance request of the second device, and after receiving the assistance request, display a prompt message, where the prompt message is used to prompt a user whether to determine assistance, and if so, create a floating window on a display interface, and start to execute the following operation steps.
An obtaining module 702, configured to obtain, through the floating window, operation information that is input by a user and is specific to the display content on the display interface, and generate a serialized auxiliary operation script from the operation information.
In specific implementation, interface information on the display interface under the floating window can be acquired through auxiliary service; drawing an action area on the suspension window according to the interface information; when it is detected that the user operates the action area on the floating window, the display content on the corresponding position on the display interface is triggered to operate through the auxiliary service, and the operation information is obtained.
For example, fig. 3 is a schematic view of a floating window provided in an embodiment of the present application. The display interface of the app is covered with a layer of floating window, and interface information of the display interface of the app under the floating window can be acquired through an auxiliary service (access) provided by the Android, wherein the interface information comprises positions and areas of the buttons in the display interface. The app displays the location and region of each button in the interface, generating the same action region at the corresponding location and region in the floating window. As shown in fig. 3, when the user clicks the action region a' in the floating window, the access property related interface is called to trigger the button a at the corresponding position in the display interface of the app, so as to operate the button a, and further obtain the operation information at the corresponding position.
Wherein the operation information comprises at least one of an operation application, an operation page, an operation position and an operation action. For example, opening the display interface of the taxi taking application program of the first device needs to assist the user of the second device in completing taxi taking operations, so after the display interface of the taxi taking application program is opened, firstly the used app is recorded, secondly the page of the opened app is recorded, secondly the operation position of the user on the app page is recorded, and finally the operation performed at the position is recorded. If the user opens a new page of the app again, the page of the app opened this time is recorded first, the operation position of the user on the page of the app is recorded, and finally the operation performed at the position is recorded. And after other pages are opened, recording all the steps according to the mode until the taxi taking operation is finished.
Alternatively, since the remote assistance comprises a plurality of steps, each step must be performed sequentially to ensure that the assisted person is performing the operation. Therefore, a recording path of the operation information can be acquired; and generating the serialized auxiliary operation script by the operation information according to the recording path. For example, the facilitator first opens the display interface of app1, records in sequence the app1 used by the user, the page of the opened app1, the operating position of the user on the page of app1, and the operations made at that position, then opens the display interface of app2, records in sequence the app2 used by the user, the page of the opened app2, the operating position of the user on the page of app2, and the operations made at that position, and completes all recordings. In this process, the recording path includes the app1 used by the user, the page of the open app1, the location of the user's operation on the app1 page and the operations made at that location, and the app2 used by the user, the page of the open app2, the location of the user's operation on the app2 page and the operations made at that location. And generating the operation information into the serialized auxiliary operation script according to the recording path so as to assist the user of the second equipment to complete the operation according to the recording path.
A sending module 703 is configured to send the auxiliary operation script to a second device, where the auxiliary operation script is used to instruct the second device to execute operations in sequence.
In a specific implementation, after the second device receives the auxiliary operation script, the user only needs to start by one key to display the floating window on the display interface of the second device, and the second user device can call, according to the auxiliary operation script, the Accessibility to click the display content on the display interface under the floating window, and complete the operation according to the sequence. For example, as shown in fig. 4, the secondary operation script is first read, it is determined whether there is a next operation, if so, the application is first opened, then the page of the application is opened, then the button is found on the page, and if so, the operation is performed at the button. After the operation is completed at the button, it is determined whether there is a next operation, and if so, the operation is performed according to the same procedure as described above.
In the embodiment of the application, first, a layer of floating window is created on a display interface by first equipment; then, operation information aiming at the display content on the display interface and input by a user is obtained through the floating window, and the operation information is generated into a serialized auxiliary operation script; and finally, sending the auxiliary operation script to a second device, wherein the auxiliary operation script is used for indicating the second device to execute the operation in sequence. After the first device records the operation completion information and sends the operation completion information to the second device, the user can be assisted to complete all operations only by clicking one key on the second device, and the efficiency of remote assistance is improved.
Referring to fig. 8, fig. 8 is a schematic diagram of a second apparatus according to an embodiment of the present disclosure. As shown in the drawings, the second apparatus of the embodiment of the present application includes:
a receiving module 801, configured to receive an auxiliary operation script sent by a first device, where the auxiliary operation script is generated by creating a layer of floating window on a display interface by the first device and acquiring operation information, which is input by a user and is for a display content on the display interface, through the floating window;
a processing module 802, configured to perform operations in sequence according to the secondary operation script.
In a specific implementation, an application program to which the auxiliary operation script belongs may be determined; and installing the application program, and operating the application program according to the auxiliary operation script in sequence.
It should be noted that the embodiment of the present application does not need to know the operation status of the second device, such as resolution, Rom, etc., and does not need to know whether an application program that the second device needs to operate exists. For example, in an operation in which the assistor remotely assists the assistor to go home using the taxi-taking software, in the conventional remote assistance scheme, if the communication between the first device and the second device is interrupted, or if the taxi-taking software is not installed in the cell phone of the assistor, the assistor cannot be assisted in completing the operation. In the embodiment of the application, after the first device sends the auxiliary operation script to the second device, the first device and the second device are not required to keep communication, and the communication terminal is prevented from causing the failure of remote assistance. And if the second device does not install the application program, the second device can automatically install the corresponding application program after reading the auxiliary operation script, so that the assisted person is assisted to complete the operation, and the convenience of remote assistance is improved.
Optionally, the event information for the auxiliary operation script may be displayed first; and when detecting that a user inputs a starting instruction aiming at the event information, sequentially executing operation according to the auxiliary operation script. For example, if the assisting person needs to assist the assisted person in completing the operation of sending the mail, after receiving the auxiliary operation script, the second device first displays the event information "send the mail" and a start button, and after the user clicks the start button, the second device can fully automatically operate to complete all the operation steps according to the auxiliary operation script.
For example, as shown in fig. 6(a), the first device completes recording operation information of taxi-home, video chat, and wechat payment, generates three types of auxiliary operation scripts, displays a sending button corresponding to each auxiliary operation script on the display interface, and the assistor can click the sending button to send the three types of auxiliary operation scripts to the assisted person. As shown in fig. 6(B), after the second device receives the three auxiliary operation scripts, the execution buttons corresponding to the three auxiliary operation scripts are displayed on the display interface, and the assisted person clicks the execution button by one key, so that the second device can actively open one page to complete all operations according to the app, the page, the position button and the action to be operated, which are recorded by the assisted person.
Referring to fig. 9, fig. 9 is a schematic structural diagram of another first device according to an embodiment of the present disclosure. As shown, the first device may include: at least one processor 901, at least one communication interface 902, at least one memory 903, and at least one communication bus 904.
The processor 901 may be a central processing unit, a general purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor may also be a combination of computing functions, e.g., comprising one or more microprocessors, a digital signal processor and a microprocessor, or the like. The communication bus 904 may be a peripheral component interconnect standard PCI bus or an extended industry standard architecture EISA bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 9, but this does not indicate only one bus or one type of bus. A communication bus 904 is used to enable connective communication between these components. The communication interface 902 of the device in this embodiment of the present application is used for performing signaling or data communication with other node devices. The Memory 903 may include a volatile Memory, such as a Nonvolatile dynamic Random Access Memory (NVRAM), a Phase Change Random Access Memory (PRAM), a Magnetoresistive Random Access Memory (MRAM), and the like, and may further include a Nonvolatile Memory, such as at least one magnetic Disk Memory device, an Electrically Erasable Programmable Read-Only Memory (EEPROM), a flash Memory device, such as a NOR flash Memory (NOR flash Memory) or a NAND flash Memory (EEPROM), a semiconductor device, such as a Solid State Disk (SSD), and the like. The memory 903 may optionally be at least one storage device located remotely from the processor 901. A set of program codes is stored in the memory 903 and executed by the processor 901 for the program executed by the first device in the memory 903
Creating a layer of floating window on a display interface;
acquiring operation information which is input by a user and aims at the display content on the display interface through the floating window, and generating a serialized auxiliary operation script from the operation information;
and sending the auxiliary operation script to a second device, wherein the auxiliary operation script is used for instructing the second device to execute operations in sequence.
Wherein the operation information comprises at least one of an operation application, an operation page, an operation position and an operation action.
Optionally, the processor 901 is further configured to perform the following operations:
acquiring interface information on the display interface under the floating window through auxiliary service;
drawing an action area on the suspension window according to the interface information;
when it is detected that the user operates the action area on the floating window, the display content on the corresponding position on the display interface is triggered to operate through the auxiliary service, and the operation information is obtained.
Optionally, the processor 901 is further configured to perform the following operations:
acquiring a recording path of the operation information;
and generating the serialized auxiliary operation script by the operation information according to the recording path.
Further, the processor may cooperate with the memory and the communication interface to perform the operations of the first device in the embodiments of the above application.
Referring to fig. 10, fig. 10 is a schematic structural diagram of another second device according to an embodiment of the present disclosure. As shown, the second device may include: at least one processor 1001, at least one communication interface 1002, at least one memory 1003 and at least one communication bus 1004.
The processor 1001 may be any of the various types of processors mentioned above. The communication bus 1004 may be a peripheral component interconnect standard PCI bus or an extended industry standard architecture EISA bus or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 10, but this is not intended to represent only one bus or type of bus. A communication bus 1004 is used to enable connective communication between these components. The communication interface 1002 of the device in this embodiment of the present application is used for performing signaling or data communication with other node devices. The memory 1003 may be various types of memories as mentioned earlier. The memory 1003 may optionally be at least one storage device located remotely from the processor 1001. A set of program codes is stored in the memory 1003, and the processor 1001 executes the program executed by the above-described second apparatus in the memory 1003.
Receiving an auxiliary operation script sent by first equipment, wherein the auxiliary operation script is generated by creating a layer of floating window on a display interface by the first equipment and acquiring operation information input by a user and aiming at display content on the display interface through the floating window;
and performing operations in sequence according to the auxiliary operation script.
Optionally, the processor 1001 is further configured to perform the following operations:
determining an application program to which the auxiliary operation script belongs;
and installing the application program, and operating the application program according to the auxiliary operation script in sequence.
Optionally, the processor 1001 is further configured to perform the following operations:
displaying event information aimed at by the auxiliary operation script;
and when detecting that a user inputs a starting instruction aiming at the event information, sequentially executing operation according to the auxiliary operation script.
Further, the processor may cooperate with the memory and the communication interface to perform the operations of the second device in the embodiments of the above application.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
The above-mentioned embodiments further explain the objects, technical solutions and advantages of the present application in detail. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (13)
1. A method of remote assistance, the method comprising:
the method comprises the steps that a layer of floating window is created on a display interface by first equipment;
acquiring interface information on the display interface under the floating window through auxiliary service;
drawing an action area on the suspension window according to the interface information;
when it is detected that a user operates the action area on the floating window, triggering display content on a corresponding position on the display interface to operate through the auxiliary service, acquiring operation information aiming at the display content on the display interface, and generating a serialized auxiliary operation script from the operation information;
and the first equipment sends the auxiliary operation script to second equipment, wherein the auxiliary operation script is used for indicating the second equipment to execute operations in sequence.
2. The method of claim 1, wherein the operational information comprises at least one of an operational application, an operational page, an operational location, and an operational action.
3. The method of claim 1, wherein the generating the operational information into a serialized auxiliary operational script comprises:
acquiring a recording path of the operation information;
and generating the serialized auxiliary operation script by the operation information according to the recording path.
4. A method of remote assistance, the method comprising:
the method comprises the steps that a second device receives an auxiliary operation script sent by a first device, the auxiliary operation script is generated by the first device through creating a layer of floating window on a display interface, obtaining interface information on the display interface under the floating window through an auxiliary service, drawing an action area on the floating window according to the interface information, triggering display content on a corresponding position on the display interface to operate through the auxiliary service when detecting that a user operates the action area on the floating window, and obtaining operation information aiming at the display content on the display interface;
and the second equipment executes the operation according to the auxiliary operation script in sequence.
5. The method of claim 4, wherein the performing operations in order according to the secondary operation script comprises:
determining an application program to which the auxiliary operation script belongs;
and installing the application program, and operating the application program according to the auxiliary operation script in sequence.
6. The method of claim 4, wherein the performing operations in order according to the secondary operation script comprises:
displaying event information aimed at by the auxiliary operation script;
and when detecting that a user inputs a starting instruction aiming at the event information, sequentially executing operation according to the auxiliary operation script.
7. A first device, characterized in that the first device comprises:
the processing module is used for creating a layer of floating window on the display interface;
the acquisition module is used for acquiring operation information which is input by a user and aims at the display content on the display interface through the floating window and generating a serialized auxiliary operation script from the operation information; the auxiliary service module is used for acquiring interface information on the display interface under the floating window;
a sending module, configured to send the auxiliary operation script to a second device, where the auxiliary operation script is used to instruct the second device to perform operations in sequence;
the processing module is further used for drawing an action area on the floating window according to the interface information; when it is detected that the user operates the action area on the floating window, the display content on the corresponding position on the display interface is triggered to operate through the auxiliary service, and the operation information is obtained.
8. The first device of claim 7, wherein the operational information comprises at least one of an operational application, an operational page, an operational location, and an operational action.
9. The first apparatus of claim 7,
the acquisition module is further used for acquiring a recording path of the operation information;
the processing module is further configured to generate the serialized auxiliary operation script from the operation information according to the recording path.
10. A second device, characterized in that the second device comprises:
the device comprises a receiving module and a display module, wherein the receiving module is used for receiving an auxiliary operation script sent by first equipment, the auxiliary operation script is generated by the first equipment by creating a layer of floating window on a display interface, acquiring interface information on the display interface under the floating window through auxiliary service, drawing an action area on the floating window according to the interface information, triggering display content on a corresponding position on the display interface to operate through the auxiliary service when detecting that a user operates the action area on the floating window, and acquiring operation information aiming at the display content on the display interface;
and the processing module is used for executing operation according to the auxiliary operation script in sequence.
11. The second device of claim 10,
the processing module is further configured to determine an application program to which the auxiliary operation script belongs; and installing the application program, and operating the application program according to the auxiliary operation script in sequence.
12. The second device of claim 10,
the processing module is further used for displaying event information aimed at by the auxiliary operation script; and when detecting that a user inputs a starting instruction aiming at the event information, sequentially executing operation according to the auxiliary operation script.
13. A computer-readable storage medium having stored therein instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810731750.4A CN108984255B (en) | 2018-07-05 | 2018-07-05 | Remote assistance method and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810731750.4A CN108984255B (en) | 2018-07-05 | 2018-07-05 | Remote assistance method and related equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108984255A CN108984255A (en) | 2018-12-11 |
| CN108984255B true CN108984255B (en) | 2021-05-28 |
Family
ID=64536205
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810731750.4A Active CN108984255B (en) | 2018-07-05 | 2018-07-05 | Remote assistance method and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108984255B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110248142B (en) * | 2019-06-12 | 2021-03-23 | 随锐科技集团股份有限公司 | Method and system for quickly sharing screen |
| CN113010242B (en) * | 2019-12-20 | 2023-06-16 | 花瓣云科技有限公司 | Auxiliary information prompting method, device, terminal equipment and computer storage medium |
| CN111966435A (en) * | 2020-07-14 | 2020-11-20 | 维沃移动通信有限公司 | Operation flow sharing method and device of electronic equipment |
| CN114327737A (en) * | 2022-03-04 | 2022-04-12 | 中信建投证券股份有限公司 | Remote assistance method, device and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103513858A (en) * | 2012-06-28 | 2014-01-15 | 北京奇虎科技有限公司 | Remote assistance method and device |
| CN105159672A (en) * | 2015-08-28 | 2015-12-16 | 小米科技有限责任公司 | Remote assistance method and client |
| CN107508849A (en) * | 2016-08-10 | 2017-12-22 | 广东小天才科技有限公司 | Remote control method and system of mobile terminal and mobile terminal |
| CN107508741A (en) * | 2017-07-21 | 2017-12-22 | 湖南机友科技有限公司 | Multi-screen interaction method based on mobile terminal |
| CN107656672A (en) * | 2017-09-29 | 2018-02-02 | 珠海市魅族科技有限公司 | A kind of information processing method and device, terminal and readable storage medium storing program for executing |
| CN107783711A (en) * | 2017-11-07 | 2018-03-09 | 北京小米移动软件有限公司 | Application program is controlled to perform the method and device of operation |
-
2018
- 2018-07-05 CN CN201810731750.4A patent/CN108984255B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103513858A (en) * | 2012-06-28 | 2014-01-15 | 北京奇虎科技有限公司 | Remote assistance method and device |
| CN105159672A (en) * | 2015-08-28 | 2015-12-16 | 小米科技有限责任公司 | Remote assistance method and client |
| CN107508849A (en) * | 2016-08-10 | 2017-12-22 | 广东小天才科技有限公司 | Remote control method and system of mobile terminal and mobile terminal |
| CN107508741A (en) * | 2017-07-21 | 2017-12-22 | 湖南机友科技有限公司 | Multi-screen interaction method based on mobile terminal |
| CN107656672A (en) * | 2017-09-29 | 2018-02-02 | 珠海市魅族科技有限公司 | A kind of information processing method and device, terminal and readable storage medium storing program for executing |
| CN107783711A (en) * | 2017-11-07 | 2018-03-09 | 北京小米移动软件有限公司 | Application program is controlled to perform the method and device of operation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108984255A (en) | 2018-12-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108984255B (en) | Remote assistance method and related equipment | |
| CN107832099B (en) | Method and device for client version compatibility and storage medium | |
| CN103168301A (en) | Exposing resource capabilities to web applications | |
| CN112114761A (en) | Wireless screen projection control method and device, terminal equipment and readable storage medium | |
| CN109783345B (en) | Method and system for testing small program performance | |
| CN107329659B (en) | Permission setting method and device, electronic equipment and storage medium | |
| CN110096329B (en) | Display content control method, electronic device and computer readable storage medium | |
| CN111858296A (en) | Interface test method, device, equipment and storage medium | |
| CN112417420A (en) | Information processing method and device and electronic equipment | |
| CN110083467B (en) | Method and device for processing applet message and computer storage medium | |
| CN114265653A (en) | Interface display method, device, equipment, storage medium and program product | |
| CN112929835B (en) | Message notification method, device, electronic terminal and storage medium | |
| CN107920383B (en) | Wireless hotspot connection method, mobile terminal and computer-readable storage medium | |
| CN110674050B (en) | Memory out-of-range detection method and device, electronic equipment and computer storage medium | |
| CN113419649A (en) | Method for operating electronic device and device thereof | |
| CN112988192A (en) | Version updating method and device, electronic equipment and storage medium | |
| CN111813407B (en) | Game development method, game running device and electronic equipment | |
| CN109634782B (en) | Method and device for detecting system robustness, storage medium and terminal | |
| CN113467656B (en) | Screen touch event notification method and vehicle machine | |
| CN116521533A (en) | Generation method, device, equipment and storage medium | |
| CN107168776B (en) | Event statistical method, device, equipment and storage medium | |
| CN111949510A (en) | Test processing method and device, electronic equipment and readable storage medium | |
| CN115185745A (en) | Data processing method, system, electronic device and computer readable storage medium | |
| CN112988426B (en) | Message processing method and device | |
| CN111752661B (en) | Interface display method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |