CN110727483A - Device and method for generating tool for assisting user to interact with application program - Google Patents
Device and method for generating tool for assisting user to interact with application program Download PDFInfo
- Publication number
- CN110727483A CN110727483A CN201810779859.5A CN201810779859A CN110727483A CN 110727483 A CN110727483 A CN 110727483A CN 201810779859 A CN201810779859 A CN 201810779859A CN 110727483 A CN110727483 A CN 110727483A
- Authority
- CN
- China
- Prior art keywords
- user
- steps
- sequence
- application
- frequently used
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims description 41
- 230000003993 interaction Effects 0.000 claims abstract description 19
- 238000007405 data analysis Methods 0.000 claims abstract description 16
- 230000006399 behavior Effects 0.000 claims description 12
- 230000015654 memory Effects 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 7
- 230000004044 response Effects 0.000 claims description 5
- 230000006870 function Effects 0.000 description 8
- 230000008901 benefit Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000010223 real-time analysis Methods 0.000 description 2
- 238000013480 data collection Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000002195 synergetic effect Effects 0.000 description 1
- 230000003936 working memory Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a device for generating tools for assisting a user in interacting with an application. The device comprises a data receiving unit configured to receive data representing an interaction behavior of the user with the application, the data comprising at least data representing a plurality of steps of the user operating the application; a data analysis unit configured to determine a sequence of steps frequently used by the user among the plurality of steps in which the user operates the application program based on the data; and a tool generation unit configured to generate the tool for assisting the user in interacting with the application based on the determined sequence of steps frequently used by the user. Thus, an apparatus is provided that automatically generates or creates tools that assist a user in interacting with an application, which can easily generate an assist tool to effectively assist the user in interacting with the application.
Description
Technical Field
The present invention relates to user interaction with applications, and more particularly to tools that assist users in interacting with applications.
Background
Typical applications can provide a human-machine interface, such as a graphical user interface, so that a user can manipulate the application to achieve its intended goal. However, a user may not always be familiar with how to manipulate such an application, or familiar with how to manipulate a corresponding graphical user interface to find the corresponding functionality that needs to be used in order to achieve their goals.
A typical graphical user interface may provide a help document, but when a new user of an application is not familiar with how to operate the application to achieve its goals, or does not know what functionality to utilize to achieve its goals, it may be difficult, complicated, and time consuming to know about the application and operate the application to achieve its goals simply by browsing the help document. This is especially true in applications that are currently trending toward more functionality, as they include more, more detailed functionality, and more complex user interfaces.
Even for an old user of an application, as the application is continually updated to add more functionality, or due to the complexity of the process of achieving a certain goal with the application, the user's interaction with the application can still be complex and time consuming.
Disclosure of Invention
It is desirable to provide an apparatus and method for automatically generating or creating tools for assisting a user in interacting with an application that can easily generate assistance tools to effectively assist the user in interacting with the application. Such an accessibility tool can even be generated or created by the user completely unconsciously and then displayed to the user as needed to assist him in operating the application.
According to one embodiment of the present invention, an apparatus for generating tools for assisting a user in interacting with an application is provided. The device comprises a data receiving unit configured to receive data representing an interaction behavior of the user with the application, the data comprising at least data representing a plurality of steps of the user operating the application; a data analysis unit configured to determine a sequence of steps frequently used by the user among the plurality of steps in which the user operates the application program based on the data; a tool generation unit configured to generate the tool for assisting the user in interacting with the application based on the determined sequence of steps frequently used by the user.
According to another embodiment of the present invention, there is provided a computer device including an application program; and a device for generating a tool for assisting a user in interacting with the application according to the invention; wherein the application comprises a user interface configured to present tools for assisting the user in interacting with the application.
According to another embodiment of the present invention, a method of generating a tool for assisting a user in interacting with an application is provided. The method comprises receiving data representing the user's interaction behavior with the application, the data comprising at least data representing a plurality of steps of the user's operation of the application; determining a sequence of steps that are frequently used by the user among the plurality of steps in which the user operates the application based on the data; generating the tool for assisting the user in interacting with the application based on the determined sequence of steps.
According to yet another embodiment of the invention, a computer storage medium is provided comprising program code for performing the method according to the invention when executed by a computer.
According to a further embodiment of the invention, a computer program product is provided comprising program code for performing the method according to the invention when executed.
In the application environment according to the above embodiment of the present invention, data representing the interaction behavior of the user with the application program is recorded when the user interacts with the application program, the data including at least a plurality of steps of the user operating the application program. According to the above embodiment of the present invention, by analyzing the behavior data and determining a frequently used sequence of steps, an assistant tool capable of assisting a user in interacting with an application program can be automatically generated based on the sequence of steps. On the one hand, this allows easy generation of the aid without excessive intervention by the user, even without the user being aware of it; on the other hand, since the assistant tool is based on the sequence of steps frequently used by the user when operating the application program, the assistant tool can be generated more specifically, and the assistant tool can help the new user or the old user more effectively to save the time and reduce the complexity of the operation of the application program.
According to a further embodiment of the invention, the received data representing the user's interaction behavior with the application further comprises data representing parameter settings in each step of the user's operation of the application.
By considering not only the steps of the application program operated by the user but also the parameter setting in each step, the accuracy of the found frequently used step sequence can be improved, so that the assistant tool generated based on the step sequence can be more accurate and detailed for the user, thereby improving the effectiveness of the assistant tool in assisting the user in operating the application program.
According to a further embodiment of the invention, the device further comprises a user interface configured to notify the user when the sequence of steps frequently used by the user is determined, and to receive an input from the user in response to the notification; wherein the tool generation unit is further configured to generate the tool for assisting the user in interacting with the application based on the input.
According to this embodiment of the invention, it is possible to inform the user of the sequence of steps found to be frequently used and to generate an aid after having obtained an input, for example, indicating the user's consent.
According to a further embodiment of the invention, the user interface is further configured to inform the user of the determined sequence of steps frequently used by the user, and the input comprises an adjustment of the sequence of steps by the user; wherein the tool generation unit is further configured to generate the tool for assisting the user in interacting with the application based on the adjusted sequence of steps. Thereby, the user can adjust the determined sequence of steps so that the device generates the aid taking into account the individual requirements of the user.
According to a further embodiment of the invention, the device further comprises a memory configured to store one or more predetermined sequences of steps; wherein the tool generation unit is further configured to compare the determined sequence of steps frequently used by the user with the one or more predetermined sequences of steps; and determining whether to generate the tool for assisting the user in interacting with the application based on the comparison result.
According to this embodiment, the user can establish a blacklist of sequences of steps for generating an aid, and the device can automatically compare a later determined sequence of steps with the blacklist, on the basis of which the aid is generated when the later determined sequence of steps is not present in the blacklist.
According to a further embodiment of the present invention, the apparatus further comprises a user interface configured to display the determined sequence of steps frequently used by the user to the user and receive a selection by the user of the determined sequence of steps frequently used by the user; wherein the memory is further configured to store the selected sequence of steps as the one or more predetermined sequences of steps when the determined sequence of steps frequently used by the user is selected by the user, wherein the tool generation unit is further configured to compare the unselected sequence of steps with the one or more predetermined sequences of steps when the determined sequence of steps frequently used by the user is not selected by the user; and determining, based on the comparison, whether to generate the tool for assisting the user in interacting with the application based on the unselected sequence of steps.
According to this embodiment, the user is able to build a black list based on the previously determined sequence of steps, so that the subsequently determined sequence of steps is compared to them. For example, when a user determines during a certain generation of an accessibility aid that the accessibility aid is not to be generated based on a certain sequence of steps, the sequence of steps may be blacklisted to ensure that the accessibility aid is not to be generated later on such sequence of steps.
Drawings
The above features, technical characteristics, advantages and modes of realisation of the present invention will be further explained in a clear and understandable manner by the description of preferred embodiments thereof in conjunction with the following drawings, wherein
FIG. 1 shows a schematic diagram of a device for generating tools for assisting a user in interacting with an application according to one embodiment of the invention;
FIG. 2 illustrates an interface of an application according to an embodiment of the present invention;
FIG. 3 illustrates a flow diagram for generating tools for assisting a user in interacting with an application according to one embodiment of the present invention;
FIG. 4 illustrates a method of generating tools for assisting a user in interacting with an application according to one embodiment of the invention;
FIG. 5 illustrates a method of generating tools for assisting a user in interacting with an application according to another embodiment of the invention; and
FIG. 6 illustrates a method of generating tools for assisting a user in interacting with an application according to yet another embodiment of the invention.
Various aspects and features of various embodiments of the present invention are described with reference to the above-identified figures. The drawings described above are only schematic and are non-limiting. The size, shape, reference numerals, or appearance of the respective elements in the above-described drawings may be changed without departing from the gist of the present invention, and are not limited to only those shown in the drawings of the specification.
Detailed Description
FIG. 1 shows a schematic diagram of a device 10 for generating tools for assisting a user in interacting with an application according to one embodiment of the invention. An "application" as referred to herein refers to software that can interact with a user in any form, including but not limited to through a graphical user interface, written for some specific application purpose, and is not limited to a specific application domain and a specific product. Examples of such applications include image processing software, mechanical motion simulation software, mechanical design software, management software, and the like.
The device 10 comprises at least a data receiving unit 12, a data analyzing unit 13 and a tool generating unit 14. Optionally, as shown in fig. 1, the device 10 further comprises a data acquisition unit 11, a user interface 15 and a memory 16, which are shown by dashed lines in fig. 1. However, fig. 1 shows only one arrangement of these components, and other arrangements are possible in conjunction with the description below.
The data receiving unit 12 receives data representing the interaction behavior of the user with the application. The data includes at least data representing a plurality of steps in which the user operates the application, and in a preferred embodiment, can also include data representing parameter settings in each step in which the user operates the application. These data can be historical data collected in advance or data collected in real time.
Generally, when a user operates an application, different operation steps are performed in a time sequence to achieve a specific purpose. The data acquisition unit 11 as shown is capable of recording such operating steps and their parameter settings. In one case, the function of the data acquisition unit 11 can be realized by an API function of an application program. In case real-time acquisition is required, the device 10 can comprise the data acquisition unit 11.
Figure 2 shows an interface of an application program, for example mechanical motion simulation software. Assuming that the user needs to sequentially click three icons of "Link", "Joint", and "driver" when operating the software, the data acquisition unit 11 can record the following contents.
The above-noted user interaction steps with the application can be represented by different data and recorded in chronological order for convenience of data recording and subsequent data analysis. For example, "connection (Link)" can be represented as 23, "Joint (Joint)" can be represented as 45, and "drive (driver)" can be represented as 32. For example, the user operation of the above table can be recorded as "23, 45, 32" in chronological order. Other representations and ways of recording data are also contemplated, such as the ability to use letters to represent different user interactions with the application; or the first digit or digits of a number can be used to represent a different interactive step for a user operating the application, while the next digit or digits represent a parameter setting for the interactive step.
FIG. 3 shows a flowchart for generating tools for assisting a user in interacting with an application according to an embodiment of the present invention, wherein 5 data segments, S1-S5, are listed, representing data collected in chronological order representing different interaction steps of the user operating the application, the different interaction steps being represented by different numbers.
Returning to fig. 1, after the data acquisition unit 11 has recorded the operating steps and/or their parameter settings, for example, represented by different numbers, the data receiving unit 12 can receive these numbers or further store them for subsequent analysis; or these numbers may be stored in the memory 16 described later. The data receiving unit 12 can store these numbers as a fragment of the numbers such as S1-S5, or store all numbers as a whole.
After the data receiving unit 12 receives enough data, the data analyzing unit 13 analyzes the data. Real-time analysis of these data is also contemplated. In one case, in the case of real-time analysis, the data analysis unit 13 can start performing data analysis when the data received by the data reception unit 12 reaches a certain amount.
From the received data, the data analysis unit 13 determines a sequence of steps frequently used in a plurality of steps in which the user operates the application. For example, the data analysis unit 13 can determine a sequence of steps that are used more than a certain threshold frequency during the operation of an application by a user. In a preferred embodiment, a sequence of steps most frequently used by a user in operating an application is determined. The data analysis unit 13 can implement the above data analysis using a machine learning algorithm. In a preferred embodiment, the data analysis unit 13 performs the above analysis during the idle time of the computer.
As shown in fig. 3, the data analysis unit 13 analyzes the data pieces S1-S5, and determines that the sequence of steps that most frequently occur during the operation of the application by the user is "23, 45, 32", i.e., "connect, join, drive".
The determined sequence of steps is received by the tool generation unit 14 for generating a tool for assisting a user in interacting with the application. In one embodiment, the tool generation unit 14 can comprise a code generation unit CG generating a code based on the determined sequence of steps and a compiler C compiling the code into a tool, such as a plug-in to a wizard or template, assisting the user in interacting with the application. The tools may be displayed on a graphical user interface of the application for later reference or use by a user. Generally, the code generation unit can be implemented by means of an API function of an application program.
Returning to fig. 1, the device 10 can also include a user interface 15 and a memory 16. In one embodiment, all of the functionality of the user interface of the device 10 may be implemented by the user's interface with the application. The user interface 15 is used to display various information to a user and receive input from the user. For example, the user interface 15 can display information to the user relating to a frequently used sequence of steps determined by the data analysis unit 13 and receive feedback input from the user regarding the sequence of steps. In one embodiment, the user interface 15 is able to inform the user about a certain sequence of steps occurring more often than a certain threshold when the data analysis unit determines that this situation is exceeded, such as showing "do you detect that you often use" connect, join, drive ", whether a wizard tool is set up? If the user selects "yes", then the tool generation unit 14 can generate a tool to assist the user in interacting with the application based on this user feedback received from the user interface 15 and the sequence of steps. If the user selects "no", then the tool generation unit 14 will not generate an auxiliary tool based on the sequence of steps. Further, the user interface 15 can prompt the user whether the step sequence needs to be adjusted, and if the step sequence is adjusted by the user, the tool generation unit 14 can generate an auxiliary tool based on the adjusted step sequence.
The memory 16 is able to store, on the one hand, the data representative of the interaction behaviour of the user with the application, as described previously, and, on the other hand, one or more predetermined sequences of steps as a black list. For example, the memory 16 can store in a blacklist a sequence of steps displayed to the user via the user interface 15 and based on which the user chooses not to generate an auxiliary tool.
After the data analysis unit 13 has detected a certain frequently used sequence of steps, it compares it with one or more predetermined sequences of steps in the black list, and if different, sends it to the tool generation unit 14 for generating an auxiliary tool, and if the same, continues to perform further data collection and analysis without informing the tool generation unit 14 of the sequence of steps. In this way, after the black list has been determined or selected, no further aids will be generated based on the sequence of steps in the black list.
While the various components of the device 10 are described above primarily with reference to fig. 1 in conjunction with fig. 2 and 3, this is not intended to be limiting and combinations and divisions of the various elements described above are contemplated to achieve their respective functions. Furthermore, the various elements of the device 10 described above may be implemented by various software, in conjunction with various applications.
The apparatus 10 according to an embodiment of the present invention can be comprised on any device comprising or running an application, such as a computer apparatus running an application or various apparatuses with processing functionality.
The computer device may include an application and a device for generating tools for assisting a user in interacting with the application according to embodiments of the present invention, wherein the application may include a user interface configured to present tools for assisting the user in interacting with the application. The various functions of implementing the user interface in the device 10 as described above can be implemented through the user interface of the application.
A method of generating a tool for assisting a user in interacting with an application according to an embodiment of the present invention is described below with reference to fig. 4-6.
FIG. 4 illustrates a fully automated method 400 of generating tools for assisting a user in interacting with an application, in accordance with an embodiment of the present invention.
At 401, data representing a user's interaction behavior with an application is received, the data comprising at least data representing steps of the user operating the application, preferably data further comprising data representing parameter settings in each step of the user operating the application.
At 402, the received data is analyzed to determine a sequence of steps that are frequently used, preferably a sequence of steps that are most frequently used, among the steps of the user operating the application. Various statistical analysis algorithms, in particular machine learning algorithms, can be employed to achieve this determination.
At 403, based on the determined sequence of steps, a tool, in particular a wizard or template, for assisting the user's interaction with the application is generated. The generated tools may be displayed in a user interface for later use by a user. The user can name the wizard or template for the purpose to be achieved by the determined sequence of steps or in any way he sees fit.
Although a fully automated method according to embodiments of the present invention has been described with reference to the above-described steps 401, 402 and 403, it is contemplated that other steps can be included, such as a step of collecting data, a step of storing data and/or a step of displaying a determined guide or template to a user.
FIG. 5 illustrates another method 500 of generating tools for assisting a user in interacting with an application, in accordance with an embodiment of the present invention.
Similar to 401, at 501, data representing a user's interaction behavior with an application is received, the data including at least data representing a step of the user operating the application. Similar to 402, at 502, the received data is analyzed to determine a sequence of steps that are frequently used in a plurality of steps of a user operating an application.
At 503, the user is notified that a frequently used sequence of steps, preferably the most frequently used sequence of steps, has been found. In a preferred embodiment, the determined sequence of steps can be displayed to the user. This may be achieved through a user interface. Preferably by means of a user interface of the application, for example a graphical user interface. Such display can be performed in various known forms.
At 504, after notifying the user that a frequently used sequence of steps has been found, or after the frequently used sequence of steps has been displayed, the user can enter feedback in response to the notification. For example, the user can decide based on the notification whether to generate a tool for the user to assist the user in interacting with the application based on the determined sequence of steps or to adjust the sequence or sequences of steps. The user can input feedback information through the user interface.
At 505, if the user feedback input received at 504 indicates that the user does not want to generate a tool to assist the user in interacting with the application based on the determined sequence of steps, then the method branches back to 501 and continues to receive data representing the user's interaction behavior with the application. If the user feedback input received at 504 indicates that the user wants to generate a tool to assist the user in interacting with the application based on the determined sequence of steps, or the user feedback input received at 504 indicates that the user adjusted the determined sequence of steps, then the method proceeds to 506.
At 506, a tool is generated to assist the user in interacting with the application based on the determined sequence of steps or the adjusted sequence of steps.
FIG. 6 illustrates another method 600 of generating tools for assisting a user in interacting with an application, in accordance with embodiments of the present invention.
In the method 600, 601-603 are similar to 501-503 of the method 500 shown in fig. 5, and are not described herein again.
At 604, the user can provide a feedback input, which can represent the user's selection of the determined sequence of steps, in response to the determined sequence of steps displayed to the user at 603.
At 605, if the user selected a certain sequence of steps, the method proceeds to 606. At 606, the selected sequence of steps is stored in a blacklist and the data continues to be received, returning to 601.
If at 605 the user does not select a certain sequence of steps, the method proceeds to 607 where the unselected sequence of steps is compared to one or more sequences of steps previously stored in the blacklist.
If at 608 it is determined that the unselected sequence of steps is the same as any of the sequences of steps in the blacklist, the method returns to 601 and continues to receive data.
If at 608 it is determined that the unselected sequence of steps is not the same as any of the sequences of steps in the blacklist, the method proceeds to 609. At 609, tools for assisting the user in interacting with the application are generated based on the unselected sequence of steps.
Although methods 400, 500 and 600 of different embodiments of the present invention are described with reference to fig. 4, 5 and 6, respectively. Other variations of the method of the present invention are contemplated. For example, in method 600, if the determined sequence of steps is multiple and a portion of the sequence of steps is selected by the user at 604, then 606 and 607 can be performed simultaneously, i.e., the selected sequence of steps is stored in the blacklist at 606, and the unselected sequence of steps is compared to a pre-stored sequence of steps in the blacklist at 607, followed by 608 and 609.
It is also contemplated that the methods described above include other steps, such as, for example, a step of collecting data and/or a step of storing data. The individual operations of the methods described above may be combined or separated in any combination or manner to achieve the corresponding functionality, or some or all of the operations of the methods described above may be combined to achieve further advantages.
The above-described exemplary embodiments of the invention encompass a computer program which uses the invention from the very beginning and a computer program by means of an update of an existing program to a program which uses the invention. Furthermore, all necessary steps of the functions of the respective units of the above-described embodiments and methods can be provided by means of computer program codes stored on a computer storage medium. Such as a CD-ROM.
Computer program code may be stored and/or distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the internet or other wired or wireless telecommunication systems.
However, the computer program code for carrying out the functions or method steps of the various embodiments of the present invention may also reside on a network such as the world wide web and may be downloaded into the working memory of a data processor from such a network.
It has to be noted that embodiments of the invention are described with reference to different subject matters. In particular, some embodiments are described with reference to method type claims whereas other embodiments are described with reference to apparatus type claims. However, a person skilled in the art will gather from the above and the following description that, unless other notified, in addition to any combination of features belonging to one type of subject-matter also any combination between features relating to different subject-matters is considered to be a disclosure of this application. All features can be combined to provide a synergistic effect more than a simple sum of features.
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive. The invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims.
In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims shall not be construed as limiting the scope.
Claims (16)
1. An apparatus for generating tools for assisting a user in interacting with an application, comprising
A data receiving unit configured to receive data representing an interaction behavior of the user with the application, the data including at least data representing a plurality of steps of the user operating the application;
a data analysis unit configured to determine a sequence of steps frequently used by the user among the plurality of steps in which the user operates the application program based on the data; and
a tool generation unit configured to generate the tool for assisting the user in interacting with the application based on the determined sequence of steps frequently used by the user.
2. The apparatus of claim 1, wherein the data further comprises data representing parameter settings in each step of the user operating the application.
3. The device of claim 1, further comprising a user interface configured to notify the user when the sequence of steps frequently used by the user is determined, and to receive input from the user in response to the notification; wherein the tool generation unit is further configured to generate the tool for assisting the user in interacting with the application based on the input.
4. The device of claim 3, wherein the user interface is further configured to display to the user the sequence of steps determined to be frequently used by the user, and the input comprises an adjustment of the sequence of steps by the user; wherein the tool generation unit is further configured to generate the tool for assisting the user in interacting with the application based on the adjusted sequence of steps.
5. The apparatus of claim 1, further comprising
A memory configured to store one or more predetermined sequences of steps;
wherein the tool generation unit is further configured to compare the determined sequence of steps frequently used by the user with the one or more predetermined sequences of steps; and determining, based on the comparison, whether to generate the tool for assisting the user in interacting with the application based on the determined sequence of steps frequently used by the user.
6. The apparatus of claim 5, further comprising
A user interface configured to display the determined sequence of steps frequently used by the user to the user and receive a selection by the user of the determined sequence of steps frequently used by the user;
wherein the memory is further configured to store the selected sequence of steps as the one or more predetermined sequences of steps when the user selects the determined sequence of steps that is frequently used by the user,
and wherein the tool generation unit is further configured to compare the determined user-frequently used sequence of steps with the one or more predetermined sequences of steps when the user does not select the sequence of steps that is not selected; and determining, based on the comparison, whether to generate the tool for assisting the user in interacting with the application based on the unselected sequence of steps.
7. The apparatus of any of claims 1-6, wherein the sequence of steps frequently used by the user comprises the sequence of steps most frequently used by the user.
8. Computer apparatus comprising
An application program; and
the device of any of claims 1-7 that generates a tool for assisting a user in interacting with the application;
wherein the application comprises a user interface configured to present tools for assisting the user in interacting with the application.
9. A method of generating a tool for assisting a user in interacting with an application, comprising
Receiving data representing the user's interaction behavior with the application, the data representing at least a plurality of steps of the user operating the application;
determining a sequence of steps that are frequently used by the user among the plurality of steps in which the user operates the application based on the data; and
generating the tool for assisting the user in interacting with the application based on the determined sequence of steps.
10. The method of claim 9, further comprising
Notifying the user when the sequence of steps frequently used by the user is determined;
receiving input by the user in response to the notification; and
generating the tool for assisting the user in interacting with the application based on the input.
11. The method of claim 10, wherein the determined sequence of steps frequently used by the user is displayed to the user, and the input comprises an adjustment of the sequence of steps by the user; wherein the tool for assisting the user in interacting with the application is generated based on the adjusted sequence of steps.
12. The method of claim 9, further comprising
Receiving one or more predetermined sequences of steps;
comparing the determined sequence of steps frequently used by the user with the one or more predetermined sequences of steps; and
determining, based on a result of the comparison, whether to generate the tool for assisting the user in interacting with the application based on the determined sequence of steps frequently used by the user.
13. The method of claim 12, further comprising
Displaying the determined sequence of steps frequently used by the user to the user;
receiving a selection by the user of the determined sequence of steps that is frequently used by the user;
when the user selects the determined sequence of steps that is frequently used by the user, storing the selected sequence of steps as the one or more predetermined sequences of steps; and is
When the user does not select the determined sequence of steps frequently used by the user, comparing the unselected sequence of steps with the one or more predetermined sequences of steps; and determining, based on the comparison, whether to generate the tool for assisting the user in interacting with the application based on the unselected sequence of steps.
14. The method of claim 9, wherein the tool for assisting the user in interacting with the application comprises a wizard or template.
15. Computer storage medium comprising program code for performing the method according to any of claims 9-14 when executed by a computer.
16. Computer program product comprising program code for performing a method according to any of claims 9-14 when executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810779859.5A CN110727483A (en) | 2018-07-16 | 2018-07-16 | Device and method for generating tool for assisting user to interact with application program |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810779859.5A CN110727483A (en) | 2018-07-16 | 2018-07-16 | Device and method for generating tool for assisting user to interact with application program |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110727483A true CN110727483A (en) | 2020-01-24 |
Family
ID=69217362
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810779859.5A Pending CN110727483A (en) | 2018-07-16 | 2018-07-16 | Device and method for generating tool for assisting user to interact with application program |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110727483A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101316423A (en) * | 2008-07-02 | 2008-12-03 | 中兴通讯股份有限公司 | Method for mobile terminal fast implementing multiple actions |
| CN101821730A (en) * | 2007-08-22 | 2010-09-01 | 普罗斯凯普科技公司 | Defining interactive user interface |
| US20130080949A1 (en) * | 2011-09-27 | 2013-03-28 | Red Eye International Ltd. | User interactions |
| CN103218129A (en) * | 2013-03-11 | 2013-07-24 | 东莞宇龙通信科技有限公司 | Method for adjusting application operation flow, and terminal thereof |
| CN103946801A (en) * | 2011-12-27 | 2014-07-23 | 宇龙计算机通信科技(深圳)有限公司 | Terminal and method for processing cooperative operation instructions |
| CN106294116A (en) * | 2015-06-11 | 2017-01-04 | 阿里巴巴集团控股有限公司 | Record and the methods, devices and systems of reproduction process process |
| KR20170055458A (en) * | 2014-03-07 | 2017-05-19 | 지멘스 악티엔게젤샤프트 | Method for enabling an interaction between an assistance device and a medical apparatus and/or an operator and/or a patient, assistance device, assistance system, unit, and system |
| CN106873854A (en) * | 2017-01-20 | 2017-06-20 | 北京奇虎科技有限公司 | Terminal and interface alternation control method, contact object creation method and device |
| CN108205467A (en) * | 2016-12-19 | 2018-06-26 | 谷歌有限责任公司 | The intelligence auxiliary of repetitive operation |
-
2018
- 2018-07-16 CN CN201810779859.5A patent/CN110727483A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101821730A (en) * | 2007-08-22 | 2010-09-01 | 普罗斯凯普科技公司 | Defining interactive user interface |
| CN101316423A (en) * | 2008-07-02 | 2008-12-03 | 中兴通讯股份有限公司 | Method for mobile terminal fast implementing multiple actions |
| US20130080949A1 (en) * | 2011-09-27 | 2013-03-28 | Red Eye International Ltd. | User interactions |
| CN103946801A (en) * | 2011-12-27 | 2014-07-23 | 宇龙计算机通信科技(深圳)有限公司 | Terminal and method for processing cooperative operation instructions |
| CN103218129A (en) * | 2013-03-11 | 2013-07-24 | 东莞宇龙通信科技有限公司 | Method for adjusting application operation flow, and terminal thereof |
| KR20170055458A (en) * | 2014-03-07 | 2017-05-19 | 지멘스 악티엔게젤샤프트 | Method for enabling an interaction between an assistance device and a medical apparatus and/or an operator and/or a patient, assistance device, assistance system, unit, and system |
| CN106294116A (en) * | 2015-06-11 | 2017-01-04 | 阿里巴巴集团控股有限公司 | Record and the methods, devices and systems of reproduction process process |
| CN108205467A (en) * | 2016-12-19 | 2018-06-26 | 谷歌有限责任公司 | The intelligence auxiliary of repetitive operation |
| CN106873854A (en) * | 2017-01-20 | 2017-06-20 | 北京奇虎科技有限公司 | Terminal and interface alternation control method, contact object creation method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107301007B (en) | Function menu display method and system | |
| CN110045953B (en) | Method and computing device for generating business rule expression | |
| US10382253B2 (en) | Method and system for network performance root cause analysis | |
| US9208137B2 (en) | Method to preview an undo/redo list | |
| CN109388506B (en) | Data processing method and electronic equipment | |
| US9213478B2 (en) | Visualization interaction design for cross-platform utilization | |
| CN103049163B (en) | User interface intelligent display control method and device | |
| CN109388791B (en) | Dynamic diagram display method and device, computer equipment and storage medium | |
| CN103049176A (en) | Method and device for displaying menus | |
| US11256996B2 (en) | Method for recommending next user input using pattern analysis of user input | |
| WO2018079225A1 (en) | Automatic prediction system, automatic prediction method and automatic prediction program | |
| US11544088B1 (en) | System and method for providing a customized graphical user interface based on user inputs | |
| CN112399006A (en) | File sending method and device and electronic equipment | |
| CN111125340A (en) | Menu information adjusting method and device, storage medium and terminal | |
| JP2008146455A (en) | Apparatus operation support device and its method and apparatus operation support program | |
| US9756451B2 (en) | Terminal apparatus and information processing method | |
| CN112799656A (en) | Script file configuration method, device, equipment and storage medium for automation operation | |
| CN106980429A (en) | The processing method and mobile terminal of desktop icons | |
| CN117218239A (en) | Data processing method and device, electronic equipment and readable storage medium | |
| CN110727483A (en) | Device and method for generating tool for assisting user to interact with application program | |
| CN111124393A (en) | Editing method and platform of algorithm logic, electronic equipment and storage medium | |
| CN106201478B (en) | Information processing method and electronic equipment | |
| JP6207888B2 (en) | Information processing device | |
| CN110322537B (en) | Slide transition animation editing method and related device | |
| CN106951147A (en) | Method and device is transferred in one kind application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200124 |