CN113961110B - User operation response method, device, computer equipment and storage medium - Google Patents
User operation response method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113961110B CN113961110B CN202010616738.6A CN202010616738A CN113961110B CN 113961110 B CN113961110 B CN 113961110B CN 202010616738 A CN202010616738 A CN 202010616738A CN 113961110 B CN113961110 B CN 113961110B
- Authority
- CN
- China
- Prior art keywords
- control
- content
- markable
- mark
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000004044 response Effects 0.000 title claims abstract description 80
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000008569 process Effects 0.000 claims abstract description 16
- 238000012545 processing Methods 0.000 claims description 38
- 238000004590 computer program Methods 0.000 claims description 16
- 230000009471 action Effects 0.000 claims description 3
- 230000000875 corresponding effect Effects 0.000 description 87
- 238000004891 communication Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 239000000284 extract Substances 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 230000001747 exhibiting effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000012384 transportation and delivery Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3438—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment monitoring of user actions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application relates to a user operation response method, a user operation response device, computer equipment and a storage medium. The method comprises the following steps: acquiring a trigger signal of user operation, extracting a control identification corresponding to the user operation in the trigger signal, identifying a control category to which the control corresponding to the control identification belongs, acquiring mark content corresponding to the control when the control category identification result is a markable control, configuring the mark content based on display content of the markable control, recording the mark content to a response event corresponding to the user operation, and responding to the user operation. By the method, the user can intuitively know which region is operated by the user when the user needs to operate in the follow-up operation, and the actual operation region is convenient to restore and the user operation process is repeated.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a user operation response method, apparatus, computer device, and storage medium.
Background
With the development of computer technology, various APPs (Application programs) are developed, so that in order to facilitate data management of the APPs, operation data are synchronously recorded when user operation is responded, data backtracking is performed, and crash scenes can be reproduced by analyzing operation areas of users when the APPs encounter abnormal conditions such as flash back and the like through recording response events of the user operation.
In the conventional technology, the response event recording is generally implemented by marking which area is currently operated by the user, and recording is performed by recording that an operation area is located at the level of the root view, so as to obtain a series of recording data, where the recorded operation data is as follows: "0.0_1.4_2.0_3.0_4.0_5.0_6.0_7.0_8.0_9.1" for identifying the hierarchical relationship between the respective elements corresponding to the operation, the character string representing the meaning "X hierarchical. Y-th element_".
Based on the existing recording mode of response events, once the view level is changed along with iteration of the APP version, an actual operation area cannot be restored, and the problem that the user operation process is difficult to reproduce is caused.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a user operation response method, apparatus, computer device, and storage medium capable of facilitating user operation area restoration and operation process reproduction.
A user operation response method, the method comprising:
Acquiring a trigger signal of user operation, and extracting a control identifier corresponding to the user operation in the trigger signal;
identifying the control category to which the control corresponding to the control identifier belongs;
when the control category identification result is a markable control, obtaining mark content corresponding to the control, wherein the mark content is configured based on display content of the markable control;
And recording the mark content to a response event corresponding to the user operation, and responding to the user operation.
A user operation response device, the device comprising:
The trigger instruction acquisition module is used for acquiring a trigger signal of user operation and extracting a control identifier corresponding to the user operation in the trigger signal;
The control category identification module is used for identifying the control category to which the control corresponding to the control identifier belongs;
The mark content acquisition module is used for acquiring mark content corresponding to the control when the control type identification result is a markable control, and the mark content is configured based on the display content of the markable control;
And the mark content recording module is used for recording the mark content to a response event corresponding to the user operation and responding to the user operation.
A computer device comprising a memory storing a computer program and a processor which when executing the computer program performs the steps of:
Acquiring a trigger signal of user operation, and extracting a control identifier corresponding to the user operation in the trigger signal;
identifying the control category to which the control corresponding to the control identifier belongs;
when the control category identification result is a markable control, obtaining mark content corresponding to the control, wherein the mark content is configured based on display content of the markable control;
And recording the mark content to a response event corresponding to the user operation, and responding to the user operation.
A computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of:
Acquiring a trigger signal of user operation, and extracting a control identifier corresponding to the user operation in the trigger signal;
identifying the control category to which the control corresponding to the control identifier belongs;
when the control category identification result is a markable control, obtaining mark content corresponding to the control, wherein the mark content is configured based on display content of the markable control;
And recording the mark content to a response event corresponding to the user operation, and responding to the user operation.
According to the user operation response method, the device, the computer equipment and the storage medium, the operation space identification corresponding to the user operation is determined by acquiring the trigger signal when the user operates the control, so as to determine the control operated by the user, then the control category corresponding to the control is identified by identifying the control identification, the mark content of the control is acquired for the markable control, and then the mark content is recorded to the response event, so that the response and the record to the user operation are realized. Because the mark content of the control is configured by the display content of the markable control, the content of the user operation area can be directly obtained in the record of the response event of the user operation, compared with the mode of recording the layers and elements in the prior art, according to the scheme, the mark content of the control is recorded in the response event, so that the user can intuitively know which area is operated by the user when the user needs to operate in the follow-up operation, and the actual operation area is conveniently restored and the user operation process is reproduced.
Drawings
FIG. 1 is an application environment diagram of a user operation response method in one embodiment;
FIG. 2 is a flow diagram of a user operation response method in one embodiment;
FIG. 3 is a flow chart of a user operation response method according to another embodiment;
FIG. 4 is a flow chart of a user operation response method in yet another embodiment;
FIG. 5 is a flow chart of a user operation response method according to another embodiment;
FIG. 6 is a flow chart of a user operation response method in yet another embodiment;
FIG. 7 is a schematic diagram of an operation interface of a user operation response method in one embodiment;
FIG. 8 is a flow chart of a user operation response method according to another embodiment;
FIG. 9 is a block diagram of a user operation response device in one embodiment;
Fig. 10 is an internal structural view of a computer device in one embodiment.
Detailed Description
The present application will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present application more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
The user operation response method provided by the application can be applied to an application environment shown in figure 1. The terminal 102 obtains a trigger signal of a user operation, extracts a control identifier corresponding to the user operation in the trigger signal, then identifies a control category to which the control identifier corresponds, obtains a mark content corresponding to the control when the control category identification result is a markable control, obtains the mark content based on the configuration of the display content of the markable control, records the mark content to a response event corresponding to the user operation, responds to the user operation, and finally reports the response event to the server 104. The terminal 102 may be, but is not limited to, a portable wearable device capable of triggering control, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a tablet computer, and a smart watch. The server 104 may be implemented by a stand-alone server or a server cluster or a distributed system formed by a plurality of servers, or may be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs (Content Delivery Network, content delivery networks), and basic cloud computing services such as big data and artificial intelligence platforms. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the present application is not limited herein.
In one embodiment, as shown in fig. 2, a user operation response method is provided, and the method is applied to the terminal in fig. 1 for illustration, and includes the following steps 202 to 208.
Step 202, acquiring a trigger signal of user operation, and extracting a control identifier corresponding to the user operation in the trigger signal.
The user operation refers to an action by which the user operates an application installed in the terminal device. For example, a user performs operation control on an application program through an input device such as a touch screen, a keyboard, a mouse, and the like. The user operation may include a click operation, a drag operation, or the like. When the terminal senses user operation, a user operation trigger signal is generated, and a control mark triggered by the user is determined based on the user operation trigger signal. The control identification is used for representing a control triggered by user operation. The control is a component element of an operable area of the application software, one or more controls can be laid out in any operation interface of the terminal, and further, the same control can also comprise a plurality of sub-controls.
Step 204, identify the control category to which the control identifier corresponds.
The control category comprises a markable control and a non-markable control, wherein the markable control is a control realizing a markable interface, and the markable interface declares a method for writing and reading the content of the mark. Corresponding to the interface, the corresponding interface is not realized by the non-markable control.
In one embodiment, identifying the control category to which the control identifier corresponds to the control belongs comprises: and identifying the control category to which the control belongs by judging whether the control corresponding to the control identifier realizes the markable interface or not.
Specifically, if the control identifier corresponds to the control to realize the markable interface, the control category to which the control belongs is a markable control, and if the control identifier corresponds to the control to realize the markable interface, the control category to which the control belongs is a non-markable control
Whether the class of controls is markable controls may be configured based on the needs of the application software. For example, in practical use, some sensitive controls, such as password input controls, are configured as markable controls if the password input controls are not distinguished, so that leakage of the private data is easy to cause and potential safety hazards exist, therefore, the sensitive controls can be configured as non-markable controls, and for other non-sensitive common controls for recording the user operation area, the control types can be configured as markable controls.
And 206, when the control type identification result is a markable control, obtaining the marking content corresponding to the control, wherein the marking content is configured based on the display content of the markable control.
And acquiring a control category identification result, wherein the control category identification result comprises a markable control and a non-markable control, and acquiring mark content corresponding to the control when the control category identification result is the markable control. The mark content is associated data corresponding to the display content of the control, and the display content of the control can be obtained directly or indirectly based on the mark content. For example, for a control in which the presentation content is text, the presentation content is directly configured as the logo content, and for a control in which the presentation content is a picture, the link of the picture is configured as the logo content.
And step 208, recording the mark content to a response event corresponding to the user operation, and responding to the user operation.
The corresponding response event of the user operation is used for recording related data of the user operation process, and the recorded data comprise user operation time, operation modes, operation areas and the like. By recording the mark content to the response event corresponding to the user operation, when the terminal reports the recorded response event to the server, the server can acquire the detailed data of the user operation, especially for the case that the iteration view level along with the APP version is changed, the actual operation area can be quickly and accurately restored based on the reported user operation response event received by the server.
In other embodiments, the data recorded in the response event may further include a type of operation, an operation time, an operation number, a user account triggering the triggering operation, etc., so that the server can count the type of operation, the operation time, and the related information of the user, which is not limited in this embodiment.
According to the user operation response method, the triggering signal when the user operates is obtained, the operation space identifier corresponding to the user operation is determined to determine the control operated by the user, then the control category corresponding to the control is identified by the control identifier, for the markable control, the mark content of the control is obtained, and then the mark content is recorded to the response event, so that the response and the record to the user operation are realized. Because the mark content of the control is configured by the display content of the markable control, the content of the user operation area can be directly obtained in the record of the response event of the user operation, compared with the mode of recording the layers and elements in the prior art, according to the scheme, the mark content of the control is recorded in the response event, so that the user can intuitively know which area is operated by the user when the user needs to operate in the follow-up operation, and the actual operation area is conveniently restored and the user operation process is reproduced.
In one embodiment, as shown in fig. 3, when the control category identification result is a markable control, the step 206 of obtaining the marking content corresponding to the control includes steps 302 to 312.
And step 302, when the control category identification result is a markable control, taking the control as a current processing control.
And 304, acquiring the mark content of the current processing control, and judging whether the current processing control contains sub-controls.
Step 306, if the current processing control includes a child control, identifying a control category of the child control.
Step 308, if the control class of the child control is a non-markable control, skipping the child control.
Step 310, if the control class of the child control is a markable control, obtaining the marking content of the child control, taking the child control as the latest current processing control, and returning to step 304.
And 312, when the unidentified child control does not exist, performing splicing processing on the obtained mark content to obtain the mark content corresponding to the control.
Control layout is the distribution of individual controls in the application's operational interface. In an embodiment, the control may be generated from a plurality of control nested layouts. And judging whether the control contains the corresponding sub-control or not based on the nesting relation existing in the control layout for the control operated by the user, and identifying the sub-control.
In a particular embodiment, a determination is first made as to whether a user-operated control attribute is that a child control may be included. A complex interface is often formed by nesting various container controls, taking a layout control as an example, an automatic layout function is provided for internal sub-controls, so that the layout control can contain a plurality of sub-controls, then according to the control attribute and the interface control layout, judging whether each control (or sub-control) contains the sub-control according to the nested layout of the control, obtaining a sub-control identification result, and finally, determining the mark content corresponding to the control based on the control composition. It can be appreciated that if the control does not include a child control, the logo content of the control only includes the logo content of the control itself.
In the embodiment, the identification of the child control in the control is a recursive loop process, in the recursive loop processing process, for each identified identifiable control, the identifiable control is taken as a current processing object, the mark content corresponding to the control is obtained, then whether the control contains the child control is identified, if the control contains the child control, the child control is taken as the current processing object, the mark content is obtained, whether the child control is contained is further identified, and if the current processing object does not contain the child control, the obtained mark contents are spliced, so that the content of the operation area is obtained.
In one embodiment, as shown in fig. 4, when there is no unidentified child control, the acquired flag content is spliced to obtain the flag content corresponding to the control, that is, step 312 includes steps 402 to 404.
And step 402, when unidentified child controls do not exist, control layer information corresponding to each mark content is obtained.
And step 404, splicing the mark contents according to the layer sequence corresponding to the control layer information to obtain the mark contents corresponding to the control.
The control layer information corresponds to the nesting relation of the controls, each child control can determine the layer where the child controls are located when performing interface layout, and the marking content of each child control is spliced according to the layer where the child control is located and the sequence from small to large or from large to small, and the splicing result is the marking content corresponding to the control.
In an embodiment, the splicing of the plurality of logo contents may be performed by connectors, for example, by adding an underline or a space character as a connector between the logo contents of different child controls, thereby obtaining a series of continuous data records.
In one embodiment, as shown in fig. 5, when the control category identification result is a markable control, the obtaining the markup content corresponding to the control, that is, step 206 includes steps 502 to 504:
And step 502, extracting the markable interface information of the markable control when the control category identification result is the markable control.
And step 504, obtaining the mark content of the markable control according to the markable interface information.
The interface is an abstract type in Java programming language, and is used for requiring the class to realize the appointed method, so that the objects of different classes can communicate by using the same method, and when the mark content of the control is configured, the mark content to be recorded is set by calling the mark-capable interface configured by the mark content. Therefore, when judging whether the control is a markable control, determining whether the control is a markable control according to whether the control realizes a markable interface, and when acquiring the mark content, acquiring the mark content corresponding to the control by calling the markable interface.
In one embodiment, configuration of the logo content for the control to be presented in the presentation interface is also required prior to implementing the user action response. The process of configuring the mark content corresponding to the control comprises the following steps: and acquiring the display content attribute of the control. The control with the display content attribute being sensitive content is configured as a non-markable control, and the marking content of the non-markable control is configured as null. The control with the display content attribute of non-sensitive content is configured as a markable control for realizing a markable interface, and the marking content of the markable control is configured by calling a setting content interface according to the display content corresponding to the markable control.
The attribute of the display content is divided into sensitive content and non-sensitive content, the sensitive content refers to data which is not suitable to be recorded in a response event, such as private data such as an account number, a password, personal information and the like input by a user, and the non-sensitive data refers to data which can be displayed to the public, such as business data in a terminal interface and the like. The display content attribute of the control is defined in the configuration process of the interface layout, the control type is further defined based on the display content attribute of the defined control, and the user is distinguished to belong to a markable control or a non-markable control, wherein the control of the sensitive content is marked as the non-markable control, and the control of the non-sensitive content is configured as the markable control. Further, for the non-signable control, the display content of the non-signable control should not be recorded to the response event, so that the flag content of the non-signable control is configured to be empty, and the flag content of the signable control is configured by calling the set content interface according to the display content corresponding to the signable control. By configuring the sensitive content as the non-markable control, the privacy protection of the data can be improved, and the leakage of the sensitive information can be avoided.
Markable controls include text controls and picture controls. In one embodiment, according to the display content corresponding to the markable control, configuring the marking content of the markable control by calling the setting content interface includes: acquiring text information corresponding to a text control in the markable control, and configuring the text information into the marking content of the text control by calling a setting content interface of the text control; and acquiring a picture link address corresponding to the picture control in the markable control, and configuring the picture link address as the mark content of the picture control by calling a set content interface of the picture control.
The content generally displayed on a UI (User Interface) Interface includes both text and pictures, the text control refers to a control in which the display content on the UI Interface is text information, and the picture control refers to a control in which the display content on the UI Interface is picture information. The picture link address may be determined according to a data source of the picture, and specifically may be a url (uniform resource locator, uniform resource location system) address of the picture, or may be a website or a storage address of the picture in local data. Because the data space occupied by the picture data is larger, the picture information can be accurately described in a picture link address mode, so that the picture is conveniently obtained, the recorded data content can be simplified in the recorded data of the response event, and the data can be conveniently recorded and managed.
In one embodiment, for a picture control, it may be defined whether to use the picture link address of the picture as the flag content of the picture control or mark the flag content of the picture control as null based on the importance degree of the picture control in the UI interface. In a specific embodiment, when the interface is laid out, whether the mark content of the picture control is marked as empty can be determined according to whether the same operable area contains other types of controls or the proportion of the number of the picture controls in the data of all controls corresponding to the operable area. For the control formed by a plurality of different child controls, the mark content of the picture control is marked as empty, so that the record content of the response event can be simplified, and when the user operation process is restored, the control can be positioned to the operation area of the user based on other controls, and the restoration of the user operation process is not influenced.
The application also provides an application scene, which applies the user operation response method.
Specifically, the application of the user operation response method in the application scene is as follows:
in the layout configuration process of the UI interface of the application software, firstly, the layout of the interface elements is carried out according to the business requirement and the layers, the layout of the interface elements is realized through the control, compared with the mode of defining the elements as the number of the layers in the prior art, the application defines the control according to whether the display content is sensitive content or not, and divides the control into a non-markable control corresponding to the sensitive content and a markable control corresponding to the non-sensitive content.
And for the markable control, the corresponding mark content is configured by calling a set content interface. Specifically, for a text control, in the process of defining an interface by the control, determining an interface corresponding to the display content of the text control on the UI interface, and marking the display content of the text control on the UI interface as the mark content of the text control at the original setting display content based on the interface. For a picture control, firstly, whether the picture control is used as an independent control or a child control of a certain control, if the picture control is used as the child control of the certain control, the picture link address of the picture control is marked as the mark content of the text control at the original setting display content of the picture control, and if the picture control is used as the child control of the certain control, the picture link address is marked as the blank at the original setting display content of the picture control, so that the definition of the control is realized.
As shown in fig. 6, when responding to the operation of a user on a control, in an application UI interface of a terminal, monitoring the click operation of the user on the application interface, generating a user operation trigger signal, then determining the control triggered by the user operation according to the identifier of the operation control corresponding to the trigger area of the user operation trigger signal, next, identifying that the control category to which the control corresponding to the control identifier belongs is a markable control or a non-markable control, specifically, if the control category identification result is a non-markable control, recording the operation directly according to the conventional technology by recording the hierarchy of the operation area in the root view, if the control category identification result is a markable control, acquiring the mark content of the markable control through the markable interface, specifically, by judging whether the control also comprises a sub-control, identifying the sub-control category, acquiring the mark content of the sub-control, then splicing the mark content of each sub-control according to the hierarchy order of the sub-control, obtaining the mark content of the control corresponding to the operation area, recording the mark content of the control corresponding to the operation area to the response event corresponding to the operation, and reporting to the server.
In an application example, as shown in fig. 7, the user clicks a control corresponding to the line box part in fig. 7, where the control includes a plurality of sub-controls, specifically text controls "rmb 3 month period", "CNY", "minimum deposit amount CNY", "1.00", "2.10%" and "highest annual rate". By the above method, recorded contents such as: "RMB 3 month period_CNY_minimum deposit amount CNY 1.00_2.40% _maximum annual rate", where underline indicates a content separator. Therefore, the recorded data in the response event can clearly and intuitively record the operation area of the user, the operation area of the user can be conveniently analyzed through the recorded data in the response event, the area with the highest use frequency is determined, and the popularization effect of the corresponding activities of each operation area is further analyzed. And when the user feeds back the problem, for example, when the feedback encounters abnormal conditions such as app flash back, the user operation path is obtained by analyzing the user operation area, so as to reproduce the crashed scene.
Through the processing, the problems that which region is operated by a user cannot be intuitively known in the prior art, and the actual operation region cannot be restored once the view level is changed along with iteration of the APP version are solved, the application extracts the markable content (such as text, picture link and the like) of the clicking region of the user and records the content as an essential element of one-time operation of the user, thus being capable of conveniently knowing which region the user currently operates.
Specifically, the display control is added with a uniform interface for setting and acquiring the content, and all elements displayed by the user can realize the interface to acquire the mark content corresponding to the externally displayed content. And the control of the interface is used for calling the interface for setting the content to set the information to be recorded when the visible content is set, such as text information is set by the text control, and the url address of the picture to be displayed is set by the picture control, so that the acquisition of response event record data is facilitated. And finally, when the control responds to the user operation event, traversing operation on the response control is added, and display content is acquired and mark content is spliced for all sub-controls of the response control through corresponding interfaces and recorded in the response event. The response event can be reported to the server, and the control capable of acquiring the markable content is limited by the processing mode, so that only the control realizing the markable interface can acquire the markable content, not all the controls can acquire related information through the markable interface, the leakage of sensitive information is avoided, and on the other hand, the visible content is uniformly reported as the mark while the visible content is set, and the reported content is ensured to be visible, public and safe.
In one embodiment, as shown in FIG. 8, the user manipulation response method includes the following steps 802 to 830.
Step 802, acquiring the display content attribute of each control in the UI.
In step 804, the control exhibiting the content attribute as sensitive content is configured as a non-signable control, and the signable content of the non-signable control is configured as null.
At step 806, the control exhibiting content properties as non-sensitive content is configured as a markable control implementing a markable interface.
Step 808, obtaining text information corresponding to the text control in the markable control, and configuring the text information into the marking content of the text control by calling the setting content interface of the text control.
Step 810, obtaining a picture link address corresponding to the picture control in the markable control, and configuring the picture link address as the mark content of the picture control by calling a set content interface of the picture control.
Step 812, acquiring a trigger signal of the user operation, and extracting a control identifier corresponding to the user operation in the trigger signal.
In step 814, the control identifier is identified as the control category to which the corresponding control belongs.
And step 816, when the control category identification result is a markable control, taking the control as a current processing control.
Step 818, obtain the mark content of the current processing control, and judge whether the current processing control contains sub-control.
In step 820, if the current processing control includes a child control, a control category of the child control is identified.
In step 822, if the control class of the child control is a non-signable control, the child control is skipped.
In step 824, if the control class of the child control is a markable control, the marking content of the child control is obtained, the child control is used as the latest current processing control, and step 818 is returned.
Step 826, when there is no unidentified child control, obtaining control layer information corresponding to each flag content
And step 828, splicing the mark contents according to the layer sequence corresponding to the control layer information to obtain the mark contents corresponding to the control.
And 830, recording the mark content to a response event corresponding to the user operation, and responding to the user operation.
It should be understood that, although the steps in the flowcharts of fig. 2-5 and 8 are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in fig. 2-5, 8 may include steps or stages that are not necessarily performed at the same time, but may be performed at different times, nor do the order in which the steps or stages are performed necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the steps or stages in other steps.
In one embodiment, as shown in fig. 9, a user operation responding apparatus 900 is provided, which may be a software module or a hardware module, or a combination of both, forming part of a computer device, and specifically includes: a trigger instruction acquisition module 902, a control category identification module 904, a logo content acquisition module 906, and a logo content recording module 908, wherein:
The trigger instruction obtaining module 902 is configured to obtain a trigger signal of a user operation, and extract a control identifier corresponding to the user operation in the trigger signal.
The control category identification module 904 is configured to identify a control category to which the control identifier corresponds.
And the mark content obtaining module 906 is configured to obtain mark content corresponding to the control when the control type recognition result is a markable control, where the mark content is configured based on the display content of the markable control.
The tag content recording module 908 is configured to record the tag content to a response event corresponding to the user operation, and respond to the user operation.
In one embodiment, the control category identification module is further configured to identify a control category to which the control belongs by determining whether the control identifier corresponds to the control to implement the markable interface.
In one embodiment, the mark content obtaining module is further configured to use the control as a current processing control when the control category identification result is a markable control; acquiring the mark content of the current processing control, and judging whether the current processing control contains sub-controls or not; when the current processing control comprises a child control, identifying the control category of the child control; when the control category of the child control is a non-markable control, skipping the child control; when the control category of the child control is a markable control, obtaining the mark content of the child control, taking the child control as the latest current processing control, returning to the step of obtaining the mark content of the current processing control, and judging whether the current processing control contains the child control or not until the unidentified child control does not exist; and performing splicing treatment on the obtained mark content to obtain the mark content corresponding to the control.
In one embodiment, the mark content obtaining module is further configured to obtain control layer information corresponding to each mark content; and splicing the mark contents according to the layer sequence corresponding to the control layer information to obtain the mark contents corresponding to the control.
In one embodiment, the mark content obtaining module is further configured to extract markable interface information of a markable control when the control category identification result is a markable control; and acquiring the mark content of the markable control according to the markable interface information.
In one embodiment, the user operation response device further comprises a mark content configuration module, wherein the mark content configuration module is used for acquiring the display content attribute of the control; configuring a control with the display content attribute of sensitive content as a non-markable control, and configuring the marking content of the non-markable control as null; the control with the display content attribute of non-sensitive content is configured as a markable control for realizing a markable interface, and the marking content of the markable control is configured by calling a setting content interface according to the display content corresponding to the markable control.
In one embodiment, the flag content configuration module is further configured to obtain text information corresponding to a text control in the markable controls, and configure the text information into the flag content of the text control by calling a setting content interface of the text control; and acquiring a picture link address corresponding to the picture control in the markable control, and configuring the picture link address as the mark content of the picture control by calling a set content interface of the picture control.
According to the user operation response device, the triggering signal when the user operates is obtained, the operation space identifier corresponding to the user operation is determined, so that the control operated by the user is determined, then the control category corresponding to the control is identified by the identification control identifier, for the markable control, the mark content of the control is obtained, and then the mark content is recorded to a response event, so that the response and the record to the user operation are realized. Because the mark content of the control is configured by the display content of the markable control, the content of the user operation area can be directly obtained in the record of the response event of the user operation, compared with the mode of recording the layers and elements in the prior art, according to the scheme, the mark content of the control is recorded in the response event, so that the user can intuitively know which area is operated by the user when the user needs to operate in the follow-up operation, and the actual operation area is conveniently restored and the user operation process is reproduced.
The specific limitation of the user operation response means may be referred to the limitation of the user operation response method hereinabove, and will not be described herein. The respective modules in the above-described user operation response means may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
In one embodiment, a computer device is provided, which may be a terminal, and an internal structure diagram thereof may be as shown in fig. 10. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless mode can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a user operation response method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
It will be appreciated by those skilled in the art that the structure shown in FIG. 10 is merely a block diagram of some of the structures associated with the present inventive arrangements and is not limiting of the computer device to which the present inventive arrangements may be applied, and that a particular computer device may include more or fewer components than shown, or may combine some of the components, or have a different arrangement of components.
In one embodiment, there is also provided a computer device including a memory and a processor, the memory storing a computer program, the processor implementing the steps of the method embodiments described above when executing the computer program.
In one embodiment, a computer-readable storage medium is provided, storing a computer program which, when executed by a processor, implements the steps of the method embodiments described above.
In one embodiment, a computer program product or computer program is provided that includes computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the steps in the above-described method embodiments.
Those skilled in the art will appreciate that implementing all or part of the above-described methods in accordance with the embodiments may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, or the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory. By way of illustration, and not limitation, RAM can be in various forms such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples illustrate only a few embodiments of the application, which are described in detail and are not to be construed as limiting the scope of the application. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the application, which are all within the scope of the application. Accordingly, the scope of protection of the present application is to be determined by the appended claims.
Claims (14)
1. A user operation response method, the method comprising:
Acquiring a trigger signal of user operation, and extracting a control identifier corresponding to the user operation in the trigger signal;
identifying the control category to which the control corresponding to the control identifier belongs;
When the control category identification result is a markable control, obtaining mark content corresponding to the control, wherein the mark content is configured based on display content of the markable control, and the mark content is associated data corresponding to the display content of the control; in the case that the control comprises a sub-control with a control category of a markable control, the marking content also comprises marking content of the sub-control; for the picture control, the identification mode of the mark content comprises the following steps: taking the picture link address as the mark content of the picture control or marking the mark content of the picture control as empty; the identification mode determining mode comprises the following steps: determining whether the mark content of the picture control is marked as empty or not according to whether the same operable area contains other types of controls except the picture control or the proportion of the number of the picture control in the number of the controls corresponding to the operation area;
Recording the mark content to a response event corresponding to the user operation, and responding to the user operation; the mark content recorded in the response event is used for carrying out data backtracking so as to restore the actual operation area operated by the user;
in the case that the control includes a child control whose control category is a markable control, the process of obtaining the marking content corresponding to the control includes:
respectively acquiring control layer information corresponding to the respective mark content of the controls and each sub-control;
and splicing the mark contents according to the layer sequence corresponding to the control layer information to obtain the mark contents corresponding to the control.
2. The method of claim 1, wherein the identifying the control category to which the control identification corresponds to the control comprises:
and identifying the control category to which the control belongs by judging whether the control corresponding to the control identifier realizes a markable interface or not.
3. The method of claim 1, wherein when the control category identification result is a markable control, the obtaining the mark content corresponding to the control comprises:
When the control category identification result is a markable control, extracting markable interface information of the markable control;
And acquiring the mark content of the markable control according to the markable interface information.
4. The method of claim 1, wherein configuring the logo content corresponding to the control comprises:
acquiring the display content attribute of the control;
configuring a control with sensitive content as the display content attribute as a non-markable control, and configuring the marking content of the non-markable control as null;
And configuring the control with the display content attribute of non-sensitive content as a markable control for realizing a markable interface, and configuring the marking content of the markable control by calling a setting content interface according to the display content corresponding to the markable control.
5. The method according to claim 4, wherein the configuring the logo content of the logo control by calling a set content interface according to the exhibition content corresponding to the logo control comprises:
Acquiring text information corresponding to a text control in the markable control, and configuring the text information into the marking content of the text control by calling a setting content interface of the text control;
And acquiring a picture link address corresponding to the picture control in the markable control, and configuring the picture link address as the mark content of the picture control by calling a set content interface of the picture control.
6. The method of claim 1, wherein when the control category identification result is a markable control, the obtaining the mark content corresponding to the control comprises:
when the control category identification result is a markable control, the control is used as a current processing control;
Acquiring the mark content of the current processing control, and judging whether the current processing control contains sub-controls or not;
when the current processing control comprises a child control, identifying a control category of the child control;
when the control category of the child control is a non-signable control, skipping the child control;
When the control category of the child control is a markable control, obtaining the mark content of the child control, taking the child control as the latest current processing control, returning to the step of obtaining the mark content of the current processing control, and judging whether the current processing control contains the child control or not until no unidentified child control exists;
And performing splicing treatment on the obtained mark content to obtain the mark content corresponding to the control.
7. A user-operated response device, the device comprising:
The trigger instruction acquisition module is used for acquiring a trigger signal of user operation and extracting a control identifier corresponding to the user operation in the trigger signal;
the control category identification module is used for identifying the control category to which the control corresponding to the control identifier belongs;
The mark content acquisition module is used for acquiring mark content corresponding to the control when the control type identification result is a mark-capable control, wherein the mark content is configured based on the display content of the mark-capable control, and the mark content is associated data corresponding to the display content of the control; in the case that the control comprises a sub-control with a control category of a markable control, the marking content also comprises marking content of the sub-control; for the picture control, the identification mode of the mark content comprises the following steps: taking the picture link address as the mark content of the picture control or marking the mark content of the picture control as empty; the identification mode determining mode comprises the following steps: determining whether the mark content of the picture control is marked as empty or not according to whether the same operable area contains other types of controls except the picture control or the proportion of the number of the picture control in the number of the controls corresponding to the operation area;
The mark content recording module is used for recording the mark content to a response event corresponding to the user operation and responding to the user operation; the mark content recorded in the response event is used for carrying out data backtracking so as to restore the actual operation area operated by the user;
the mark content acquisition module is further used for respectively acquiring the control and the control layer information corresponding to the mark content of each sub-control when the control comprises the sub-control with the control category of the markable control; and splicing the mark contents according to the layer sequence corresponding to the control layer information to obtain the mark contents corresponding to the control.
8. The apparatus of claim 7, wherein the control category identification module is further configured to identify a control category to which the control belongs by determining whether a markable interface is implemented for the control corresponding to the control identifier.
9. The apparatus of claim 7, wherein the logo content acquisition module is further configured to extract logo interface information of a logo-able control when a control category recognition result is the logo-able control; and acquiring the mark content of the markable control according to the markable interface information.
10. The apparatus of claim 7 wherein said user action response means further comprises a logo content configuration module,
The mark content configuration module is used for acquiring the display content attribute of the control; configuring a control with sensitive content as the display content attribute as a non-markable control, and configuring the marking content of the non-markable control as null; and configuring the control with the display content attribute of non-sensitive content as a markable control for realizing a markable interface, and configuring the marking content of the markable control by calling a setting content interface according to the display content corresponding to the markable control.
11. The apparatus of claim 10, wherein the logo content configuration module is further configured to obtain text information corresponding to a text control in the logo-able controls, and configure the text information as logo content of the text control by calling a setup content interface of the text control; and acquiring a picture link address corresponding to the picture control in the markable control, and configuring the picture link address as the mark content of the picture control by calling a set content interface of the picture control.
12. The apparatus of claim 7, wherein the flag content acquisition module is further configured to take a control as a current processing control when the control category identification result is a markable control; acquiring the mark content of the current processing control, and judging whether the current processing control contains sub-controls or not; when the current processing control comprises a child control, identifying a control category of the child control; when the control category of the child control is a non-signable control, skipping the child control; when the control category of the child control is a markable control, obtaining the mark content of the child control, taking the child control as the latest current processing control, returning to the step of obtaining the mark content of the current processing control, and judging whether the current processing control contains the child control or not until no unidentified child control exists; and performing splicing treatment on the obtained mark content to obtain the mark content corresponding to the control.
13. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any of claims 1 to 6 when the computer program is executed.
14. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010616738.6A CN113961110B (en) | 2020-07-01 | 2020-07-01 | User operation response method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010616738.6A CN113961110B (en) | 2020-07-01 | 2020-07-01 | User operation response method, device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113961110A CN113961110A (en) | 2022-01-21 |
| CN113961110B true CN113961110B (en) | 2024-08-13 |
Family
ID=79459119
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010616738.6A Active CN113961110B (en) | 2020-07-01 | 2020-07-01 | User operation response method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113961110B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105607985A (en) * | 2015-09-29 | 2016-05-25 | 中国船舶重工集团公司第七0九研究所 | Qt graphical interface software-based operation log recording method and system |
| CN109634756A (en) * | 2018-11-26 | 2019-04-16 | 平安科技（深圳）有限公司 | Page events processing method, device, computer equipment and storage medium |
| CN110874307A (en) * | 2018-08-29 | 2020-03-10 | 北京京东尚科信息技术有限公司 | Event buried point collecting and reporting method and device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109857505A (en) * | 2019-01-31 | 2019-06-07 | Oppo广东移动通信有限公司 | Execution method, apparatus, terminal and the storage medium of operation |
| CN110134656B (en) * | 2019-04-04 | 2021-10-22 | 微民保险代理有限公司 | Page control method and device, computer readable storage medium and computer equipment |
| CN111209000B (en) * | 2020-01-08 | 2024-01-26 | 网易（杭州）网络有限公司 | Processing method and device of custom control, electronic equipment and storage medium |
-
2020
- 2020-07-01 CN CN202010616738.6A patent/CN113961110B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105607985A (en) * | 2015-09-29 | 2016-05-25 | 中国船舶重工集团公司第七0九研究所 | Qt graphical interface software-based operation log recording method and system |
| CN110874307A (en) * | 2018-08-29 | 2020-03-10 | 北京京东尚科信息技术有限公司 | Event buried point collecting and reporting method and device |
| CN109634756A (en) * | 2018-11-26 | 2019-04-16 | 平安科技（深圳）有限公司 | Page events processing method, device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113961110A (en) | 2022-01-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10466971B2 (en) | Generation of an application from data | |
| US8024651B1 (en) | Data visualization using tables integrated with hierarchical pie charts | |
| US20230055241A1 (en) | Digital processing systems and methods for external events trigger automatic text-based document alterations in collaborative work systems | |
| CN112817817B (en) | Buried point information query method, buried point information query device, computer equipment and storage medium | |
| CN101611422A (en) | Web data usage platform | |
| US20210124541A1 (en) | Conversational Analytics with Data Visualization Snapshots | |
| CN109145231A (en) | A kind of generation method, device and the electronic equipment of interface element identifier | |
| CN111596911B (en) | Method, device, computer equipment and storage medium for generating control | |
| US11120200B1 (en) | Capturing unstructured information in application pages | |
| CN104657451A (en) | Processing method and processing device for page | |
| CN111258466A (en) | Data visualization method and device, computer equipment and storage medium | |
| WO2022153122A1 (en) | Systems, methods, and devices for enhanced collaborative work documents | |
| CN109213668B (en) | Operation recording method and device and terminal | |
| CN113407284A (en) | Navigation interface generation method and device, storage medium and electronic equipment | |
| CN114730341A (en) | Protecting user privacy in user interface data collection for native applications | |
| CN114020589B (en) | Buried point processing method, buried point processing device, computer equipment and storage medium | |
| JP6505849B2 (en) | Generation of element identifier | |
| CN113961110B (en) | User operation response method, device, computer equipment and storage medium | |
| CN116204172A (en) | Code generation method, device, apparatus, medium and program product | |
| CN112685678B (en) | Page configuration method, page configuration device, computer equipment and storage medium | |
| CN110569459A (en) | statistical method and device for webpage information | |
| CN111177614A (en) | Source tracking method and device for injecting content to third party of webpage | |
| CN112988291B (en) | Page event management method and device, computer readable medium and electronic equipment | |
| CN112433712B (en) | Report display method, report display device, computer equipment and storage medium | |
| CN117390317A (en) | Method and device for realizing dynamic form |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |