CN112286620A - Application program interaction method and device, electronic equipment and storage medium - Google Patents
Application program interaction method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112286620A CN112286620A CN202011597040.0A CN202011597040A CN112286620A CN 112286620 A CN112286620 A CN 112286620A CN 202011597040 A CN202011597040 A CN 202011597040A CN 112286620 A CN112286620 A CN 112286620A
- Authority
- CN
- China
- Prior art keywords
- application program
- user interface
- interface
- object data
- interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/453—Help systems
Abstract
The invention provides an application program interaction method, an application program interaction device, electronic equipment and a storage medium, wherein the interaction method comprises the following steps: scanning a display page in a current display screen on the intelligent terminal; generating a user interface on a changed display page under the condition that the interface of an application program in a display screen is changed; determining an executable operation function and an operation which can be executed according to the user interface in the application program according to the user interface; and executing the operation instruction corresponding to the user interface in the application program according to the executable operation function and the operation executable according to the user interface. The invention adds a new interaction mode to the application program, and improves and enriches the interaction experience of the user using the application program.
Description
Technical Field
The invention relates to the technical field of mobile internet, in particular to an application program interaction method and device, electronic equipment and a storage medium.
Background
In recent years, with the popularization of intelligent terminals, application programs are developed in large quantities, and great convenience is brought to the life of people. Applications (APP) running on the smart mobile terminal generally implement interaction by clicking a touch screen, and specifically include: the user sends out a command through manual operation on the control interface, the intelligent mobile terminal receives the command and then responds, the response result is fed back to the user in a visual mode, and the user performs corresponding operation according to the seen interface.
However, in some scenarios, the use experience brought to the user is not perfect only by means of interaction through clicking a touch screen, and there may be some problems, for example, the use experience of the user is boring due to such a single interaction manner, or the user just opens a new application, the page operation of which is not familiar, and only the operation can be attempted, and the like.
Therefore, adding a new interaction mode to a page to improve and enrich the user's interaction experience with APP is a technical problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The invention provides an application program interaction method, an application program interaction device, electronic equipment and a storage medium, which are used for adding a new interaction mode to an application program and achieving the purpose of improving and enriching the interaction experience of a user using APP.
The invention provides an application program interaction method, which comprises the following steps: scanning a display page in a current display screen on the intelligent terminal; generating a user interface on the changed display page under the condition that the interface of the application program in the display screen is changed; wherein the user interface is pre-configured to have a correspondence with an executable operational function on an interface of the application program; the executable operation function comprises the operation which can be executed by the current interface of the application program according to the user interface; determining the executable operation function and the operation which can be executed according to the user interface in the application program according to the user interface; and executing an operation instruction corresponding to the user interface in the application program according to the executable operation function and the operation which can be executed according to the user interface.
According to the application program interaction method provided by the invention, under the condition that the interface of the application program in the display screen is changed, the user interface is generated on the changed display page, and the method comprises the following steps: scanning each display interface node contained in the display interface of the current application program which changes, and acquiring dynamic interface node object data corresponding to each display interface node; the dynamic interface node object data form a dynamic interface node object data set; matching and searching pre-stored searching characteristic object data associated with the current application program in the dynamic interface node object data set; and determining an operation instruction associated with the dynamic interface node object data matched with the search characteristic object data, selecting a user interface which is stored in advance and corresponds to the operation instruction, and generating the user interface on the changed page.
According to the application program interaction method provided by the invention, the pre-stored search characteristic object data associated with the current application program is obtained through the following steps:
when the application program is opened, identifying a name identification corresponding to the application program; transmitting the name identification to a cloud server, and requesting search feature object data associated with the name identification from the cloud server; and receiving the search characteristic object data from the cloud server.
According to the application program interaction method provided by the invention, the searching feature object data comprises the following steps: a name identification of an application program, and search policy object data associated with the application program; the search policy object data includes a user interface interaction identification, and at least one of: text information, interface identification information, class name information and a search mode.
According to the application program interaction method provided by the invention, the dynamic interface node object data corresponding to each display interface node at least comprises one of the following data: text information of the interface node; rectangular frame information of the interface node; interface node identification information; class name information; and, whether it is visible.
According to the application program interaction method provided by the invention, the step of displaying the user interface on the changed page comprises the following steps:
generating a user interface display data set based on the dynamic interface node object data matched with the search strategy object data and a prestored user interface interaction identifier in the search strategy object data; polling the user interface display data set; determining the position of an interface node based on the rectangular frame information of the interface node in the dynamic interface node object data; and selecting a matched user interface interaction generation method according to the user interface interaction identifier, generating drawing data, and displaying the user interface based on the drawing data.
According to the application program interaction method provided by the invention, the drawing data comprises at least one of the following: planar coordinates of the user interface, background pattern, width and height of the user interface, text content, and animation content.
The invention also provides an application program interaction device, which comprises: the device comprises a scanning module, a user interface generating module, an operation confirming module and an executing module. The scanning module is used for scanning a display page in a current display screen on the intelligent terminal; the user interface generating module is used for generating a user interface on the changed display page under the condition that the interface of the application program in the display screen is changed; wherein the user interface is pre-configured to have a correspondence with an executable operational function on an interface of the application program; the executable operation function comprises the operation which can be executed by the current interface of the application program according to the user interface; the operation confirmation module is used for determining the executable operation function and the operation which can be executed according to the user interface in the application program according to the user interface; the execution module is used for executing the operation instruction corresponding to the user interface in the application program according to the executable operation function and the operation which can be executed according to the user interface.
The invention also provides an electronic device comprising a memory, a processor and a computer program stored on the memory and operable on the processor, wherein the processor executes the program to implement the steps of the application program interaction method according to any one of the above.
The invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the application interaction method as any one of the above.
In the application program interaction method, device, electronic device and storage medium provided by the invention, under the condition that the interface of the application program in the display screen is changed, a new user interface (for example, the user interface can be used for setting prompt information such as characters, pictures or animations) is added on the changed display page, and an additional prompt is performed on the interface node of the current application program, so that the functions of guiding the user and prompting the user to operate are achieved. Therefore, the method and the device add a new interaction mode for the application program, and improve and enrich the interaction experience of the user using the application program.
Moreover, it should be noted that the present invention is independent of the design scheme of the application program in the current mobile terminal, and does not involve the extension and modification of the application program itself, that is, when the present invention is applied to the existing intelligent terminal, it is not necessary to separately add a toolkit of the interaction method to each application in advance, and only the operation of the present invention needs to be started at the mobile terminal, and different application programs in the background of the intelligent terminal can all use the application program interaction method of the present invention to guide the user (especially, novice user) to operate, which is convenient and practical, and easy to popularize.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a flow chart diagram of an application interaction method provided by the present invention;
FIG. 2 is a flowchart illustrating steps of generating a user interface in the application program interaction method according to the present invention;
FIG. 3 is a schematic flow chart of obtaining search feature object data in the application program interaction method provided by the present invention;
FIG. 4 is a flowchart illustrating steps of generating a user interface in the application program interaction method according to the present invention;
FIG. 5 is a schematic view of a user page presented by an App interface;
FIG. 6 is a schematic diagram of a floating window overlaid as a user interface based on the application interaction method of the present invention;
FIG. 7 is a second flowchart illustrating an application interaction method according to the present invention;
FIG. 8 is a schematic structural diagram of an application program interaction device provided by the present invention;
FIG. 9 is a schematic structural diagram of a matching module in an embodiment of the application interaction apparatus provided in the present invention;
FIG. 10 is a schematic structural diagram of a matching unit of a user interface generating module in the application program interaction apparatus according to the present invention;
FIG. 11 is a block diagram of a generating unit of a user interface generating module in the application interactive apparatus according to the present invention;
fig. 12 is a schematic structural diagram of an electronic device provided in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The application interaction method of the present invention is described below in conjunction with fig. 1-7.
It should be noted that an execution main body of the application program interaction method of the present invention may be a terminal device, and specifically may be a processing system of the terminal device, or a plug-in loaded in the terminal device for implementing voice control, and the terminal device here may be a smart phone, a tablet computer, a vehicle-mounted control device, and the present invention is not limited thereto.
Referring to fig. 1, fig. 1 is a flowchart illustrating an application program interaction method according to an embodiment of the present invention, including the following steps:
and step 140, executing an operation instruction corresponding to the user interface in the application program according to the executable operation function and the operation executable according to the user interface.
In this embodiment, when the interface of the application program in the display screen changes, a new user interface is added to the changed display page (for example, the user interface may be prompt information such as setting characters, pictures, or animations), and an additional prompt is performed on the interface node of the current application program, so as to guide the user and prompt the user to perform an operation. Therefore, the method and the device add a new interaction mode for the application program, and improve and enrich the interaction experience of the user using the application program.
Moreover, it should be noted that the present invention is independent of the design scheme of the application program in the current mobile terminal, and does not involve the extension and modification of the application program itself, that is, when the present invention is applied to the existing intelligent terminal, it is not necessary to separately add a toolkit of the interaction method to each application in advance, and only the operation of the present invention needs to be started at the mobile terminal, and different application programs in the background of the intelligent terminal can all use the application program interaction method of the present invention to guide the user (especially, novice user) to operate, which is convenient and practical, and easy to popularize.
Referring to fig. 2, fig. 2 is a flowchart of steps for generating a user interface in the application program interaction method provided by the present invention, and the steps include:
step 210, monitoring the interface of the current application program;
In this embodiment, a dynamic interface node object data set corresponding to each display interface node in a changed interface is obtained by monitoring an interface of a current application program, search feature object data associated with the current application program and stored in advance are subjected to matching search in the dynamic interface node object data set, after an interface node associated with the dynamic interface node object data matched with the search feature object data is determined, a pre-stored user interface interaction generation method matched with the interface node is selected, and a user interface (for example, a floating window) is generated and displayed.
In the following, possible implementations of the above steps in specific embodiments are further explained.
Step 210, monitoring the interface of the application program.
In this step, the application is software installed in the terminal device to implement a specific function, and in fact, it can be seen that the application here refers to a third party application other than the application integrated according to the method of the present invention. That is, in the implementation, the application program interaction method of the present invention can be developed as a stand-alone application program, but the "application program" referred to in this step does not include the application program developed according to the advertisement processing method of the present invention. In specific implementation, the number of the monitored third-party applications is not limited, and may be one or more.
The "monitoring" here may be implemented in actual operation as follows: the interface of the third party application is refreshed periodically or aperiodically.
the change can be the sliding of the current interface of the application program, the switching of the user interface and other operations. The invention is not limited in this regard.
If no change occurs, for example, no operation such as sliding or window switching occurs on the interface, the process returns to step 210 to continue monitoring.
If so, go to step 230.
For example, in one embodiment, if the method of the present invention is integrated in a Service named Service, each time an interface of another application (App) changes, the Service is triggered to perform an interface node (View node) scan on the interface of the application.
As described above, when the interface changes, after each display interface node included in the interface is scanned, the dynamic interface node object data corresponding to each display interface node is collected.
In particular implementations, the interface of the current application may include multiple interface nodes, and thus, dynamic interface node object data for multiple interface nodes may be collected.
More specifically, if the interface V of the current application includes the interface nodes V1, V2, V3, …, vn.
The interface node v1 corresponds to dynamic interface node object data NodeInfo 1;
the interface node v2 corresponds to dynamic interface node object data NodeInfo 2;
the interface node v3 corresponds to dynamic interface node object data NodeInfo 3;
……
and
the interface node vn corresponds to the dynamic interface node object data NodeInfo n.
Then, the dynamic interface node object data set M is:
M=[ NodeInfo 1，NodeInfo 2，NodeInfo 3, …，NodeInfo n]
in a preferred embodiment, each dynamic interface node object data NodeInfo stores text information of the interface node, rectangular frame information of the interface node, interface node identification information, class name information, and whether the information is visible.
And the dynamic interface node object data set M can be stored in a cache data linked list of the intelligent terminal.
Still, the Service of Service integrated by the method of the present invention is taken as an example for explanation. After the App with a changed interface is scanned, the Service collects data of all View nodes on the App interface, the interface comprises n View nodes, 1 NodeInfo data object is created for each View node, the NodeInfo data object stores Text information of the View, rectangular frame information Rect (Left, Right, Top and Bottom) of the View, interface node identification ViewId, class name information ClassName, visible information and the like.
Finally, all NodeInfo objects, NodeInfo 1, NodeInfo 2, NodeInfo 3, … and NodeInfo n can be stored in a data linked list named as cacheList. The cacheList cache data linked list is created at runtime by the Service of Service.
Step 250 is explained below.
And step 250, matching and searching the pre-stored searching characteristic object data associated with the current application program in the dynamic interface node object data set.
Searching for feature object data is explained first.
As described above, the search feature object data is pre-stored in the local smart terminal and associated with the current application.
With reference to fig. 3, a description is provided below of an obtaining method of searching feature object data in the application program interaction method of the present invention, including the following steps:
step 30, monitoring the opening of the application program;
step 31, identifying a name identifier corresponding to the application program;
step 32, transmitting the name identifier to a cloud server, and requesting search feature object data associated with the name identifier from the cloud server;
step 33, the cloud server searches the corresponding search feature object data in the local database by using the name identifier as an index;
step 34, sending the searched characteristic object data to the intelligent terminal;
and step 35, receiving the search feature object data from the cloud server, downloading and storing.
Wherein, in one embodiment, searching the feature object data may comprise: a name identification of an application program, and search policy object data associated with the application program; the search policy object data includes a user interface interaction identification, and at least one of: text information, interface identification information, class name information and a search mode.
As can be seen from the above description, in an embodiment, if the Service of the Service integrated by the method of the present invention is matched, search feature object data corresponding to a plurality of applications APP needs to be stored in the cloud server in advance.
For example, APP 1 corresponds to search feature object data 1, APP 2 corresponds to search feature object data 2, APP 3 corresponds to search feature object data 3, …, and APP n corresponds to search feature object data n.
Then the search feature object data 1, the search feature object data 2, the search feature object data 3, etc. form an array object, which is stored in the cloud server.
In a specific implementation, the search feature object data 1 may be named as PolicyCache1, the search feature object data 2 may be named as PolicyCache2, the search feature object data 3 may be named as PolicyCache3 and …, and the search feature object data n may be named as PolicyCache n.
An array object composed of search feature object data 1, search feature object data 2, search feature object data 3, and the like is named policycache.
The data structure of any search feature object data PolicyCache is described below by taking it as an example.
The PolicyCache consists of an array of search policy object data SearchPolicy and the PackageName of the application.
The data structure of the search policy object data SearchPolicy includes text information text (character string array type), interface identification information viewId (character string array type), class name information className (character string array type), search mode action (integer type), and user interface interaction identification uiId (uiId corresponding to subcoverlay described below).
It should be noted that each application corresponds to a unique PackageName, and one application may correspond to 1 PolicyCache.
When a user opens an application program on terminal equipment, a Service can identify a packageName of the current application program, transmit the packageName to a cloud server as a parameter, download PolicyCache object data, equal to the packageName transmitted up, of the packageName from a PolicyCaches array in the cloud server to the local, and load search policy object data SearchPolicy objects in the PolicyCache data objects into a searchList data link list, wherein the searchList data link list is cached by the Service created during running.
In practice, it is common to download to 1 PolicyCache object, and the PolicyCache contains multiple SearchPolicy objects inside.
From the above description, it can be seen that:
pre-stored in searchList data link list, and search feature object data associated with the current application program is PolicyCache
PolicyCache = PackageName + SearchPolicy [text（）、viewId（）、className（）、action（）、uiId（）]
Scanning the changed interface to obtain a dynamic interface node object data set M stored in a cacheList data linked list
M = [ NodeInfo 1, NodeInfo 2, NodeInfo 3, …, NodeInfo n ] for matching.
Each NodeInfo = [ Text () ], Rect (Left, Right, Top, Bottom), ViewId (), ClassName (), whether visible () ]
And matching and searching a certain PolicyCache with the NodeInfo in the M.
Next, step 260 will be explained.
At step 260, the interface node associated with the dynamic interface node object data matched to the search feature object data is determined.
As described above, the PolicyCache is compared with each piece of dynamic interface node object data NodeInfo in the dynamic interface node object data set M to determine the associated interface node. For example, the associated interface node may be determined by ViewId (), ClassName (), Text (), or the like.
Next, step 270 will be explained.
Referring to fig. 4, in one embodiment, this step may be further implemented by:
and step 40, generating a user interface display data set based on the dynamic interface node object data matched with the search strategy object data and the pre-stored user interface interaction identification in the search strategy object data.
As described above, the user interface display data set is W
W=[ NodeInfo（），uiId（）]
And step 42, polling the user interface to display the data set.
The purpose of polling is to discover if the user interface display data set is updated for W. If the data is updated, adding W = [ NodeInfo (), uiId () ] into a feedback data linked list of the feedbackList, wherein the cache data linked list of the feedbackList is created by the Service of Service during operation, and then the feedbackList is continuously updated according to the interface nodes of the scanning plane.
In one embodiment, after a user opens an application program on a terminal device, the interface change of the application program triggers Service to start working, the Service starts searching after establishing a cacheList and a searchList, the searchList is matched and searched by using a SearchPolicy object in the searchList, and a new object consisting of a NodeInfo object in the cacheList corresponding to the searched SearchPolicy and the uiId of the SearchPolicy is added into the feedback list
And step 44, determining the position of the interface node based on the rectangular frame information of the interface node in the dynamic interface node object data.
The location of the interface node is determined based on Rect (Left, Right, Top, Bottom) in NodeInfo ().
And step 46, selecting a matched user interface interaction generation method according to the user interface interaction identifier, generating drawing data, and displaying the user interface based on the drawing data.
In this step, based on uiId (), a matching user interface interaction generation method is selected, and drawing data is generated. And displaying a user interface corresponding to the drawing data, such as a floating window.
Further, the implementation of the invention is supplemented by:
1) it can be seen from the above description that the Service monitors changes on any other third party App interface except for the Service itself, including not limited to sliding App and switching windows, and when the type changes, the Service is triggered to scan a View node on the third party App interface, and if a View node to be searched is scanned, a ui suspension window is suspended on the View node, and the suspension window has characters, pictures and animations, and performs an additional prompt on the View node, thereby guiding a user and prompting the user to perform additional operations.
2) A Service is resident and operated in a system memory, and a cacheList, a searchList, a feedback List and a uiList data linked list are created and cached in the memory at the same time.
The device comprises a Service, a Service server and a Service server, wherein the Service server comprises a cacheList, a searchList and a feedback list, the cacheList, the search list and the feedback list can be empty, a uiList chain table or an array is preset, the inside of the uiList is formed by linking individual sub-overlay objects, the sub-overlay inherits a common View object, internal variables of the sub-overlay comprise parameters such as uiId (unique number), length and width, text content, text size, background, shape and type, the Service server utilizes the sub-overlay to draw a graph in a floating window created by the Service server, and the type of the graph comprises but is not limited to a triangle, a square and an ellipse with characters, numbers and animation.
3) When a user opens a certain App on terminal equipment, the interface change of the App triggers the Service to start working, the Service starts searching after establishing a cacheList and a searchList, the searchList object in the searchList is used for matching searching in the cacheList, and a NodeInfo object in the cacheList corresponding to the searched searchPolicy and the uiId of the searchPolicy form a new object to be added into the feedback List.
4) Service polling feedback list, reading the Rect data of NodeInfo object of data object in list, directly copying and copying to generate new raw Rect data, using uiId of data object in list as parameter, reading corresponding sub overlay from uiList, using internal data of raw Rect and sub overlay to generate a drawing data, using the data to draw suspension icon on ui, the data includes xy coordinate, background pattern, width and height, text content or animation content and other display effect.
With reference to fig. 5 and 6, fig. 5 is a schematic view of a user page opening a certain App interface presentation, wherein the geometric figures arranged in different areas represent different content available for the user to request, e.g. may be embodied as icons representing different dramas, movies, etc. Fig. 6 is a diagram showing the App in fig. 5 superimposed with a floating window generated by the method according to the present invention as a user interface, where 1, 2, 3, 4, etc. digital prompts are added to form an effect according to digital on demand. Under the condition that the code of the App is not changed, the Service is utilized to draw the floating window on the App, and the additional superposition prompt effect is achieved. Fig. 6 is only an exemplary illustration of the added floating window, and in fact, in the implementation, the user interface is not limited to the floating window, and can be arbitrarily set as required.
Referring to fig. 7, fig. 7 is a second flowchart of the application program interaction method provided by the present invention, which includes the following steps:
In this embodiment, the implementation of steps 710 to 730 is described in the foregoing embodiments. In relation thereto, reference is made to the foregoing description. The present invention will not be described herein.
What is different from the above embodiments is that the present embodiment can prompt or guide the user to perform voice interaction based on the interaction information of the user interface, and perform recognition and response based on the voice instruction sent by the user. The embodiment further enriches the information interaction mode of the user when using the APP, and further improves the use experience of the user.
In addition, in the above description of the embodiment of the implementation of the present invention, the Service is taken as an example for explanation. The method is an application program which is resident in the background of the terminal equipment in implementation, and the method is grounded through the visual angle realized by computer software. It should be noted that the above example is only one possible program implementation manner for implementing the method of the present invention, and the present invention is not limited to the implementation manner of the Service.
The application program interaction device provided by the present invention is described below with reference to fig. 8 to 11, and the application program interaction device described below and the application program interaction method described above may be referred to correspondingly.
Referring to fig. 8, fig. 8 is a schematic structural diagram of an application program interaction apparatus provided in the present invention, including: a scanning module 80, a user interface generation module 82, an operation confirmation module 84, and an execution module 86. The scanning module 80 is configured to scan a display page in a current display screen on the intelligent terminal; the user interface generating module 82 is configured to generate a user interface on the changed display page when the interface of the application program in the display screen is changed; wherein the user interface is pre-configured to have a correspondence with an executable operational function on an interface of the application program; the executable operation function comprises the operation which can be executed by the current interface of the application program according to the user interface; the operation confirmation module 84 is configured to determine, according to the user interface, the executable operation function and the operation that can be executed according to the user interface in the application program; the execution module 86 is configured to execute the operation instruction corresponding to the user interface in the application program according to the executable operation function and the operation that can be executed according to the user interface.
In this embodiment, when the interface of the application program in the display screen changes, a new user interface is added to the changed display page (for example, the user interface may be prompt information such as setting characters, pictures, or animations), and an additional prompt is performed on the interface node of the current application program, so as to guide the user and prompt the user to perform an operation. Therefore, the method and the device add a new interaction mode for the application program, and improve and enrich the interaction experience of the user using the application program.
Moreover, it should be noted that the present invention is independent of the design scheme of the application program in the current mobile terminal, and does not involve the extension and modification of the application program itself, that is, when the present invention is applied to the existing intelligent terminal, it is not necessary to separately add a toolkit of the interaction method to each application in advance, and only the operation of the present invention needs to be started at the mobile terminal, and different application programs in the background of the intelligent terminal can all use the application program interaction method of the present invention to guide the user (especially, novice user) to operate, which is convenient and practical, and easy to popularize.
Further, referring to fig. 9, a block diagram of the user interface generation module 82 in an embodiment of the application program interaction apparatus is shown, which includes: an acquisition unit 821, a matching unit 822, and a generation unit 823.
The obtaining unit 821 is configured to scan each display interface node included in the display interface of the current application program that changes, and obtain dynamic interface node object data corresponding to each display interface node; and the dynamic interface node object data form a dynamic interface node object data set. The matching unit 822 is configured to perform matching search on the pre-stored search feature object data associated with the current application program in the dynamic interface node object data set. The generating unit 823 is configured to determine an operation instruction associated with the dynamic interface node object data matched with the search feature object data, select a user interface corresponding to the operation instruction and stored in advance, and display the user interface on the changed page.
Fig. 10 is a block diagram of a matching unit 822 in an embodiment of an application program interaction apparatus, including: an identification subunit 8221, a request subunit 8222 and a receiving subunit 8223.
The identification subunit 8221 is configured to identify, when the application is opened, a name identifier corresponding to the application; the request subunit 8222 is configured to transmit the name identifier to a cloud server, and request search feature object data associated with the name identifier from the cloud server; the receiving subunit 8223 is configured to receive search feature object data from the cloud server.
Further, in one embodiment, searching the feature object data comprises: name identification of the application program, and search policy object data associated with the application program; the search policy object data includes window interaction identification, and at least one of: text information, interface identification information, class name information and a search mode.
Further, in an embodiment, the dynamic interface node object data corresponding to each display interface node includes at least one of the following: the method comprises the steps of interface node text information, interface node rectangular box information, interface node identification information, class name information and the visibility.
Referring to fig. 11, fig. 11 is a block diagram of a generating unit 823 in an embodiment of the application program interaction apparatus of the present invention.
In this embodiment, the generation unit 823 includes: an interface display data set generation sub-unit 8231, a polling sub-unit 8232, a position determination sub-unit 8233, and a drawing sub-unit 8234.
An interface display data set generating subunit 8231, configured to generate a user interface display data set based on the dynamic interface node object data matched with the search policy object data and a pre-stored user interface interaction identifier in the search policy object data; a polling subunit 8232, configured to poll the user interface display data set; a position determining subunit 8233, configured to determine a position of an interface node based on the rectangular frame information of the interface node in the dynamic interface node object data; and a drawing subunit 8234, configured to select a matched user interface interaction generation method according to the user interface interaction identifier, generate drawing data, and display the user interface based on the drawing data.
In one embodiment, the rendering data may include at least one of: plane coordinates of the window, background pattern, width and height of the window, text content, and animation content. Scanning each display interface node contained in the interface of the changed current application program, wherein the change comprises the following steps:
the application is slid or window switched.
Fig. 12 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 12: a processor (processor)1210, a communication Interface (Communications Interface)1220, a memory (memory)1230, and a communication bus 1240, wherein the processor 1210, the communication Interface 1220, and the memory 1230 communicate with each other via the communication bus 1240. Processor 1210 may invoke logic instructions in memory 1230 to perform the aforementioned application interaction methods.
In addition, the logic instructions in the memory 1230 may be implemented in software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as a stand-alone product. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions, which when executed by a computer, enable the computer to perform the methods provided by the above methods to perform the aforementioned application program interaction methods.
In yet another aspect, the present invention also provides a non-transitory computer readable storage medium, on which a computer program is stored, the computer program being implemented by a processor to perform the above-mentioned methods of application program interaction.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. An application program interaction method, characterized in that the method comprises the following steps:
scanning a display page in a current display screen on the intelligent terminal;
generating a user interface on the changed display page under the condition that the interface of the application program in the display screen is changed; wherein the user interface is pre-configured to have a correspondence with an executable operational function on an interface of the application program; the executable operation function comprises the operation which can be executed by the current interface of the application program according to the user interface;
determining the executable operation function and the operation which can be executed according to the user interface in the application program according to the user interface;
and executing an operation instruction corresponding to the user interface in the application program according to the executable operation function and the operation which can be executed according to the user interface.
2. The application program interaction method according to claim 1, wherein the step of generating the user interface on the changed display page comprises the following steps:
scanning each display interface node contained in the display interface of the current application program which changes, and acquiring dynamic interface node object data corresponding to each display interface node; the dynamic interface node object data form a dynamic interface node object data set;
matching and searching pre-stored searching characteristic object data associated with the current application program in the dynamic interface node object data set;
and determining an operation instruction associated with the dynamic interface node object data matched with the search characteristic object data, selecting a user interface which is stored in advance and corresponds to the operation instruction, and displaying the user interface on the changed page.
3. The application interaction method of claim 2, wherein the pre-stored search feature object data associated with the current application is obtained by:
when the application program is opened, identifying a name identification corresponding to the application program;
transmitting the name identification to a cloud server, and requesting search feature object data associated with the name identification from the cloud server;
and receiving the search characteristic object data from the cloud server.
4. The application interaction method of claim 3,
the searching the feature object data includes: a name identification of an application program, and search policy object data associated with the application program;
the search policy object data includes a user interface interaction identification, and at least one of: text information, interface identification information, class name information and a search mode.
5. The application program interaction method of claim 4, wherein the dynamic interface node object data corresponding to each display interface node comprises at least one of:
text information of the interface node;
rectangular frame information of the interface node;
interface node identification information;
class name information; and
whether or not it is visible.
6. The application interaction method of claim 5, wherein the displaying the user interface on the changed page comprises the following steps:
generating a user interface display data set based on the dynamic interface node object data matched with the search strategy object data and a prestored user interface interaction identifier in the search strategy object data;
polling the user interface display data set;
determining the position of an interface node based on the rectangular frame information of the interface node in the dynamic interface node object data;
and selecting a matched user interface interaction generation method according to the user interface interaction identifier, generating drawing data, and displaying the user interface based on the drawing data.
7. The application interaction method of claim 6,
the rendering data includes at least one of: planar coordinates of the user interface, background pattern, width and height of the user interface, text content, and animation content.
8. An application interaction apparatus, comprising:
the scanning module is used for scanning a display page in a current display screen on the intelligent terminal;
the user interface generating module is used for generating a user interface on the changed display page under the condition that the interface of the application program in the display screen is changed; wherein the user interface is pre-configured to have a correspondence with an executable operational function on an interface of the application program; the executable operation function comprises the operation which can be executed by the current interface of the application program according to the user interface;
an operation confirmation module, configured to determine, according to the user interface, the executable operation function and the operation that can be executed according to the user interface in the application program;
and the execution module is used for executing the operation instruction corresponding to the user interface in the application program according to the executable operation function and the operation which can be executed according to the user interface.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the application program interaction method according to any of claims 1 to 7 are implemented when the program is executed by the processor.
10. A non-transitory computer readable storage medium, having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the steps of the application program interaction method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011597040.0A CN112286620B (en) | 2020-12-30 | 2020-12-30 | Application program interaction method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011597040.0A CN112286620B (en) | 2020-12-30 | 2020-12-30 | Application program interaction method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112286620A true CN112286620A (en) | 2021-01-29 |
| CN112286620B CN112286620B (en) | 2021-03-19 |
Family
ID=74426591
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011597040.0A Active CN112286620B (en) | 2020-12-30 | 2020-12-30 | Application program interaction method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112286620B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080307336A1 (en) * | 2007-06-08 | 2008-12-11 | Apple Inc. | User interface for application interface manipulation |
| CN109698866A (en) * | 2019-01-11 | 2019-04-30 | 科世达（上海）管理有限公司 | A kind of Intelligent control display systems based on raspberry pie |
| CN111506237A (en) * | 2020-04-15 | 2020-08-07 | 青岛海信移动通信技术股份有限公司 | Terminal and method for starting operation function in application |
-
2020
- 2020-12-30 CN CN202011597040.0A patent/CN112286620B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080307336A1 (en) * | 2007-06-08 | 2008-12-11 | Apple Inc. | User interface for application interface manipulation |
| CN109698866A (en) * | 2019-01-11 | 2019-04-30 | 科世达（上海）管理有限公司 | A kind of Intelligent control display systems based on raspberry pie |
| CN111506237A (en) * | 2020-04-15 | 2020-08-07 | 青岛海信移动通信技术股份有限公司 | Terminal and method for starting operation function in application |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112286620B (en) | 2021-03-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3623942B1 (en) | Message processing method and apparatus, storage medium, and computer device | |
| CN106294816B (en) | Page information processing method and device | |
| US11132114B2 (en) | Method and apparatus for generating customized visualization component | |
| CN110119294A (en) | The generation method of menu page, apparatus and system | |
| CN105630525B (en) | Page synchronization method and device | |
| CN111459594A (en) | Display interface processing method, device and system | |
| CN111443910A (en) | Skin rendering method and device, electronic equipment and computer storage medium | |
| CN113242308B (en) | Information pushing method, device, equipment and storage medium | |
| CN105867910A (en) | Dynamic wallpaper presenting method and apparatus for mobile terminal | |
| CN110366025B (en) | Configuration method of display content, intelligent terminal and computer readable storage medium | |
| CN115795203B (en) | Method and device for constructing menu page, electronic equipment and storage medium | |
| CN112286620B (en) | Application program interaction method and device, electronic equipment and storage medium | |
| CN108156534B (en) | Method and device for generating demonstration application and computer readable storage medium | |
| CN114257624B (en) | Configuration method, device and equipment of Internet of things equipment and storage medium | |
| CN111367606A (en) | Application page display method, device, terminal and medium | |
| CN107704536B (en) | Software content display method and system | |
| CN105988992A (en) | Icon pushing method and device | |
| CN114217795A (en) | Page generation method and device, electronic equipment and readable storage medium | |
| CN113900764A (en) | Page data acquisition method, page data display method and device | |
| CN111078215A (en) | Software product application method and device, storage medium and electronic equipment | |
| CN111782992A (en) | Display control method, device, equipment and readable storage medium | |
| CN112732379A (en) | Operation method of application program on intelligent terminal, terminal and storage medium | |
| CN111625746A (en) | Display method and system of application program page, electronic device and storage medium | |
| CN112799552A (en) | Method and device for sharing promotion pictures and storage medium | |
| CN113687901B (en) | Interface display method and interface display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |